source: trunk/MagicSoft/Mars/NEWS@ 9036

Last change on this file since 9036 was 9036, checked in by tbretz, 16 years ago
*** empty log message ***
File size: 120.2 KB
Line 
1 -*-*- END -*-*-
2
3== <cvs> ==
4
5 ;general
6
7 * should work now with root 5.20/00
8
9 * Sequences and Datasets are now stored as "MDataSet" and "MSequence"
10 instead of the base name of the file. This makes them easier to
11 access from the code
12
13 * Default Monte Carlo names in MSequence do not require the _E at
14 the end anymore
15
16 * where abrrevating a sequence file with a sequence number is possible
17 also "telescope:sequence" is now accepted, e.g.:
18 star 2:2000123 --out=output
19 see the programs' help for more details.
20
21 * sequences (MSequence or MSequenceSQL) can now directly be retrieved
22 from the database. See the constructors for more details.
23
24 * MReadTree now supports friends
25
26 * MReadTree can now read also files not written by MARS and store
27 the data encapsulated in emulated MParContainers
28
29 ;merpp
30
31 * we merpp the dc currents now also from the camera reports (they have
32 just a lower rate than the current reports, 0.1Hz instead of 1Hz)
33
34 * In the automatic analysis we omit merpping of the currents from the
35 caco files and use the lower rate camera reports from the cc files
36 instead
37
38 * merpp has been redisigned to allow merpping of the cc-reports
39 of a whole sequence. This allows to design a very simple analysis:
40 mkdir output
41 ./callisto 100776 --out=output
42 ./merpp 100776 output
43 ./star 100776 --ind=output --out=output
44 Instead of the sequence number also sequence files are accepted.
45
46 ;star
47
48 * The camera currents are now displayed with the rate of the camera
49 reports instead of the caco reports
50
51
52
53== Version 2.1 (2007/09/03) ==
54
55 ;Database
56
57 * introduced average temperature and wind speed from star-files
58
59 * introduced average values from Pyrometer (mainly Cloudiness)
60
61 * introduced the ratio of accepted calibration events in the
62 calibration run
63
64 * introduced the average rates of the different trigger pattern,
65 e.g. the rate of pedestal and calibration events, from the signal-file
66
67 ;general
68
69 * fixed GroupBy options in plot*.C macros
70
71 * only display KVA points (not the Tuorla points) in plotoptical.C
72
73 * all programs now allow to add resources to the ones from the resource
74 file or overwrite them from the command line. This can be done like this
75 ganymed --config=ganymed.rc --rc=Cut1.Param1:0.25 --rc=Cut1.Param3:5.5
76 if something seems to be wrong you can debug what the program is doing
77 using the option --debug-env=3
78
79 * increased the diversity of debug levels. That also means that with -v3
80 you get now less output, i.e. only the output which is important for
81 an analysis. To get more output which helps for debugging try 4, 5 and 6.
82
83 * fixed a problem in the task synchronizing the reading of the reports
84 and the data stream. The effect was that in some circumstances the last
85 events of some trees could have been skipped. Since this is only a
86 very tiny part of the data no severe effect to your analysis results
87 is expected (an exception might be very short, i.e. singel runs,
88 datasets).
89
90 * Dataset file now allow to include the sequence file directly within
91 the dataset file and also allow to exclude single runs from the dataset.
92 (for more details see Class reference of MDataSet)
93
94 * Sequence files now allow for excluding runs from the analysis
95 (for more details see Class reference of MSequence)
96
97 * added code to process the sum-trigger flag
98
99 * the histogram classes MH3 and MHn now support profile histograms
100
101 * the histogram classes MH3 and MHn now support labels at the axis
102
103 * the Random Forest Train-classes (MJTRain*) now store the used datasets
104 in the output file
105
106 * the MFMagicCuts have a new option to allow a linear area cut (for
107 special studies)
108
109 * The liniking of the shared object is now done into a file defined
110 by 'mktemp'. This should be a local file system which accelerates
111 liniking a lot.
112
113 * The code has been prepared for compilation with root 5.18/00d
114
115 * The MHEnergyEst histogram now shows the distribution of
116 (Eest-Emc)/Est and the distributions (Eest-Emc)/Eest vs. Eest
117 and (Eest-Emc)/Emc vs Emc.
118
119 * fixed mars (event display) for merpped raw-data and MC data
120
121 * adapted the synatx of sequence files to allow for the new run/file
122 scheme. For more details see class description of MSequence
123
124 ;showplot
125
126 * Added support for tiff files
127
128 * Added support for csv files (tables containing tab number,
129 name and title)
130
131 * Tabs now can have a title which is displayed in the postscript file
132
133 * When multiple file are written at once (e.g. pngs from a display)
134 it is now possible to use the tab name and or tab number in the
135 file name. For details see showplos's help.
136
137 ;merpp
138
139 * Implemented cc file version 2008-02-20/0
140
141 * Implemented cc file version 2008-05-19/0
142
143 * With new options merpping can be restricted (in addition to the
144 run-number) also by telescope and file number.
145 For details see "merpp --help"
146
147 * Implemented raw data format 11 (the most important change, except
148 from plenty of changes in the format definition, is the addition
149 of the file-number in the header) If nobody makes a mistake this
150 format should have the advantage that it is by definition forward
151 compatible, so old programs will be able to read newer formats.
152
153 * Added Pyrometer information to default output (stored in a new Tree
154 Pyrometer, needs a complete new merpp, i.e. new calibration)
155
156 * Merpping (also update) can now be restricted to one single report.
157 For example:
158 If you want to update an old file with Pyrometer information call
159 merpp --only=Pyrometer --update
160
161 ;callisto
162
163 * in the pedestal processing now at least 50 processed events are
164 required for succeeding.
165
166 * the signal and calib files now contain also the sequence information
167
168 * the two MPedestalCam in the calib file now have proper names
169 to distinguish them from each other (MPedestalCam, MPedestalExtracted)
170
171 * Both pedestal cams now contain the number of events processed
172
173 * In Mars V2.0 the extraction of the fundamental pedestal was broken,
174 i.e. for the extraction of the calibration pulses basically the average
175 over all events of the first slice instead of all slices was used.
176 Since pedestal and calibration constants are continously recalculated
177 this only effected the very first events of every sequence.
178
179 * For the extraction of the position of the maximum sample now the
180 extraction range is set automatically to the extraction window,
181 before the whole accessible range was used.
182
183 * If the number of samples in the events and the number of samples
184 in the run-header disagrees now an error is raised (this can
185 happen in not well simulated Monte Carlo files)
186
187 * In the case of MUX-data pedestal events with the lvl1 trigger flag
188 could survive into the pedestal calculation -- fixed.
189
190 * Tab "TrigPat" added showing the distribution of the trigger pattern
191 as found in the run-files (normalized with the run length)
192
193 * The selection of events from the trigger pattern has been improved.
194 If the trigger pattern is corrupted events won't pass anymore.
195
196 * Added a new command line option --dev-null to suppress output of
197 Y-files (this is useful for test cases)
198
199 * added a new tab "CalPos" showing the arrival time of extracted
200 interleaved calibration events
201
202 ;star
203
204 * the star file now contains also the sequence information
205
206 * Added a new command line option --dev-null to suppress output of
207 I-files (this is useful for test cases)
208
209 * Tab "Rate" added showing the distribution of the trigger pattern
210 (should only be Trig (Lvl1/Lvl2) and Sum (Sum only)) as found in
211 the Y-files (normalized with the run length)
212
213 * The effective on-time calculation doesn't use events with only
214 sum-trigger anymore
215
216 * The data in the MHWeather tab has been reorganized. The never
217 working solar radiation has been removed and the data from
218 the pyrometer (cloudiness, air and sky temperature) is
219 displayed in addition.
220
221 ;ganymed/sponde
222
223 * Now data points are even shown correctly if they have error bars larger
224 than one sigma. Points with null or negative significances are omitted.
225
226 * DrawNicePlot now allows to set a projection range
227
228 * Updates pointing models. One is applied after the implementation
229 of the new LUTS in August, the other one is applied after the
230 next major change of the pointing model in October. Note that
231 these models are preliminary and give wrong results below Zd=65deg
232
233 ;sponde
234
235 * fixed resource files ('''Spectrum''' instead of '''MJSpectrum''')
236
237 * a new option "--force-runtime" is available. In case of very short
238 datasets (for light-curves) which are in the order of a few
239 minutes the calculated effective on-time is not very acurate because
240 it is quantizised in the order of a minute. Therefore you can switch
241 to using the real run-time instead (remakrt: this ignores any
242 dead-time!)
243
244 * a more analytical way is used to "fill" Monte Carlos into regions
245 of impact parameters which have not been simulated because the
246 trigger efficiency is assumed to be 0.
247
248 * estimated sensitivity curves for hi and lo zenith angles are shown
249 scaled to the correct observation time and collection area
250
251 * the Monte Carlo events after cuts are now written to the output file
252 if an output file given
253
254
255
256 *** Version 2.0 (2007/09/03)
257
258 - database: the position used for the pulse pos check was missing
259 in the callisto output and could thus not be filled into the DB.
260 Also the old values seemed not exactly the PulsePos used for
261 teh check.
262
263 - general: Resource file now allow an Include-Resource, i.e. you can
264 read a resource file with default settings, include it in your
265 resource file and overwrite the settings in your file. More than
266 one include file is allowed. Inclusions can be iterative.
267 Include: mydefaults.rc yourdefaults.rc
268 The resources in the first file have higher priority than the
269 second file.
270
271 - general: Now the output files (calib*.root, etc) also contain the
272 resource file (to check it open it in the TBrowser and choose Print()
273 from the context menu)
274
275 - general: Dataset files now allow to overwrite the default path
276 to search for sequence and data files. Note, that the program
277 option and individual resources will overwrite it. For example:
278 SequencePath: /magic/montecarlo/sequences
279 DataPath: /magic/montecarlo/star
280
281 - general: Fixed a problem with variables in MDataPhrase. It seems
282 that only optimdisp (didn't work) was effected.
283
284 - general: Some improvements to the optim and train processing. For
285 example the ststud window now got a proper title.
286
287 - general: The "Status Display: " was removed from the window title
288 within an Eventloop.
289
290 - general: added a new flexible histogram-class (MHn) which can be used
291 for example in testing after optimizations or training to produce
292 user defined histograms.
293
294 - general: The Random Forest now allows attaching an evaluation
295 function which is applied to its output. This allows to train
296 on whatever you like (eg. train on log10(energy), but return
297 energy)
298
299 - general: The Random Forest training of energy (trainenergy.c) and
300 disp (traindisp.C) has been improved by more graphical output to
301 judge the result.
302
303 - general: The training of energy (trainenergy.C) has been improved
304 a lot by training on a different quantity than energy. It gives
305 a result which is highly independant of the source spectrum
306 and shows lower bias than all other options.
307
308 - general: Dataset files are allowed to contain collections of
309 datasets. For more details see the class reference of MDataSet.
310
311 - general: The default WobbleMode in a datset file now (if not
312 overwritten) is "auto", i.e. wobble mode is set if the dataset
313 doesn't contain off-sequences.
314
315 - merpp: Merpp can read file format version 9 now. Please realize
316 that for file format version 9 the extraction range is different
317 and must be set to 0/49 instead of 15/64 in callisto_mux.rc until
318 the first and last 15 slices have been removed from all MUX data.
319
320 - mars: Similar to writing movies you can now select events which
321 should be displayed in your display. Therefore add the following
322 lines to your mars.rc:
323 MFEvtNumber.FileName: ganymed00223552.root
324 MFEvtNumber.Selector: ThetaSquared.fVal<0.04 && DataType.fVal>0.5
325 The input file can be a ganymed-file after (ganymed*.root) or
326 before (ganymed*-summary.root) file. For example to select all events
327 from your on sample after cuts (excluding the ThetaSq cut) use
328 MFEvtNumber.Selector: DataType.fVal>0.5
329 To show all events from your on-sample after quality cuts
330 use the summary file instead.
331
332 - mars: new ways to call mars are implemented. Instead
333 of calling
334 mars filename.root
335 you can now also use
336 mars sequence.txt
337 or
338 mars sequence.txt inputpath
339 or replace sequence.txt by the sequence number if the default
340 sequence file should be used.
341
342 - mars: The default size has been increased
343
344 - mars: There are two new heckboxes which allow to switch off
345 the calculated image parameters
346
347 - callisto: was broken for MCs... fixed.
348
349 - callisto: improved calculation of spline coefficients a lot. This
350 leads to a further improvement of the event rate calibrating MUX
351 data of about 15% (175evt/s instead of 150evt/s)
352
353 - callisto: finally the raw data we read is now real 16bit (with
354 10bit precision) for MUX data and not a stripped 8bit number
355 anymore. Due to scaling of the numbers (without precision loss
356 into an [0-256[ range, the final numbers for pedestal, pedestalrms
357 and extacted signal don't change. However, at all places where
358 raw data is directly accessed (eg. saturation and variation
359 limits in the signal- and pedestal-extraction) the numbers
360 refer still to the data's 16bit range.
361
362 - callisto: The maximum arrival time difference used in the bad
363 pixel treatment is now in units of nanoseconds, which leads to 3.0ns
364 for both, old FADC and MUX-FADC, data.
365
366 - callisto: Be aware that callisto is now calibrating the arrival time
367 in nanoseconds rather than time slices. Also all following tasks
368 have been changed to assume ns units now. If you star data
369 calibrated with an older version it might be necessary to adapt
370 some timimng parameters (Muon Analysis and MFSoftwareTrigger)
371 to obtain optimal results. The plot in the PulsePos tab
372 will now be in ns, too. This might also mean that the Muon
373 analysis in star might not work as perfect as expected as long
374 as old files read in.
375
376 - callisto: The calibration constants of earlier updates got lost
377 somehow. All constants have been updated.
378
379 - star: The PSF is now determined from the profile of the ArcWidth
380 instead of arcwidth/radius. The old way gave to much weight
381 to the bins with low statistics. The reference lines have been
382 updated.
383
384 - star: For speed reasons events suitable for the muon analysis
385 are now also preselected by fConcCOG<0.1 which seems to be a very
386 good preselector for muons.
387
388 - star: is now calculating a new timing parameter the Slope along
389 the major and minor axis of the shower. Therefore a numerical
390 solution of a line-fit is used. To use MHillasExt.fSlopeLong
391 and MHillasExt.fSlopeTrans don't forget to multiply it with
392 the sign stored in MHillasSrc.fCosDeltaAlpha as usual.
393
394 - star: The parameters fInnerSize, fInnerLeakage1 and fInnerLeakage2
395 have been removed from MNewImagePar. They have never been good for
396 anything.
397
398 - star: Implemented a new recursive algorithm which is supposed to be
399 faster. Also implemented new cleaning oiptions, which are:
400 + CleanLevel0:
401 The cleaning level above single core pixels can be kept
402 + KeepIsolatedPixels:
403 Define whether single core pixels should be kept
404 + TimeLevel1:
405 The coincidence window in nanoseconds to single used neighbors
406 + TimeLevel2:
407 The coincidence window in nanoseconds to two used neighbors
408 + PostCleanType:
409 MOde in which a time dependent post cleaning should be applied
410 0: No post cleaning
411 1: Require for each used pixels at least one used neighbor
412 within a time-window of CleanLevel1
413 2: Require for each used pixels at least two used neighbor
414 within a time-window of CleanLevel2
415 3: Require first two and second one used neighbor
416 within a time-window of CleanLevel1 and fCleanLevel2
417 respectively
418 + RecoverIsolatedPixels:
419 - recoveres isolated core pixels if they have a used neighbor
420
421 - mars/star: The new default cleaning is:
422 + CleanLevel1: 6.0
423 + CleanLevel2: 3.0
424 + CleanTime1: 1.75
425 + CleanTime2: 1.75
426 + PostCleanType: 3
427
428 - star/ganymed: The old spark-cuts have been replaced by new ones.
429 These new spark cuts have been cross checked with the sequences
430 84720 (before splitter), 101041 (after splitter) and 223539 (new
431 FADCs). In all cases they seperate pretty well, but of course not
432 perfect. Monte Carlos have suggested to tighten the cuts a little
433 bit further at low sizes. This has been done.
434
435 - ganymed: IMPORTANT - The spark cuts have been changed to match
436 all available data more or less well. This might mean that for
437 YOUR data there are still sparks visible.
438 Whenever you do an analysis you have to make sure that NO sparks
439 survive your cuts!
440
441 - ganymed: The old hadronness and size cuts have gotten new indices
442 (10, 11). The old indices 8 and 9 now mean an additional condition
443 for ghostbusting based on the formula (dist-c[9])*c[8]-slope.
444 If you want to switch off this cut just move the line far away enough,
445 e.g. by setting c[9] to -500. Please update your ganymed.rc files
446 accordingly!
447 The unit of c[9] is deg. It is the dist at which your cut will
448 cross the slope==0. The unit of the slope is ns/deg. So if
449 you readin files calibrated with an older Mars-version you
450 have to adapt the default value for c[9] to the FADCs:
451 - Multiply by two for the MUX FADCs (run number > 200.000)
452 - Multiply by 0.3 for the Siegen FADCs (run number < 200.000)
453 - Multiply by 42 for the meaning of life (run number = 200.000)
454
455 - ganymed: The old Cut0 is now called CutQ and is calculated before
456 the source position is caluclated. If you need a quality cut
457 including source dependant data (be very carefull with this!)
458 you have to use Cut0 instead.
459
460 - ganymed: now properly supports three off regions in wobble mode.
461 It will be the default from now on in ganymed_wobble.rc. To change
462 the number of off-regions use
463 NumOffSourcePositions: 1
464 in your ganymed.rc. Also by default no off-theta cut will be done
465 anymore so that you will get a background level higher than the
466 signal level in your ThetaSq plot for ThetaSq>0.2.
467 Due to this be carefull changing the scaling mode away from
468 "None". You will underestimate your signal if your scale interval
469 is not properly set.
470 (Rem: ThetaSqN is no longer needed)
471
472 - ganymed: is now storing the events of all (on- and off-)
473 source positions even in the case of more than one off-source
474 position. This should allow sponde to work properly and the
475 energy estimation is done correctly in all cases (without any
476 "nearest position" trick)
477
478 - ganymed: From 85340 (19.3.2006) on a real starguider calibration
479 with a real pointing model for the starguider is done, calibrated
480 with more than thousand tpoints taken from this date on.
481
482 - ganymed: was broken for Wobble-MCs... fixed.
483
484 - ganymed: The default cuts (MFMagicCuts) and the disp-parametrization
485 has changed. Note that your old ganymed.rc will be incompatible
486 with the new algorithms! Please check the ganymed.rc files and
487 the class description of MFMagicCuts for more information.
488 It is recommended at the moment to use identical Disp-Parametrizations
489 for on/off- and wobble-mode. If cuts are optimized only
490 the Area-Cut (parameters 2,3,4) and the theta-sq cut (parameter 1)
491 should be optimized. All other values should be kept as they are.
492 If you want to do an anylsis without timing a parameters, you can
493 switch off the timing cuts by seeting parameter 7 to a very small
494 value (eg. -99). To remove the slope parameter from the disp
495 paremtrization set parameter 8 to 0.
496
497 - ganymed: The distribution of observation time versus zenith
498 angle is now shown for off- AND on-data.
499
500 - ganymed: The contents of the source position plot are no longer
501 averaged, thus a lot of (fake) events between the two wobble
502 positions have disappeared.
503
504 - ganymed: There is a new tab "CutT" it contains the VsSize plots
505 with the CutT, whihc is defined in ganymed.rc, applied. It
506 is resonable to use your theta-cut for it, to see if there is
507 something strange (sparks!) in your signal-region.
508
509 - ganymed: To choose a dataset from a collection in a dataset file
510 use the new command line option "--dataset=12345"
511
512 - optim, sponde: should now properly support three off-regions.
513 Just produce your ganymed summary files with three off-regions.
514 optim and sponde will automatically get all off events from
515 all off-regions from this file. Please do not forget to
516 set the scaling in optimwobble.C properly:
517 fit.SetScaleUser(1./3);
518 it is not yet read in automatically (will follow soon).
519 In the case of fixed Scale you can also use
520 cuts.SetThetaCut(MFMagicCuts::kOn);
521 no off-cut needed.
522 Be carefull in case of three off-regions when switching on
523 scale mode. Make sure that the scale interval is set correctly.
524
525 - sponde: sponde.rc and sponde_onoff.rc are now idetical
526
527 - sponde: the resouce files have been rewritten with a lot of
528 comments and a well working parametrization for an energy estimator
529
530 - sponde: In the estimated energy versus monte carlo energy plot the
531 contents where exchanged.... fixed.
532
533 - sponde: the so called "accurate"-mode has been removed. It didn't
534 give any improvement in accuracy, only decreased execution speed.
535
536 - sponde: the so called "simple"-mode has been removed. It didn't
537 give any improvement in simple.
538
539 - sponde: the so called "refill"-mode has been removed. It was anyhow
540 not implemented.
541
542 - sponde: now checks whether the theta distribution of your on-data
543 and the theta-distribution of your Monte Carlo sample (after
544 weighting) fits. If it doesn't fit properly (eg. the Monte Carlo
545 sample is incomplete) execution is stopped. Execution can be forced
546 using the new option --force-theta. Use this option with care!
547
548 - sponde: Proper collection areas can now be constructed also from
549 Monte Carlo samples generated with different maximum impact
550 parameters. Note that in previous version you neither got
551 a warning or failure, nor was there any obvious sign that the
552 collection area was overestimated due to usage of files with
553 different maximum impact parameters.
554
555 - sponde: If MC files with different lower energy limits are used
556 the primary MC spectrum is artificially completed down to the
557 lowest energy used at all. WARNING: that this gives correct
558 collection areas ONLY if none of the events in this region would
559 survive your cuts at all.
560
561 - sponde: the output file now contains more information about
562 the spectrum (eg. the full 2D collection area histogram).
563 Note, that this information can only be written to the file
564 if it is stored automatically via command line argument.
565 If you only store the status display from within the display
566 the information is lost.
567
568 - sponde: added a new tab "Disp". It shows the residual of the disp
569 (Disp-Dist) versus several parameters and it is meant to judge the
570 quality of the disp estimator. In the ideal case the residual is zero
571 and doesn't depend on any variable. The tab is displayed after
572 CutQ and Cut0.
573
574 - sponde: added a new tab "Energy". It shows the residual of the
575 energy (lg(estimated energy)-lg(monte carlo energy)) versus
576 several parameters and it is meant to judge the quality of the
577 energy estimator. In the ideal case the residual is zero
578 and doesn't depend on any variable. In reality even a good estimator
579 can show residuals versus Monte Carlo energy. The tab is displayed
580 after all cuts.
581
582 - sponde: added a new tab "EventDist" showing the unweighted real
583 absolute number of events of your sample after cuts. This tells
584 you how many events with this energy you had in your MC files.
585 The same information you get from the error bars of the weighted
586 histograms, but this is less intuitive.
587
588 - sponde: The spectrum plots now show the crab- and 1553-spectrum
589 for comparison. It is not meant to show these curves in
590 publications, they are only for production.
591
592 - sponde: The OriginalMC tree with the events produced by corsika
593 is now processed only once
594
595 - sponde: Finally fixed most annoying bug, which has effected the
596 last bin of the collection area. It was the problem that binnings
597 of root histograms are from 1 to n (included) but there was a C-like
598 loop in sponde from 0 to n (excluded). Now the loop also includes
599 correctly under- and overflow-bins. The worse thing with this is,
600 that for the events in the highest bin not only the bin-content
601 was wrong, but also the weights applied to these events, which could
602 in pricipal effect also other parts of the distribution (eg. due
603 to energy estimation). Fortunately it effected only a few events
604 in most cases.
605
606
607
608 *** Version 1.2 (2007/05/14)
609
610 - database: The database now has two new values Unsuitable50 and
611 Unsuitable01. They express the number of pixels which are
612 unsuitable for more than 50%, respectively more than 1%, of
613 all calibrated event. It is a more accurate number than the
614 previously used numbers, because they only take the first
615 calibration (ignoring the interleaved calibrations) into account.
616
617 - database: The database now has two other new values UnsuitableMax and
618 DeadMax. They express the maximum number of pixels which were
619 unsuitable, respectively dead, during the sequence. Because
620 of high pedestal rms (cars passing) a few events with very high
621 numbers of unsuitable pixels can happen. Not to suffer from this
622 effect we don't take the highest 0.1% of the numbers into account.
623
624 - general: fixed a bug which caused callisto and star to stop working
625 properly because the callisto output was currupted
626
627 - general: a script called scripts/makemovie has been added which
628 simplified the process of producing several movies from a single
629 sequence with different setup.
630
631 - callisto: Some more code cleanup. Started to remove old obsolete
632 code from cvs.
633
634 - callisto: The extraction of the pedestal with the extractor was
635 not random. It seems that extracting at one position is still biased
636 (for example in the first or last slices we could still suffer from
637 switching noise) Now it is completely random.
638
639 - callisto: In MPedCalcPedRun (which is the pedestal extraction from
640 pedestal files) individual pixels could be skipped due to high
641 variations. This was already the case for the pedestal extraction
642 from the lo-gains since the beginning and properly handled
643 there, but was introduced in the extraction from the pedestal files
644 a while ago. To calculate the average value it was still divided
645 by the number of events procesed not by the number of summands
646 really summed. This let to a pedestal which was a tiny amount too
647 small (for a few piels in the order of 0.1%). This led to an slightly
648 positive offset of the randomly extracted pedestal for a few pixels.
649 I doubt that this has a big effect on the result, because the effect
650 on the individual numbers is quite small. Due to this it is suggested
651 that you rerun your calibration to make sure you are without any
652 avoidable bias.
653
654 - callisto: the ArrTimeRmsLimit is now is a check of the deviation from
655 the median rms of the absolute arrival time and expressed in significance
656 levels. This replaces the old meaning of an abolute upper limit. An
657 absolute upper limit doesn't make much sense, because in our data
658 all arrival times are shifted at the same time (in fact it might be
659 a shift of the artificial trigger w.r.t. to the light flash).
660
661 - callisto: Added a new tab "BadPixTm" which shows the time evolution
662 of the number of unsuitable pixels over the whole sequence. This
663 is usefull mainly to judge if an intermediate calibration had
664 problems.
665
666 - callisto: Added a new tab "DeadPixTm" which shows the time evolution
667 of the number of dead pixels over the whole sequence. Dead pixels
668 in this context are unmapped pixels, i.e. pixels which could not
669 be interpolated, and thus are ignored in the further analysis.
670
671 - callisto: It is now possible to use the position of the maximum
672 of the spline as arrival time instead of the leading edge even
673 when using the integral for the signal. Therefor set the extraction
674 type to kIntegralRel ("IntegralRelative") and the relative height
675 ("HeightTm") to -1:
676 MJPedestalC1.ExtractSignal.ExtractionType: IntegralRelative
677 MJPedestalC1.ExtractSignal.HeightTm: -1
678
679
680
681
682 *** Version 1.1 (2007/04/27)
683
684 - general: The new class MGeomCamDwarf contains the camera geometry
685 for our prefered Dwarf camera and can be used to create general
686 geometries of roundish or hexagonal cameras.
687
688 - mars: The default cleaning is now abolute 8.5/4.0.
689
690 - mars: The resource file mars.rc now contains examples for MUX data
691
692 - merpp: Implemented file format version 8 (MUX FADC data). The 16-bit
693 data containing only 10-bit information is still cooked down to
694 8-bit, by cutting away the lowest 8-bit.
695
696 - merpp: When reading raw data the data is now stored in a single
697 array. The lo-gain array is obsolete. The interface stays the same.
698
699 - callisto: To process the new MUX data use the resource file
700 callisto_mux.rc
701
702 - callisto: The -root and -raw options to read merpped raw data have
703 been removed
704
705 - callisto: If the -mc option is given the sequence-name can now be
706 replaced by the MC sequence number
707
708 - callisto: If the sequence file contains "MonteCarlo: Yes" the
709 -mc option can now be omitted
710
711 - callisto: Started further simplification by removing obsolete
712 dependancies on MCalibIntensity*Cams.
713
714 - callisto: removed unsused intensity calibration from MJCalibration
715 for further simplification
716
717 - callisto: for simplification removed references to
718 MBadPixelsIntensityCam, MCalibrationIntensityQECam,
719 MCalibrationIntensityRelTimeCam, MCalibrationIntensityTestCam,
720 MCalibrationIntensityChargeCam, and MCalibrationIntensityBlindCam
721 (this should at minimum change nothing at all, and at maximum
722 improve thing if these containers where somewhere not handled
723 properly)
724
725 - callisto: Added the option to write an event movie. Please use
726 this option with care (huge files) but exessively to understand
727 our events. For further documentation please refer to the
728 IACT wiki
729 (currently at http://www.astro.uni.wuerzburg.de/mediawiki-1.9.0)
730
731 - callisto: Improved binning for the pulse position check histogram
732
733 - callisto: The code calculating the pulse position checknow takes
734 the pedestal into account
735
736 - callisto: The arrival time is now stored with full precision this
737 helps to get rid of artefacts in histograms. For the signal this
738 is not necessray because it is displayed in log-scale anyhow
739
740 - callisto: Fixed a problem with internal exclusions. Pixels which
741 have once been marked as unsuitable didn't get the necessary
742 histograms filled anymore to be rechecked with each interleaved
743 calibration.
744
745 - callisto: The relative arrival time resolution (the rms of the
746 relative arrival time offset) is now checked against its
747 median and the median deviation, instead of the average
748 plus an absolute offset.
749
750 - callisto: The relative arrival time offset is now calculated
751 w.r.t. its median not w.r.t. to an artificial reference pixel.
752
753 - callisto: The relative time calibration now marks pixels with
754 outlaying offset as unsuitable
755
756 - callisto: The interleaved relative time calibration has been switched
757 on. The advantage is that pixels which are marked as outliers
758 now can recover. An improvement over time is not expected, because
759 the relative time calibration seems stable.
760
761 - ganymed: If the dataset file containes "MonteCarlo: Yes" the "-mc"
762 option can now be omitted.
763
764 - ganymed: If either the dataset file containes "MonteCarlo: Yes"
765 or the option "-mc" is specified as default the monte carlo datacenter
766 paths (/magic/montecarlo/...) are used if not overwritten in the
767 dataset file.
768
769 - ganymed: The output files now contain run- and event-number for all
770 events, accessible as RunNumber.fVal and EvtNumber.fVal
771
772 - ganymed: Added a plot showing the source position in the camera also
773 for wobble mode
774
775 - ganymed: In addition to the existing task which can be setup to
776 be executed after Cut1 a final task called "EstimateEnergy"
777 has been added, executed before writing the final output
778 (ganymed00000000.root). The task setup in all three cases
779 can be choosen individually. (For all three(!) cases you
780 can for example choose MRanForestCalc. For examples see all
781 sponde*.rc and all ganymed*rc)
782
783 - ganymed: If a container "MEstimatedEnergy" is found in the
784 parameter list (eg. because it was setup by MEstimateEnergy)
785 it will be written to the output file.
786
787
788
789 *** Version 1.0 (2007/02/16)
790
791 - database: Website to plot values from the database has been added.
792
793 - database: The rate of spark events as found by star is now kept
794 and the rate after cleaning is now with spark events subtracted
795
796 - general: The changes to the interpretation of phrases lead to
797 a problem with the access of MHMatrix objects (eg. "M[0]")... fixed.
798
799 - general: Added example files how you can create your own calendar
800 (eg. as christmas present) with Mars. Just run
801 root macros/tutorials/calendar.C
802
803 - general: Added a possibility to display grouped data in the plotdb.C
804 macro (and similar macros). This allows to plot hourly, nightly,
805 weekly, monthly and yearly averages.
806 For more details see the plotall function of the macro
807
808 - general: fixed the error display of the camera display. It showed
809 wrong results.
810
811 - general: fixed a memory leak when reading many MStatusDisplays
812
813 - general: added a macro (macros/tutorials/mirrordelay.C) plotting the delay
814 between a spherical and a parabolic mirror
815
816 - callisto: We have a new pulse position check which takes the properties
817 of the extractor automatically into account. So no need to set
818 ExtractWinLeft/Right anymore. Again a check for pulses too much to the
819 left is done. If possible the lo-gain extraction start and hi-gain
820 extraction end is changed accordingly. If no proper extraction range
821 can be set (hi-gain too much to the left) an error is raised.
822
823 - callisto: New swapped pixels have been found and corrected
824
825 - callisto: Redone the signal extraction this includes:
826 + Unified the algorithms to extract the pedestal for all pedestal
827 extractions done
828 + Unification of hi- and lo-gain into one array
829 + Unification of hi- and lo-gain extraction for Spline and
830 Digital Filter (means now exactly the same algorithm is used,
831 not a copy-and-pasted one)
832 + Store pedestal subtracted data in a common place
833 + Improved extraction algorithms. If the algorithms search a
834 maximum but don't find one they don't return the maximum anymore
835 + Improved the extraction such that a information for signal
836 and time which is consistent is returned
837 + replaced the numerical spline with a (not slower) analytical
838 solution
839 + Lowered the saturation limit from 250 to 245 to make sure that
840 we are far away in all pixels from problems with the clock-noise
841 + The start of the lo-gain extraction is calculated from the hi-gain
842 arrival time. In case of saturation an estimation is used.
843 + the hi-gain window was extended to slice 16. This allows extraction
844 of very late pulses in single pixels or of huge hadron showers.
845 + Now uses the lo-gain extraction range for pedestal extraction,
846 not the hi-gain range in the lo-gain
847
848 - callisto: New hi-/lo-gain calibration constants have been produced
849 for all periods from the statistic of the whole period. They are
850 now used automatically depending on the periods. The old constants
851 where deviation in avarega about 2%-3%. The constants are very
852 stable from period to period (<<1%) except for exchanged channels.
853 In a few cases the constants used so far were off by 1%-2% (maybe
854 temperature effects?)
855
856 - callisto: To gain obsolete space we do not write the
857 MPedestalFundamental anymore. Also calibration and bad pixel
858 treatment is not done for it anymore because it has never been used.
859
860 - callisto: Fixed a bug in the seuqence handling which caused the
861 light condition to be ignored
862
863 - star: Added two new tabs "Sparkless" and "Sparks" these tabs show
864 basically the same as "Cleaned" but the distribution devided into
865 the events fullfilling a spark cut or being rejected by it.
866 This cut can be changed from star.rc (see example inside) by
867 the "SparkCut" directive
868
869 - star: Star displays now the average individual pixel-rate (IPR) versus
870 time and the average discriminator threshold (DT) of all pixels.
871
872 - optim: fixed a problem with the optim-macros which was due to a bug
873 in the new phrase parsing
874
875 - ganymed: To get a nice FalseSource plot (instead of the all-information
876 debug plot displayed as a standard plot) use the context menu
877 somewhere between the two upper plots, click on "DrawNicePlot"
878 and enjoy the result. (It is the same context menu which contains
879 the other options)
880 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
881
882 - ganymed/optim/train: The cut program, trainings- and optimization
883 macros could run with less files found than expected from the
884 sequence-files. No the execution is stopped in this case.
885
886 - ganymed: now stores the dataset in the output file with all information
887 contained (as sequence number, sequence path, data path) so that the
888 used dataset file can be recreated complete from the output
889
890 - sponde: now also allows the uasge of random forest
891
892 - sponde: added a plot showing the cut efficiency
893
894 - sponde: Using root versions < 5.13/04 still resulted in wrong binomial
895 errors (eg. effecting the collection area) because the errors of the
896 two histograms were swapped in the calculation, which makes a difference
897 in the case the histograms contains weighted events. Aditionally the
898 totalarea was incorrectly taken into account, which results in too small
899 errors, which makes a difference at low statistics were the errors
900 or the collection area dominate.
901
902
903
904 *** Version 0.10.3 (2006/10/23)
905
906 - database: Implemented ObservationMode flag in websites.
907
908 - database: For sequences there is now also the stoptime available on the
909 websites.
910
911 - database: Removed ManuallyChanged flag from sequence-info websites,
912 as it is not needed anymore with the new sequence building algorithm.
913
914 - general: MRolke.[cc,h]: Modification of TRolke from root_v5.12.00b.
915 Class for calculation of confidence intervals (upper limits).
916 Use model 3 or 4 for upper limit calculation for MAGIC observations.
917 Please read the class instruction of TRolke for more information.
918
919 - general: The programs now return 0xfe if the requested resource file
920 doesn't exist.
921
922 - general: Errors comming from root itself are now not output to
923 stderr anymore but to our default (colored) log-stream.
924
925 - general: Changed the interface to TFormula such that now everything
926 is parsed by TFormula, which should allow to use phrases even
927 without paranthesis correctly parsed.
928
929 - callisto: replaced the AdHoc number of effective integration slices
930 in the digital filter by an average of the correct number, averaged
931 over all possible set of weights. This also gives correct numbers
932 for the lo-gains which were totally wrong before.
933
934 - callisto: drastically reduced memory consumption by not storing
935 all intermediate calibration results in memory anymore (we might
936 write them into a file in the future)
937
938 - ganymed: To get a nice Theta-Sq plot (instead of the all-information
939 debug plot displayed as a standard plot) use the context menu
940 somewhere between the two upper plots, click on "DrawNicePlot"
941 and enjoy the result. (It is the same context menu which contains
942 the "DrawAll" option)
943 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
944
945
946
947 *** Version 0.10.2 (2006/10/15)
948
949 - general: changed the building of the sequence files such, that
950 the source-/project name in case of wobble-sources is not the
951 source/project of the first data run anymore but the new generalized
952 wobble source/project
953
954 - general: Added some functions to MAstro to calculate sun and
955 moon properties
956
957 - general: Added two new macros (starvisday.C and starvisyear.C)
958 which allow to plot the visibility of several stars in one day
959 or of one star along one year
960
961
962
963 *** Version 0.10.1 (2006/10/11)
964
965 - general: HTML logging output was distorted... fixed.
966
967 - general: Changed the writing of the sequencefiles such that only
968 as many pedestal files as giving at least 1000 pedestal events which
969 are nearby the first calibration run are used as pedestal runs
970
971 - sponde: In the calculation of the collection area(s) and the
972 distribution for MOnte Carlo and estimated energy the error
973 calculation was wrong because root didn't take the errors
974 properly into account... fixed.
975
976
977
978 *** Version 0.10 (2006/10/10)
979
980 - general: all executables now check consistency of the root version
981 installed with the root version used for compilation. The return
982 code in this case is 255.
983
984 - general: The algorithm to build seqeunces has been redesigned
985 completly. It is now more flexible in terms of a resource file
986 resources/sequences.rc which can be used to partly overwrite
987 the default algorithm and defined the important part of the
988 algorithm. It also takes correctly into account several ways
989 of taking wobble-data. Currently the new algorithm doesn't take
990 the number of pedestal events anymore into account (so a sequence
991 could have much less than 1000 pedestal events and data runs are
992 no-more used instead)
993
994 - general: a lot of small changes to make the code compatible with
995 root 5.12/00 and gcc 4.1
996
997 - general: Fixed some warnings thrown if more warnings are switched
998 on in the compiler
999
1000 - general: Added a function to MMath which returns the Median of
1001 the distribution abs(y[i]-median) but at 68:32 division instead
1002 of 50:50, which is somehow the median counterpart of the rms.
1003
1004 - general: MAstroCatalog allows now to read calatog files (as bsc5)
1005 even if they are compressed with gzip (recommended compression
1006 is with "-1")
1007
1008 - showplot:
1009 + batch mode creation of image files now works with root 5.12/00
1010 + added support for writing bmp (though it never produces
1011 bmp which can be read by programs like xv or gimp)
1012 + added support for xml
1013 + added new option to start the display with a different size, by
1014 --display-width=nnn or --display-height=nnn
1015 + added options to define the canvas size when the display is started
1016 --canvas-width=nnn or --canvas-height=nnn
1017 the option can also be used for batch-mode conversion
1018 + added an option which automatically fits the display size to the
1019 desktop-size: --auto-size
1020
1021 - merpp: didn't recognize files with the extension .raw.gz - fixed.
1022
1023 - merpp: allow the reports to have 1000ms due to a bug in the camera
1024 program.
1025
1026 - callisto: New swapped pixels have been found and corrected. For
1027 details see MRawRunHeader::FixAssignment()
1028
1029 - callisto: Callisto now raises an error if one of the input files could
1030 not be opened.
1031
1032 - callisto: In some rare cases it could happen that in the signal
1033 extraction of the digital filter the extractor returned nonsense
1034 results due a wrong initializion of a variable (this happens in
1035 cases in which the extracted signal is exactly zero or the
1036 digital filter couldn't slide because of a too small extraction
1037 window, which could happen in the lo-gain extraction)
1038
1039 - callisto: The lo-gains have been marked as valid in some cases
1040 when they got not extracted at all (deltsumlo=deltatimelo=0) because
1041 the allowed extraction range (fLoGainLast-fLoGainFirst) was
1042 smaller than the number of slices (fLoGainWindowSize) needed
1043 by the lo-gain extractor
1044
1045 - callisto: Updated absolute calibration constants (muon calibration)
1046
1047 - callisto: fixed a bug which caused the hi-gain saturation not
1048 to be handled properly in the spline (the position of the
1049 saturation was calculated incorrectly)
1050
1051 - callisto: fixed a bug which gave weird results if hi- _and_
1052 lo-gain could not be extracted properly. In some cases hi-
1053 and lo-gain have not been extracted at all and the random result
1054 got calibrated. In other cases the hi-gain was saturating and the
1055 lo-gain has not been extracted. For this a completly arbitraty
1056 scale factor was applied to the result from extracting the
1057 charge of the saturating hi-gain.
1058
1059 - callisto: improves handling of extracted signal if lo- and/or
1060 hi-gain could not be extracted properly. If no appropriate
1061 calibration of either the signal or the arrival time is possible
1062 the pixel is now markes as unsuitable instead of estimated.
1063
1064 - callisto: Fixed a problem in the spline extraction which gave
1065 weird results if the signal was extracted from the first (and
1066 highest) slice (as a workaround extraction from the first
1067 slice has been forbidden)
1068
1069 - callisto: Fixed a bug regarding the use of the QE which doesn't
1070 effect the result because the default is used anyhow.
1071 (The bug was there since 14/07/2005)
1072
1073 - callisto: Changed the default for fgLoGainStartShift to -2.4
1074
1075 - callisto: Fixed a bug which caused all hi-/lo-gain calibration
1076 factors to be always 10 for all pixels as soon as the first
1077 calibration update has happend.
1078
1079 - callisto: Fixed the hi-/lo-gain offset for the Digital Filter. It
1080 was off by more than one slice (which gives wrong values for
1081 pixels which have saturated the hi-gain) This was a problem
1082 mainly for timing studies, not so much for the automatic standard
1083 analysis. Also the values for the Spline have been changed slightly:
1084 + Digital Filter from 1.70 to 0.95
1085 + Spline from 1.39 to 1.30
1086 The numbers were sorted out by an extensive test in the
1087 test-database.
1088
1089 - callisto: Removed the tab showing the average calibrated arrival
1090 time. It never gave useful information.
1091
1092 - callisto: Now tab "HiLoCal" which shows the ratio between hi- and
1093 lo-gain pulse for data pulses if hi- and lo-gain have saturated
1094 and both were extracted because the hi-gain was above the
1095 LoGainSwitch.
1096
1097 - callisto: Now tab "HiLoOff" which shows the offset between hi- and
1098 lo-gain pulse position (after application of LoGainOffset, which
1099 means in the ideal case it is 0) for data pulses if hi- and lo-gain
1100 have saturated and both were extracted because the hi-gain was above
1101 the LoGainSwitch.
1102
1103 - callisto: After extensive tests a new threshold level for determination
1104 of the pulse position has been found at 50phe. This is due to the
1105 fact that for lower pulses the arrival time changes its average
1106 behaviour dramatically. It tends to the average of the extraction
1107 range and starts sticking to non-floating point numbers (5, 6, 7, ...)
1108
1109 - callisto: Added two more plots to the calibration part. The average
1110 extracted signal and the average extracted arrival time as
1111 extracted by the signal extractor (This can help debugging problems
1112 because it doesn't involve a fit)
1113
1114 - star: changed the fit for the effective on time such that initial
1115 values are calculated automatically now instead of using build
1116 in values. This makes the fit more indepedant of the underlaying
1117 rates. With a test of ~350 sequences in the test database it could
1118 be shown that the new fit gives the same result +/-1sek.
1119 The highest deviation was +5s the lowest -10s. You can now control
1120 the bahaviour with two resource values:
1121 MHEffectiveOnTime.FistBin: 3
1122 MHEffectiveOnTime.NumEvents: 12000
1123 Use FirstBin=1 and NumEvents=120 to fit the effective on time
1124 from the resulting gamma candidates
1125
1126 - star: The Center histogram in MHHillas is now by default displayed
1127 with the colz draw-option
1128
1129 - ganymed: now produces valid error codes if failed
1130
1131 - ganymed: MFMagicCuts now supports a hadronness cut. Switch it on
1132 with the option "hadronness" instead of "area" or "both" if
1133 you want to use both cuts. The hadronness cut includes a fixed
1134 cut in hadronness (index 8) and a fixed cut in size (index 9).
1135
1136 - ganymed: MFMagicCuts: fixed abug introduced 2005/7/14 which caused
1137 the M3Long of the anti source to be not properly evaluated
1138 (actually is was evaluated as a unique random number) in case
1139 of optimization with anti-theta cut switched on. This might have
1140 lead to improper, but not necessarily wrong, optimization results.
1141
1142 - ganymed: ganymed_onoff.rc, ganymed_wobble.rc - updated with comments
1143 how to use random forest
1144
1145 - ganymed: use the same spark cuts as in ganymed_wobble.rc as in
1146 ganymed_onoff.rc. Seems to be unintentional that they were different.
1147
1148 - sponde: Since the introduction of the possibility to define a
1149 normalization energy instead of using the integral the default
1150 was not using the integral anymore but a normalization energy of
1151 1GeV. It is now the integral again.
1152
1153 - sponde: Fixed a problem in the weighting which did not allow
1154 a MC slope of -1.
1155
1156
1157
1158 *** Version 0.9.6 (2006/05/24)
1159
1160 - general: changed the binning of the azimuthal profile of the camera
1161 such that it is aligned with the 60deg boundaries.
1162
1163 - merpp: better handling of problems with the TH, TD part of the
1164 CC-REPORT for files older than 200507190 and 200412210
1165 respectively
1166
1167 - merpp: improved handling of RECEIVERS-COM-ERROR in CC-REPORT
1168
1169 - merpp: implementd latest changes in starguider reports (sinc 9th May)
1170
1171 - callisto: if an arrival time is extracted outside the fadc range is
1172 was set to the boundary before. Now a random number is assigned
1173 instead to avoid unfortunate coincidences of arrival times just
1174 by this arbitrary value.
1175
1176 - callisto: added a new option to callisto.rc which allows
1177 to set the maximum arrival time difference allowed for the
1178 badpixel algorithm to determin whether a pixels belongs to a shower:
1179 MJCalibrateSignal.MBadPixelsTreat.MaxArrivalTimeDiff: 0.9
1180
1181 - callisto: changed the old value (0.5) for MaxArrivalTimeDiff
1182 to 0.9 as suggested by Stefan due to a recent study on the fraction
1183 of pixels surviving the image cleaning
1184
1185 - callisto: switched off error in case of "pulse is too much to the left"
1186
1187 - callisto: The extraction window is not adapted anymore. This means that
1188 the pulse is extracted from the full range. The draw-back is that the
1189 background (pedestal) will become slightly higher. Switching on/off
1190 the PulsePosCheck in the callisto.rc only effects filling the
1191 histograms.
1192 WARNING: If the pulse is too much to the left data is calibrated!
1193 Check the PulsePosCheck-PulsePosition AND the Inhomogeneity parameter
1194 in the database to make sure that your data is valid!
1195
1196 - star: Show also the number of stars correlated correctly by the
1197 starguider
1198
1199 - ganymed: implemented a new class (MHThetaSqN) which allows to use more
1200 than one off-source region in wobble-mode. To use it add the following to
1201 your ganymed_wobble.rc:
1202 + MJCut.NameHist: MHThetaSqN (switch the new feature on)
1203 + MHThetaSqN.NumOffSourcePos: 3 (define number of off-regions)
1204 + MHThetaSqN.DoOffCut: Yes,No (switch on/off the off-cut)
1205 + Cut1.ThetaCut: None
1206 + MHThetaSqN.SignificanceCutLevel: 2.0 (increase off-cut by 2.0/1.7)
1207
1208 - ganymed: in the case the latest report is older than a default (currently
1209 one minute) and the current report will be skip the starguider
1210 correction and calibration will be reset. The maximum age can be
1211 setup from ganymed.rc by (minutes):
1212 MPointingDevCalc.MaxAge: 1.5
1213
1214 - ganymed: A first implementation showing all size-bins for the theta-sq
1215 resp. alpha-plots in a single tab automatically
1216
1217
1218
1219 *** Version 0.9.5.1 (2006/05/05)
1220
1221 - general: Added a new option "zdiff" to the Makefile which runs
1222 "cvs diff" as "make diff" would do, but with compression
1223
1224 - general: accelerated MTFillMatrix (used for eample in all training
1225 and optimization macros) by skipping some obsolete calles in the
1226 eventloop the first and second loop could be accelerated by ~20%
1227
1228 - general: Added a missing feature in the MFilterList class which
1229 prevented MFEnergySlope from working correctly in trainenergy.C
1230
1231 - general: Accelerated the random forest training and usage a bit
1232
1233 - merpp: Adapted to new raw data file format version 6
1234
1235 - merpp: fixed a problem with reading the starguider reports
1236 after 6.3.2006
1237
1238 - callisto: At some times six pixels had to be exchanged manually in the
1239 data. If the pixels to be swaped are both not found, an error was raised
1240 and calibration was stopped. Now it is assumed they are intentially not
1241 mapped and the Error has been changed to a Warning.
1242
1243 - star: Added new image cleaning based on the arrival time of the shower.
1244 The new cleaning can be accessed using the parameter "Time" instead of
1245 the the old one (like "Absolute) in the star.rc-file.
1246 Recommended parameters:
1247 + MImgCleanStd.CleanLevel1: 8.2
1248 + MImgCleanStd.CleanLevel2: 5
1249 + MImgCleanStd.CleanRings: 2
1250 + MImgCleanStd.KeepSinglePixels: No
1251
1252 - star: Simplified the calculation of the effective on time. By letting
1253 the fit start in the third bin the result should become more stable.
1254 The fit quality is now ignored for the theta-plot which is not used
1255 in the analysis later. Still better pre-cut which, for example,
1256 remove events triggered by car-light (rate changing on a short
1257 time-scale) are missing.
1258
1259 - macros: optimonoff.C, optimwobble.C: implemented a new strategy
1260 for optimization (kWeakSource) which is suggested by the Berlin
1261 people for weak sources.
1262
1263 - macros: plotdb.C:
1264 + if no dataset and no time-interval is given only sequences with
1265 an effective on-time above five minutes are plotted anymore
1266 + added a new tab "RelTime" displaying the relative on-time
1267 (effective on-time divided by the observation time)
1268
1269 - macros: optim*.C: by skipping some obsolete calles in the eventloop
1270 the optimization became a lot faster
1271
1272 - ganymed: In the second loop the MHNewImagePar histograms disapeared.
1273 To display them just delete the pads displayed on top.
1274
1275 - ganymed: fixed a bug which could cause strange behaviour in wobble
1276 mode if no starguider information was available due to an incorrect
1277 initialization of the starguider calibration
1278
1279 - ganymed: The scale region in the False Source Plot (MHDisp) can now
1280 be changed from within the plot. It can also be setup from the
1281 resource file using:
1282 + MHDisp.fScaleMin: 0.325
1283 + MHDisp.fScaleMax: 0.475
1284
1285 - ganymed, showplot: Fixed a problem with the fit to the off-data
1286 (HistOff) which could cause a time lag or an inifinite loop.
1287 The bug did not effect the results at all.
1288
1289 - sponde: Added a new tab showing the effective collection area after
1290 trigger (including the software trigger)
1291
1292 - sponde: MMcSpectrumWeight has a new option which allows to define
1293 the scaling factor not by the integral of the events but at
1294 a defined energy:
1295 e.g. MMcSpectrumWeight.NormEnergy: 200
1296
1297 - MTFillMatrix, sponde: by skipping some obsolete calles in the
1298 eventloops the loop could be accelerated by ~20%
1299
1300
1301
1302 *** Version 0.9.5 (2006/03/13)
1303
1304 - macros: fixed a typo optimwoble.C (SetThetaCut instead SetAlphaCut)
1305 and added the standard Disp-parametrization
1306
1307 - macros: added a new macro datacenter/macros/plotstat.C allowing
1308 to plot statistics about the data processing
1309
1310 - macros: added a new macro to plot the muon correction coefficients
1311 versus period (macros/plot/mucal.C)
1312
1313 - showplot: path inflation for ganymed files was broken
1314
1315 - callisto: Fixed an important bug. When the number of saturating pixels
1316 were calculated the bad pixel information already available from the
1317 calibration was ignored. This yields wrong values in case pixels
1318 are broken and saturate all the time or randomly.
1319
1320 - callisto: Updated Muon calibration constants. Spline data now also uses
1321 different values for different periods
1322
1323 - star: The time-evolution shown in the effective on-time plot now displays
1324 the axis range (if there are no holes it should be similar to the
1325 effective on-time)
1326
1327 - star: Added two new image parameters:
1328 + MNewImagePar.fConcCOG: The ratio of the equivalent signals of
1329 the three pixels next to the center of gravity and the size
1330 + MNewImagePar.fConcCore: The ratio of the signals of all
1331 pixels inside or touching the ellipse and the size
1332
1333 - ganymed: now stops in requested source isn't found in catalog file
1334
1335 - ganymed: Many improvements to the phi-plot in wobble mode:
1336 + with a template the ideal background is displayed
1337 + a possible camera inhomogeneity is taken into account
1338 + the anti theta cut is better supported
1339 + the phi cut is automatically calculated from the theta cut
1340 See the examples in ganymed_wobble.rc for more details.
1341
1342 - ganymed: fixed plot for E^2*dN/dE. The spectrum was multiplied with two
1343 times the bin-width instead of the absolute energy
1344
1345 - ganymed: New cuts for on/off and wobble mode
1346
1347 - ganymed: The smearing of the False Source plot has been increased
1348 to 0.06
1349
1350 - ganymed: The starguider calibration can now be changed from the
1351 resource file.
1352 See the examples in ganymed*.rc for more details.
1353
1354 - ganymed: added a new option for on-/off-observations
1355 MJCut.RandomSourcePosition
1356 If switched on the distribution of observation time of the source
1357 position in the camera is calculated from the on-data and randomly
1358 applied with this distrbution to the off-data.
1359
1360 - ganymed: by skipping some obsolete calles in the eventloop the
1361 first and second loop could be accelerated by ~20%
1362
1363 - ganymed: The default in ganymed_onoff.rc is now to determin the source
1364 position in the off-data randomly according to its distribution in the
1365 on-data.
1366
1367
1368
1369 *** Version 0.9.4.3 (2006/02/13)
1370
1371 - general: Fixed a bug in most of the programs which prevented the
1372 compile date in the startup message to be displayed
1373
1374 - general: Simplified program calls. The following abbreviations
1375 are now possible:
1376 showlog callisto 55599
1377 showplot signal 55599
1378 star 55599
1379 callisto 55999
1380 ganymed 2
1381 In this cases the corrsponding root-, log-, sequence- or dataset-
1382 filename is automatically compiled using the default datacenter
1383 paths ("/magic/*")
1384
1385 - general: Fixed a long outstanding bug which made axis tick marks
1386 disappear if MDataFormula was used (eg. abs(x))
1387
1388 - general: Updated MMath with new functions to calculate the results of
1389 a exponential, logarithmic and powerlaw fits analytically.
1390
1391 - general: Updated some macros with comments:
1392 + macros/optim/optimdisp.C
1393 + macros/optim/optimenergy.C
1394 + macros/optim/optimwobble.C:
1395
1396 - general: MTFillMatrix (the class to fill one or two MHMatrix from
1397 files) now allows adding a pre-cut like in the optimization. E.g. this
1398 is useful to perform g/h-separation cuts before training the random
1399 forest.
1400
1401 - general: Between the rund 53300 and 68754 the pixels 553-558 were not
1402 correctly assigned in the raw data assignement table. A fix to correct
1403 the assignment tabel have been implemented.
1404
1405 - general: MAstroCatalog now allows rotating of the sky-grid and stars
1406 by 90, 180 and 270 deg.
1407
1408 - general: the macro plotdb.C now allows to highlight sequences belonging
1409 to a datset. For more details see the descritions in the macro.
1410
1411 - StatusDisplay: Fixed the algorithm to calculate the size ratio
1412 of the display, it gave wrong results espacially for big sizes.
1413 Now the embedded canvas should always have a ratio width/height=3/2.
1414 The "Size" options have been updated with values fitting the 3/2
1415 size ratio.
1416
1417 - RanForest:
1418 + Updated the random forest classes to support also the
1419 regression method implemented by Thomas H.
1420 + added new tutorial macro how to train the random forest
1421 for energy estimation (macros/optim/rfenergyest.C)
1422 + new classes to train the random forest (still in development)
1423 mjtrain/MJTrainEnergy, mjtrain/MJTrainDisp, mjtrain/MJTrainSeparation
1424 + new tutorial macros for random forest training in macros/train
1425 trainenergy.C, traindisp.C, trainseparation.C
1426
1427 - mars: now allows to setup a cut in the resource file mars.rc to choose
1428 the events to be displayed, eg:
1429 Cut.Condition: {0} && {1}
1430 Cut.0: MHillas.fSize>100
1431 Cut.1: MHillas.fSize<900
1432
1433 - merpp: Made aware of the new .rep format 200510250. This includes
1434 interpretation of the Receiver Board Temperatures (MCameraRecTemp),
1435 the discriminator thresholds (MCameraTD) and the disciminator
1436 delays (MCameraTD). All of them come with the CC report and are therefor
1437 written to the CC tree.
1438
1439 - callisto: fixed a bug in the calculation of the arrival times in
1440 the Digital Filter. They were all shifted by the same amount
1441 fHiGainFirst. This caused an offset in the order of the position of
1442 the left border of the extraction window in the times calculated
1443 from high-gain and from low-gain. The bug effected only the absolute
1444 arrival times. The bug was there since 30.1.2005.
1445
1446 - callisto: Changed the ExtractionWindow for the pulse position check
1447 such that the camera inhomogeneity becomes as less as possible and
1448 comparable to the pulso position check switched off. More details
1449 on the study will be given at our result web-page.
1450
1451 - ganymed: ganymed.rc, ganymed_onoff.rc:
1452 changed to new cuts trained with 1ES1218 and Crab-data
1453 for maximum sigma*log10(excess)
1454
1455 - ganymed: In addition to the Hadronness calculator (CalcHadronness)
1456 a new option was implemented to estimate Disp (CalcDisp)
1457
1458 - ganymed: Implemented two new options which allow
1459 to overwrite the default path to search for the sequence files
1460 --ins=/magic/sequences
1461 and where to search for the image data
1462 --ind=/magic/data/star
1463
1464 - ganymed: MSrcPosCorrect now allows overwriting of the misfocussing
1465 dx/dy from the resource file by
1466 MSrcPosCorrect.Dx
1467 MSrcPosCorrect.Dy
1468
1469 - ganymed: fixed reading the source catalog. Only as many chars
1470 as the requested source name had were compared (If a source
1471 "1ES1218" and "1ES1218+304" were in the catalog and "1ES1218+304"
1472 were requested it could happen that the coordinates of
1473 "1ES1218" were read) The source coordinates are now printed
1474 in addition to its name to the logging output.
1475
1476 - ganymed: changed the background fit in the case of a ThetaSq function
1477 from a polynomial to a exponential, this should give a big improvement
1478 for on-only analysis'
1479
1480 - ganymed/sponde: Calculation of the error of single size-/energy-
1481 bins now uses Li/Ma (5) instead of LiMa (17)
1482
1483 - sponde: Added a plot E^2*dN/dE
1484
1485 - sponde: The energy estimator plot should now show values like
1486 they are commonly used.
1487
1488 - sponde: Now MMcSpectrumWeight also excepts formulas with two X
1489 (a powerlaw with cutoff didn't work before)
1490
1491
1492
1493 *** Version 0.9.4.2 (2005/10/01)
1494
1495 - general: added new tutorial macro macros/tutorials/threshold.C:
1496 how to calculate the threshold
1497
1498 - general: added a new game. Start it from the interpreter with
1499 MagicJam j; (other games are: MineSweeper, MagicSnake, MagicDomino
1500 and MagicReversi)
1501
1502 - general: neighbor pixels in MGeoms are now sorted clockwise
1503
1504 - merpp: made aware of new format 20050829-0
1505
1506 - callisto: New scale factors from muon analysis, stored in new
1507 resource file resources/calibration.rc
1508
1509 - callisto: MBadPixelsCalc now raises an error instead of simply stopping
1510 the eventloop if something went wrong. This is necessary for the
1511 automatic processing
1512
1513 - callisto: Implemented a new treatment for the time information
1514 developed by S.Ruegamer, this should give much better response than
1515 the old very primitive algorithm. This is especially important
1516 for bad pixels due to bright stars as Ceta-Tauri (btw: the old
1517 treatment was buggy! As neighbor pixels to interpolate the
1518 arrival times always the pixels 0 to 5 were taken)
1519
1520 - callisto: In addition to the new treatment of arrival times the
1521 decision of the treatment whether a pixel contains shower
1522 information or not is used to improve the signal interpolation
1523 further. Previously interpolated pixels showed a non-zero signal
1524 do the peak searching signal extractors. Having a signal pixel
1525 beside raised the signal above the cleaning level. Thus the
1526 pixel survived cleaning to often but with a too low mean signal.
1527 By replacing empty pixels with a gaus (mean and rms from the
1528 corresponding Area entries in MPedPhotCam) this effect can
1529 be supressed.
1530
1531 - callisto: The status "unmapped" (for pixel which cannot be interpolated)
1532 got lost when the events were stored by the calibration... fixed.
1533 (This was no problem for normal image cleaning because the pixel
1534 content was artificially set to 0 not surviving standard cleaning
1535 algorithm)
1536
1537 - callisto: Fixed a bug which caused the random and peak-search pedestal
1538 extracted with an extractor to be exchanged for the first (roughly)
1539 500 events (*Extractor and *ExtractorRndm).
1540 (They were simply exchanged in callisto.cc) This bug might have been
1541 introduced in Mars 0.9.4 when the order of calculation of the two
1542 types of pedestal in callisto got exchanged. The bug only effects
1543 the first seconds of data of each sequence.
1544
1545 - star: Taking the arrival time of Muons into account the calculation
1546 of the parameters could be made independant of the noise
1547 (pedestal rms). The dependance was due to the bias of the peak search
1548 extractor. Now only a ZA dependamcy is left which is not yet fully
1549 understood.
1550
1551 - ganymed: The sequences were still not sorted correctly in any case,
1552 because they were sorted by the full qualified path name. Now they
1553 are sorted by their sequence number.
1554
1555 - ganymed: new values for the spark-event-cut
1556
1557 - sponde: required missing MEnergyEst from ganymed.root... fixed.
1558
1559
1560
1561 *** Version 0.9.4.1 (2005/08/18)
1562
1563 - callisto: fixed some problems with the calibration in case of
1564 inteleaved events. Therefor the final and some intermediate
1565 fits are skipped which would take place on partly filled #
1566 histograms and gave wrong results or failed completely.
1567
1568 - callisto: If the intermediate finalization of the histograms
1569 calculating the mean charge of the calibration signal fails
1570 it is counted now and printed in PostProcess of MCalibCalcFromPast.
1571
1572 - ganymed: Fixed some bugs which caused problems in On-only mode.
1573 Still the false source plot doesn't give reasonable results.
1574
1575
1576
1577 *** Version 0.9.4 (2005/08/05)
1578
1579 - general: Fixed the ZA binning. It did not correctly fit the
1580 MC binning
1581
1582 - general: Added a class to correct for the missfocussing in
1583 April (MSrcPosCorrect)
1584
1585 - general: Random Forest energy estimator should now work properly
1586
1587 - general: MHCamera now displays the profiles in deg instead of mm
1588
1589 - general: MH::SetPalette offers a lot of new palettes
1590
1591 - general: MHillas - the case of CorrXY==0 is now handled properly
1592
1593 - general: implemented the possibility to change the line and
1594 marker style of a sky-grid drawn by MAstroCatalog
1595
1596 - general: Runs in sequences and datasets are now automatically
1597 ordered (it is assumed that the order of their filenames correctly
1598 represents the order of observations) to ensure correct reading
1599 of the subsystem data
1600
1601 - general: Runs cannot be added to a sequence twice anymore. Also
1602 Sequences cannot be added twice anymore to a dataset.
1603
1604 - general: fixed a bug in MAstro::Deg2Hms reported by Abelardo.
1605 It gave wrong results by 1./2pi
1606
1607 - showplot: got a new option to start a root interpreter, too
1608
1609 - mars: now displays a rough estimate of Disp and the third moment
1610
1611 - mars: now displays the event time MTime if available
1612
1613 - mars: show muon parameters graphically
1614
1615 - mars: now the file to open can be given as commandline
1616 argument
1617
1618 - merpp: Added support for new arehucas version >= 200507190
1619 implementing values for three temperature sensors in the
1620 counting house (MCameraAUX) and the name of the HV settings file
1621 (MCameraHV).
1622
1623 - merrp: Also fixed some problems with wrong versions numbers stated
1624 by arehucas and implemented some fixed for old versions (<200407070)
1625
1626 - callisto: MCalibrationHiLoCam can now be printed from its context
1627 menu, eg in the TBrowser
1628
1629 - callisto: fixed logain offset (fgOffsetLoGain) from 1.7 to
1630 - 1.39 (MExtractTimeAndChargeSpline)
1631 - 1.40 (MExtractTimeAndChargeDigitalFilter)
1632 This is important mainly for timing studies.
1633
1634 - callisto: Changed limits in MHCalibrationChargeCalc from
1635 - -100.125 to -98 (fgChargeHiGainFirst)
1636 - 1899.875 to 1902. (fgChargeHiGainLast)
1637 - -100.25 to -99 (fgChargeLoGainFirst)
1638 - 899.75 to 901. (fgChargeLoGainLast)
1639 Introduced new limits:
1640 - fgNumLoGainBlackoutLimit: 0.05
1641 - fgLoGainBlackoutLimit: 3.5
1642 - fgLoGainPickupLimit: 3.5
1643
1644 - callisto: The handling of automatic weights for the digital filter
1645 has been improved. There are now new calibration weights special
1646 for Monte Carlo calibrations.
1647
1648 - callisto: Updated Muon scale with latest results (1% difference
1649 for most data, 5% for Mar/Apr'05)
1650
1651 - callisto: use a new criterium to exclude bad pixels: If the high-gain
1652 was saturated and the blackout-events in the low-gain exceed the
1653 fNumLoGainBlackoutLimit, the pixel is declared unsuitable.
1654 This excludes those pixels which have a saturating high-gain
1655 channel, but the low-gain switch does not switch often enough
1656 to make the distribution reliable.
1657
1658 - callisto: fix a bug counting the number of saturated events. Up to now,
1659 the number of saturated slices was counted (which is one for a not too
1660 high number), but for some (pathological) pixels, many more slices
1661 saturated and produced wrong limits.
1662
1663 - callisto: New options in in callisto.rc for MCalibrationRelTimeCalc:
1664 + MCalibrationRelTimeCam.CheckFitResults: Yes
1665 + MCalibrationRelTimeCam.CheckDeviatingBehavior: Yes
1666 + MCalibrationRelTimeCam.CheckHistOverflow: Yes
1667 + MCalibrationRelTimeCam.CheckOscillations: Yes
1668
1669 - callisto: introduce max. number of events for intercalibration,
1670 the rest gets skipped. Default: 4096
1671 The calibration causes too many un-reliable pixels if more
1672 than about 5000 events are treated (@500 Hz) because of the
1673 mode hopping of the VCSels. However, in the past, some
1674 calibration runs have been taken (erroneously) with more
1675 than 5000 events, especially the intensity scans where
1676 a good precision is needed.
1677
1678 - callisto: Set UseExtractorRes to kTRUE, will raise the number of
1679 photo-electrons for the spline extractor by 1-2% (correctly).
1680
1681 - callisto: The intercalibration is now done using a full f-factor
1682 method instead of a simple update. This makes things slower but
1683 more reliable in terms of gain-fluctuations and sudden VCSEL gain
1684 changes.
1685
1686 - callisto: MPedestalY3 now uses the same extraction range as the data
1687 as calculated by MPedestalY2
1688
1689 - callisto: A check of the fraction of allowed unsuitable (10%) and
1690 unreliable (30%) pixels has been addded when the conversion is
1691 calculated from interleaved events
1692
1693 - star: fixed a bug which caused MEffectiveOnTime containers not to
1694 be written. In the worst case they were skipped almost all, in the
1695 best case they were all ok. It depends on how often the new value
1696 was assigned just with an event which was skipped later by another
1697 task
1698
1699 - star: new histograms MHPointing and MHRate
1700
1701 - star: New tab (Currents) displaying the time evolution of the mean
1702 DC currents
1703
1704 - star: New tab (MeanRms) displaying the time volution of the mean
1705 Pedestal Rms
1706
1707 - star: Output now contains MReportStarguider
1708
1709 - star: Improved muon analysis. Due to the absense of a constant
1710 for the gaus fit for arc width and the fact that the arcwidth
1711 plot was a histogram instead of a profile the resulting psf
1712 became pedestal rms dependant
1713
1714 - ganymed: added new plot (MHPhi) for wobble mode as described in
1715 http://www.astro.uni-wuerzburg.de/results/ringmethod/
1716
1717 - ganymed: corrects now (correctly?) for the misspointing in
1718 May/April 05
1719
1720 - ganymed: Two new default templates for ganymed.rc are avilable:
1721 ganymed_onoff.rc and ganymed_wobble.rc
1722
1723 - ganymed: The first version of MFMagicCuts has been released
1724
1725 - ganymed: the Conc1 plot was incorrectly scaled in MHVsSize
1726
1727 - ganymed, sponde: There are two new options to determin the number
1728 of bins for the signal region (NumBinsSignal) and the number of
1729 total bins (NumBinsTotal) in the MHThetaSq histogram
1730
1731 - ganymed: optimized palettes for MHDisp
1732
1733 - ganymed: Fixed an important bug when using ThetaSq as fit function:
1734 The result for the sigma of the gauss(sqrt(x)) fit was a factor
1735 sqrt(2) to large
1736
1737 - ganymed: The false source plot (MHDisp) is now based on Disp
1738 and a background model determined in the first loop is
1739 subtracted
1740
1741 - ganymed: MFMagicCuts are now available in the cvs. The correct
1742 solution for the disp ambiguity problem is now calculated using
1743 the third moment. The third moment cut therefor is skipped.
1744
1745 - ganymed: Output now contains "Disp [MParameterD]" which sign is
1746 already determined by the third moment along the major axis and
1747 so its actual sign is aligned along the major axis of the shower.
1748
1749 - ganymed: If starguider data is available it is taken into account
1750 when calculating the source position. This is especially important
1751 for wobble data at high zenith angles and culmination data.
1752
1753 - ganymed: If available the starguider data is taken into account as
1754 good as it is possible without a starguider calibration. To switch
1755 it off add
1756 MPointingDevCalc.MaxAbsDev: -1
1757 to your ganymed.rc
1758
1759 - sponde: the zenith angle distribution is now weighted instead of
1760 choosen by default. This gurantees higher statistics in the highest
1761 and lowest energy bins. To switch this behaviour off use...
1762
1763 - sponde: now automatically displays the energy threshold
1764
1765
1766
1767 *** Version 0.9.3 (2005/06/03)
1768
1769 - general: MMcEvt now derived from MMcEvtBasic which should
1770 have no influence on compatibility with older camera files
1771
1772 - general: Implemented a new option to MReadReports which allows
1773 to force reading of the first event of some trees (eg. Drive-tree)
1774 before any other tree.
1775
1776 - general: Made a fix to MPointingPosCalc which assumes that the
1777 run-type is real-data if Process is called before ReInit, such
1778 that also the very first Drive-events in a run are treated
1779 correctly.
1780
1781 - shoplot now displays the filename in the title bar of the window
1782
1783 - merpp: new options: --auto-time-start --auto-time-stop which
1784 allow to cut updating with slow-control at the start- or
1785 (previousle --auto-time only allowed: and) stop-time of
1786 the run stored in the runheader.
1787
1788 - callisto: changed default of fgFallTimeHiGain in
1789 MExtractTimeAndChargeSpline from 1.5 to 0.5. 0.5 was
1790 already set as default in callisto_Dec04Jan05.rc
1791
1792 - callisto: the digital filter (MExtractTimeAndChargeDigitalFilter)
1793 now changes the filename for new weights automatically for
1794 cosmics, MC and for different calibration colors.
1795
1796 - callisto: a problem with the order of some code cause the
1797 name of the weights file in MPedestalY2 to be ignored.
1798 Wrongly the calibration_UV weights were used instead
1799 of the cosmics weights set in callisto.rc.
1800
1801 - callisto: should allow ct1 pulser data when the color is
1802 explicitly set also for pretty new runs
1803
1804 - callisto: a new option (MCalibrateData.ScaleFactor) allows
1805 to introduce an additional scale factor (should be around 1)
1806 to adapt for slight deviations in different extractors from
1807 the MC calibration. For MC calibrations the scale factor
1808 is fixed to 1
1809
1810 - callisto: MFCosmics should handle very high signals a bit
1811 more accurate now
1812
1813 - callisto: when calculating the mean pedestal rms for different
1814 pixel sizes or sectors also kUnsuitableEvt is now taken into
1815 account - not only kUnsuitableRun
1816
1817 - callisto: '-raw' option is now the default
1818
1819 - callisto: A dead pixel check has been implemented in MJPedestalC2.
1820 This has the advantage that mean values in the calibration (eg
1821 arrival times) are calculated more accuratly.
1822
1823 - callisto: In the resource file callisto_Dec04Jan05.rc
1824 MJPedestalY2.ExtractWinRight has been reduced from 4.0 to 2.0
1825
1826 - callisto: new Hi-/Lo-Gain intercalibration constants
1827 hilocalib_sp1.root and hilocalib_sp1_mc.root
1828
1829 - callisto: changed default for MJPedestalY2.MaxEvents
1830 from 2000 to 5000 like in callisto_Dec04Jan05.txt
1831
1832 - callisto: in MCalibrationChargeCalc the limit fgPheErrLowerLimit
1833 has changed from 9.0 to 6.0. This is necessary to exclude two very
1834 ringing pixels in September which - when kept - destroy the image
1835 cleaning around them (Markus G.)
1836
1837 - callisto: (!) The Muon analysis of all data taken so far has
1838 suggested that different extractors give slightly different
1839 absolute results after calibration, due to there different
1840 handling of the calibration- and cosmics pulse shape. Although
1841 the over all calibration seems to be a bit to pesimistic (or
1842 the MC seems to be a little bit - 3-5% - too much attenuated).
1843 There for correction factors have been introduced which correct
1844 the calibration constants by
1845 0.956937799 for Digital Filter (callisto.rc)
1846 and
1847 0.904159132 for Spline (callisto_Dec04Jan05.rc)
1848 calibration. The main advantage is, that both data types can
1849 be easily analysed together and compared to the same MC sample.
1850 The factors are choosen such, that the reference is now a
1851 Monte Carlo sample calibrated with Digital Filter (callisto.rc)
1852
1853 - star: fixed a bug which caused the first bin of the histograms
1854 vs time to disapear in PostProcess. This gave wrong results
1855 on the screen. The output and all following programs not
1856 directly accessing the histograms haven't been affected
1857
1858 - star, ganymed: Made sure that always the first Drive-tree event
1859 is read and Processed before the first data event was read.
1860
1861 - ganymed: implemented the possibility to replace the standard
1862 false source plot with a different one. For example: If
1863 you want to use a Disp based FS plot use the resource:
1864 NameHistFS: MHDisp
1865 For details about the requirements of these plots look
1866 at the corresponding classes
1867
1868 - MJOptimize: For On/Off and Wobble optimization MJOptimize
1869 has been replaced by MJOptimizeCuts. To use MHThetaSq instead
1870 of MHAlpha call MJOptimizeCuts("MHThetaSq"). Make sure in this
1871 case MAlphaFitter is setup correctly. For On-Only optimization
1872 MJOptimize has been Replaced by MJOptimizeCuts, too. Call
1873 RunOn() instead of Run(). For energy estimation MJOptimize
1874 has been replaced by MJOptimizeEnergy
1875
1876 - sponde: The input MC spectrum can now be weighted to fake a
1877 different spectrum. This is done via MMcSpectrumWeight. For
1878 more details see the class description and sponde.rc
1879
1880 - sponde: The paremeter comparsion plots are not scaled by
1881 their entries anymore. Instead the MC plot is scaled by using
1882 the result spectrum of the analysis. If the input MC spectrum
1883 and the result spectrum has different slopes the absolut
1884 normalization is normally wrong.
1885
1886
1887
1888 *** Version 0.9.2 (2005/05/20)
1889
1890 - general: Changed the default paths for calibrated data and image
1891 files. (The implemented access to these files doesn't yet exist)
1892
1893 - general: support for MRunIter has been removed from the job classes
1894 (use the setter functions of MSeqeunce instead)
1895
1896 - general: ProcessFile has been renamed to Process in all job classes,
1897 because ProcessFile is missleading
1898
1899 - general: The storage of the palette in MHCamera is now possible
1900
1901 - general: new bits describing unsuitable and unreliable pixels have
1902 been introduced in MBadPixelsPix: kPreviouslyExcluded,
1903 kDeadPedestalRms, kFluctuatingArrivalTimes
1904
1905 - general: fixed reading of CC-REPORTS (weather data) for Arehucas file
1906 versions newer than V200404070
1907
1908 - general: support for cc file versions newer than V200504130. Added
1909 support for active loads (MCameraActiveLoad) and central pixel
1910 (MCameraCentralPixel)
1911
1912 - general: added new histograms for image parameters versus size
1913 (MHVsSize)
1914
1915 - general: The eventloop now automatically calls PrintStatistics
1916
1917 - Status Display: Improved support for printing:
1918 + A default can now be set in .rootrc (for more details see
1919 MStatusDisplay::PrintPS)
1920 + A print dialog is opened so that printer and command line
1921 can be canged
1922
1923 - showlog: improved such that it handles different verbosity levels
1924 more accurate now. This mean you can suppress output when
1925 using showlog.
1926
1927 - showplot: improved
1928 + The new graphics formats have been implemented
1929 (pdf, svg, png, jpg and xpm)
1930 + Implemented an interface for printing. Because you can change
1931 the printing command from the command line you can use all
1932 the nice postscript tool. To print a booklet for example call:
1933 showplot -b --print --print-cmd="cat %f" filename.root | lpr
1934 showplot -b --print --print-cmd="psbook %f | psnup -2 | lpr" filename.root
1935 showplot -b --null --print --print-cmd="psbook %f" filename.root > book.ps
1936
1937 - callisto: fixed a bug in the recognition of the calibration bit
1938 pattern. Concerns only intensity calibration. (The strength of the
1939 intensity has been updated in some cases)
1940
1941 - callisto: add a filter against PIN Diode events when running over
1942 calibration runs since some of the recent calibration runs have
1943 been taken with Pin Diode.
1944
1945 - callisto: added support for the runs 39942, 39944, 44834, 39941,
1946 39943, 44833 in the calibration (MCalibColorSet)
1947
1948 - callisto: MJCalibration.MHCalibrationChargeCam.ProbLimit has
1949 been set to 1e-18 in callisto_Dec04_Jan05.rc
1950
1951 - callisto: in callisto_Dec04Jan05.rc: set value for
1952 MJPedestalY2.MaxEvents from 2000 to 5000 to get better
1953 statistics for the calculation of the mean pulse time
1954 of the cosmisc
1955
1956 - callisto: the charge limit in the calibration has been raised
1957 from 2.5 to 4.5
1958
1959 - callisto: new setup read from callisto.rc
1960 + MCalibCalcFromPast.fNumEventsDump
1961 + MHCalibrationChargeCam.NumHiGainSaturationLimit
1962 + MHCalibrationChargeCam.NumLoGainSaturationLimit
1963
1964 - callisto: MExtractTimeAndChargeSpline extractor:
1965 + The integration ranges were shifted by 0.2 FADC slices to the right.
1966 + unreliable handling of floating point values caused different
1967 results on different platform or with different compiler options:
1968 The new algorithm is numerically exact and more accurate because
1969 it doesn't calculate the integration position by multiple times
1970 adding the step-size (which results in numerical uncertanties
1971 exspecially if multiplied with large numbers)
1972 + A lot of fixes have been introduced which effects integrating the
1973 spline at the edges of the valid range. In this case any memory
1974 was randomly accessed. This behaviour can be tested replacing
1975 all MArrayF by TArrayF which perform a range check (but of course
1976 they are a lot slower)
1977 ! No result obtained with the Spline before can be trusted! Due to
1978 random memory access it might by completely random!
1979
1980 - callisto: set new defaults in MExtractTimeAndChargeDigitalFilter:
1981 + extraction range in the high gain to 4.
1982 + weights file to cosmics_weights46.dat
1983
1984 - callisto:
1985 + introduce the check for fluctuating arrival times.
1986 + set charge limit to from 2.5 to 4.5
1987 + introduce asymmetric exclusion due to "deviating number of phes":
1988 Default: -9.0 +4.5
1989 + make deviating number of phes unsuitable (see David's findings).
1990
1991 - callisto: fixed the display of unsuitable pixels. The old change
1992 to a real profile in MHCamera broke it.
1993
1994 - callisto: The cosmics filter is used in MJCalibration now
1995 independant of the pulser color (formaly it was used only for
1996 CT1-pulser data). The threshold of number of max empty pixels
1997 has been raised from 2% to 5% in MJCalibration. The maximum
1998 fraction of rejected event is 50% otherwise the calibration has
1999 failed. The filter now ignores unsuitable pixels.
2000 Setup the filter from callisto.rc using "ContCosmics"
2001 (see MFCosmics::ReadEnv)
2002
2003 - callisto: changed default for fgOffsetFromLogain back
2004 from -2.8 to -1.8 in digital filter.
2005
2006 - callisto: for the common extractors
2007 + MExtractFixedWindow
2008 * MExtractTimeAndChargeSlidingWindow
2009 * MExtractTimeAndChargeSpline
2010 * MExtractTimeAndChargeDigitalFilter
2011 the hi- and lo-gain reolution is stored in fResolutionPerPheHiGain
2012 and fResolutionPerPheLoGain
2013
2014 - callisto: Updated the hi-/lo-gain intercalibration constants
2015 hilocalib_sp1.root, hilocalib_df46_mc.root, hilocalib_df4.root,
2016 hilocalib_df6.root
2017
2018 - callisto: The default lo-gain extraction window for the
2019 MExtractTimeAndChargeSlidingWindow extractor has been increased
2020 from 6 to 8 to take the stretch of the pusle into account
2021
2022 - callisto (!!!): fixed an important bug in the setting of the
2023 incoming pedestal pointer to the signal extractor extracting
2024 pedestals. This bug caused the pedestals not to be subtracted
2025 correctly in the calibration afterwards. The effect was about 10%
2026 too high conversion factors for the digital filter and the spline
2027 and more than 40% for the sliding window.
2028 The bug existed since end of February! (Markus G.)
2029
2030 - star: added muon support to star. A new tab "MHMuonPar" is
2031 displayed. The lower right plot is an estimate of the point spread
2032 function. A reference value is displayed. To get the real PSF
2033 you must compare with MC. The setup for the muon analysis
2034 is done in star.rc. More informations can be found in
2035 MHSingleMuon and MHCalibParCalc
2036
2037 - star: The weather data is now displayed in star
2038
2039 - star: MEventRateCalc handles the calculation of the event rate more
2040 accurate now in case of the start of a new run inside a sequence
2041
2042 - ganymed: a bug in MSrcPosCalc has been fixed (The changes were taken
2043 from a bugfix of Wolfgang to Loc0LocToCam; Wolfgang: the results are
2044 changed only minimally
2045
2046 - ganymed: (MJCut and MJOptimize) now displayes the number of
2047 excess events versus size. The energy estimation is done in
2048 MJSpectrum (sponde)
2049
2050 - ganymed: got support for using other variables than Alpha, eg. Theta.
2051 Therefor you need a class deriving from MHAlpha which supports
2052 this variable (one is already existing: MHTheta, which is now the
2053 default in ganymed). It is setup through ganymed.rc
2054
2055 - added a full featured spectrum program (sponde) which reads
2056 ganymed output and monte carlos and compiles a spectrum
2057
2058
2059
2060 *** Version 0.9.1 (2005/04/14)
2061
2062 - Fix bug on the arrival time reconstruction when using Digital
2063 Filter (in some marginal cases (10%) times were reconstructed shifted
2064 by 0.2 slices)
2065
2066 - all executables now return 2 where in previous versions -1 has
2067 been returned (gave problems with shell-scripts)
2068
2069 - the Hi-/Lo-Gain intercalibration for monte carlo files is now
2070 also done with a intercalibration input file
2071
2072 - a bug in the time fine adjustment of the digital filter has been fixed
2073
2074 - a lot of small fixes to calling TPad::Divide with a margin==0
2075
2076 - MStatusDisplay now shows the memory usage
2077
2078 - added a memory leak statistic after the eventloop
2079
2080 - MHadronness replaced by MParameterD
2081
2082 - MEnergyEst replaced by MParameterD
2083
2084 - wobble mode can now be switched on from the data-set
2085
2086 - switched on bad pixel detection for a pedestal level
2087 which is more than 5 times the variance
2088
2089 - Fixed default paths to be correct for the new data center
2090
2091 - Fixed handling of drive data. The pointing position in now
2092 copied to MPointingPos inside star for real and MC events
2093
2094 - made sure, that the sequences in a dataset are sorted by
2095 their number to ensure the correct synchronization
2096
2097 - added all resource files necessary to handle spline extraction
2098 of signal for the late 2004 and the early 2005 data
2099
2100 - update the reference lines for the december data
2101
2102 - changed default for fgHiGainFirst from 2 to 0 in spline extractor
2103 This is important for the Dec. and Jan. data where the calibration
2104 pulse position changes much.
2105
2106 - changed default for fgOffsetFromLogain from -1.8 to -2.8 in digital
2107 filter. This corrects only an defective extraction of the MC at
2108 low-gain signals lower than 90 phes.
2109
2110 - fixed some slowdown in calibrating data with interleaved events from
2111 Jan and Dec. As a workaround made the pretty palette the default.
2112 The inverse Deep Blue Sea has a bug which slows down long calibration
2113 runs a lot.
2114
2115 - implemented new values from new starguider report as defined
2116 in TDAS00-07 V7.1 (eg SkyBrighness)
2117
2118 - Fixed the formerly wrong unit of azimuth and zenith angle deviation
2119 in starguider report (If you merpp the same reports with this version
2120 you'll get the correct units (arcmin) but a different result
2121 than with old versions (wrong units))
2122
2123 - Now the status display can also write PNG, JPEG and XPM (other file
2124 formats are still unsupported by root)
2125
2126 - added a lot of scripts and macros in directory datacenter used
2127 for automatic processing
2128
2129
2130
2131 *** Version 0.9 (2005/03/23)
2132
2133 - Calibration is now done autmatically into photo-electrons like
2134 decided by the Collaboration Board
2135
2136 - Reference lines in the display can be read from resource file
2137
2138 - Interlaced calibration events can be handled by callisto
2139
2140 - Hi-Gain vs. Lo-Gain calibration constants can be calculated
2141 and applied in callisto.
2142
2143 - class MJCalibTest can be called by callisto
2144
2145 - callisto can now run with three data types: rawdata, rootdata, MC
2146
2147 - added two classes mreport/MReportStarguider.cc and
2148 mreport/MReportStarguider.h for implementing starguider-data
2149
2150 - the output of merpp-update now contains starguider information:
2151 MReportStarguider and MTimeStarguider
2152
2153 - Fixed bug in MHHadronness.cc which made that the displayed Q-factor
2154 values were lower than they should. This was more visible for high
2155 energy (Size) events.
2156
2157 - Made MExtractTimeAndChargeDigitalFilter the default for callisto
2158
2159 - added a new loop to callisto to support the correct extraction of
2160 the pedestal and pedestal rms through the signal extractor
2161
2162 - added class to perform fourier tranformation of a hexagonal structure
2163 (MHexagonalFT)
2164
2165 - added class to perform fourier tranformation of a hexagonal structure
2166 in a tasklist (MHexagonalFTCalc) example: hft.C
2167
2168 - added class to enhance the MCerPhotEvt from the Magic camera geometry
2169 MGeomCamMagic to a enhanced geometry MGeomCamMagicXT having only
2170 small pixels, example: extendcam.C
2171
2172 - added possibility to write data to memory (TTree) using MWriteRootFile
2173
2174 - added possibility to read a TTree stored only in memory by MReadTree
2175
2176 - new classes to deal with the interleaved calibration events:
2177 MTriggerPattern, MTriggerPatternDecode and MFTriggerPattern
2178
2179 - implemented filters to callisto to skip calibration events
2180
2181 - changed callisto to calculate three kinds of pedestals and pedestal rms:
2182 + fundamental pedestal (MPedPhotFundamental): extracted directly from
2183 the slices by statistics
2184 + pedestal from extractor (MPedPhotFromExtractor): extracted with the
2185 signal extractor without randomization
2186 + random pedestal from extractor (MPedPhotFromExtractorRndm): extracted
2187 with the signal extractor with randomization (extraction window is
2188 randomly fixed)
2189 The three kind of pedestal is not yet implemented (for speed reasons) as
2190 long as nobody really needs it:
2191 + pedestal from extractor with randomizatiuon (MPedPhotFromExtractorRndm):
2192 extracted with the signal extractor with randomization
2193
2194 - callisto now finds the pulse position in the data automatically
2195
2196 - implemented data reduction in calibrated data by reducing the precision
2197 of the stored floating point values (pedestal, rms and signal) to
2198 roughly 0.5%
2199
2200 - fixed showplot to make file format conversion (eg. converting a
2201 status display stored in a root file into a postscript file) in
2202 batch mode possible:
2203 showplot -b --save-as-ps[=outfile.ps] infile.root
2204
2205 - Allow class names as part of filter rules, eg
2206 (MFSupercuts) && (MHillas.fSize>100)
2207
2208 - fixed a lot of stuff to allow all programs to process MonteCarlo
2209 camera files.
2210
2211 - enhanced possibility to debug reading of resource file
2212
2213 - MDataChain should handle priorities of operator more
2214 accurate now
2215
2216 - completely revised the container in which the signal is stored
2217 MCerPhotEvt/Pix, MArrivalTime --> MSignalCam/Pix
2218 * the new implementation is faster and
2219 * needs less storage space
2220
2221 - FIRST version which can process Monte Carlos through the
2222 whole chain of programs (callisto, star, etc)
2223
2224 - implemented new image parameters for the border length of
2225 the shower image (MNewImagePar2)
2226
2227 - implemented wobble-mode in ganymed
2228
2229 - new class (MJOptimize) taking care of all optimization processes
2230
2231
2232
2233 *** Version 0.8.6 (2004/10/05)
2234
2235 - New combined signal and time extractor
2236 MExtractTimeAndChargeDigitalFilter
2237
2238 - The Report for the trigger section in the CC run summary has been
2239 updated, and now the IPRs (Individual Pixel Rates) are available.
2240
2241 - new macros for database interaction: filldotrun.C, filldotrbk.C
2242
2243 - added new program which can convert colored output which was redirected
2244 into a file back into colored text (for example to display it with
2245 more): showlog
2246
2247 - added new program to display an MStatusArray of plots (stored with
2248 MStatusDisplay) from a file: showplot
2249
2250 - Added support for Sequences (MSequence). Sequences are blocks of run
2251 files containing the same calibration and belonging to the same
2252 source
2253
2254 - Added a new task (MTaskEnv) which can be used in setup files to switch
2255 between different tasks (for example to choose a signal extractor)
2256
2257 - Implemented automatic file splitting in MWriteRootFile
2258
2259 - After image cleaning an island index is assigned to all used pixels.
2260 The index corresponds to the order of the islands in size.
2261
2262 - added a cleaning which takes signal height _and_ arrival time into
2263 account: probability cleaning (for more details see MImgCleanStd)
2264
2265 - added a cleaning which takes takes the absolute number of photons
2266 times the area ratio as cleaning level
2267 (for more details see MImgCleanStd)
2268
2269 - Changed calculation of image parameters such, that it can be done
2270 for all used pixels or the pixels with a defined island index only
2271
2272 - implemented new image parameters displaying the number of islands,
2273 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
2274
2275 - event display in executable changed to support also calibrated files
2276 (done with MJCalibrateSignal)
2277
2278 - added program doing the calibration and the signal extraction
2279 and signal calibration: callisto Most part of the setup is done
2280 by a resource file: callisto.rc
2281
2282 - implemented support for pixels with negative IDs (Raw file format
2283 version 4)
2284
2285 - implemented an new option in merpp (--auto-time) to get the time
2286 range for cc and/or caco data from the run header of the raw data
2287
2288 - New star-program (star and MJStar). Taking calibrated data from
2289 callisto/MJCalibrateSignal as input. The setup is done through
2290 a resource file: star.rc
2291
2292 - Added possibility to setup the eventloop in the mars-executable
2293 Camera Display by a resource file: mars.rc
2294
2295 - The the mars-executable Camera Display can now also read
2296 calibrated data files written by callisto/MJCalibrateSignal
2297
2298 - Added a new class which can calculate the source position in
2299 the camera from a pointing model known to be correct and
2300 the pointing model used for observations (MSrcPosFromModel)
2301
2302 - added a new version of the class calculating the effective on-time
2303 MHEffectiveOnTime. It unifies the old classes MHEffOnTime,
2304 MHEffOnTimeTime, MHEffOnTimeTheta, MHTimeDiff, MHTimeDiffTime and
2305 MHTimeDiffTheta.
2306
2307 - added the possibility to count how often a signal is above (or
2308 below) a certain threshold in MHCamEvent and MHCamEventRot (this
2309 can replace MHTriggerLvl0)
2310
2311 - added ore convinient ways to set the axis-titles of your histograms
2312 in your macro to some MH-classes like: MH3, MHVsTime, MHSectorVsTime,
2313 MHPixVsTime, MHVsTime, MHCamEvent and MHCamEventRot
2314
2315
2316
2317 *** Version 0.8.5 (2004/08/06)
2318
2319 - new Signal Extractors: MExtractFixedWindowSpline
2320 and MExtractAmplitudeSpline
2321
2322 - implementes interleave in merpp to be able to merpp parts of a file
2323
2324 - implemented force-functionality to merpp
2325
2326 - star display to display star catalogs (MAstroCatalog)
2327
2328 - star display to 'mirror' stars to the camera (MAstroCamera)
2329
2330 - implemented a new cleaning option which allows cleaning scaled with
2331 the real ratio of the rms depending on the pixel size, not only the
2332 square root of the pixelsize (MImgCleanStd, MCameraData)
2333
2334 - removed obsolete MBlind* classes
2335
2336 - Signal extractor taking the AB flag into account implemented (this makes
2337 an odd number of slices for signal extraction possible
2338 (MExtractSignalABcorr)
2339
2340 - implemented a class extracting the pedestal from the raw-data (events)
2341 itself using empty lo-gain (MpedCalcFromLoGain)
2342
2343 - Added mean values to MPedPhotCam
2344
2345 - Added Makefile for Darwin (this OS is NOT officially supported!)
2346
2347
2348
2349 *** Version 0.8.4 (2004/04/19)
2350
2351 - new fast arrival time extractor using cubic splines:
2352 MExtractTimeFastSpline
2353
2354 - implementes multi-argument support in MDataChain
2355 ("pow(a, b)")
2356
2357 - implemented double reference support in MDataChain
2358 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
2359
2360 - added support in MF for expressiond like
2361 "MHillas.fWidth<2*<MHillas.fLength"
2362
2363 - MDataChain is now able to support variables like [0], [1], ...
2364 which can be used in fit functions as parameters. The interface
2365 is implemented through the new virtual function
2366 MParContainer::SetVariables
2367
2368 - added new class MArrivalTimeCam/MArrivalTimePix:
2369 Storage containers to hold the ArrivalTime of the camera/pixel
2370
2371 - added new classes for the calibration of relative arrival times:
2372 MCalibrationRelTimePix and MCalibrationRelTimeCam
2373
2374 - added new classes to extract the signal of the blind pixel and the
2375 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
2376
2377 - added new classes for the bad-pixels treatment (MBadPixels*)
2378 which are more powerfull than the old ones (MBlindPixel*)
2379 and will replace them.
2380
2381 - added filter against cosmics: MFCosmics
2382
2383 - added new class MArrivalTimeCalc2:
2384 Calculates the arrival time as the signal weighted mean of the time
2385 slices in the maximum window
2386
2387 - added a new macro call pointspreadfucntion.C that fits with a 2D
2388 gaussian the DC spot for an star. It gives you the RMS of
2389 the PSF and the center of the star, very useful for misspointing
2390 studies.
2391
2392 - added support for multi-telescope camera files. Added classes
2393 MStereoCalc and MStereoPar, classes to calculate and store shower
2394 parameters calculated from the data of two telescopes, for the MC
2395 studies regarding the MAGIC clone.
2396
2397 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
2398 MC data calibrated in photons instead of ADC counts.
2399
2400 - added three macros to show the calibration and analysis chain of
2401 MC data. The macro starmc.C does both calibration and analysis, producing
2402 an output containing Hillas parameters for each event. The macro
2403 mccalibrate.C does just the calibration and writes out a file containing
2404 pixel information in photons instead of FADC data. The macro starmc2.C
2405 reads in such a file and produces an output with Hillas parameters.
2406
2407 - added MPedPhotCalc to compute pedestals in units of photons, see
2408 macro pedphotcalc.C
2409
2410 - added all class to perform the calibration, see macro calibration.C
2411
2412 - added class MFFT to perform Fast Fourier Transforms
2413
2414 - added class MSimulatedAnnealing to perform simulated annealing
2415 minimizations
2416
2417 - added new macro bootcampstandardanalysis.C which holds the skeleton
2418 of the analysis chain discussed in the december bootcamp.
2419
2420 - added support for DAQ raw data file format V2
2421
2422 - implemented an arbitrary time stamp for the events from raw-data
2423 files with file version<3. It is calculated from the run number,
2424 the date of start and the FADC clock tick from the first module
2425
2426 - implemented the correct decoding of the event time-stamp
2427 coming from the DAQ for raw-data files with file-version>2
2428
2429 - added a new classes storing the pedestals in units of photons:
2430 MPedPhotPix, MPedPhotCam
2431
2432 - added support for DC current files from the camera control
2433
2434 - added support for start- and stop-time when merpping report files
2435
2436 - added MReportCC storing the weather data from the CC-REPORT
2437
2438 - added class to fill trainings and test matrices (MTFillMatrix)
2439
2440 - added a filter performing a software trigger (MFSoftwareTrigger)
2441
2442 - Added classes to perform parts of the standard analysis (Jobs):
2443 + MJPedestals
2444 + MJCalibration
2445 + MJExtractSignal
2446 Note: All of them are preliminary!
2447
2448 - Added Iterator to iterate over files giving only the run-number
2449
2450 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
2451 the evolution of a sector vs time
2452
2453
2454
2455 *** Version 0.8.3 (2003/12/05)
2456
2457 - adapted Random Forest classes to allow the use with MC
2458 multi-telescope files which can be produced with the coming
2459 camera version 0.7.
2460
2461 - added classes to read and interprete central control report files
2462 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
2463
2464 - enhanced merpp (the executable) to support .raw and .rep files.
2465
2466 - added classes for light calibration (MCalibration* and
2467 MHCalibration*) by Markus Gaug. Further work has to be and will
2468 be done soon.
2469
2470 - Added a preliminary 'synchronizer' (MReadReports) which will
2471 replace MReadMarsFile as soon as it is finished.
2472
2473 - Added a tutorial macro demonstrating how report files are merpped
2474 and how they can be read from the root file in the correct order
2475 of time (readrep.C)
2476
2477 - Added a generalized histogram (similar to MH3) called MVsTime
2478 which allows to plot variables (or rules - MDataChain - of
2479 variables) vs time. For an example have a look at tempvstime.C.
2480
2481 - Changed the name of the event trees:
2482 + Events --> Events
2483 + PedEvents --> Pedestals
2484 + CalEvents --> Calibration
2485
2486 - changed name of MTime in the event trees from MRawEvtTime to MTime
2487
2488 - added displaying the sector indices to the mars event display
2489
2490 - Magic Online Analysis (MOnA) implemented in a first version
2491 (see mona.cc, MOnlineDump and MOnlineDisplay)
2492
2493 - added classes to calculate event rate
2494 (preliminary: MEventRateCalc, MEventRate)
2495
2496 - added new executable 'readdaq' to read *.raw files from the DAQ directly
2497
2498 - added classes dealing with the telescope pointing position (MPointing*)
2499
2500 - implemented the 'final' Mars time stamp based on some experiences with
2501 the new 'Synchonizer'
2502
2503
2504
2505 *** Version 0.8.2 (2003/11/10)
2506
2507 - accelerated standard analysis by a factor of 6-8 ...
2508 + doing precalculations in MGeomCam for the pixel area ratio
2509 + creating a look up table for the single pixels in MCerPhotEvt
2510
2511 - added task to calculates weights in case you want to 'change'
2512 the energy spectrum of a monte carlo file
2513 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
2514
2515 - added a new executable star which implements the
2516 star.C macro as precompiled executable. Currently a flexible
2517 setup is not possible, but a 'input card' setup will follow.
2518
2519 - Starting to implement Multi-Telescope-Support based on the
2520 upcomming camera version 0.7. The base for a general support
2521 is implemented and the star-functionality is proven to work.
2522
2523 - Replaced Event-Display in and Camera-Display in the Mars GUI
2524 executable by a more convinient display base on MStatusDisplay.
2525
2526 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
2527
2528
2529
2530 *** Version 0.8.1 (2003/10/20)
2531
2532 - added signal subtraction for pure on data by means of fitting
2533 the background in the off region or by performing a combined
2534 signal/background fit. Provides necessary histograms for
2535 obtaining energy spectra and a light curve.
2536
2537 - added classes to perform and study the selection of the
2538 2nd Level Trigger on MC data (example in triglvl2.C macro)
2539
2540 - added pedestal calculation
2541
2542 - implemented "democratic cleaning" (tail cut value proportional
2543 to pixel area) according to Wolfgang's suggestion.
2544
2545 - added Sigmabar treatment (calculation and basic histogramming)
2546
2547 - added basic routines to apply padding
2548
2549 - added first implementation of MARS-based source visibility plotter
2550 (needs to be linked against slalib, preliminary version)
2551
2552 - enhanced functionality of data chains: random numbers, conversion
2553 functions and access to MHMatrix objects
2554
2555 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
2556 numbers under certain circumstances (runs with 0 events included)
2557
2558 - fixed a bug in the general filter MF (didn't work on some systems
2559 at all)
2560
2561 - fixed a bug in chaining files, which caused the analysis to crash or
2562 ignore files
2563
2564 - implemented more geometry classes describing the parameters used
2565 to simulate the PMT camera
2566
2567 - added new Monte Carlo classes containing the setup of the different
2568 programs in the MC chain.
2569
2570 - added a (preliminary) general task to evaluate chi-square of a given
2571 parameter in an eventloop.
2572
2573 - first implementation of a container describing the observatory
2574 location (Long, Lat, etc)
2575
2576 - added Random Forest - method for g/h-separation
2577
2578 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
2579 (this means, that it is compiling, but not yet fully tested)
2580
2581 - added a new status display which can show the present status
2582 of histograms while an eventloop is running (MStatusDisplay,
2583 an example can be found at status.C)
2584
2585 - reorganized directories:
2586 classes describing the image --> mimage
2587 classes containing Monte Carlo Histograms --> mhistmc
2588 classes for Random Forest method --> mranforest
2589
2590 - added (event-)weights to fill histograms
2591
2592 - colors in logging output to screen
2593
2594 - changes to the Image Parameter declaration:
2595 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
2596 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
2597 + MHillasExt now derives from MParContainer instead of MHillas
2598 --> Files written with the old definition are more or less unreadable
2599
2600 - reading of reflector files
2601
2602 - display data from reflector files in the camera
2603
2604 - implemented currents (and display them in the camera)
2605
2606 - logarithmic scale in camera
2607
2608 - added class to iterate through directory contents (MDirIter)
2609
2610
2611
2612 *** Version 0.8 (2002/11/18)
2613
2614 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
2615
2616 - corrected 48(!) wrong entries in the Next Neighbor table of the
2617 Magic Camera (all in the inner part of the outer ring, mostly
2618 missing a single NN)
2619
2620 - Fixed a bug in the table describing the Next Neighbours of the
2621 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
2622 have any neighbour)
2623
2624 - changed trigrate.C: now it calculates the pure NSB triggers from
2625 a camera file (generated with no showers), so there is no need
2626 to introduce them by hand in the BgR array (for more details
2627 please ask Abelardo)
2628
2629 - added MHHadronness (and MHadronness) as a general facility to evaluate
2630 the quality of a gamma-hadron seperation method
2631
2632 - changed MWriteAsciiFile to accept rules (MDataChain)
2633
2634 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
2635 must be replaced by calles to MWriteAsciiFile::AddColumn and
2636 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
2637 changed.
2638
2639 - Implemented generalized event-matrices (one row per event)
2640 (MHMatrix)
2641
2642 - implemented the one dimensional composite probabilities
2643 (MHCompProb, MCompProbCalc, comprob.C)
2644
2645 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
2646 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
2647
2648 - Added a camera display displaying the pixel numbers to the
2649 event display gui.
2650
2651 - Added Monte Carlo Informations to event display gui
2652
2653 - Changed the camera display to display the pixel numbering
2654
2655 - Added three buttons to the camera display to change the palette
2656
2657 - Added the number of used and core pixels after image cleaning
2658 to MHillas
2659
2660 - Changed the algorithm used in MHillas according to TDAS 02-03
2661
2662 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
2663
2664 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
2665
2666 - Added fCosDeltaAlpha to MHillasSrc
2667
2668 - The numbers of photons used to calculate fConc and fConc1 in
2669 MHillasExt are now scaled with the pixel size, so that one get
2670 a four times smaller value for the bigger pixels in the outer ring.
2671
2672 - added new task to smooth the camera contents (MCameraSmooth)
2673
2674 - added possibility to use interpolated pixel values for blind pixels
2675 instead of removing it completely from the analysis
2676
2677 - Implemented the possibility to save the whole eventloop with
2678 its setup to a file. This information can be read and from
2679 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
2680 and MEvtLoop::MakeMacro. If you find something not working, please
2681 report - this stuff is still in a beta phase.
2682
2683 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
2684 file having crab starfield, but also for all following files - fixed
2685
2686 - MTaskList::PrintStatistics can now be instructud to print also the
2687 title, too: use PrintStatistics(0, kTRUE)
2688
2689 - Changed the image cleaning so that pixels with to many 'used'
2690 neighbors are left used (to get rid of 'holes' in events)
2691
2692 - Introduced more output to the camera displays
2693
2694 - Added an array of histograms (eg one hist per run), MHArray
2695
2696 - Added a _preliminary_ version of the reader for CT1 PreProc files
2697 (MCT1ReadPreProc)
2698
2699 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
2700 (thanks to Raquel)
2701
2702 - added the first energy estimator (MEnergyEstParam, estimate.C,
2703 estfit.C) using a parametrization
2704
2705 - Added some new Monte Carlo paremeter containers used to store
2706 setup information from the MC chain (MMcConfigRunHeader,
2707 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
2708
2709
2710
2711 *** Version 0.7 (2002/04/30)
2712
2713 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
2714 the pedestal mean value was saved incorrectly. For files from
2715 this versions we substract 0.5 from the pedestal mean.
2716 WARNING: This may effect your results, so don't wonder...
2717
2718 - First implementation of an algorithm using only triggered events
2719 for the collection area calculation
2720
2721 - Ascii Output can now also be used for parameter containers which
2722 doesn't overload MParCointainer::AsciiWrite
2723
2724 - The Ascii Output is now also capable of writing single data members
2725 of one container
2726
2727 - You are now able to change the order of the values written to the
2728 ascii file
2729
2730 - You can now specify a conversion factor for each data member written
2731 to an ascii file. This may be usefull to change the units of the
2732 data member (eg. degrees instead of millimeters in case of the
2733 hillas parameters)
2734
2735 - Replaced old MHillas by a new structure which allows you to extend
2736 the parameters stored in MHillas very easily:
2737 see MHillas and MHillasExt
2738
2739 - Added classes to handle source dependancy of image parameters:
2740 see MHillasSrc
2741
2742 - Added container (MBinning) to have a standard input for the binning
2743 in different histograms (eg. the Energy bins should be the same in
2744 all histograms)
2745
2746 - Changed Hillas histograms from mm to deg
2747
2748 - Added the flexible binning to the hillas histograms
2749
2750 - Added a filter for the alpha parameter (MFAlpha)
2751
2752 - It is now possible to write single data members of a class object to
2753 an output stream instead of the whole container only
2754
2755 - Added a generalized filter for a data member:
2756 MFDataMember filter("MHillas.fWidth", '<', 0.5);
2757
2758 - Added a generalized Filter parser for more difficult filter rules
2759 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
2760
2761 - Added new Monte Carlo histograms:
2762 MHMcEnergyImpact and MHMcEfficiency
2763
2764 - Added many new histograms needed for the flux calculation.
2765
2766 - Added a generalized histograms which can fill and show up to three
2767 data members in either a one-, two- or three-dimensional histogram, eg:
2768 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
2769
2770 - Added:
2771 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
2772 * calculation of <Theta> as a function of time (MHThetabarTime)
2773 they are needed in the flux calculation in
2774 order to select for a given bin in Theta (or time) the appropriate
2775 effective collection area, which is assumed to be given as a function
2776 of Theta and the true energy
2777
2778 - Added calculation of the migration matrix in the energy
2779 (MHMcEnergyMigration):
2780 the migration matrix describes the migration from the true (E_true)
2781 to the estimated energy (E_est); it is needed to determine the
2782 distribution of E_true from the measured distribution of E_est
2783 by unfolding
2784
2785 - changed the color palette in the camera display to DeapSea.
2786
2787
2788
2789 *** Version 0.6 (2002/01/15)
2790
2791 - Introduce the option of disable pixels (MBlindPixels and
2792 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
2793 able to deal with Star Field NSB.
2794
2795 - Fixed a bug in the pedestals substraction
2796
2797 - Introduced verbosity levels
2798
2799 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
2800
2801 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
2802 work correctly (thanks to Abelardo)
2803
2804 - Introduced correct treatment of the diffuse Night Sky Background
2805 and NSB (MMcPedestalNSB)
2806
2807 - Corrected treatment of the electronic noise (MMcPedestalCopy)
2808
2809 - Introduced MMcRunHeaders which contains monte carlo run informations
2810
2811 - Added a 'Print'-Task (MPrint) which calls the Print function
2812 of a parameter container for each event
2813
2814 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
2815
2816 - changes to be more efficient with root 3.02/06
2817
2818 - root 3.02/06 fixes:
2819 + the memory leak when reading MRawEvtData
2820 + loosing more time than necessary to update the progress bar
2821
2822 - MWriteAsciiFile is now capable of writing more than one container
2823 in a line. For example: To be able to write Monte Carlo and
2824 Hillas values (energy and alpha) in one line.
2825
2826
2827
2828 *** Version 0.5 (2001/11/06)
2829
2830 - Added new GUI functionality (Analysis)
2831
2832 - Added a camera display to be able to display events in the camera
2833 together with the calculated hillas ellipse
2834
2835 - Added a 'Clone'-Task (MClone) which can clone a parameter container
2836 object at any state of the analysis, so that the output are several
2837 states
2838
2839 - Fixed a bug in the collection area error calculation
2840 (Thanks to Ciro and Abelardo)
2841
2842 - Fixed a bug which causes merpp to crash in some environments
2843
2844 - Implemented auto enabling scheme for Branches to speed up reading
2845 a lot (see MReadTree and MTask)
2846
2847 - Fixed a bug in the Histogram classes which caused histograms to
2848 be written to a file by MWriteRootFile without request
2849
2850 - changed the object I/O from the old stylish root I/O to the new
2851 'auto evolution scheme' This was done only for classes which are not
2852 yet used in Monte Carlo files, so that these files are still readable.
2853
2854 - Added support for a progress bar in MEvtLoop and MReadTree
2855 (see the Analysis Window in Mars for an example)
2856
2857 - Fixed a bug in the package creation which disturbed the conversion
2858 between a mars version unpacked from a tar file and the repository.
2859
2860 - Changed the code to writer merpped (converted into root format)
2861 raw files, to get faster (around 10%)
2862
2863
2864
2865 *** Version 0.4 (2001/09/20)
2866
2867 - This release is made to compile on a root version >= 3.00
2868
2869 - Fixed a bug which causes MReadTree to read the first file only
2870
2871 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
2872
2873 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
2874
2875 - Added a task to write several container to a root file (MWriteRootFile)
2876
2877 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
2878
2879 - Added calculation of the collection area (MMcCollectionAreaCalc)
2880
2881 - fixed some bugs in the Hillas calculation
2882
2883 - added filters to be able to control the task execution dependent on
2884 a parameter (for example: the number of level 1 triggers in a MC-file)
2885
2886
2887
2888 *** Version 0.3 (2001/04/23)
2889
2890 - Many demo macros added
2891
2892 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
2893
2894 - Hillas Calculation added
2895
2896 - Standard image cleaning available
2897
2898 - MReadTree is now able to handle more than one file
2899 (Remark: of the same structure)
2900
2901 - Now we are able to display events in a first version of the
2902 Camera event display. To do this we must run the macro
2903 "macros/readCT1.C" to read data from CT1.
2904
2905
2906
2907 *** Version 0.2 (2001/01/24)
2908
2909 - First Implementation of a Gui to read the raw data. Start the
2910 gui with the command mars.
2911
2912
2913
2914 *** Version 0.1 (2000/12/20)
2915
2916 - First official release 0.1
2917
2918 - Changes:
2919
2920 + changed calling style of MRawPixelIterator from do...while to
2921 while-loop
Note: See TracBrowser for help on using the repository browser.