source: trunk/MagicSoft/Mars/NEWS@ 9146

Last change on this file since 9146 was 9145, checked in by tbretz, 16 years ago
*** empty log message ***
File size: 124.2 KB
Line 
1 -*-*- END -*-*-
2
3== <cvs> ==
4
5 ;general
6
7 * All command line options after -- are now interpreted as
8 arguments (usually everything which doesn't start with a minus)
9 rather than options (usually everything which starts with a
10 minus). This allows to use file names starting with a -
11
12 ;Database
13
14 * Added informations about the DC currents (fMinCurrents, fMedCurrents
15 and fMaxCurrents). The values are retrieved from the plots showing
16 the average DC currents of all pixels versus time.
17
18 ;automatic analyis
19
20 * Rewritten producing plots in the web.
21 New plots, namely the output of plotoptical.C (extinction curve from
22 KVA), plotstat.C (status of the automatic analysis (percentage of
23 processed, analysed data etc.)) and plotusage.C (statistics of the
24 condor usage in the data center) has been are available now next to the
25 plots of plotdb.C
26 Mean values from the plots (output of the macro) are provided in a
27 txt file now.
28 The creation of the plots for callisto, star and ganymed in the web is
29 now steered via database. Consequently the plots are faster and
30 reliable up-to-date.
31
32 ;merpp
33
34 * Fixed merpping of raw-files (the runheader tree got the name RunHeader
35 instead of RunHeaders)
36
37 * Now allows to merpp files newer than 2008/09/03.
38
39 ;callisto
40
41 * Extracting the pulse position for the pulse position check events
42 with sum trigger were denied. This decreased the statistics
43 extremely and therefor the resulting puse position was calculated
44 quite weak. Now sum events pass the calculation if and only if they
45 have also a level 1 trigger.
46
47 ;ganymed
48
49 * If the source position is more than 1deg away from the camera
50 center an error is raised now.
51
52
53
54== Version 2.1.1 (2008/08/04) ==
55
56 ;Database
57
58 * Added the median number of photo electrons from the calibration
59 pulses to the db (fMedNumPheInner, fMedNumPheOuter) and the relative
60 error of their raw counts (fRelChargeRmsInner, fRelChargeRmsOuter)
61
62 * Added fTotOnTime, which is the on-time as given by the run-headers
63 (in contradiction to fAbsOnTime which comes from CC)
64
65 * Added new primaries for the new data structure (Magic II): for the
66 tables dealing with sequences (SequenceBuild Status, Sequences,
67 SequenceProcessStatus, Calibration, Star and DataSetSequenceProcessing)
68 this is the telescope number (fTelescopeNumber) for the tables dealing
69 with runs (RunData and RunProcessStatus) this is in addition the file
70 number (fFileNumber)
71
72 * Added column fPriority to the status tables to be able to steer the order
73 in which the data is processed. As default the run, sequence and dataset
74 number are used.
75
76 ;automatic analyis
77
78 * Adapted scripts to the new data structure: They can handle now different
79 telescopes (getting the information as usual from the database).
80 The paths for Magic 2 are not yet implemented.
81
82 ;general
83
84 * should work now with root 5.20/00 (please note that root 5.20/00
85 we encounter crahses in the status display which are ot yet
86 understood)
87
88 * Sequences and Datasets are now stored as "MDataSet" and "MSequence"
89 instead of the base name of the file. This makes them easier to
90 access from the code
91
92 * Default Monte Carlo names in MSequence do not require the _E at
93 the end anymore
94
95 * where abrrevating a sequence file with a sequence number is possible
96 also "telescope:sequence" is now accepted, e.g.:
97 star 2:2000123 --out=output
98 see the programs' help for more details.
99
100 * sequences (MSequence or MSequenceSQL) can now directly be retrieved
101 from the database. See the constructors for more details.
102
103 * MReadTree now supports friends
104
105 * MReadTree can now read also files not written by MARS and store
106 the data encapsulated in emulated MParContainers
107
108 * added a new starguider calibration valid since 15.1.08
109
110 ;showplot
111
112 * showplot can now read more than one file at once. This is especially
113 inetersting if reading files containing pure canvases
114
115 ;merpp
116
117 * we merpp the dc currents now also from the camera reports (they have
118 just a lower rate than the current reports, 0.1Hz instead of 1Hz)
119
120 * In the automatic analysis we omit merpping of the currents from the
121 caco files and use the lower rate camera reports from the cc files
122 instead
123
124 * merpp has been redisigned to allow merpping of the cc-reports
125 of a whole sequence. This allows to design a very simple analysis:
126 mkdir output
127 ./callisto 100776 --out=output
128 ./merpp 100776 output
129 ./star 100776 --ind=output --out=output
130 Instead of the sequence number also sequence files are accepted.
131
132 * Implemented a fix for run-numbers between 1001348 and 1001396
133 which were incorrectly assigned by the cc.
134
135
136 ;callisto
137
138 * added a filter again which was was removed in the last release.
139 it removed the most brightest events. This should not change
140 any analysis result because these events are so bright that
141 they cannot be analysed anyway, but the bad-pixel plots doesn't
142 show outliers.
143
144 * updated muon calibration constants for the periods 51-57,
145 58-63 and 67-
146
147 ;star
148
149 * The camera currents are now displayed with the rate of the camera
150 reports instead of the caco reports
151
152 ;ganymed
153
154 * if mc camera files are new enough (>=8) the source position in the
155 camera is now calculated from the stored telscope and shower
156 orientation (Note, that this might not be suitable in all cases
157 depending on the aim of the study. These case still needs
158 implementation)
159
160
161
162== Version 2.1 (2008/06/18) ==
163
164 ;Database
165
166 * introduced average temperature and wind speed from star-files
167
168 * introduced average values from Pyrometer (mainly Cloudiness)
169
170 * introduced the ratio of accepted calibration events in the
171 calibration run
172
173 * introduced the average rates of the different trigger pattern,
174 e.g. the rate of pedestal and calibration events, from the signal-file
175
176 ;general
177
178 * fixed GroupBy options in plot*.C macros
179
180 * only display KVA points (not the Tuorla points) in plotoptical.C
181
182 * all programs now allow to add resources to the ones from the resource
183 file or overwrite them from the command line. This can be done like this
184 ganymed --config=ganymed.rc --rc=Cut1.Param1:0.25 --rc=Cut1.Param3:5.5
185 if something seems to be wrong you can debug what the program is doing
186 using the option --debug-env=3
187
188 * increased the diversity of debug levels. That also means that with -v3
189 you get now less output, i.e. only the output which is important for
190 an analysis. To get more output which helps for debugging try 4, 5 and 6.
191
192 * fixed a problem in the task synchronizing the reading of the reports
193 and the data stream. The effect was that in some circumstances the last
194 events of some trees could have been skipped. Since this is only a
195 very tiny part of the data no severe effect to your analysis results
196 is expected (an exception might be very short, i.e. singel runs,
197 datasets).
198
199 * Dataset file now allow to include the sequence file directly within
200 the dataset file and also allow to exclude single runs from the dataset.
201 (for more details see Class reference of MDataSet)
202
203 * Sequence files now allow for excluding runs from the analysis
204 (for more details see Class reference of MSequence)
205
206 * added code to process the sum-trigger flag
207
208 * the histogram classes MH3 and MHn now support profile histograms
209
210 * the histogram classes MH3 and MHn now support labels at the axis
211
212 * the Random Forest Train-classes (MJTRain*) now store the used datasets
213 in the output file
214
215 * the MFMagicCuts have a new option to allow a linear area cut (for
216 special studies)
217
218 * The liniking of the shared object is now done into a file defined
219 by 'mktemp'. This should be a local file system which accelerates
220 liniking a lot.
221
222 * The code has been prepared for compilation with root 5.18/00d
223
224 * The MHEnergyEst histogram now shows the distribution of
225 (Eest-Emc)/Est and the distributions (Eest-Emc)/Eest vs. Eest
226 and (Eest-Emc)/Emc vs Emc.
227
228 * fixed mars (event display) for merpped raw-data and MC data
229
230 * adapted the synatx of sequence files to allow for the new run/file
231 scheme. For more details see class description of MSequence
232
233 ;showplot
234
235 * Added support for tiff files
236
237 * Added support for csv files (tables containing tab number,
238 name and title)
239
240 * Tabs now can have a title which is displayed in the postscript file
241
242 * When multiple file are written at once (e.g. pngs from a display)
243 it is now possible to use the tab name and or tab number in the
244 file name. For details see showplos's help.
245
246 ;merpp
247
248 * Implemented cc file version 2008-02-20/0
249
250 * Implemented cc file version 2008-05-19/0
251
252 * With new options merpping can be restricted (in addition to the
253 run-number) also by telescope and file number.
254 For details see "merpp --help"
255
256 * Implemented raw data format 11 (the most important change, except
257 from plenty of changes in the format definition, is the addition
258 of the file-number in the header) If nobody makes a mistake this
259 format should have the advantage that it is by definition forward
260 compatible, so old programs will be able to read newer formats.
261
262 * Added Pyrometer information to default output (stored in a new Tree
263 Pyrometer, needs a complete new merpp, i.e. new calibration)
264
265 * Merpping (also update) can now be restricted to one single report.
266 For example:
267 If you want to update an old file with Pyrometer information call
268 merpp --only=Pyrometer --update
269
270 ;callisto
271
272 * in the pedestal processing now at least 50 processed events are
273 required for succeeding.
274
275 * the signal and calib files now contain also the sequence information
276
277 * the two MPedestalCam in the calib file now have proper names
278 to distinguish them from each other (MPedestalCam, MPedestalExtracted)
279
280 * Both pedestal cams now contain the number of events processed
281
282 * In Mars V2.0 the extraction of the fundamental pedestal was broken,
283 i.e. for the extraction of the calibration pulses basically the average
284 over all events of the first slice instead of all slices was used.
285 Since pedestal and calibration constants are continously recalculated
286 this only effected the very first events of every sequence.
287
288 * For the extraction of the position of the maximum sample now the
289 extraction range is set automatically to the extraction window,
290 before the whole accessible range was used.
291
292 * If the number of samples in the events and the number of samples
293 in the run-header disagrees now an error is raised (this can
294 happen in not well simulated Monte Carlo files)
295
296 * In the case of MUX-data pedestal events with the lvl1 trigger flag
297 could survive into the pedestal calculation -- fixed.
298
299 * Tab "TrigPat" added showing the distribution of the trigger pattern
300 as found in the run-files (normalized with the run length)
301
302 * The selection of events from the trigger pattern has been improved.
303 If the trigger pattern is corrupted events won't pass anymore.
304
305 * Added a new command line option --dev-null to suppress output of
306 Y-files (this is useful for test cases)
307
308 * added a new tab "CalPos" showing the arrival time of extracted
309 interleaved calibration events
310
311 ;star
312
313 * the star file now contains also the sequence information
314
315 * Added a new command line option --dev-null to suppress output of
316 I-files (this is useful for test cases)
317
318 * Tab "Rate" added showing the distribution of the trigger pattern
319 (should only be Trig (Lvl1/Lvl2) and Sum (Sum only)) as found in
320 the Y-files (normalized with the run length)
321
322 * The effective on-time calculation doesn't use events with only
323 sum-trigger anymore
324
325 * The data in the MHWeather tab has been reorganized. The never
326 working solar radiation has been removed and the data from
327 the pyrometer (cloudiness, air and sky temperature) is
328 displayed in addition.
329
330 ;ganymed/sponde
331
332 * Now data points are even shown correctly if they have error bars larger
333 than one sigma. Points with null or negative significances are omitted.
334
335 * DrawNicePlot now allows to set a projection range
336
337 * Updates pointing models. One is applied after the implementation
338 of the new LUTS in August, the other one is applied after the
339 next major change of the pointing model in October. Note that
340 these models are preliminary and give wrong results below Zd=65deg
341
342 ;sponde
343
344 * fixed resource files ('''Spectrum''' instead of '''MJSpectrum''')
345
346 * a new option "--force-runtime" is available. In case of very short
347 datasets (for light-curves) which are in the order of a few
348 minutes the calculated effective on-time is not very acurate because
349 it is quantizised in the order of a minute. Therefore you can switch
350 to using the real run-time instead (remakrt: this ignores any
351 dead-time!)
352
353 * a more analytical way is used to "fill" Monte Carlos into regions
354 of impact parameters which have not been simulated because the
355 trigger efficiency is assumed to be 0.
356
357 * estimated sensitivity curves for hi and lo zenith angles are shown
358 scaled to the correct observation time and collection area
359
360 * the Monte Carlo events after cuts are now written to the output file
361 if an output file given
362
363
364
365 *** Version 2.0 (2007/09/03)
366
367 - database: the position used for the pulse pos check was missing
368 in the callisto output and could thus not be filled into the DB.
369 Also the old values seemed not exactly the PulsePos used for
370 teh check.
371
372 - general: Resource file now allow an Include-Resource, i.e. you can
373 read a resource file with default settings, include it in your
374 resource file and overwrite the settings in your file. More than
375 one include file is allowed. Inclusions can be iterative.
376 Include: mydefaults.rc yourdefaults.rc
377 The resources in the first file have higher priority than the
378 second file.
379
380 - general: Now the output files (calib*.root, etc) also contain the
381 resource file (to check it open it in the TBrowser and choose Print()
382 from the context menu)
383
384 - general: Dataset files now allow to overwrite the default path
385 to search for sequence and data files. Note, that the program
386 option and individual resources will overwrite it. For example:
387 SequencePath: /magic/montecarlo/sequences
388 DataPath: /magic/montecarlo/star
389
390 - general: Fixed a problem with variables in MDataPhrase. It seems
391 that only optimdisp (didn't work) was effected.
392
393 - general: Some improvements to the optim and train processing. For
394 example the ststud window now got a proper title.
395
396 - general: The "Status Display: " was removed from the window title
397 within an Eventloop.
398
399 - general: added a new flexible histogram-class (MHn) which can be used
400 for example in testing after optimizations or training to produce
401 user defined histograms.
402
403 - general: The Random Forest now allows attaching an evaluation
404 function which is applied to its output. This allows to train
405 on whatever you like (eg. train on log10(energy), but return
406 energy)
407
408 - general: The Random Forest training of energy (trainenergy.c) and
409 disp (traindisp.C) has been improved by more graphical output to
410 judge the result.
411
412 - general: The training of energy (trainenergy.C) has been improved
413 a lot by training on a different quantity than energy. It gives
414 a result which is highly independant of the source spectrum
415 and shows lower bias than all other options.
416
417 - general: Dataset files are allowed to contain collections of
418 datasets. For more details see the class reference of MDataSet.
419
420 - general: The default WobbleMode in a datset file now (if not
421 overwritten) is "auto", i.e. wobble mode is set if the dataset
422 doesn't contain off-sequences.
423
424 - merpp: Merpp can read file format version 9 now. Please realize
425 that for file format version 9 the extraction range is different
426 and must be set to 0/49 instead of 15/64 in callisto_mux.rc until
427 the first and last 15 slices have been removed from all MUX data.
428
429 - mars: Similar to writing movies you can now select events which
430 should be displayed in your display. Therefore add the following
431 lines to your mars.rc:
432 MFEvtNumber.FileName: ganymed00223552.root
433 MFEvtNumber.Selector: ThetaSquared.fVal<0.04 && DataType.fVal>0.5
434 The input file can be a ganymed-file after (ganymed*.root) or
435 before (ganymed*-summary.root) file. For example to select all events
436 from your on sample after cuts (excluding the ThetaSq cut) use
437 MFEvtNumber.Selector: DataType.fVal>0.5
438 To show all events from your on-sample after quality cuts
439 use the summary file instead.
440
441 - mars: new ways to call mars are implemented. Instead
442 of calling
443 mars filename.root
444 you can now also use
445 mars sequence.txt
446 or
447 mars sequence.txt inputpath
448 or replace sequence.txt by the sequence number if the default
449 sequence file should be used.
450
451 - mars: The default size has been increased
452
453 - mars: There are two new heckboxes which allow to switch off
454 the calculated image parameters
455
456 - callisto: was broken for MCs... fixed.
457
458 - callisto: improved calculation of spline coefficients a lot. This
459 leads to a further improvement of the event rate calibrating MUX
460 data of about 15% (175evt/s instead of 150evt/s)
461
462 - callisto: finally the raw data we read is now real 16bit (with
463 10bit precision) for MUX data and not a stripped 8bit number
464 anymore. Due to scaling of the numbers (without precision loss
465 into an [0-256[ range, the final numbers for pedestal, pedestalrms
466 and extacted signal don't change. However, at all places where
467 raw data is directly accessed (eg. saturation and variation
468 limits in the signal- and pedestal-extraction) the numbers
469 refer still to the data's 16bit range.
470
471 - callisto: The maximum arrival time difference used in the bad
472 pixel treatment is now in units of nanoseconds, which leads to 3.0ns
473 for both, old FADC and MUX-FADC, data.
474
475 - callisto: Be aware that callisto is now calibrating the arrival time
476 in nanoseconds rather than time slices. Also all following tasks
477 have been changed to assume ns units now. If you star data
478 calibrated with an older version it might be necessary to adapt
479 some timimng parameters (Muon Analysis and MFSoftwareTrigger)
480 to obtain optimal results. The plot in the PulsePos tab
481 will now be in ns, too. This might also mean that the Muon
482 analysis in star might not work as perfect as expected as long
483 as old files read in.
484
485 - callisto: The calibration constants of earlier updates got lost
486 somehow. All constants have been updated.
487
488 - star: The PSF is now determined from the profile of the ArcWidth
489 instead of arcwidth/radius. The old way gave to much weight
490 to the bins with low statistics. The reference lines have been
491 updated.
492
493 - star: For speed reasons events suitable for the muon analysis
494 are now also preselected by fConcCOG<0.1 which seems to be a very
495 good preselector for muons.
496
497 - star: is now calculating a new timing parameter the Slope along
498 the major and minor axis of the shower. Therefore a numerical
499 solution of a line-fit is used. To use MHillasExt.fSlopeLong
500 and MHillasExt.fSlopeTrans don't forget to multiply it with
501 the sign stored in MHillasSrc.fCosDeltaAlpha as usual.
502
503 - star: The parameters fInnerSize, fInnerLeakage1 and fInnerLeakage2
504 have been removed from MNewImagePar. They have never been good for
505 anything.
506
507 - star: Implemented a new recursive algorithm which is supposed to be
508 faster. Also implemented new cleaning oiptions, which are:
509 + CleanLevel0:
510 The cleaning level above single core pixels can be kept
511 + KeepIsolatedPixels:
512 Define whether single core pixels should be kept
513 + TimeLevel1:
514 The coincidence window in nanoseconds to single used neighbors
515 + TimeLevel2:
516 The coincidence window in nanoseconds to two used neighbors
517 + PostCleanType:
518 MOde in which a time dependent post cleaning should be applied
519 0: No post cleaning
520 1: Require for each used pixels at least one used neighbor
521 within a time-window of CleanLevel1
522 2: Require for each used pixels at least two used neighbor
523 within a time-window of CleanLevel2
524 3: Require first two and second one used neighbor
525 within a time-window of CleanLevel1 and fCleanLevel2
526 respectively
527 + RecoverIsolatedPixels:
528 - recoveres isolated core pixels if they have a used neighbor
529
530 - mars/star: The new default cleaning is:
531 + CleanLevel1: 6.0
532 + CleanLevel2: 3.0
533 + CleanTime1: 1.75
534 + CleanTime2: 1.75
535 + PostCleanType: 3
536
537 - star/ganymed: The old spark-cuts have been replaced by new ones.
538 These new spark cuts have been cross checked with the sequences
539 84720 (before splitter), 101041 (after splitter) and 223539 (new
540 FADCs). In all cases they seperate pretty well, but of course not
541 perfect. Monte Carlos have suggested to tighten the cuts a little
542 bit further at low sizes. This has been done.
543
544 - ganymed: IMPORTANT - The spark cuts have been changed to match
545 all available data more or less well. This might mean that for
546 YOUR data there are still sparks visible.
547 Whenever you do an analysis you have to make sure that NO sparks
548 survive your cuts!
549
550 - ganymed: The old hadronness and size cuts have gotten new indices
551 (10, 11). The old indices 8 and 9 now mean an additional condition
552 for ghostbusting based on the formula (dist-c[9])*c[8]-slope.
553 If you want to switch off this cut just move the line far away enough,
554 e.g. by setting c[9] to -500. Please update your ganymed.rc files
555 accordingly!
556 The unit of c[9] is deg. It is the dist at which your cut will
557 cross the slope==0. The unit of the slope is ns/deg. So if
558 you readin files calibrated with an older Mars-version you
559 have to adapt the default value for c[9] to the FADCs:
560 - Multiply by two for the MUX FADCs (run number > 200.000)
561 - Multiply by 0.3 for the Siegen FADCs (run number < 200.000)
562 - Multiply by 42 for the meaning of life (run number = 200.000)
563
564 - ganymed: The old Cut0 is now called CutQ and is calculated before
565 the source position is caluclated. If you need a quality cut
566 including source dependant data (be very carefull with this!)
567 you have to use Cut0 instead.
568
569 - ganymed: now properly supports three off regions in wobble mode.
570 It will be the default from now on in ganymed_wobble.rc. To change
571 the number of off-regions use
572 NumOffSourcePositions: 1
573 in your ganymed.rc. Also by default no off-theta cut will be done
574 anymore so that you will get a background level higher than the
575 signal level in your ThetaSq plot for ThetaSq>0.2.
576 Due to this be carefull changing the scaling mode away from
577 "None". You will underestimate your signal if your scale interval
578 is not properly set.
579 (Rem: ThetaSqN is no longer needed)
580
581 - ganymed: is now storing the events of all (on- and off-)
582 source positions even in the case of more than one off-source
583 position. This should allow sponde to work properly and the
584 energy estimation is done correctly in all cases (without any
585 "nearest position" trick)
586
587 - ganymed: From 85340 (19.3.2006) on a real starguider calibration
588 with a real pointing model for the starguider is done, calibrated
589 with more than thousand tpoints taken from this date on.
590
591 - ganymed: was broken for Wobble-MCs... fixed.
592
593 - ganymed: The default cuts (MFMagicCuts) and the disp-parametrization
594 has changed. Note that your old ganymed.rc will be incompatible
595 with the new algorithms! Please check the ganymed.rc files and
596 the class description of MFMagicCuts for more information.
597 It is recommended at the moment to use identical Disp-Parametrizations
598 for on/off- and wobble-mode. If cuts are optimized only
599 the Area-Cut (parameters 2,3,4) and the theta-sq cut (parameter 1)
600 should be optimized. All other values should be kept as they are.
601 If you want to do an anylsis without timing a parameters, you can
602 switch off the timing cuts by seeting parameter 7 to a very small
603 value (eg. -99). To remove the slope parameter from the disp
604 paremtrization set parameter 8 to 0.
605
606 - ganymed: The distribution of observation time versus zenith
607 angle is now shown for off- AND on-data.
608
609 - ganymed: The contents of the source position plot are no longer
610 averaged, thus a lot of (fake) events between the two wobble
611 positions have disappeared.
612
613 - ganymed: There is a new tab "CutT" it contains the VsSize plots
614 with the CutT, whihc is defined in ganymed.rc, applied. It
615 is resonable to use your theta-cut for it, to see if there is
616 something strange (sparks!) in your signal-region.
617
618 - ganymed: To choose a dataset from a collection in a dataset file
619 use the new command line option "--dataset=12345"
620
621 - optim, sponde: should now properly support three off-regions.
622 Just produce your ganymed summary files with three off-regions.
623 optim and sponde will automatically get all off events from
624 all off-regions from this file. Please do not forget to
625 set the scaling in optimwobble.C properly:
626 fit.SetScaleUser(1./3);
627 it is not yet read in automatically (will follow soon).
628 In the case of fixed Scale you can also use
629 cuts.SetThetaCut(MFMagicCuts::kOn);
630 no off-cut needed.
631 Be carefull in case of three off-regions when switching on
632 scale mode. Make sure that the scale interval is set correctly.
633
634 - sponde: sponde.rc and sponde_onoff.rc are now idetical
635
636 - sponde: the resouce files have been rewritten with a lot of
637 comments and a well working parametrization for an energy estimator
638
639 - sponde: In the estimated energy versus monte carlo energy plot the
640 contents where exchanged.... fixed.
641
642 - sponde: the so called "accurate"-mode has been removed. It didn't
643 give any improvement in accuracy, only decreased execution speed.
644
645 - sponde: the so called "simple"-mode has been removed. It didn't
646 give any improvement in simple.
647
648 - sponde: the so called "refill"-mode has been removed. It was anyhow
649 not implemented.
650
651 - sponde: now checks whether the theta distribution of your on-data
652 and the theta-distribution of your Monte Carlo sample (after
653 weighting) fits. If it doesn't fit properly (eg. the Monte Carlo
654 sample is incomplete) execution is stopped. Execution can be forced
655 using the new option --force-theta. Use this option with care!
656
657 - sponde: Proper collection areas can now be constructed also from
658 Monte Carlo samples generated with different maximum impact
659 parameters. Note that in previous version you neither got
660 a warning or failure, nor was there any obvious sign that the
661 collection area was overestimated due to usage of files with
662 different maximum impact parameters.
663
664 - sponde: If MC files with different lower energy limits are used
665 the primary MC spectrum is artificially completed down to the
666 lowest energy used at all. WARNING: that this gives correct
667 collection areas ONLY if none of the events in this region would
668 survive your cuts at all.
669
670 - sponde: the output file now contains more information about
671 the spectrum (eg. the full 2D collection area histogram).
672 Note, that this information can only be written to the file
673 if it is stored automatically via command line argument.
674 If you only store the status display from within the display
675 the information is lost.
676
677 - sponde: added a new tab "Disp". It shows the residual of the disp
678 (Disp-Dist) versus several parameters and it is meant to judge the
679 quality of the disp estimator. In the ideal case the residual is zero
680 and doesn't depend on any variable. The tab is displayed after
681 CutQ and Cut0.
682
683 - sponde: added a new tab "Energy". It shows the residual of the
684 energy (lg(estimated energy)-lg(monte carlo energy)) versus
685 several parameters and it is meant to judge the quality of the
686 energy estimator. In the ideal case the residual is zero
687 and doesn't depend on any variable. In reality even a good estimator
688 can show residuals versus Monte Carlo energy. The tab is displayed
689 after all cuts.
690
691 - sponde: added a new tab "EventDist" showing the unweighted real
692 absolute number of events of your sample after cuts. This tells
693 you how many events with this energy you had in your MC files.
694 The same information you get from the error bars of the weighted
695 histograms, but this is less intuitive.
696
697 - sponde: The spectrum plots now show the crab- and 1553-spectrum
698 for comparison. It is not meant to show these curves in
699 publications, they are only for production.
700
701 - sponde: The OriginalMC tree with the events produced by corsika
702 is now processed only once
703
704 - sponde: Finally fixed most annoying bug, which has effected the
705 last bin of the collection area. It was the problem that binnings
706 of root histograms are from 1 to n (included) but there was a C-like
707 loop in sponde from 0 to n (excluded). Now the loop also includes
708 correctly under- and overflow-bins. The worse thing with this is,
709 that for the events in the highest bin not only the bin-content
710 was wrong, but also the weights applied to these events, which could
711 in pricipal effect also other parts of the distribution (eg. due
712 to energy estimation). Fortunately it effected only a few events
713 in most cases.
714
715
716
717 *** Version 1.2 (2007/05/14)
718
719 - database: The database now has two new values Unsuitable50 and
720 Unsuitable01. They express the number of pixels which are
721 unsuitable for more than 50%, respectively more than 1%, of
722 all calibrated event. It is a more accurate number than the
723 previously used numbers, because they only take the first
724 calibration (ignoring the interleaved calibrations) into account.
725
726 - database: The database now has two other new values UnsuitableMax and
727 DeadMax. They express the maximum number of pixels which were
728 unsuitable, respectively dead, during the sequence. Because
729 of high pedestal rms (cars passing) a few events with very high
730 numbers of unsuitable pixels can happen. Not to suffer from this
731 effect we don't take the highest 0.1% of the numbers into account.
732
733 - general: fixed a bug which caused callisto and star to stop working
734 properly because the callisto output was currupted
735
736 - general: a script called scripts/makemovie has been added which
737 simplified the process of producing several movies from a single
738 sequence with different setup.
739
740 - callisto: Some more code cleanup. Started to remove old obsolete
741 code from cvs.
742
743 - callisto: The extraction of the pedestal with the extractor was
744 not random. It seems that extracting at one position is still biased
745 (for example in the first or last slices we could still suffer from
746 switching noise) Now it is completely random.
747
748 - callisto: In MPedCalcPedRun (which is the pedestal extraction from
749 pedestal files) individual pixels could be skipped due to high
750 variations. This was already the case for the pedestal extraction
751 from the lo-gains since the beginning and properly handled
752 there, but was introduced in the extraction from the pedestal files
753 a while ago. To calculate the average value it was still divided
754 by the number of events procesed not by the number of summands
755 really summed. This let to a pedestal which was a tiny amount too
756 small (for a few piels in the order of 0.1%). This led to an slightly
757 positive offset of the randomly extracted pedestal for a few pixels.
758 I doubt that this has a big effect on the result, because the effect
759 on the individual numbers is quite small. Due to this it is suggested
760 that you rerun your calibration to make sure you are without any
761 avoidable bias.
762
763 - callisto: the ArrTimeRmsLimit is now is a check of the deviation from
764 the median rms of the absolute arrival time and expressed in significance
765 levels. This replaces the old meaning of an abolute upper limit. An
766 absolute upper limit doesn't make much sense, because in our data
767 all arrival times are shifted at the same time (in fact it might be
768 a shift of the artificial trigger w.r.t. to the light flash).
769
770 - callisto: Added a new tab "BadPixTm" which shows the time evolution
771 of the number of unsuitable pixels over the whole sequence. This
772 is usefull mainly to judge if an intermediate calibration had
773 problems.
774
775 - callisto: Added a new tab "DeadPixTm" which shows the time evolution
776 of the number of dead pixels over the whole sequence. Dead pixels
777 in this context are unmapped pixels, i.e. pixels which could not
778 be interpolated, and thus are ignored in the further analysis.
779
780 - callisto: It is now possible to use the position of the maximum
781 of the spline as arrival time instead of the leading edge even
782 when using the integral for the signal. Therefor set the extraction
783 type to kIntegralRel ("IntegralRelative") and the relative height
784 ("HeightTm") to -1:
785 MJPedestalC1.ExtractSignal.ExtractionType: IntegralRelative
786 MJPedestalC1.ExtractSignal.HeightTm: -1
787
788
789
790
791 *** Version 1.1 (2007/04/27)
792
793 - general: The new class MGeomCamDwarf contains the camera geometry
794 for our prefered Dwarf camera and can be used to create general
795 geometries of roundish or hexagonal cameras.
796
797 - mars: The default cleaning is now abolute 8.5/4.0.
798
799 - mars: The resource file mars.rc now contains examples for MUX data
800
801 - merpp: Implemented file format version 8 (MUX FADC data). The 16-bit
802 data containing only 10-bit information is still cooked down to
803 8-bit, by cutting away the lowest 8-bit.
804
805 - merpp: When reading raw data the data is now stored in a single
806 array. The lo-gain array is obsolete. The interface stays the same.
807
808 - callisto: To process the new MUX data use the resource file
809 callisto_mux.rc
810
811 - callisto: The -root and -raw options to read merpped raw data have
812 been removed
813
814 - callisto: If the -mc option is given the sequence-name can now be
815 replaced by the MC sequence number
816
817 - callisto: If the sequence file contains "MonteCarlo: Yes" the
818 -mc option can now be omitted
819
820 - callisto: Started further simplification by removing obsolete
821 dependancies on MCalibIntensity*Cams.
822
823 - callisto: removed unsused intensity calibration from MJCalibration
824 for further simplification
825
826 - callisto: for simplification removed references to
827 MBadPixelsIntensityCam, MCalibrationIntensityQECam,
828 MCalibrationIntensityRelTimeCam, MCalibrationIntensityTestCam,
829 MCalibrationIntensityChargeCam, and MCalibrationIntensityBlindCam
830 (this should at minimum change nothing at all, and at maximum
831 improve thing if these containers where somewhere not handled
832 properly)
833
834 - callisto: Added the option to write an event movie. Please use
835 this option with care (huge files) but exessively to understand
836 our events. For further documentation please refer to the
837 IACT wiki
838 (currently at http://www.astro.uni.wuerzburg.de/mediawiki-1.9.0)
839
840 - callisto: Improved binning for the pulse position check histogram
841
842 - callisto: The code calculating the pulse position checknow takes
843 the pedestal into account
844
845 - callisto: The arrival time is now stored with full precision this
846 helps to get rid of artefacts in histograms. For the signal this
847 is not necessray because it is displayed in log-scale anyhow
848
849 - callisto: Fixed a problem with internal exclusions. Pixels which
850 have once been marked as unsuitable didn't get the necessary
851 histograms filled anymore to be rechecked with each interleaved
852 calibration.
853
854 - callisto: The relative arrival time resolution (the rms of the
855 relative arrival time offset) is now checked against its
856 median and the median deviation, instead of the average
857 plus an absolute offset.
858
859 - callisto: The relative arrival time offset is now calculated
860 w.r.t. its median not w.r.t. to an artificial reference pixel.
861
862 - callisto: The relative time calibration now marks pixels with
863 outlaying offset as unsuitable
864
865 - callisto: The interleaved relative time calibration has been switched
866 on. The advantage is that pixels which are marked as outliers
867 now can recover. An improvement over time is not expected, because
868 the relative time calibration seems stable.
869
870 - ganymed: If the dataset file containes "MonteCarlo: Yes" the "-mc"
871 option can now be omitted.
872
873 - ganymed: If either the dataset file containes "MonteCarlo: Yes"
874 or the option "-mc" is specified as default the monte carlo datacenter
875 paths (/magic/montecarlo/...) are used if not overwritten in the
876 dataset file.
877
878 - ganymed: The output files now contain run- and event-number for all
879 events, accessible as RunNumber.fVal and EvtNumber.fVal
880
881 - ganymed: Added a plot showing the source position in the camera also
882 for wobble mode
883
884 - ganymed: In addition to the existing task which can be setup to
885 be executed after Cut1 a final task called "EstimateEnergy"
886 has been added, executed before writing the final output
887 (ganymed00000000.root). The task setup in all three cases
888 can be choosen individually. (For all three(!) cases you
889 can for example choose MRanForestCalc. For examples see all
890 sponde*.rc and all ganymed*rc)
891
892 - ganymed: If a container "MEstimatedEnergy" is found in the
893 parameter list (eg. because it was setup by MEstimateEnergy)
894 it will be written to the output file.
895
896
897
898 *** Version 1.0 (2007/02/16)
899
900 - database: Website to plot values from the database has been added.
901
902 - database: The rate of spark events as found by star is now kept
903 and the rate after cleaning is now with spark events subtracted
904
905 - general: The changes to the interpretation of phrases lead to
906 a problem with the access of MHMatrix objects (eg. "M[0]")... fixed.
907
908 - general: Added example files how you can create your own calendar
909 (eg. as christmas present) with Mars. Just run
910 root macros/tutorials/calendar.C
911
912 - general: Added a possibility to display grouped data in the plotdb.C
913 macro (and similar macros). This allows to plot hourly, nightly,
914 weekly, monthly and yearly averages.
915 For more details see the plotall function of the macro
916
917 - general: fixed the error display of the camera display. It showed
918 wrong results.
919
920 - general: fixed a memory leak when reading many MStatusDisplays
921
922 - general: added a macro (macros/tutorials/mirrordelay.C) plotting the delay
923 between a spherical and a parabolic mirror
924
925 - callisto: We have a new pulse position check which takes the properties
926 of the extractor automatically into account. So no need to set
927 ExtractWinLeft/Right anymore. Again a check for pulses too much to the
928 left is done. If possible the lo-gain extraction start and hi-gain
929 extraction end is changed accordingly. If no proper extraction range
930 can be set (hi-gain too much to the left) an error is raised.
931
932 - callisto: New swapped pixels have been found and corrected
933
934 - callisto: Redone the signal extraction this includes:
935 + Unified the algorithms to extract the pedestal for all pedestal
936 extractions done
937 + Unification of hi- and lo-gain into one array
938 + Unification of hi- and lo-gain extraction for Spline and
939 Digital Filter (means now exactly the same algorithm is used,
940 not a copy-and-pasted one)
941 + Store pedestal subtracted data in a common place
942 + Improved extraction algorithms. If the algorithms search a
943 maximum but don't find one they don't return the maximum anymore
944 + Improved the extraction such that a information for signal
945 and time which is consistent is returned
946 + replaced the numerical spline with a (not slower) analytical
947 solution
948 + Lowered the saturation limit from 250 to 245 to make sure that
949 we are far away in all pixels from problems with the clock-noise
950 + The start of the lo-gain extraction is calculated from the hi-gain
951 arrival time. In case of saturation an estimation is used.
952 + the hi-gain window was extended to slice 16. This allows extraction
953 of very late pulses in single pixels or of huge hadron showers.
954 + Now uses the lo-gain extraction range for pedestal extraction,
955 not the hi-gain range in the lo-gain
956
957 - callisto: New hi-/lo-gain calibration constants have been produced
958 for all periods from the statistic of the whole period. They are
959 now used automatically depending on the periods. The old constants
960 where deviation in avarega about 2%-3%. The constants are very
961 stable from period to period (<<1%) except for exchanged channels.
962 In a few cases the constants used so far were off by 1%-2% (maybe
963 temperature effects?)
964
965 - callisto: To gain obsolete space we do not write the
966 MPedestalFundamental anymore. Also calibration and bad pixel
967 treatment is not done for it anymore because it has never been used.
968
969 - callisto: Fixed a bug in the seuqence handling which caused the
970 light condition to be ignored
971
972 - star: Added two new tabs "Sparkless" and "Sparks" these tabs show
973 basically the same as "Cleaned" but the distribution devided into
974 the events fullfilling a spark cut or being rejected by it.
975 This cut can be changed from star.rc (see example inside) by
976 the "SparkCut" directive
977
978 - star: Star displays now the average individual pixel-rate (IPR) versus
979 time and the average discriminator threshold (DT) of all pixels.
980
981 - optim: fixed a problem with the optim-macros which was due to a bug
982 in the new phrase parsing
983
984 - ganymed: To get a nice FalseSource plot (instead of the all-information
985 debug plot displayed as a standard plot) use the context menu
986 somewhere between the two upper plots, click on "DrawNicePlot"
987 and enjoy the result. (It is the same context menu which contains
988 the other options)
989 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
990
991 - ganymed/optim/train: The cut program, trainings- and optimization
992 macros could run with less files found than expected from the
993 sequence-files. No the execution is stopped in this case.
994
995 - ganymed: now stores the dataset in the output file with all information
996 contained (as sequence number, sequence path, data path) so that the
997 used dataset file can be recreated complete from the output
998
999 - sponde: now also allows the uasge of random forest
1000
1001 - sponde: added a plot showing the cut efficiency
1002
1003 - sponde: Using root versions < 5.13/04 still resulted in wrong binomial
1004 errors (eg. effecting the collection area) because the errors of the
1005 two histograms were swapped in the calculation, which makes a difference
1006 in the case the histograms contains weighted events. Aditionally the
1007 totalarea was incorrectly taken into account, which results in too small
1008 errors, which makes a difference at low statistics were the errors
1009 or the collection area dominate.
1010
1011
1012
1013 *** Version 0.10.3 (2006/10/23)
1014
1015 - database: Implemented ObservationMode flag in websites.
1016
1017 - database: For sequences there is now also the stoptime available on the
1018 websites.
1019
1020 - database: Removed ManuallyChanged flag from sequence-info websites,
1021 as it is not needed anymore with the new sequence building algorithm.
1022
1023 - general: MRolke.[cc,h]: Modification of TRolke from root_v5.12.00b.
1024 Class for calculation of confidence intervals (upper limits).
1025 Use model 3 or 4 for upper limit calculation for MAGIC observations.
1026 Please read the class instruction of TRolke for more information.
1027
1028 - general: The programs now return 0xfe if the requested resource file
1029 doesn't exist.
1030
1031 - general: Errors comming from root itself are now not output to
1032 stderr anymore but to our default (colored) log-stream.
1033
1034 - general: Changed the interface to TFormula such that now everything
1035 is parsed by TFormula, which should allow to use phrases even
1036 without paranthesis correctly parsed.
1037
1038 - callisto: replaced the AdHoc number of effective integration slices
1039 in the digital filter by an average of the correct number, averaged
1040 over all possible set of weights. This also gives correct numbers
1041 for the lo-gains which were totally wrong before.
1042
1043 - callisto: drastically reduced memory consumption by not storing
1044 all intermediate calibration results in memory anymore (we might
1045 write them into a file in the future)
1046
1047 - ganymed: To get a nice Theta-Sq plot (instead of the all-information
1048 debug plot displayed as a standard plot) use the context menu
1049 somewhere between the two upper plots, click on "DrawNicePlot"
1050 and enjoy the result. (It is the same context menu which contains
1051 the "DrawAll" option)
1052 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
1053
1054
1055
1056 *** Version 0.10.2 (2006/10/15)
1057
1058 - general: changed the building of the sequence files such, that
1059 the source-/project name in case of wobble-sources is not the
1060 source/project of the first data run anymore but the new generalized
1061 wobble source/project
1062
1063 - general: Added some functions to MAstro to calculate sun and
1064 moon properties
1065
1066 - general: Added two new macros (starvisday.C and starvisyear.C)
1067 which allow to plot the visibility of several stars in one day
1068 or of one star along one year
1069
1070
1071
1072 *** Version 0.10.1 (2006/10/11)
1073
1074 - general: HTML logging output was distorted... fixed.
1075
1076 - general: Changed the writing of the sequencefiles such that only
1077 as many pedestal files as giving at least 1000 pedestal events which
1078 are nearby the first calibration run are used as pedestal runs
1079
1080 - sponde: In the calculation of the collection area(s) and the
1081 distribution for MOnte Carlo and estimated energy the error
1082 calculation was wrong because root didn't take the errors
1083 properly into account... fixed.
1084
1085
1086
1087 *** Version 0.10 (2006/10/10)
1088
1089 - general: all executables now check consistency of the root version
1090 installed with the root version used for compilation. The return
1091 code in this case is 255.
1092
1093 - general: The algorithm to build seqeunces has been redesigned
1094 completly. It is now more flexible in terms of a resource file
1095 resources/sequences.rc which can be used to partly overwrite
1096 the default algorithm and defined the important part of the
1097 algorithm. It also takes correctly into account several ways
1098 of taking wobble-data. Currently the new algorithm doesn't take
1099 the number of pedestal events anymore into account (so a sequence
1100 could have much less than 1000 pedestal events and data runs are
1101 no-more used instead)
1102
1103 - general: a lot of small changes to make the code compatible with
1104 root 5.12/00 and gcc 4.1
1105
1106 - general: Fixed some warnings thrown if more warnings are switched
1107 on in the compiler
1108
1109 - general: Added a function to MMath which returns the Median of
1110 the distribution abs(y[i]-median) but at 68:32 division instead
1111 of 50:50, which is somehow the median counterpart of the rms.
1112
1113 - general: MAstroCatalog allows now to read calatog files (as bsc5)
1114 even if they are compressed with gzip (recommended compression
1115 is with "-1")
1116
1117 - showplot:
1118 + batch mode creation of image files now works with root 5.12/00
1119 + added support for writing bmp (though it never produces
1120 bmp which can be read by programs like xv or gimp)
1121 + added support for xml
1122 + added new option to start the display with a different size, by
1123 --display-width=nnn or --display-height=nnn
1124 + added options to define the canvas size when the display is started
1125 --canvas-width=nnn or --canvas-height=nnn
1126 the option can also be used for batch-mode conversion
1127 + added an option which automatically fits the display size to the
1128 desktop-size: --auto-size
1129
1130 - merpp: didn't recognize files with the extension .raw.gz - fixed.
1131
1132 - merpp: allow the reports to have 1000ms due to a bug in the camera
1133 program.
1134
1135 - callisto: New swapped pixels have been found and corrected. For
1136 details see MRawRunHeader::FixAssignment()
1137
1138 - callisto: Callisto now raises an error if one of the input files could
1139 not be opened.
1140
1141 - callisto: In some rare cases it could happen that in the signal
1142 extraction of the digital filter the extractor returned nonsense
1143 results due a wrong initializion of a variable (this happens in
1144 cases in which the extracted signal is exactly zero or the
1145 digital filter couldn't slide because of a too small extraction
1146 window, which could happen in the lo-gain extraction)
1147
1148 - callisto: The lo-gains have been marked as valid in some cases
1149 when they got not extracted at all (deltsumlo=deltatimelo=0) because
1150 the allowed extraction range (fLoGainLast-fLoGainFirst) was
1151 smaller than the number of slices (fLoGainWindowSize) needed
1152 by the lo-gain extractor
1153
1154 - callisto: Updated absolute calibration constants (muon calibration)
1155
1156 - callisto: fixed a bug which caused the hi-gain saturation not
1157 to be handled properly in the spline (the position of the
1158 saturation was calculated incorrectly)
1159
1160 - callisto: fixed a bug which gave weird results if hi- _and_
1161 lo-gain could not be extracted properly. In some cases hi-
1162 and lo-gain have not been extracted at all and the random result
1163 got calibrated. In other cases the hi-gain was saturating and the
1164 lo-gain has not been extracted. For this a completly arbitraty
1165 scale factor was applied to the result from extracting the
1166 charge of the saturating hi-gain.
1167
1168 - callisto: improves handling of extracted signal if lo- and/or
1169 hi-gain could not be extracted properly. If no appropriate
1170 calibration of either the signal or the arrival time is possible
1171 the pixel is now markes as unsuitable instead of estimated.
1172
1173 - callisto: Fixed a problem in the spline extraction which gave
1174 weird results if the signal was extracted from the first (and
1175 highest) slice (as a workaround extraction from the first
1176 slice has been forbidden)
1177
1178 - callisto: Fixed a bug regarding the use of the QE which doesn't
1179 effect the result because the default is used anyhow.
1180 (The bug was there since 14/07/2005)
1181
1182 - callisto: Changed the default for fgLoGainStartShift to -2.4
1183
1184 - callisto: Fixed a bug which caused all hi-/lo-gain calibration
1185 factors to be always 10 for all pixels as soon as the first
1186 calibration update has happend.
1187
1188 - callisto: Fixed the hi-/lo-gain offset for the Digital Filter. It
1189 was off by more than one slice (which gives wrong values for
1190 pixels which have saturated the hi-gain) This was a problem
1191 mainly for timing studies, not so much for the automatic standard
1192 analysis. Also the values for the Spline have been changed slightly:
1193 + Digital Filter from 1.70 to 0.95
1194 + Spline from 1.39 to 1.30
1195 The numbers were sorted out by an extensive test in the
1196 test-database.
1197
1198 - callisto: Removed the tab showing the average calibrated arrival
1199 time. It never gave useful information.
1200
1201 - callisto: Now tab "HiLoCal" which shows the ratio between hi- and
1202 lo-gain pulse for data pulses if hi- and lo-gain have saturated
1203 and both were extracted because the hi-gain was above the
1204 LoGainSwitch.
1205
1206 - callisto: Now tab "HiLoOff" which shows the offset between hi- and
1207 lo-gain pulse position (after application of LoGainOffset, which
1208 means in the ideal case it is 0) for data pulses if hi- and lo-gain
1209 have saturated and both were extracted because the hi-gain was above
1210 the LoGainSwitch.
1211
1212 - callisto: After extensive tests a new threshold level for determination
1213 of the pulse position has been found at 50phe. This is due to the
1214 fact that for lower pulses the arrival time changes its average
1215 behaviour dramatically. It tends to the average of the extraction
1216 range and starts sticking to non-floating point numbers (5, 6, 7, ...)
1217
1218 - callisto: Added two more plots to the calibration part. The average
1219 extracted signal and the average extracted arrival time as
1220 extracted by the signal extractor (This can help debugging problems
1221 because it doesn't involve a fit)
1222
1223 - star: changed the fit for the effective on time such that initial
1224 values are calculated automatically now instead of using build
1225 in values. This makes the fit more indepedant of the underlaying
1226 rates. With a test of ~350 sequences in the test database it could
1227 be shown that the new fit gives the same result +/-1sek.
1228 The highest deviation was +5s the lowest -10s. You can now control
1229 the bahaviour with two resource values:
1230 MHEffectiveOnTime.FistBin: 3
1231 MHEffectiveOnTime.NumEvents: 12000
1232 Use FirstBin=1 and NumEvents=120 to fit the effective on time
1233 from the resulting gamma candidates
1234
1235 - star: The Center histogram in MHHillas is now by default displayed
1236 with the colz draw-option
1237
1238 - ganymed: now produces valid error codes if failed
1239
1240 - ganymed: MFMagicCuts now supports a hadronness cut. Switch it on
1241 with the option "hadronness" instead of "area" or "both" if
1242 you want to use both cuts. The hadronness cut includes a fixed
1243 cut in hadronness (index 8) and a fixed cut in size (index 9).
1244
1245 - ganymed: MFMagicCuts: fixed abug introduced 2005/7/14 which caused
1246 the M3Long of the anti source to be not properly evaluated
1247 (actually is was evaluated as a unique random number) in case
1248 of optimization with anti-theta cut switched on. This might have
1249 lead to improper, but not necessarily wrong, optimization results.
1250
1251 - ganymed: ganymed_onoff.rc, ganymed_wobble.rc - updated with comments
1252 how to use random forest
1253
1254 - ganymed: use the same spark cuts as in ganymed_wobble.rc as in
1255 ganymed_onoff.rc. Seems to be unintentional that they were different.
1256
1257 - sponde: Since the introduction of the possibility to define a
1258 normalization energy instead of using the integral the default
1259 was not using the integral anymore but a normalization energy of
1260 1GeV. It is now the integral again.
1261
1262 - sponde: Fixed a problem in the weighting which did not allow
1263 a MC slope of -1.
1264
1265
1266
1267 *** Version 0.9.6 (2006/05/24)
1268
1269 - general: changed the binning of the azimuthal profile of the camera
1270 such that it is aligned with the 60deg boundaries.
1271
1272 - merpp: better handling of problems with the TH, TD part of the
1273 CC-REPORT for files older than 200507190 and 200412210
1274 respectively
1275
1276 - merpp: improved handling of RECEIVERS-COM-ERROR in CC-REPORT
1277
1278 - merpp: implementd latest changes in starguider reports (sinc 9th May)
1279
1280 - callisto: if an arrival time is extracted outside the fadc range is
1281 was set to the boundary before. Now a random number is assigned
1282 instead to avoid unfortunate coincidences of arrival times just
1283 by this arbitrary value.
1284
1285 - callisto: added a new option to callisto.rc which allows
1286 to set the maximum arrival time difference allowed for the
1287 badpixel algorithm to determin whether a pixels belongs to a shower:
1288 MJCalibrateSignal.MBadPixelsTreat.MaxArrivalTimeDiff: 0.9
1289
1290 - callisto: changed the old value (0.5) for MaxArrivalTimeDiff
1291 to 0.9 as suggested by Stefan due to a recent study on the fraction
1292 of pixels surviving the image cleaning
1293
1294 - callisto: switched off error in case of "pulse is too much to the left"
1295
1296 - callisto: The extraction window is not adapted anymore. This means that
1297 the pulse is extracted from the full range. The draw-back is that the
1298 background (pedestal) will become slightly higher. Switching on/off
1299 the PulsePosCheck in the callisto.rc only effects filling the
1300 histograms.
1301 WARNING: If the pulse is too much to the left data is calibrated!
1302 Check the PulsePosCheck-PulsePosition AND the Inhomogeneity parameter
1303 in the database to make sure that your data is valid!
1304
1305 - star: Show also the number of stars correlated correctly by the
1306 starguider
1307
1308 - ganymed: implemented a new class (MHThetaSqN) which allows to use more
1309 than one off-source region in wobble-mode. To use it add the following to
1310 your ganymed_wobble.rc:
1311 + MJCut.NameHist: MHThetaSqN (switch the new feature on)
1312 + MHThetaSqN.NumOffSourcePos: 3 (define number of off-regions)
1313 + MHThetaSqN.DoOffCut: Yes,No (switch on/off the off-cut)
1314 + Cut1.ThetaCut: None
1315 + MHThetaSqN.SignificanceCutLevel: 2.0 (increase off-cut by 2.0/1.7)
1316
1317 - ganymed: in the case the latest report is older than a default (currently
1318 one minute) and the current report will be skip the starguider
1319 correction and calibration will be reset. The maximum age can be
1320 setup from ganymed.rc by (minutes):
1321 MPointingDevCalc.MaxAge: 1.5
1322
1323 - ganymed: A first implementation showing all size-bins for the theta-sq
1324 resp. alpha-plots in a single tab automatically
1325
1326
1327
1328 *** Version 0.9.5.1 (2006/05/05)
1329
1330 - general: Added a new option "zdiff" to the Makefile which runs
1331 "cvs diff" as "make diff" would do, but with compression
1332
1333 - general: accelerated MTFillMatrix (used for eample in all training
1334 and optimization macros) by skipping some obsolete calles in the
1335 eventloop the first and second loop could be accelerated by ~20%
1336
1337 - general: Added a missing feature in the MFilterList class which
1338 prevented MFEnergySlope from working correctly in trainenergy.C
1339
1340 - general: Accelerated the random forest training and usage a bit
1341
1342 - merpp: Adapted to new raw data file format version 6
1343
1344 - merpp: fixed a problem with reading the starguider reports
1345 after 6.3.2006
1346
1347 - callisto: At some times six pixels had to be exchanged manually in the
1348 data. If the pixels to be swaped are both not found, an error was raised
1349 and calibration was stopped. Now it is assumed they are intentially not
1350 mapped and the Error has been changed to a Warning.
1351
1352 - star: Added new image cleaning based on the arrival time of the shower.
1353 The new cleaning can be accessed using the parameter "Time" instead of
1354 the the old one (like "Absolute) in the star.rc-file.
1355 Recommended parameters:
1356 + MImgCleanStd.CleanLevel1: 8.2
1357 + MImgCleanStd.CleanLevel2: 5
1358 + MImgCleanStd.CleanRings: 2
1359 + MImgCleanStd.KeepSinglePixels: No
1360
1361 - star: Simplified the calculation of the effective on time. By letting
1362 the fit start in the third bin the result should become more stable.
1363 The fit quality is now ignored for the theta-plot which is not used
1364 in the analysis later. Still better pre-cut which, for example,
1365 remove events triggered by car-light (rate changing on a short
1366 time-scale) are missing.
1367
1368 - macros: optimonoff.C, optimwobble.C: implemented a new strategy
1369 for optimization (kWeakSource) which is suggested by the Berlin
1370 people for weak sources.
1371
1372 - macros: plotdb.C:
1373 + if no dataset and no time-interval is given only sequences with
1374 an effective on-time above five minutes are plotted anymore
1375 + added a new tab "RelTime" displaying the relative on-time
1376 (effective on-time divided by the observation time)
1377
1378 - macros: optim*.C: by skipping some obsolete calles in the eventloop
1379 the optimization became a lot faster
1380
1381 - ganymed: In the second loop the MHNewImagePar histograms disapeared.
1382 To display them just delete the pads displayed on top.
1383
1384 - ganymed: fixed a bug which could cause strange behaviour in wobble
1385 mode if no starguider information was available due to an incorrect
1386 initialization of the starguider calibration
1387
1388 - ganymed: The scale region in the False Source Plot (MHDisp) can now
1389 be changed from within the plot. It can also be setup from the
1390 resource file using:
1391 + MHDisp.fScaleMin: 0.325
1392 + MHDisp.fScaleMax: 0.475
1393
1394 - ganymed, showplot: Fixed a problem with the fit to the off-data
1395 (HistOff) which could cause a time lag or an inifinite loop.
1396 The bug did not effect the results at all.
1397
1398 - sponde: Added a new tab showing the effective collection area after
1399 trigger (including the software trigger)
1400
1401 - sponde: MMcSpectrumWeight has a new option which allows to define
1402 the scaling factor not by the integral of the events but at
1403 a defined energy:
1404 e.g. MMcSpectrumWeight.NormEnergy: 200
1405
1406 - MTFillMatrix, sponde: by skipping some obsolete calles in the
1407 eventloops the loop could be accelerated by ~20%
1408
1409
1410
1411 *** Version 0.9.5 (2006/03/13)
1412
1413 - macros: fixed a typo optimwoble.C (SetThetaCut instead SetAlphaCut)
1414 and added the standard Disp-parametrization
1415
1416 - macros: added a new macro datacenter/macros/plotstat.C allowing
1417 to plot statistics about the data processing
1418
1419 - macros: added a new macro to plot the muon correction coefficients
1420 versus period (macros/plot/mucal.C)
1421
1422 - showplot: path inflation for ganymed files was broken
1423
1424 - callisto: Fixed an important bug. When the number of saturating pixels
1425 were calculated the bad pixel information already available from the
1426 calibration was ignored. This yields wrong values in case pixels
1427 are broken and saturate all the time or randomly.
1428
1429 - callisto: Updated Muon calibration constants. Spline data now also uses
1430 different values for different periods
1431
1432 - star: The time-evolution shown in the effective on-time plot now displays
1433 the axis range (if there are no holes it should be similar to the
1434 effective on-time)
1435
1436 - star: Added two new image parameters:
1437 + MNewImagePar.fConcCOG: The ratio of the equivalent signals of
1438 the three pixels next to the center of gravity and the size
1439 + MNewImagePar.fConcCore: The ratio of the signals of all
1440 pixels inside or touching the ellipse and the size
1441
1442 - ganymed: now stops in requested source isn't found in catalog file
1443
1444 - ganymed: Many improvements to the phi-plot in wobble mode:
1445 + with a template the ideal background is displayed
1446 + a possible camera inhomogeneity is taken into account
1447 + the anti theta cut is better supported
1448 + the phi cut is automatically calculated from the theta cut
1449 See the examples in ganymed_wobble.rc for more details.
1450
1451 - ganymed: fixed plot for E^2*dN/dE. The spectrum was multiplied with two
1452 times the bin-width instead of the absolute energy
1453
1454 - ganymed: New cuts for on/off and wobble mode
1455
1456 - ganymed: The smearing of the False Source plot has been increased
1457 to 0.06
1458
1459 - ganymed: The starguider calibration can now be changed from the
1460 resource file.
1461 See the examples in ganymed*.rc for more details.
1462
1463 - ganymed: added a new option for on-/off-observations
1464 MJCut.RandomSourcePosition
1465 If switched on the distribution of observation time of the source
1466 position in the camera is calculated from the on-data and randomly
1467 applied with this distrbution to the off-data.
1468
1469 - ganymed: by skipping some obsolete calles in the eventloop the
1470 first and second loop could be accelerated by ~20%
1471
1472 - ganymed: The default in ganymed_onoff.rc is now to determin the source
1473 position in the off-data randomly according to its distribution in the
1474 on-data.
1475
1476
1477
1478 *** Version 0.9.4.3 (2006/02/13)
1479
1480 - general: Fixed a bug in most of the programs which prevented the
1481 compile date in the startup message to be displayed
1482
1483 - general: Simplified program calls. The following abbreviations
1484 are now possible:
1485 showlog callisto 55599
1486 showplot signal 55599
1487 star 55599
1488 callisto 55999
1489 ganymed 2
1490 In this cases the corrsponding root-, log-, sequence- or dataset-
1491 filename is automatically compiled using the default datacenter
1492 paths ("/magic/*")
1493
1494 - general: Fixed a long outstanding bug which made axis tick marks
1495 disappear if MDataFormula was used (eg. abs(x))
1496
1497 - general: Updated MMath with new functions to calculate the results of
1498 a exponential, logarithmic and powerlaw fits analytically.
1499
1500 - general: Updated some macros with comments:
1501 + macros/optim/optimdisp.C
1502 + macros/optim/optimenergy.C
1503 + macros/optim/optimwobble.C:
1504
1505 - general: MTFillMatrix (the class to fill one or two MHMatrix from
1506 files) now allows adding a pre-cut like in the optimization. E.g. this
1507 is useful to perform g/h-separation cuts before training the random
1508 forest.
1509
1510 - general: Between the rund 53300 and 68754 the pixels 553-558 were not
1511 correctly assigned in the raw data assignement table. A fix to correct
1512 the assignment tabel have been implemented.
1513
1514 - general: MAstroCatalog now allows rotating of the sky-grid and stars
1515 by 90, 180 and 270 deg.
1516
1517 - general: the macro plotdb.C now allows to highlight sequences belonging
1518 to a datset. For more details see the descritions in the macro.
1519
1520 - StatusDisplay: Fixed the algorithm to calculate the size ratio
1521 of the display, it gave wrong results espacially for big sizes.
1522 Now the embedded canvas should always have a ratio width/height=3/2.
1523 The "Size" options have been updated with values fitting the 3/2
1524 size ratio.
1525
1526 - RanForest:
1527 + Updated the random forest classes to support also the
1528 regression method implemented by Thomas H.
1529 + added new tutorial macro how to train the random forest
1530 for energy estimation (macros/optim/rfenergyest.C)
1531 + new classes to train the random forest (still in development)
1532 mjtrain/MJTrainEnergy, mjtrain/MJTrainDisp, mjtrain/MJTrainSeparation
1533 + new tutorial macros for random forest training in macros/train
1534 trainenergy.C, traindisp.C, trainseparation.C
1535
1536 - mars: now allows to setup a cut in the resource file mars.rc to choose
1537 the events to be displayed, eg:
1538 Cut.Condition: {0} && {1}
1539 Cut.0: MHillas.fSize>100
1540 Cut.1: MHillas.fSize<900
1541
1542 - merpp: Made aware of the new .rep format 200510250. This includes
1543 interpretation of the Receiver Board Temperatures (MCameraRecTemp),
1544 the discriminator thresholds (MCameraTD) and the disciminator
1545 delays (MCameraTD). All of them come with the CC report and are therefor
1546 written to the CC tree.
1547
1548 - callisto: fixed a bug in the calculation of the arrival times in
1549 the Digital Filter. They were all shifted by the same amount
1550 fHiGainFirst. This caused an offset in the order of the position of
1551 the left border of the extraction window in the times calculated
1552 from high-gain and from low-gain. The bug effected only the absolute
1553 arrival times. The bug was there since 30.1.2005.
1554
1555 - callisto: Changed the ExtractionWindow for the pulse position check
1556 such that the camera inhomogeneity becomes as less as possible and
1557 comparable to the pulso position check switched off. More details
1558 on the study will be given at our result web-page.
1559
1560 - ganymed: ganymed.rc, ganymed_onoff.rc:
1561 changed to new cuts trained with 1ES1218 and Crab-data
1562 for maximum sigma*log10(excess)
1563
1564 - ganymed: In addition to the Hadronness calculator (CalcHadronness)
1565 a new option was implemented to estimate Disp (CalcDisp)
1566
1567 - ganymed: Implemented two new options which allow
1568 to overwrite the default path to search for the sequence files
1569 --ins=/magic/sequences
1570 and where to search for the image data
1571 --ind=/magic/data/star
1572
1573 - ganymed: MSrcPosCorrect now allows overwriting of the misfocussing
1574 dx/dy from the resource file by
1575 MSrcPosCorrect.Dx
1576 MSrcPosCorrect.Dy
1577
1578 - ganymed: fixed reading the source catalog. Only as many chars
1579 as the requested source name had were compared (If a source
1580 "1ES1218" and "1ES1218+304" were in the catalog and "1ES1218+304"
1581 were requested it could happen that the coordinates of
1582 "1ES1218" were read) The source coordinates are now printed
1583 in addition to its name to the logging output.
1584
1585 - ganymed: changed the background fit in the case of a ThetaSq function
1586 from a polynomial to a exponential, this should give a big improvement
1587 for on-only analysis'
1588
1589 - ganymed/sponde: Calculation of the error of single size-/energy-
1590 bins now uses Li/Ma (5) instead of LiMa (17)
1591
1592 - sponde: Added a plot E^2*dN/dE
1593
1594 - sponde: The energy estimator plot should now show values like
1595 they are commonly used.
1596
1597 - sponde: Now MMcSpectrumWeight also excepts formulas with two X
1598 (a powerlaw with cutoff didn't work before)
1599
1600
1601
1602 *** Version 0.9.4.2 (2005/10/01)
1603
1604 - general: added new tutorial macro macros/tutorials/threshold.C:
1605 how to calculate the threshold
1606
1607 - general: added a new game. Start it from the interpreter with
1608 MagicJam j; (other games are: MineSweeper, MagicSnake, MagicDomino
1609 and MagicReversi)
1610
1611 - general: neighbor pixels in MGeoms are now sorted clockwise
1612
1613 - merpp: made aware of new format 20050829-0
1614
1615 - callisto: New scale factors from muon analysis, stored in new
1616 resource file resources/calibration.rc
1617
1618 - callisto: MBadPixelsCalc now raises an error instead of simply stopping
1619 the eventloop if something went wrong. This is necessary for the
1620 automatic processing
1621
1622 - callisto: Implemented a new treatment for the time information
1623 developed by S.Ruegamer, this should give much better response than
1624 the old very primitive algorithm. This is especially important
1625 for bad pixels due to bright stars as Ceta-Tauri (btw: the old
1626 treatment was buggy! As neighbor pixels to interpolate the
1627 arrival times always the pixels 0 to 5 were taken)
1628
1629 - callisto: In addition to the new treatment of arrival times the
1630 decision of the treatment whether a pixel contains shower
1631 information or not is used to improve the signal interpolation
1632 further. Previously interpolated pixels showed a non-zero signal
1633 do the peak searching signal extractors. Having a signal pixel
1634 beside raised the signal above the cleaning level. Thus the
1635 pixel survived cleaning to often but with a too low mean signal.
1636 By replacing empty pixels with a gaus (mean and rms from the
1637 corresponding Area entries in MPedPhotCam) this effect can
1638 be supressed.
1639
1640 - callisto: The status "unmapped" (for pixel which cannot be interpolated)
1641 got lost when the events were stored by the calibration... fixed.
1642 (This was no problem for normal image cleaning because the pixel
1643 content was artificially set to 0 not surviving standard cleaning
1644 algorithm)
1645
1646 - callisto: Fixed a bug which caused the random and peak-search pedestal
1647 extracted with an extractor to be exchanged for the first (roughly)
1648 500 events (*Extractor and *ExtractorRndm).
1649 (They were simply exchanged in callisto.cc) This bug might have been
1650 introduced in Mars 0.9.4 when the order of calculation of the two
1651 types of pedestal in callisto got exchanged. The bug only effects
1652 the first seconds of data of each sequence.
1653
1654 - star: Taking the arrival time of Muons into account the calculation
1655 of the parameters could be made independant of the noise
1656 (pedestal rms). The dependance was due to the bias of the peak search
1657 extractor. Now only a ZA dependamcy is left which is not yet fully
1658 understood.
1659
1660 - ganymed: The sequences were still not sorted correctly in any case,
1661 because they were sorted by the full qualified path name. Now they
1662 are sorted by their sequence number.
1663
1664 - ganymed: new values for the spark-event-cut
1665
1666 - sponde: required missing MEnergyEst from ganymed.root... fixed.
1667
1668
1669
1670 *** Version 0.9.4.1 (2005/08/18)
1671
1672 - callisto: fixed some problems with the calibration in case of
1673 inteleaved events. Therefor the final and some intermediate
1674 fits are skipped which would take place on partly filled #
1675 histograms and gave wrong results or failed completely.
1676
1677 - callisto: If the intermediate finalization of the histograms
1678 calculating the mean charge of the calibration signal fails
1679 it is counted now and printed in PostProcess of MCalibCalcFromPast.
1680
1681 - ganymed: Fixed some bugs which caused problems in On-only mode.
1682 Still the false source plot doesn't give reasonable results.
1683
1684
1685
1686 *** Version 0.9.4 (2005/08/05)
1687
1688 - general: Fixed the ZA binning. It did not correctly fit the
1689 MC binning
1690
1691 - general: Added a class to correct for the missfocussing in
1692 April (MSrcPosCorrect)
1693
1694 - general: Random Forest energy estimator should now work properly
1695
1696 - general: MHCamera now displays the profiles in deg instead of mm
1697
1698 - general: MH::SetPalette offers a lot of new palettes
1699
1700 - general: MHillas - the case of CorrXY==0 is now handled properly
1701
1702 - general: implemented the possibility to change the line and
1703 marker style of a sky-grid drawn by MAstroCatalog
1704
1705 - general: Runs in sequences and datasets are now automatically
1706 ordered (it is assumed that the order of their filenames correctly
1707 represents the order of observations) to ensure correct reading
1708 of the subsystem data
1709
1710 - general: Runs cannot be added to a sequence twice anymore. Also
1711 Sequences cannot be added twice anymore to a dataset.
1712
1713 - general: fixed a bug in MAstro::Deg2Hms reported by Abelardo.
1714 It gave wrong results by 1./2pi
1715
1716 - showplot: got a new option to start a root interpreter, too
1717
1718 - mars: now displays a rough estimate of Disp and the third moment
1719
1720 - mars: now displays the event time MTime if available
1721
1722 - mars: show muon parameters graphically
1723
1724 - mars: now the file to open can be given as commandline
1725 argument
1726
1727 - merpp: Added support for new arehucas version >= 200507190
1728 implementing values for three temperature sensors in the
1729 counting house (MCameraAUX) and the name of the HV settings file
1730 (MCameraHV).
1731
1732 - merrp: Also fixed some problems with wrong versions numbers stated
1733 by arehucas and implemented some fixed for old versions (<200407070)
1734
1735 - callisto: MCalibrationHiLoCam can now be printed from its context
1736 menu, eg in the TBrowser
1737
1738 - callisto: fixed logain offset (fgOffsetLoGain) from 1.7 to
1739 - 1.39 (MExtractTimeAndChargeSpline)
1740 - 1.40 (MExtractTimeAndChargeDigitalFilter)
1741 This is important mainly for timing studies.
1742
1743 - callisto: Changed limits in MHCalibrationChargeCalc from
1744 - -100.125 to -98 (fgChargeHiGainFirst)
1745 - 1899.875 to 1902. (fgChargeHiGainLast)
1746 - -100.25 to -99 (fgChargeLoGainFirst)
1747 - 899.75 to 901. (fgChargeLoGainLast)
1748 Introduced new limits:
1749 - fgNumLoGainBlackoutLimit: 0.05
1750 - fgLoGainBlackoutLimit: 3.5
1751 - fgLoGainPickupLimit: 3.5
1752
1753 - callisto: The handling of automatic weights for the digital filter
1754 has been improved. There are now new calibration weights special
1755 for Monte Carlo calibrations.
1756
1757 - callisto: Updated Muon scale with latest results (1% difference
1758 for most data, 5% for Mar/Apr'05)
1759
1760 - callisto: use a new criterium to exclude bad pixels: If the high-gain
1761 was saturated and the blackout-events in the low-gain exceed the
1762 fNumLoGainBlackoutLimit, the pixel is declared unsuitable.
1763 This excludes those pixels which have a saturating high-gain
1764 channel, but the low-gain switch does not switch often enough
1765 to make the distribution reliable.
1766
1767 - callisto: fix a bug counting the number of saturated events. Up to now,
1768 the number of saturated slices was counted (which is one for a not too
1769 high number), but for some (pathological) pixels, many more slices
1770 saturated and produced wrong limits.
1771
1772 - callisto: New options in in callisto.rc for MCalibrationRelTimeCalc:
1773 + MCalibrationRelTimeCam.CheckFitResults: Yes
1774 + MCalibrationRelTimeCam.CheckDeviatingBehavior: Yes
1775 + MCalibrationRelTimeCam.CheckHistOverflow: Yes
1776 + MCalibrationRelTimeCam.CheckOscillations: Yes
1777
1778 - callisto: introduce max. number of events for intercalibration,
1779 the rest gets skipped. Default: 4096
1780 The calibration causes too many un-reliable pixels if more
1781 than about 5000 events are treated (@500 Hz) because of the
1782 mode hopping of the VCSels. However, in the past, some
1783 calibration runs have been taken (erroneously) with more
1784 than 5000 events, especially the intensity scans where
1785 a good precision is needed.
1786
1787 - callisto: Set UseExtractorRes to kTRUE, will raise the number of
1788 photo-electrons for the spline extractor by 1-2% (correctly).
1789
1790 - callisto: The intercalibration is now done using a full f-factor
1791 method instead of a simple update. This makes things slower but
1792 more reliable in terms of gain-fluctuations and sudden VCSEL gain
1793 changes.
1794
1795 - callisto: MPedestalY3 now uses the same extraction range as the data
1796 as calculated by MPedestalY2
1797
1798 - callisto: A check of the fraction of allowed unsuitable (10%) and
1799 unreliable (30%) pixels has been addded when the conversion is
1800 calculated from interleaved events
1801
1802 - star: fixed a bug which caused MEffectiveOnTime containers not to
1803 be written. In the worst case they were skipped almost all, in the
1804 best case they were all ok. It depends on how often the new value
1805 was assigned just with an event which was skipped later by another
1806 task
1807
1808 - star: new histograms MHPointing and MHRate
1809
1810 - star: New tab (Currents) displaying the time evolution of the mean
1811 DC currents
1812
1813 - star: New tab (MeanRms) displaying the time volution of the mean
1814 Pedestal Rms
1815
1816 - star: Output now contains MReportStarguider
1817
1818 - star: Improved muon analysis. Due to the absense of a constant
1819 for the gaus fit for arc width and the fact that the arcwidth
1820 plot was a histogram instead of a profile the resulting psf
1821 became pedestal rms dependant
1822
1823 - ganymed: added new plot (MHPhi) for wobble mode as described in
1824 http://www.astro.uni-wuerzburg.de/results/ringmethod/
1825
1826 - ganymed: corrects now (correctly?) for the misspointing in
1827 May/April 05
1828
1829 - ganymed: Two new default templates for ganymed.rc are avilable:
1830 ganymed_onoff.rc and ganymed_wobble.rc
1831
1832 - ganymed: The first version of MFMagicCuts has been released
1833
1834 - ganymed: the Conc1 plot was incorrectly scaled in MHVsSize
1835
1836 - ganymed, sponde: There are two new options to determin the number
1837 of bins for the signal region (NumBinsSignal) and the number of
1838 total bins (NumBinsTotal) in the MHThetaSq histogram
1839
1840 - ganymed: optimized palettes for MHDisp
1841
1842 - ganymed: Fixed an important bug when using ThetaSq as fit function:
1843 The result for the sigma of the gauss(sqrt(x)) fit was a factor
1844 sqrt(2) to large
1845
1846 - ganymed: The false source plot (MHDisp) is now based on Disp
1847 and a background model determined in the first loop is
1848 subtracted
1849
1850 - ganymed: MFMagicCuts are now available in the cvs. The correct
1851 solution for the disp ambiguity problem is now calculated using
1852 the third moment. The third moment cut therefor is skipped.
1853
1854 - ganymed: Output now contains "Disp [MParameterD]" which sign is
1855 already determined by the third moment along the major axis and
1856 so its actual sign is aligned along the major axis of the shower.
1857
1858 - ganymed: If starguider data is available it is taken into account
1859 when calculating the source position. This is especially important
1860 for wobble data at high zenith angles and culmination data.
1861
1862 - ganymed: If available the starguider data is taken into account as
1863 good as it is possible without a starguider calibration. To switch
1864 it off add
1865 MPointingDevCalc.MaxAbsDev: -1
1866 to your ganymed.rc
1867
1868 - sponde: the zenith angle distribution is now weighted instead of
1869 choosen by default. This gurantees higher statistics in the highest
1870 and lowest energy bins. To switch this behaviour off use...
1871
1872 - sponde: now automatically displays the energy threshold
1873
1874
1875
1876 *** Version 0.9.3 (2005/06/03)
1877
1878 - general: MMcEvt now derived from MMcEvtBasic which should
1879 have no influence on compatibility with older camera files
1880
1881 - general: Implemented a new option to MReadReports which allows
1882 to force reading of the first event of some trees (eg. Drive-tree)
1883 before any other tree.
1884
1885 - general: Made a fix to MPointingPosCalc which assumes that the
1886 run-type is real-data if Process is called before ReInit, such
1887 that also the very first Drive-events in a run are treated
1888 correctly.
1889
1890 - shoplot now displays the filename in the title bar of the window
1891
1892 - merpp: new options: --auto-time-start --auto-time-stop which
1893 allow to cut updating with slow-control at the start- or
1894 (previousle --auto-time only allowed: and) stop-time of
1895 the run stored in the runheader.
1896
1897 - callisto: changed default of fgFallTimeHiGain in
1898 MExtractTimeAndChargeSpline from 1.5 to 0.5. 0.5 was
1899 already set as default in callisto_Dec04Jan05.rc
1900
1901 - callisto: the digital filter (MExtractTimeAndChargeDigitalFilter)
1902 now changes the filename for new weights automatically for
1903 cosmics, MC and for different calibration colors.
1904
1905 - callisto: a problem with the order of some code cause the
1906 name of the weights file in MPedestalY2 to be ignored.
1907 Wrongly the calibration_UV weights were used instead
1908 of the cosmics weights set in callisto.rc.
1909
1910 - callisto: should allow ct1 pulser data when the color is
1911 explicitly set also for pretty new runs
1912
1913 - callisto: a new option (MCalibrateData.ScaleFactor) allows
1914 to introduce an additional scale factor (should be around 1)
1915 to adapt for slight deviations in different extractors from
1916 the MC calibration. For MC calibrations the scale factor
1917 is fixed to 1
1918
1919 - callisto: MFCosmics should handle very high signals a bit
1920 more accurate now
1921
1922 - callisto: when calculating the mean pedestal rms for different
1923 pixel sizes or sectors also kUnsuitableEvt is now taken into
1924 account - not only kUnsuitableRun
1925
1926 - callisto: '-raw' option is now the default
1927
1928 - callisto: A dead pixel check has been implemented in MJPedestalC2.
1929 This has the advantage that mean values in the calibration (eg
1930 arrival times) are calculated more accuratly.
1931
1932 - callisto: In the resource file callisto_Dec04Jan05.rc
1933 MJPedestalY2.ExtractWinRight has been reduced from 4.0 to 2.0
1934
1935 - callisto: new Hi-/Lo-Gain intercalibration constants
1936 hilocalib_sp1.root and hilocalib_sp1_mc.root
1937
1938 - callisto: changed default for MJPedestalY2.MaxEvents
1939 from 2000 to 5000 like in callisto_Dec04Jan05.txt
1940
1941 - callisto: in MCalibrationChargeCalc the limit fgPheErrLowerLimit
1942 has changed from 9.0 to 6.0. This is necessary to exclude two very
1943 ringing pixels in September which - when kept - destroy the image
1944 cleaning around them (Markus G.)
1945
1946 - callisto: (!) The Muon analysis of all data taken so far has
1947 suggested that different extractors give slightly different
1948 absolute results after calibration, due to there different
1949 handling of the calibration- and cosmics pulse shape. Although
1950 the over all calibration seems to be a bit to pesimistic (or
1951 the MC seems to be a little bit - 3-5% - too much attenuated).
1952 There for correction factors have been introduced which correct
1953 the calibration constants by
1954 0.956937799 for Digital Filter (callisto.rc)
1955 and
1956 0.904159132 for Spline (callisto_Dec04Jan05.rc)
1957 calibration. The main advantage is, that both data types can
1958 be easily analysed together and compared to the same MC sample.
1959 The factors are choosen such, that the reference is now a
1960 Monte Carlo sample calibrated with Digital Filter (callisto.rc)
1961
1962 - star: fixed a bug which caused the first bin of the histograms
1963 vs time to disapear in PostProcess. This gave wrong results
1964 on the screen. The output and all following programs not
1965 directly accessing the histograms haven't been affected
1966
1967 - star, ganymed: Made sure that always the first Drive-tree event
1968 is read and Processed before the first data event was read.
1969
1970 - ganymed: implemented the possibility to replace the standard
1971 false source plot with a different one. For example: If
1972 you want to use a Disp based FS plot use the resource:
1973 NameHistFS: MHDisp
1974 For details about the requirements of these plots look
1975 at the corresponding classes
1976
1977 - MJOptimize: For On/Off and Wobble optimization MJOptimize
1978 has been replaced by MJOptimizeCuts. To use MHThetaSq instead
1979 of MHAlpha call MJOptimizeCuts("MHThetaSq"). Make sure in this
1980 case MAlphaFitter is setup correctly. For On-Only optimization
1981 MJOptimize has been Replaced by MJOptimizeCuts, too. Call
1982 RunOn() instead of Run(). For energy estimation MJOptimize
1983 has been replaced by MJOptimizeEnergy
1984
1985 - sponde: The input MC spectrum can now be weighted to fake a
1986 different spectrum. This is done via MMcSpectrumWeight. For
1987 more details see the class description and sponde.rc
1988
1989 - sponde: The paremeter comparsion plots are not scaled by
1990 their entries anymore. Instead the MC plot is scaled by using
1991 the result spectrum of the analysis. If the input MC spectrum
1992 and the result spectrum has different slopes the absolut
1993 normalization is normally wrong.
1994
1995
1996
1997 *** Version 0.9.2 (2005/05/20)
1998
1999 - general: Changed the default paths for calibrated data and image
2000 files. (The implemented access to these files doesn't yet exist)
2001
2002 - general: support for MRunIter has been removed from the job classes
2003 (use the setter functions of MSeqeunce instead)
2004
2005 - general: ProcessFile has been renamed to Process in all job classes,
2006 because ProcessFile is missleading
2007
2008 - general: The storage of the palette in MHCamera is now possible
2009
2010 - general: new bits describing unsuitable and unreliable pixels have
2011 been introduced in MBadPixelsPix: kPreviouslyExcluded,
2012 kDeadPedestalRms, kFluctuatingArrivalTimes
2013
2014 - general: fixed reading of CC-REPORTS (weather data) for Arehucas file
2015 versions newer than V200404070
2016
2017 - general: support for cc file versions newer than V200504130. Added
2018 support for active loads (MCameraActiveLoad) and central pixel
2019 (MCameraCentralPixel)
2020
2021 - general: added new histograms for image parameters versus size
2022 (MHVsSize)
2023
2024 - general: The eventloop now automatically calls PrintStatistics
2025
2026 - Status Display: Improved support for printing:
2027 + A default can now be set in .rootrc (for more details see
2028 MStatusDisplay::PrintPS)
2029 + A print dialog is opened so that printer and command line
2030 can be canged
2031
2032 - showlog: improved such that it handles different verbosity levels
2033 more accurate now. This mean you can suppress output when
2034 using showlog.
2035
2036 - showplot: improved
2037 + The new graphics formats have been implemented
2038 (pdf, svg, png, jpg and xpm)
2039 + Implemented an interface for printing. Because you can change
2040 the printing command from the command line you can use all
2041 the nice postscript tool. To print a booklet for example call:
2042 showplot -b --print --print-cmd="cat %f" filename.root | lpr
2043 showplot -b --print --print-cmd="psbook %f | psnup -2 | lpr" filename.root
2044 showplot -b --null --print --print-cmd="psbook %f" filename.root > book.ps
2045
2046 - callisto: fixed a bug in the recognition of the calibration bit
2047 pattern. Concerns only intensity calibration. (The strength of the
2048 intensity has been updated in some cases)
2049
2050 - callisto: add a filter against PIN Diode events when running over
2051 calibration runs since some of the recent calibration runs have
2052 been taken with Pin Diode.
2053
2054 - callisto: added support for the runs 39942, 39944, 44834, 39941,
2055 39943, 44833 in the calibration (MCalibColorSet)
2056
2057 - callisto: MJCalibration.MHCalibrationChargeCam.ProbLimit has
2058 been set to 1e-18 in callisto_Dec04_Jan05.rc
2059
2060 - callisto: in callisto_Dec04Jan05.rc: set value for
2061 MJPedestalY2.MaxEvents from 2000 to 5000 to get better
2062 statistics for the calculation of the mean pulse time
2063 of the cosmisc
2064
2065 - callisto: the charge limit in the calibration has been raised
2066 from 2.5 to 4.5
2067
2068 - callisto: new setup read from callisto.rc
2069 + MCalibCalcFromPast.fNumEventsDump
2070 + MHCalibrationChargeCam.NumHiGainSaturationLimit
2071 + MHCalibrationChargeCam.NumLoGainSaturationLimit
2072
2073 - callisto: MExtractTimeAndChargeSpline extractor:
2074 + The integration ranges were shifted by 0.2 FADC slices to the right.
2075 + unreliable handling of floating point values caused different
2076 results on different platform or with different compiler options:
2077 The new algorithm is numerically exact and more accurate because
2078 it doesn't calculate the integration position by multiple times
2079 adding the step-size (which results in numerical uncertanties
2080 exspecially if multiplied with large numbers)
2081 + A lot of fixes have been introduced which effects integrating the
2082 spline at the edges of the valid range. In this case any memory
2083 was randomly accessed. This behaviour can be tested replacing
2084 all MArrayF by TArrayF which perform a range check (but of course
2085 they are a lot slower)
2086 ! No result obtained with the Spline before can be trusted! Due to
2087 random memory access it might by completely random!
2088
2089 - callisto: set new defaults in MExtractTimeAndChargeDigitalFilter:
2090 + extraction range in the high gain to 4.
2091 + weights file to cosmics_weights46.dat
2092
2093 - callisto:
2094 + introduce the check for fluctuating arrival times.
2095 + set charge limit to from 2.5 to 4.5
2096 + introduce asymmetric exclusion due to "deviating number of phes":
2097 Default: -9.0 +4.5
2098 + make deviating number of phes unsuitable (see David's findings).
2099
2100 - callisto: fixed the display of unsuitable pixels. The old change
2101 to a real profile in MHCamera broke it.
2102
2103 - callisto: The cosmics filter is used in MJCalibration now
2104 independant of the pulser color (formaly it was used only for
2105 CT1-pulser data). The threshold of number of max empty pixels
2106 has been raised from 2% to 5% in MJCalibration. The maximum
2107 fraction of rejected event is 50% otherwise the calibration has
2108 failed. The filter now ignores unsuitable pixels.
2109 Setup the filter from callisto.rc using "ContCosmics"
2110 (see MFCosmics::ReadEnv)
2111
2112 - callisto: changed default for fgOffsetFromLogain back
2113 from -2.8 to -1.8 in digital filter.
2114
2115 - callisto: for the common extractors
2116 + MExtractFixedWindow
2117 * MExtractTimeAndChargeSlidingWindow
2118 * MExtractTimeAndChargeSpline
2119 * MExtractTimeAndChargeDigitalFilter
2120 the hi- and lo-gain reolution is stored in fResolutionPerPheHiGain
2121 and fResolutionPerPheLoGain
2122
2123 - callisto: Updated the hi-/lo-gain intercalibration constants
2124 hilocalib_sp1.root, hilocalib_df46_mc.root, hilocalib_df4.root,
2125 hilocalib_df6.root
2126
2127 - callisto: The default lo-gain extraction window for the
2128 MExtractTimeAndChargeSlidingWindow extractor has been increased
2129 from 6 to 8 to take the stretch of the pusle into account
2130
2131 - callisto (!!!): fixed an important bug in the setting of the
2132 incoming pedestal pointer to the signal extractor extracting
2133 pedestals. This bug caused the pedestals not to be subtracted
2134 correctly in the calibration afterwards. The effect was about 10%
2135 too high conversion factors for the digital filter and the spline
2136 and more than 40% for the sliding window.
2137 The bug existed since end of February! (Markus G.)
2138
2139 - star: added muon support to star. A new tab "MHMuonPar" is
2140 displayed. The lower right plot is an estimate of the point spread
2141 function. A reference value is displayed. To get the real PSF
2142 you must compare with MC. The setup for the muon analysis
2143 is done in star.rc. More informations can be found in
2144 MHSingleMuon and MHCalibParCalc
2145
2146 - star: The weather data is now displayed in star
2147
2148 - star: MEventRateCalc handles the calculation of the event rate more
2149 accurate now in case of the start of a new run inside a sequence
2150
2151 - ganymed: a bug in MSrcPosCalc has been fixed (The changes were taken
2152 from a bugfix of Wolfgang to Loc0LocToCam; Wolfgang: the results are
2153 changed only minimally
2154
2155 - ganymed: (MJCut and MJOptimize) now displayes the number of
2156 excess events versus size. The energy estimation is done in
2157 MJSpectrum (sponde)
2158
2159 - ganymed: got support for using other variables than Alpha, eg. Theta.
2160 Therefor you need a class deriving from MHAlpha which supports
2161 this variable (one is already existing: MHTheta, which is now the
2162 default in ganymed). It is setup through ganymed.rc
2163
2164 - added a full featured spectrum program (sponde) which reads
2165 ganymed output and monte carlos and compiles a spectrum
2166
2167
2168
2169 *** Version 0.9.1 (2005/04/14)
2170
2171 - Fix bug on the arrival time reconstruction when using Digital
2172 Filter (in some marginal cases (10%) times were reconstructed shifted
2173 by 0.2 slices)
2174
2175 - all executables now return 2 where in previous versions -1 has
2176 been returned (gave problems with shell-scripts)
2177
2178 - the Hi-/Lo-Gain intercalibration for monte carlo files is now
2179 also done with a intercalibration input file
2180
2181 - a bug in the time fine adjustment of the digital filter has been fixed
2182
2183 - a lot of small fixes to calling TPad::Divide with a margin==0
2184
2185 - MStatusDisplay now shows the memory usage
2186
2187 - added a memory leak statistic after the eventloop
2188
2189 - MHadronness replaced by MParameterD
2190
2191 - MEnergyEst replaced by MParameterD
2192
2193 - wobble mode can now be switched on from the data-set
2194
2195 - switched on bad pixel detection for a pedestal level
2196 which is more than 5 times the variance
2197
2198 - Fixed default paths to be correct for the new data center
2199
2200 - Fixed handling of drive data. The pointing position in now
2201 copied to MPointingPos inside star for real and MC events
2202
2203 - made sure, that the sequences in a dataset are sorted by
2204 their number to ensure the correct synchronization
2205
2206 - added all resource files necessary to handle spline extraction
2207 of signal for the late 2004 and the early 2005 data
2208
2209 - update the reference lines for the december data
2210
2211 - changed default for fgHiGainFirst from 2 to 0 in spline extractor
2212 This is important for the Dec. and Jan. data where the calibration
2213 pulse position changes much.
2214
2215 - changed default for fgOffsetFromLogain from -1.8 to -2.8 in digital
2216 filter. This corrects only an defective extraction of the MC at
2217 low-gain signals lower than 90 phes.
2218
2219 - fixed some slowdown in calibrating data with interleaved events from
2220 Jan and Dec. As a workaround made the pretty palette the default.
2221 The inverse Deep Blue Sea has a bug which slows down long calibration
2222 runs a lot.
2223
2224 - implemented new values from new starguider report as defined
2225 in TDAS00-07 V7.1 (eg SkyBrighness)
2226
2227 - Fixed the formerly wrong unit of azimuth and zenith angle deviation
2228 in starguider report (If you merpp the same reports with this version
2229 you'll get the correct units (arcmin) but a different result
2230 than with old versions (wrong units))
2231
2232 - Now the status display can also write PNG, JPEG and XPM (other file
2233 formats are still unsupported by root)
2234
2235 - added a lot of scripts and macros in directory datacenter used
2236 for automatic processing
2237
2238
2239
2240 *** Version 0.9 (2005/03/23)
2241
2242 - Calibration is now done autmatically into photo-electrons like
2243 decided by the Collaboration Board
2244
2245 - Reference lines in the display can be read from resource file
2246
2247 - Interlaced calibration events can be handled by callisto
2248
2249 - Hi-Gain vs. Lo-Gain calibration constants can be calculated
2250 and applied in callisto.
2251
2252 - class MJCalibTest can be called by callisto
2253
2254 - callisto can now run with three data types: rawdata, rootdata, MC
2255
2256 - added two classes mreport/MReportStarguider.cc and
2257 mreport/MReportStarguider.h for implementing starguider-data
2258
2259 - the output of merpp-update now contains starguider information:
2260 MReportStarguider and MTimeStarguider
2261
2262 - Fixed bug in MHHadronness.cc which made that the displayed Q-factor
2263 values were lower than they should. This was more visible for high
2264 energy (Size) events.
2265
2266 - Made MExtractTimeAndChargeDigitalFilter the default for callisto
2267
2268 - added a new loop to callisto to support the correct extraction of
2269 the pedestal and pedestal rms through the signal extractor
2270
2271 - added class to perform fourier tranformation of a hexagonal structure
2272 (MHexagonalFT)
2273
2274 - added class to perform fourier tranformation of a hexagonal structure
2275 in a tasklist (MHexagonalFTCalc) example: hft.C
2276
2277 - added class to enhance the MCerPhotEvt from the Magic camera geometry
2278 MGeomCamMagic to a enhanced geometry MGeomCamMagicXT having only
2279 small pixels, example: extendcam.C
2280
2281 - added possibility to write data to memory (TTree) using MWriteRootFile
2282
2283 - added possibility to read a TTree stored only in memory by MReadTree
2284
2285 - new classes to deal with the interleaved calibration events:
2286 MTriggerPattern, MTriggerPatternDecode and MFTriggerPattern
2287
2288 - implemented filters to callisto to skip calibration events
2289
2290 - changed callisto to calculate three kinds of pedestals and pedestal rms:
2291 + fundamental pedestal (MPedPhotFundamental): extracted directly from
2292 the slices by statistics
2293 + pedestal from extractor (MPedPhotFromExtractor): extracted with the
2294 signal extractor without randomization
2295 + random pedestal from extractor (MPedPhotFromExtractorRndm): extracted
2296 with the signal extractor with randomization (extraction window is
2297 randomly fixed)
2298 The three kind of pedestal is not yet implemented (for speed reasons) as
2299 long as nobody really needs it:
2300 + pedestal from extractor with randomizatiuon (MPedPhotFromExtractorRndm):
2301 extracted with the signal extractor with randomization
2302
2303 - callisto now finds the pulse position in the data automatically
2304
2305 - implemented data reduction in calibrated data by reducing the precision
2306 of the stored floating point values (pedestal, rms and signal) to
2307 roughly 0.5%
2308
2309 - fixed showplot to make file format conversion (eg. converting a
2310 status display stored in a root file into a postscript file) in
2311 batch mode possible:
2312 showplot -b --save-as-ps[=outfile.ps] infile.root
2313
2314 - Allow class names as part of filter rules, eg
2315 (MFSupercuts) && (MHillas.fSize>100)
2316
2317 - fixed a lot of stuff to allow all programs to process MonteCarlo
2318 camera files.
2319
2320 - enhanced possibility to debug reading of resource file
2321
2322 - MDataChain should handle priorities of operator more
2323 accurate now
2324
2325 - completely revised the container in which the signal is stored
2326 MCerPhotEvt/Pix, MArrivalTime --> MSignalCam/Pix
2327 * the new implementation is faster and
2328 * needs less storage space
2329
2330 - FIRST version which can process Monte Carlos through the
2331 whole chain of programs (callisto, star, etc)
2332
2333 - implemented new image parameters for the border length of
2334 the shower image (MNewImagePar2)
2335
2336 - implemented wobble-mode in ganymed
2337
2338 - new class (MJOptimize) taking care of all optimization processes
2339
2340
2341
2342 *** Version 0.8.6 (2004/10/05)
2343
2344 - New combined signal and time extractor
2345 MExtractTimeAndChargeDigitalFilter
2346
2347 - The Report for the trigger section in the CC run summary has been
2348 updated, and now the IPRs (Individual Pixel Rates) are available.
2349
2350 - new macros for database interaction: filldotrun.C, filldotrbk.C
2351
2352 - added new program which can convert colored output which was redirected
2353 into a file back into colored text (for example to display it with
2354 more): showlog
2355
2356 - added new program to display an MStatusArray of plots (stored with
2357 MStatusDisplay) from a file: showplot
2358
2359 - Added support for Sequences (MSequence). Sequences are blocks of run
2360 files containing the same calibration and belonging to the same
2361 source
2362
2363 - Added a new task (MTaskEnv) which can be used in setup files to switch
2364 between different tasks (for example to choose a signal extractor)
2365
2366 - Implemented automatic file splitting in MWriteRootFile
2367
2368 - After image cleaning an island index is assigned to all used pixels.
2369 The index corresponds to the order of the islands in size.
2370
2371 - added a cleaning which takes signal height _and_ arrival time into
2372 account: probability cleaning (for more details see MImgCleanStd)
2373
2374 - added a cleaning which takes takes the absolute number of photons
2375 times the area ratio as cleaning level
2376 (for more details see MImgCleanStd)
2377
2378 - Changed calculation of image parameters such, that it can be done
2379 for all used pixels or the pixels with a defined island index only
2380
2381 - implemented new image parameters displaying the number of islands,
2382 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
2383
2384 - event display in executable changed to support also calibrated files
2385 (done with MJCalibrateSignal)
2386
2387 - added program doing the calibration and the signal extraction
2388 and signal calibration: callisto Most part of the setup is done
2389 by a resource file: callisto.rc
2390
2391 - implemented support for pixels with negative IDs (Raw file format
2392 version 4)
2393
2394 - implemented an new option in merpp (--auto-time) to get the time
2395 range for cc and/or caco data from the run header of the raw data
2396
2397 - New star-program (star and MJStar). Taking calibrated data from
2398 callisto/MJCalibrateSignal as input. The setup is done through
2399 a resource file: star.rc
2400
2401 - Added possibility to setup the eventloop in the mars-executable
2402 Camera Display by a resource file: mars.rc
2403
2404 - The the mars-executable Camera Display can now also read
2405 calibrated data files written by callisto/MJCalibrateSignal
2406
2407 - Added a new class which can calculate the source position in
2408 the camera from a pointing model known to be correct and
2409 the pointing model used for observations (MSrcPosFromModel)
2410
2411 - added a new version of the class calculating the effective on-time
2412 MHEffectiveOnTime. It unifies the old classes MHEffOnTime,
2413 MHEffOnTimeTime, MHEffOnTimeTheta, MHTimeDiff, MHTimeDiffTime and
2414 MHTimeDiffTheta.
2415
2416 - added the possibility to count how often a signal is above (or
2417 below) a certain threshold in MHCamEvent and MHCamEventRot (this
2418 can replace MHTriggerLvl0)
2419
2420 - added ore convinient ways to set the axis-titles of your histograms
2421 in your macro to some MH-classes like: MH3, MHVsTime, MHSectorVsTime,
2422 MHPixVsTime, MHVsTime, MHCamEvent and MHCamEventRot
2423
2424
2425
2426 *** Version 0.8.5 (2004/08/06)
2427
2428 - new Signal Extractors: MExtractFixedWindowSpline
2429 and MExtractAmplitudeSpline
2430
2431 - implementes interleave in merpp to be able to merpp parts of a file
2432
2433 - implemented force-functionality to merpp
2434
2435 - star display to display star catalogs (MAstroCatalog)
2436
2437 - star display to 'mirror' stars to the camera (MAstroCamera)
2438
2439 - implemented a new cleaning option which allows cleaning scaled with
2440 the real ratio of the rms depending on the pixel size, not only the
2441 square root of the pixelsize (MImgCleanStd, MCameraData)
2442
2443 - removed obsolete MBlind* classes
2444
2445 - Signal extractor taking the AB flag into account implemented (this makes
2446 an odd number of slices for signal extraction possible
2447 (MExtractSignalABcorr)
2448
2449 - implemented a class extracting the pedestal from the raw-data (events)
2450 itself using empty lo-gain (MpedCalcFromLoGain)
2451
2452 - Added mean values to MPedPhotCam
2453
2454 - Added Makefile for Darwin (this OS is NOT officially supported!)
2455
2456
2457
2458 *** Version 0.8.4 (2004/04/19)
2459
2460 - new fast arrival time extractor using cubic splines:
2461 MExtractTimeFastSpline
2462
2463 - implementes multi-argument support in MDataChain
2464 ("pow(a, b)")
2465
2466 - implemented double reference support in MDataChain
2467 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
2468
2469 - added support in MF for expressiond like
2470 "MHillas.fWidth<2*<MHillas.fLength"
2471
2472 - MDataChain is now able to support variables like [0], [1], ...
2473 which can be used in fit functions as parameters. The interface
2474 is implemented through the new virtual function
2475 MParContainer::SetVariables
2476
2477 - added new class MArrivalTimeCam/MArrivalTimePix:
2478 Storage containers to hold the ArrivalTime of the camera/pixel
2479
2480 - added new classes for the calibration of relative arrival times:
2481 MCalibrationRelTimePix and MCalibrationRelTimeCam
2482
2483 - added new classes to extract the signal of the blind pixel and the
2484 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
2485
2486 - added new classes for the bad-pixels treatment (MBadPixels*)
2487 which are more powerfull than the old ones (MBlindPixel*)
2488 and will replace them.
2489
2490 - added filter against cosmics: MFCosmics
2491
2492 - added new class MArrivalTimeCalc2:
2493 Calculates the arrival time as the signal weighted mean of the time
2494 slices in the maximum window
2495
2496 - added a new macro call pointspreadfucntion.C that fits with a 2D
2497 gaussian the DC spot for an star. It gives you the RMS of
2498 the PSF and the center of the star, very useful for misspointing
2499 studies.
2500
2501 - added support for multi-telescope camera files. Added classes
2502 MStereoCalc and MStereoPar, classes to calculate and store shower
2503 parameters calculated from the data of two telescopes, for the MC
2504 studies regarding the MAGIC clone.
2505
2506 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
2507 MC data calibrated in photons instead of ADC counts.
2508
2509 - added three macros to show the calibration and analysis chain of
2510 MC data. The macro starmc.C does both calibration and analysis, producing
2511 an output containing Hillas parameters for each event. The macro
2512 mccalibrate.C does just the calibration and writes out a file containing
2513 pixel information in photons instead of FADC data. The macro starmc2.C
2514 reads in such a file and produces an output with Hillas parameters.
2515
2516 - added MPedPhotCalc to compute pedestals in units of photons, see
2517 macro pedphotcalc.C
2518
2519 - added all class to perform the calibration, see macro calibration.C
2520
2521 - added class MFFT to perform Fast Fourier Transforms
2522
2523 - added class MSimulatedAnnealing to perform simulated annealing
2524 minimizations
2525
2526 - added new macro bootcampstandardanalysis.C which holds the skeleton
2527 of the analysis chain discussed in the december bootcamp.
2528
2529 - added support for DAQ raw data file format V2
2530
2531 - implemented an arbitrary time stamp for the events from raw-data
2532 files with file version<3. It is calculated from the run number,
2533 the date of start and the FADC clock tick from the first module
2534
2535 - implemented the correct decoding of the event time-stamp
2536 coming from the DAQ for raw-data files with file-version>2
2537
2538 - added a new classes storing the pedestals in units of photons:
2539 MPedPhotPix, MPedPhotCam
2540
2541 - added support for DC current files from the camera control
2542
2543 - added support for start- and stop-time when merpping report files
2544
2545 - added MReportCC storing the weather data from the CC-REPORT
2546
2547 - added class to fill trainings and test matrices (MTFillMatrix)
2548
2549 - added a filter performing a software trigger (MFSoftwareTrigger)
2550
2551 - Added classes to perform parts of the standard analysis (Jobs):
2552 + MJPedestals
2553 + MJCalibration
2554 + MJExtractSignal
2555 Note: All of them are preliminary!
2556
2557 - Added Iterator to iterate over files giving only the run-number
2558
2559 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
2560 the evolution of a sector vs time
2561
2562
2563
2564 *** Version 0.8.3 (2003/12/05)
2565
2566 - adapted Random Forest classes to allow the use with MC
2567 multi-telescope files which can be produced with the coming
2568 camera version 0.7.
2569
2570 - added classes to read and interprete central control report files
2571 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
2572
2573 - enhanced merpp (the executable) to support .raw and .rep files.
2574
2575 - added classes for light calibration (MCalibration* and
2576 MHCalibration*) by Markus Gaug. Further work has to be and will
2577 be done soon.
2578
2579 - Added a preliminary 'synchronizer' (MReadReports) which will
2580 replace MReadMarsFile as soon as it is finished.
2581
2582 - Added a tutorial macro demonstrating how report files are merpped
2583 and how they can be read from the root file in the correct order
2584 of time (readrep.C)
2585
2586 - Added a generalized histogram (similar to MH3) called MVsTime
2587 which allows to plot variables (or rules - MDataChain - of
2588 variables) vs time. For an example have a look at tempvstime.C.
2589
2590 - Changed the name of the event trees:
2591 + Events --> Events
2592 + PedEvents --> Pedestals
2593 + CalEvents --> Calibration
2594
2595 - changed name of MTime in the event trees from MRawEvtTime to MTime
2596
2597 - added displaying the sector indices to the mars event display
2598
2599 - Magic Online Analysis (MOnA) implemented in a first version
2600 (see mona.cc, MOnlineDump and MOnlineDisplay)
2601
2602 - added classes to calculate event rate
2603 (preliminary: MEventRateCalc, MEventRate)
2604
2605 - added new executable 'readdaq' to read *.raw files from the DAQ directly
2606
2607 - added classes dealing with the telescope pointing position (MPointing*)
2608
2609 - implemented the 'final' Mars time stamp based on some experiences with
2610 the new 'Synchonizer'
2611
2612
2613
2614 *** Version 0.8.2 (2003/11/10)
2615
2616 - accelerated standard analysis by a factor of 6-8 ...
2617 + doing precalculations in MGeomCam for the pixel area ratio
2618 + creating a look up table for the single pixels in MCerPhotEvt
2619
2620 - added task to calculates weights in case you want to 'change'
2621 the energy spectrum of a monte carlo file
2622 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
2623
2624 - added a new executable star which implements the
2625 star.C macro as precompiled executable. Currently a flexible
2626 setup is not possible, but a 'input card' setup will follow.
2627
2628 - Starting to implement Multi-Telescope-Support based on the
2629 upcomming camera version 0.7. The base for a general support
2630 is implemented and the star-functionality is proven to work.
2631
2632 - Replaced Event-Display in and Camera-Display in the Mars GUI
2633 executable by a more convinient display base on MStatusDisplay.
2634
2635 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
2636
2637
2638
2639 *** Version 0.8.1 (2003/10/20)
2640
2641 - added signal subtraction for pure on data by means of fitting
2642 the background in the off region or by performing a combined
2643 signal/background fit. Provides necessary histograms for
2644 obtaining energy spectra and a light curve.
2645
2646 - added classes to perform and study the selection of the
2647 2nd Level Trigger on MC data (example in triglvl2.C macro)
2648
2649 - added pedestal calculation
2650
2651 - implemented "democratic cleaning" (tail cut value proportional
2652 to pixel area) according to Wolfgang's suggestion.
2653
2654 - added Sigmabar treatment (calculation and basic histogramming)
2655
2656 - added basic routines to apply padding
2657
2658 - added first implementation of MARS-based source visibility plotter
2659 (needs to be linked against slalib, preliminary version)
2660
2661 - enhanced functionality of data chains: random numbers, conversion
2662 functions and access to MHMatrix objects
2663
2664 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
2665 numbers under certain circumstances (runs with 0 events included)
2666
2667 - fixed a bug in the general filter MF (didn't work on some systems
2668 at all)
2669
2670 - fixed a bug in chaining files, which caused the analysis to crash or
2671 ignore files
2672
2673 - implemented more geometry classes describing the parameters used
2674 to simulate the PMT camera
2675
2676 - added new Monte Carlo classes containing the setup of the different
2677 programs in the MC chain.
2678
2679 - added a (preliminary) general task to evaluate chi-square of a given
2680 parameter in an eventloop.
2681
2682 - first implementation of a container describing the observatory
2683 location (Long, Lat, etc)
2684
2685 - added Random Forest - method for g/h-separation
2686
2687 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
2688 (this means, that it is compiling, but not yet fully tested)
2689
2690 - added a new status display which can show the present status
2691 of histograms while an eventloop is running (MStatusDisplay,
2692 an example can be found at status.C)
2693
2694 - reorganized directories:
2695 classes describing the image --> mimage
2696 classes containing Monte Carlo Histograms --> mhistmc
2697 classes for Random Forest method --> mranforest
2698
2699 - added (event-)weights to fill histograms
2700
2701 - colors in logging output to screen
2702
2703 - changes to the Image Parameter declaration:
2704 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
2705 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
2706 + MHillasExt now derives from MParContainer instead of MHillas
2707 --> Files written with the old definition are more or less unreadable
2708
2709 - reading of reflector files
2710
2711 - display data from reflector files in the camera
2712
2713 - implemented currents (and display them in the camera)
2714
2715 - logarithmic scale in camera
2716
2717 - added class to iterate through directory contents (MDirIter)
2718
2719
2720
2721 *** Version 0.8 (2002/11/18)
2722
2723 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
2724
2725 - corrected 48(!) wrong entries in the Next Neighbor table of the
2726 Magic Camera (all in the inner part of the outer ring, mostly
2727 missing a single NN)
2728
2729 - Fixed a bug in the table describing the Next Neighbours of the
2730 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
2731 have any neighbour)
2732
2733 - changed trigrate.C: now it calculates the pure NSB triggers from
2734 a camera file (generated with no showers), so there is no need
2735 to introduce them by hand in the BgR array (for more details
2736 please ask Abelardo)
2737
2738 - added MHHadronness (and MHadronness) as a general facility to evaluate
2739 the quality of a gamma-hadron seperation method
2740
2741 - changed MWriteAsciiFile to accept rules (MDataChain)
2742
2743 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
2744 must be replaced by calles to MWriteAsciiFile::AddColumn and
2745 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
2746 changed.
2747
2748 - Implemented generalized event-matrices (one row per event)
2749 (MHMatrix)
2750
2751 - implemented the one dimensional composite probabilities
2752 (MHCompProb, MCompProbCalc, comprob.C)
2753
2754 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
2755 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
2756
2757 - Added a camera display displaying the pixel numbers to the
2758 event display gui.
2759
2760 - Added Monte Carlo Informations to event display gui
2761
2762 - Changed the camera display to display the pixel numbering
2763
2764 - Added three buttons to the camera display to change the palette
2765
2766 - Added the number of used and core pixels after image cleaning
2767 to MHillas
2768
2769 - Changed the algorithm used in MHillas according to TDAS 02-03
2770
2771 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
2772
2773 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
2774
2775 - Added fCosDeltaAlpha to MHillasSrc
2776
2777 - The numbers of photons used to calculate fConc and fConc1 in
2778 MHillasExt are now scaled with the pixel size, so that one get
2779 a four times smaller value for the bigger pixels in the outer ring.
2780
2781 - added new task to smooth the camera contents (MCameraSmooth)
2782
2783 - added possibility to use interpolated pixel values for blind pixels
2784 instead of removing it completely from the analysis
2785
2786 - Implemented the possibility to save the whole eventloop with
2787 its setup to a file. This information can be read and from
2788 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
2789 and MEvtLoop::MakeMacro. If you find something not working, please
2790 report - this stuff is still in a beta phase.
2791
2792 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
2793 file having crab starfield, but also for all following files - fixed
2794
2795 - MTaskList::PrintStatistics can now be instructud to print also the
2796 title, too: use PrintStatistics(0, kTRUE)
2797
2798 - Changed the image cleaning so that pixels with to many 'used'
2799 neighbors are left used (to get rid of 'holes' in events)
2800
2801 - Introduced more output to the camera displays
2802
2803 - Added an array of histograms (eg one hist per run), MHArray
2804
2805 - Added a _preliminary_ version of the reader for CT1 PreProc files
2806 (MCT1ReadPreProc)
2807
2808 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
2809 (thanks to Raquel)
2810
2811 - added the first energy estimator (MEnergyEstParam, estimate.C,
2812 estfit.C) using a parametrization
2813
2814 - Added some new Monte Carlo paremeter containers used to store
2815 setup information from the MC chain (MMcConfigRunHeader,
2816 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
2817
2818
2819
2820 *** Version 0.7 (2002/04/30)
2821
2822 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
2823 the pedestal mean value was saved incorrectly. For files from
2824 this versions we substract 0.5 from the pedestal mean.
2825 WARNING: This may effect your results, so don't wonder...
2826
2827 - First implementation of an algorithm using only triggered events
2828 for the collection area calculation
2829
2830 - Ascii Output can now also be used for parameter containers which
2831 doesn't overload MParCointainer::AsciiWrite
2832
2833 - The Ascii Output is now also capable of writing single data members
2834 of one container
2835
2836 - You are now able to change the order of the values written to the
2837 ascii file
2838
2839 - You can now specify a conversion factor for each data member written
2840 to an ascii file. This may be usefull to change the units of the
2841 data member (eg. degrees instead of millimeters in case of the
2842 hillas parameters)
2843
2844 - Replaced old MHillas by a new structure which allows you to extend
2845 the parameters stored in MHillas very easily:
2846 see MHillas and MHillasExt
2847
2848 - Added classes to handle source dependancy of image parameters:
2849 see MHillasSrc
2850
2851 - Added container (MBinning) to have a standard input for the binning
2852 in different histograms (eg. the Energy bins should be the same in
2853 all histograms)
2854
2855 - Changed Hillas histograms from mm to deg
2856
2857 - Added the flexible binning to the hillas histograms
2858
2859 - Added a filter for the alpha parameter (MFAlpha)
2860
2861 - It is now possible to write single data members of a class object to
2862 an output stream instead of the whole container only
2863
2864 - Added a generalized filter for a data member:
2865 MFDataMember filter("MHillas.fWidth", '<', 0.5);
2866
2867 - Added a generalized Filter parser for more difficult filter rules
2868 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
2869
2870 - Added new Monte Carlo histograms:
2871 MHMcEnergyImpact and MHMcEfficiency
2872
2873 - Added many new histograms needed for the flux calculation.
2874
2875 - Added a generalized histograms which can fill and show up to three
2876 data members in either a one-, two- or three-dimensional histogram, eg:
2877 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
2878
2879 - Added:
2880 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
2881 * calculation of <Theta> as a function of time (MHThetabarTime)
2882 they are needed in the flux calculation in
2883 order to select for a given bin in Theta (or time) the appropriate
2884 effective collection area, which is assumed to be given as a function
2885 of Theta and the true energy
2886
2887 - Added calculation of the migration matrix in the energy
2888 (MHMcEnergyMigration):
2889 the migration matrix describes the migration from the true (E_true)
2890 to the estimated energy (E_est); it is needed to determine the
2891 distribution of E_true from the measured distribution of E_est
2892 by unfolding
2893
2894 - changed the color palette in the camera display to DeapSea.
2895
2896
2897
2898 *** Version 0.6 (2002/01/15)
2899
2900 - Introduce the option of disable pixels (MBlindPixels and
2901 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
2902 able to deal with Star Field NSB.
2903
2904 - Fixed a bug in the pedestals substraction
2905
2906 - Introduced verbosity levels
2907
2908 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
2909
2910 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
2911 work correctly (thanks to Abelardo)
2912
2913 - Introduced correct treatment of the diffuse Night Sky Background
2914 and NSB (MMcPedestalNSB)
2915
2916 - Corrected treatment of the electronic noise (MMcPedestalCopy)
2917
2918 - Introduced MMcRunHeaders which contains monte carlo run informations
2919
2920 - Added a 'Print'-Task (MPrint) which calls the Print function
2921 of a parameter container for each event
2922
2923 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
2924
2925 - changes to be more efficient with root 3.02/06
2926
2927 - root 3.02/06 fixes:
2928 + the memory leak when reading MRawEvtData
2929 + loosing more time than necessary to update the progress bar
2930
2931 - MWriteAsciiFile is now capable of writing more than one container
2932 in a line. For example: To be able to write Monte Carlo and
2933 Hillas values (energy and alpha) in one line.
2934
2935
2936
2937 *** Version 0.5 (2001/11/06)
2938
2939 - Added new GUI functionality (Analysis)
2940
2941 - Added a camera display to be able to display events in the camera
2942 together with the calculated hillas ellipse
2943
2944 - Added a 'Clone'-Task (MClone) which can clone a parameter container
2945 object at any state of the analysis, so that the output are several
2946 states
2947
2948 - Fixed a bug in the collection area error calculation
2949 (Thanks to Ciro and Abelardo)
2950
2951 - Fixed a bug which causes merpp to crash in some environments
2952
2953 - Implemented auto enabling scheme for Branches to speed up reading
2954 a lot (see MReadTree and MTask)
2955
2956 - Fixed a bug in the Histogram classes which caused histograms to
2957 be written to a file by MWriteRootFile without request
2958
2959 - changed the object I/O from the old stylish root I/O to the new
2960 'auto evolution scheme' This was done only for classes which are not
2961 yet used in Monte Carlo files, so that these files are still readable.
2962
2963 - Added support for a progress bar in MEvtLoop and MReadTree
2964 (see the Analysis Window in Mars for an example)
2965
2966 - Fixed a bug in the package creation which disturbed the conversion
2967 between a mars version unpacked from a tar file and the repository.
2968
2969 - Changed the code to writer merpped (converted into root format)
2970 raw files, to get faster (around 10%)
2971
2972
2973
2974 *** Version 0.4 (2001/09/20)
2975
2976 - This release is made to compile on a root version >= 3.00
2977
2978 - Fixed a bug which causes MReadTree to read the first file only
2979
2980 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
2981
2982 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
2983
2984 - Added a task to write several container to a root file (MWriteRootFile)
2985
2986 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
2987
2988 - Added calculation of the collection area (MMcCollectionAreaCalc)
2989
2990 - fixed some bugs in the Hillas calculation
2991
2992 - added filters to be able to control the task execution dependent on
2993 a parameter (for example: the number of level 1 triggers in a MC-file)
2994
2995
2996
2997 *** Version 0.3 (2001/04/23)
2998
2999 - Many demo macros added
3000
3001 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
3002
3003 - Hillas Calculation added
3004
3005 - Standard image cleaning available
3006
3007 - MReadTree is now able to handle more than one file
3008 (Remark: of the same structure)
3009
3010 - Now we are able to display events in a first version of the
3011 Camera event display. To do this we must run the macro
3012 "macros/readCT1.C" to read data from CT1.
3013
3014
3015
3016 *** Version 0.2 (2001/01/24)
3017
3018 - First Implementation of a Gui to read the raw data. Start the
3019 gui with the command mars.
3020
3021
3022
3023 *** Version 0.1 (2000/12/20)
3024
3025 - First official release 0.1
3026
3027 - Changes:
3028
3029 + changed calling style of MRawPixelIterator from do...while to
3030 while-loop
Note: See TracBrowser for help on using the repository browser.