source: trunk/MagicSoft/Mars/NEWS@ 9208

Last change on this file since 9208 was 9186, checked in by tbretz, 16 years ago
*** empty log message ***
File size: 126.0 KB
Line 
1 -*-*- END -*-*-
2
3== <cvs> ==
4
5 ;SUGGESTION
6
7 * This release doesn't contain a major changed which is expected to
8 change your result. Nevertheless there are small changes to
9 the calibration which can effect at least the first few hundred
10 events in any (mainly MUX and even more SUM) sequence a little bit.
11 So it is recommended although not necessary to reset your sequences
12 in the database before further processing.
13
14 ;general
15
16 * All command line options after -- are now interpreted as
17 arguments (usually everything which doesn't start with a minus)
18 rather than options (usually everything which starts with a
19 minus). This allows to use file names starting with a -
20
21 ;Database
22
23 * Added informations about the DC currents (fMinCurrents, fMedCurrents
24 and fMaxCurrents). The values are retrieved from the plots showing
25 the average DC currents of all pixels versus time.
26
27 * Websites with tables have now the opportunity to remove lines
28 ('-' button at beginning of each line) and get all lines back
29 ('+' at top of the column)
30
31 * Websites: added option to query only sequences containing sumtrigger
32 events
33
34 ;automatic analyis
35
36 * Rewritten producing plots in the web.
37 New plots, namely the output of plotoptical.C (extinction curve from
38 KVA), plotstat.C (status of the automatic analysis (percentage of
39 processed, analysed data etc.)) and plotusage.C (statistics of the
40 condor usage in the data center) has been are available now next to the
41 plots of plotdb.C
42 Mean values from the plots (output of the macro) are provided in a
43 txt file now.
44 The creation of the plots for callisto, star and ganymed in the web is
45 now steered via database. Consequently the plots are faster and
46 reliable up-to-date.
47 For all plots, a new layout is available facilitating the browsing
48 through the plots and providing additional information on the
49 displayed values. (tabs.php) These plots are linked from the DB
50 websites and the wiki.
51
52 ;statusdisplay
53
54 * The ''Loop'' entry in the menu bar now contains an option to pause
55 the loop and to process single events.
56
57 ;merpp
58
59 * Fixed merpping of raw-files (the runheader tree got the name RunHeader
60 instead of RunHeaders)
61
62 * Now allows to merpp files newer than 2008/09/03.
63
64 ;callisto
65
66 * Extracting the pulse position for the pulse position check events
67 with sum trigger were denied. This decreased the statistics
68 extremely and therefor the resulting puse position was calculated
69 quite weak. Now sum events pass the calculation if and only if they
70 have also a level 1 trigger.
71
72 * the extraction of pedestal events and pulse position from the
73 first data events is now more automatic and makes sure that
74 a more precise number of events is extracted independent of
75 the ratio with which pedestal events or events with signals
76 are contained in the data.
77
78 ;star
79
80 * For the calculation of the effective on time all sum-triggered events
81 were skipped. Now all Level1-triggeres events will pass. This might
82 result in a slight inaccuracy of the effective on time.
83
84 ;ganymed
85
86 * If the source position is more than 1deg away from the camera
87 center an error is raised now.
88
89 ;sponde
90
91 * Fixed a problem which causes the fitted spectral slope to be displayed
92 incorrectly. If you use MJSpectrum::FormFlux in your macros make
93 sure that the parameter 0 of your fit is negative.
94
95 * Added a histogram showing the read source position of your MCs
96
97
98
99== Version 2.1.1 (2008/08/04) ==
100
101 ;Database
102
103 * Added the median number of photo electrons from the calibration
104 pulses to the db (fMedNumPheInner, fMedNumPheOuter) and the relative
105 error of their raw counts (fRelChargeRmsInner, fRelChargeRmsOuter)
106
107 * Added fTotOnTime, which is the on-time as given by the run-headers
108 (in contradiction to fAbsOnTime which comes from CC)
109
110 * Added new primaries for the new data structure (Magic II): for the
111 tables dealing with sequences (SequenceBuild Status, Sequences,
112 SequenceProcessStatus, Calibration, Star and DataSetSequenceProcessing)
113 this is the telescope number (fTelescopeNumber) for the tables dealing
114 with runs (RunData and RunProcessStatus) this is in addition the file
115 number (fFileNumber)
116
117 * Added column fPriority to the status tables to be able to steer the order
118 in which the data is processed. As default the run, sequence and dataset
119 number are used.
120
121 ;automatic analyis
122
123 * Adapted scripts to the new data structure: They can handle now different
124 telescopes (getting the information as usual from the database).
125 The paths for Magic 2 are not yet implemented.
126
127 ;general
128
129 * should work now with root 5.20/00 (please note that root 5.20/00
130 we encounter crahses in the status display which are ot yet
131 understood)
132
133 * Sequences and Datasets are now stored as "MDataSet" and "MSequence"
134 instead of the base name of the file. This makes them easier to
135 access from the code
136
137 * Default Monte Carlo names in MSequence do not require the _E at
138 the end anymore
139
140 * where abrrevating a sequence file with a sequence number is possible
141 also "telescope:sequence" is now accepted, e.g.:
142 star 2:2000123 --out=output
143 see the programs' help for more details.
144
145 * sequences (MSequence or MSequenceSQL) can now directly be retrieved
146 from the database. See the constructors for more details.
147
148 * MReadTree now supports friends
149
150 * MReadTree can now read also files not written by MARS and store
151 the data encapsulated in emulated MParContainers
152
153 * added a new starguider calibration valid since 15.1.08
154
155 ;showplot
156
157 * showplot can now read more than one file at once. This is especially
158 inetersting if reading files containing pure canvases
159
160 ;merpp
161
162 * we merpp the dc currents now also from the camera reports (they have
163 just a lower rate than the current reports, 0.1Hz instead of 1Hz)
164
165 * In the automatic analysis we omit merpping of the currents from the
166 caco files and use the lower rate camera reports from the cc files
167 instead
168
169 * merpp has been redisigned to allow merpping of the cc-reports
170 of a whole sequence. This allows to design a very simple analysis:
171 mkdir output
172 ./callisto 100776 --out=output
173 ./merpp 100776 output
174 ./star 100776 --ind=output --out=output
175 Instead of the sequence number also sequence files are accepted.
176
177 * Implemented a fix for run-numbers between 1001348 and 1001396
178 which were incorrectly assigned by the cc.
179
180
181 ;callisto
182
183 * added a filter again which was was removed in the last release.
184 it removed the most brightest events. This should not change
185 any analysis result because these events are so bright that
186 they cannot be analysed anyway, but the bad-pixel plots doesn't
187 show outliers.
188
189 * updated muon calibration constants for the periods 51-57,
190 58-63 and 67-
191
192 ;star
193
194 * The camera currents are now displayed with the rate of the camera
195 reports instead of the caco reports
196
197 ;ganymed
198
199 * if mc camera files are new enough (>=8) the source position in the
200 camera is now calculated from the stored telscope and shower
201 orientation (Note, that this might not be suitable in all cases
202 depending on the aim of the study. These case still needs
203 implementation)
204
205
206
207== Version 2.1 (2008/06/18) ==
208
209 ;Database
210
211 * introduced average temperature and wind speed from star-files
212
213 * introduced average values from Pyrometer (mainly Cloudiness)
214
215 * introduced the ratio of accepted calibration events in the
216 calibration run
217
218 * introduced the average rates of the different trigger pattern,
219 e.g. the rate of pedestal and calibration events, from the signal-file
220
221 ;general
222
223 * fixed GroupBy options in plot*.C macros
224
225 * only display KVA points (not the Tuorla points) in plotoptical.C
226
227 * all programs now allow to add resources to the ones from the resource
228 file or overwrite them from the command line. This can be done like this
229 ganymed --config=ganymed.rc --rc=Cut1.Param1:0.25 --rc=Cut1.Param3:5.5
230 if something seems to be wrong you can debug what the program is doing
231 using the option --debug-env=3
232
233 * increased the diversity of debug levels. That also means that with -v3
234 you get now less output, i.e. only the output which is important for
235 an analysis. To get more output which helps for debugging try 4, 5 and 6.
236
237 * fixed a problem in the task synchronizing the reading of the reports
238 and the data stream. The effect was that in some circumstances the last
239 events of some trees could have been skipped. Since this is only a
240 very tiny part of the data no severe effect to your analysis results
241 is expected (an exception might be very short, i.e. singel runs,
242 datasets).
243
244 * Dataset file now allow to include the sequence file directly within
245 the dataset file and also allow to exclude single runs from the dataset.
246 (for more details see Class reference of MDataSet)
247
248 * Sequence files now allow for excluding runs from the analysis
249 (for more details see Class reference of MSequence)
250
251 * added code to process the sum-trigger flag
252
253 * the histogram classes MH3 and MHn now support profile histograms
254
255 * the histogram classes MH3 and MHn now support labels at the axis
256
257 * the Random Forest Train-classes (MJTRain*) now store the used datasets
258 in the output file
259
260 * the MFMagicCuts have a new option to allow a linear area cut (for
261 special studies)
262
263 * The liniking of the shared object is now done into a file defined
264 by 'mktemp'. This should be a local file system which accelerates
265 liniking a lot.
266
267 * The code has been prepared for compilation with root 5.18/00d
268
269 * The MHEnergyEst histogram now shows the distribution of
270 (Eest-Emc)/Est and the distributions (Eest-Emc)/Eest vs. Eest
271 and (Eest-Emc)/Emc vs Emc.
272
273 * fixed mars (event display) for merpped raw-data and MC data
274
275 * adapted the synatx of sequence files to allow for the new run/file
276 scheme. For more details see class description of MSequence
277
278 ;showplot
279
280 * Added support for tiff files
281
282 * Added support for csv files (tables containing tab number,
283 name and title)
284
285 * Tabs now can have a title which is displayed in the postscript file
286
287 * When multiple file are written at once (e.g. pngs from a display)
288 it is now possible to use the tab name and or tab number in the
289 file name. For details see showplos's help.
290
291 ;merpp
292
293 * Implemented cc file version 2008-02-20/0
294
295 * Implemented cc file version 2008-05-19/0
296
297 * With new options merpping can be restricted (in addition to the
298 run-number) also by telescope and file number.
299 For details see "merpp --help"
300
301 * Implemented raw data format 11 (the most important change, except
302 from plenty of changes in the format definition, is the addition
303 of the file-number in the header) If nobody makes a mistake this
304 format should have the advantage that it is by definition forward
305 compatible, so old programs will be able to read newer formats.
306
307 * Added Pyrometer information to default output (stored in a new Tree
308 Pyrometer, needs a complete new merpp, i.e. new calibration)
309
310 * Merpping (also update) can now be restricted to one single report.
311 For example:
312 If you want to update an old file with Pyrometer information call
313 merpp --only=Pyrometer --update
314
315 ;callisto
316
317 * in the pedestal processing now at least 50 processed events are
318 required for succeeding.
319
320 * the signal and calib files now contain also the sequence information
321
322 * the two MPedestalCam in the calib file now have proper names
323 to distinguish them from each other (MPedestalCam, MPedestalExtracted)
324
325 * Both pedestal cams now contain the number of events processed
326
327 * In Mars V2.0 the extraction of the fundamental pedestal was broken,
328 i.e. for the extraction of the calibration pulses basically the average
329 over all events of the first slice instead of all slices was used.
330 Since pedestal and calibration constants are continously recalculated
331 this only effected the very first events of every sequence.
332
333 * For the extraction of the position of the maximum sample now the
334 extraction range is set automatically to the extraction window,
335 before the whole accessible range was used.
336
337 * If the number of samples in the events and the number of samples
338 in the run-header disagrees now an error is raised (this can
339 happen in not well simulated Monte Carlo files)
340
341 * In the case of MUX-data pedestal events with the lvl1 trigger flag
342 could survive into the pedestal calculation -- fixed.
343
344 * Tab "TrigPat" added showing the distribution of the trigger pattern
345 as found in the run-files (normalized with the run length)
346
347 * The selection of events from the trigger pattern has been improved.
348 If the trigger pattern is corrupted events won't pass anymore.
349
350 * Added a new command line option --dev-null to suppress output of
351 Y-files (this is useful for test cases)
352
353 * added a new tab "CalPos" showing the arrival time of extracted
354 interleaved calibration events
355
356 ;star
357
358 * the star file now contains also the sequence information
359
360 * Added a new command line option --dev-null to suppress output of
361 I-files (this is useful for test cases)
362
363 * Tab "Rate" added showing the distribution of the trigger pattern
364 (should only be Trig (Lvl1/Lvl2) and Sum (Sum only)) as found in
365 the Y-files (normalized with the run length)
366
367 * The effective on-time calculation doesn't use events with only
368 sum-trigger anymore
369
370 * The data in the MHWeather tab has been reorganized. The never
371 working solar radiation has been removed and the data from
372 the pyrometer (cloudiness, air and sky temperature) is
373 displayed in addition.
374
375 ;ganymed/sponde
376
377 * Now data points are even shown correctly if they have error bars larger
378 than one sigma. Points with null or negative significances are omitted.
379
380 * DrawNicePlot now allows to set a projection range
381
382 * Updates pointing models. One is applied after the implementation
383 of the new LUTS in August, the other one is applied after the
384 next major change of the pointing model in October. Note that
385 these models are preliminary and give wrong results below Zd=65deg
386
387 ;sponde
388
389 * fixed resource files ('''Spectrum''' instead of '''MJSpectrum''')
390
391 * a new option "--force-runtime" is available. In case of very short
392 datasets (for light-curves) which are in the order of a few
393 minutes the calculated effective on-time is not very acurate because
394 it is quantizised in the order of a minute. Therefore you can switch
395 to using the real run-time instead (remakrt: this ignores any
396 dead-time!)
397
398 * a more analytical way is used to "fill" Monte Carlos into regions
399 of impact parameters which have not been simulated because the
400 trigger efficiency is assumed to be 0.
401
402 * estimated sensitivity curves for hi and lo zenith angles are shown
403 scaled to the correct observation time and collection area
404
405 * the Monte Carlo events after cuts are now written to the output file
406 if an output file given
407
408
409
410 *** Version 2.0 (2007/09/03)
411
412 - database: the position used for the pulse pos check was missing
413 in the callisto output and could thus not be filled into the DB.
414 Also the old values seemed not exactly the PulsePos used for
415 teh check.
416
417 - general: Resource file now allow an Include-Resource, i.e. you can
418 read a resource file with default settings, include it in your
419 resource file and overwrite the settings in your file. More than
420 one include file is allowed. Inclusions can be iterative.
421 Include: mydefaults.rc yourdefaults.rc
422 The resources in the first file have higher priority than the
423 second file.
424
425 - general: Now the output files (calib*.root, etc) also contain the
426 resource file (to check it open it in the TBrowser and choose Print()
427 from the context menu)
428
429 - general: Dataset files now allow to overwrite the default path
430 to search for sequence and data files. Note, that the program
431 option and individual resources will overwrite it. For example:
432 SequencePath: /magic/montecarlo/sequences
433 DataPath: /magic/montecarlo/star
434
435 - general: Fixed a problem with variables in MDataPhrase. It seems
436 that only optimdisp (didn't work) was effected.
437
438 - general: Some improvements to the optim and train processing. For
439 example the ststud window now got a proper title.
440
441 - general: The "Status Display: " was removed from the window title
442 within an Eventloop.
443
444 - general: added a new flexible histogram-class (MHn) which can be used
445 for example in testing after optimizations or training to produce
446 user defined histograms.
447
448 - general: The Random Forest now allows attaching an evaluation
449 function which is applied to its output. This allows to train
450 on whatever you like (eg. train on log10(energy), but return
451 energy)
452
453 - general: The Random Forest training of energy (trainenergy.c) and
454 disp (traindisp.C) has been improved by more graphical output to
455 judge the result.
456
457 - general: The training of energy (trainenergy.C) has been improved
458 a lot by training on a different quantity than energy. It gives
459 a result which is highly independant of the source spectrum
460 and shows lower bias than all other options.
461
462 - general: Dataset files are allowed to contain collections of
463 datasets. For more details see the class reference of MDataSet.
464
465 - general: The default WobbleMode in a datset file now (if not
466 overwritten) is "auto", i.e. wobble mode is set if the dataset
467 doesn't contain off-sequences.
468
469 - merpp: Merpp can read file format version 9 now. Please realize
470 that for file format version 9 the extraction range is different
471 and must be set to 0/49 instead of 15/64 in callisto_mux.rc until
472 the first and last 15 slices have been removed from all MUX data.
473
474 - mars: Similar to writing movies you can now select events which
475 should be displayed in your display. Therefore add the following
476 lines to your mars.rc:
477 MFEvtNumber.FileName: ganymed00223552.root
478 MFEvtNumber.Selector: ThetaSquared.fVal<0.04 && DataType.fVal>0.5
479 The input file can be a ganymed-file after (ganymed*.root) or
480 before (ganymed*-summary.root) file. For example to select all events
481 from your on sample after cuts (excluding the ThetaSq cut) use
482 MFEvtNumber.Selector: DataType.fVal>0.5
483 To show all events from your on-sample after quality cuts
484 use the summary file instead.
485
486 - mars: new ways to call mars are implemented. Instead
487 of calling
488 mars filename.root
489 you can now also use
490 mars sequence.txt
491 or
492 mars sequence.txt inputpath
493 or replace sequence.txt by the sequence number if the default
494 sequence file should be used.
495
496 - mars: The default size has been increased
497
498 - mars: There are two new heckboxes which allow to switch off
499 the calculated image parameters
500
501 - callisto: was broken for MCs... fixed.
502
503 - callisto: improved calculation of spline coefficients a lot. This
504 leads to a further improvement of the event rate calibrating MUX
505 data of about 15% (175evt/s instead of 150evt/s)
506
507 - callisto: finally the raw data we read is now real 16bit (with
508 10bit precision) for MUX data and not a stripped 8bit number
509 anymore. Due to scaling of the numbers (without precision loss
510 into an [0-256[ range, the final numbers for pedestal, pedestalrms
511 and extacted signal don't change. However, at all places where
512 raw data is directly accessed (eg. saturation and variation
513 limits in the signal- and pedestal-extraction) the numbers
514 refer still to the data's 16bit range.
515
516 - callisto: The maximum arrival time difference used in the bad
517 pixel treatment is now in units of nanoseconds, which leads to 3.0ns
518 for both, old FADC and MUX-FADC, data.
519
520 - callisto: Be aware that callisto is now calibrating the arrival time
521 in nanoseconds rather than time slices. Also all following tasks
522 have been changed to assume ns units now. If you star data
523 calibrated with an older version it might be necessary to adapt
524 some timimng parameters (Muon Analysis and MFSoftwareTrigger)
525 to obtain optimal results. The plot in the PulsePos tab
526 will now be in ns, too. This might also mean that the Muon
527 analysis in star might not work as perfect as expected as long
528 as old files read in.
529
530 - callisto: The calibration constants of earlier updates got lost
531 somehow. All constants have been updated.
532
533 - star: The PSF is now determined from the profile of the ArcWidth
534 instead of arcwidth/radius. The old way gave to much weight
535 to the bins with low statistics. The reference lines have been
536 updated.
537
538 - star: For speed reasons events suitable for the muon analysis
539 are now also preselected by fConcCOG<0.1 which seems to be a very
540 good preselector for muons.
541
542 - star: is now calculating a new timing parameter the Slope along
543 the major and minor axis of the shower. Therefore a numerical
544 solution of a line-fit is used. To use MHillasExt.fSlopeLong
545 and MHillasExt.fSlopeTrans don't forget to multiply it with
546 the sign stored in MHillasSrc.fCosDeltaAlpha as usual.
547
548 - star: The parameters fInnerSize, fInnerLeakage1 and fInnerLeakage2
549 have been removed from MNewImagePar. They have never been good for
550 anything.
551
552 - star: Implemented a new recursive algorithm which is supposed to be
553 faster. Also implemented new cleaning oiptions, which are:
554 + CleanLevel0:
555 The cleaning level above single core pixels can be kept
556 + KeepIsolatedPixels:
557 Define whether single core pixels should be kept
558 + TimeLevel1:
559 The coincidence window in nanoseconds to single used neighbors
560 + TimeLevel2:
561 The coincidence window in nanoseconds to two used neighbors
562 + PostCleanType:
563 MOde in which a time dependent post cleaning should be applied
564 0: No post cleaning
565 1: Require for each used pixels at least one used neighbor
566 within a time-window of CleanLevel1
567 2: Require for each used pixels at least two used neighbor
568 within a time-window of CleanLevel2
569 3: Require first two and second one used neighbor
570 within a time-window of CleanLevel1 and fCleanLevel2
571 respectively
572 + RecoverIsolatedPixels:
573 - recoveres isolated core pixels if they have a used neighbor
574
575 - mars/star: The new default cleaning is:
576 + CleanLevel1: 6.0
577 + CleanLevel2: 3.0
578 + CleanTime1: 1.75
579 + CleanTime2: 1.75
580 + PostCleanType: 3
581
582 - star/ganymed: The old spark-cuts have been replaced by new ones.
583 These new spark cuts have been cross checked with the sequences
584 84720 (before splitter), 101041 (after splitter) and 223539 (new
585 FADCs). In all cases they seperate pretty well, but of course not
586 perfect. Monte Carlos have suggested to tighten the cuts a little
587 bit further at low sizes. This has been done.
588
589 - ganymed: IMPORTANT - The spark cuts have been changed to match
590 all available data more or less well. This might mean that for
591 YOUR data there are still sparks visible.
592 Whenever you do an analysis you have to make sure that NO sparks
593 survive your cuts!
594
595 - ganymed: The old hadronness and size cuts have gotten new indices
596 (10, 11). The old indices 8 and 9 now mean an additional condition
597 for ghostbusting based on the formula (dist-c[9])*c[8]-slope.
598 If you want to switch off this cut just move the line far away enough,
599 e.g. by setting c[9] to -500. Please update your ganymed.rc files
600 accordingly!
601 The unit of c[9] is deg. It is the dist at which your cut will
602 cross the slope==0. The unit of the slope is ns/deg. So if
603 you readin files calibrated with an older Mars-version you
604 have to adapt the default value for c[9] to the FADCs:
605 - Multiply by two for the MUX FADCs (run number > 200.000)
606 - Multiply by 0.3 for the Siegen FADCs (run number < 200.000)
607 - Multiply by 42 for the meaning of life (run number = 200.000)
608
609 - ganymed: The old Cut0 is now called CutQ and is calculated before
610 the source position is caluclated. If you need a quality cut
611 including source dependant data (be very carefull with this!)
612 you have to use Cut0 instead.
613
614 - ganymed: now properly supports three off regions in wobble mode.
615 It will be the default from now on in ganymed_wobble.rc. To change
616 the number of off-regions use
617 NumOffSourcePositions: 1
618 in your ganymed.rc. Also by default no off-theta cut will be done
619 anymore so that you will get a background level higher than the
620 signal level in your ThetaSq plot for ThetaSq>0.2.
621 Due to this be carefull changing the scaling mode away from
622 "None". You will underestimate your signal if your scale interval
623 is not properly set.
624 (Rem: ThetaSqN is no longer needed)
625
626 - ganymed: is now storing the events of all (on- and off-)
627 source positions even in the case of more than one off-source
628 position. This should allow sponde to work properly and the
629 energy estimation is done correctly in all cases (without any
630 "nearest position" trick)
631
632 - ganymed: From 85340 (19.3.2006) on a real starguider calibration
633 with a real pointing model for the starguider is done, calibrated
634 with more than thousand tpoints taken from this date on.
635
636 - ganymed: was broken for Wobble-MCs... fixed.
637
638 - ganymed: The default cuts (MFMagicCuts) and the disp-parametrization
639 has changed. Note that your old ganymed.rc will be incompatible
640 with the new algorithms! Please check the ganymed.rc files and
641 the class description of MFMagicCuts for more information.
642 It is recommended at the moment to use identical Disp-Parametrizations
643 for on/off- and wobble-mode. If cuts are optimized only
644 the Area-Cut (parameters 2,3,4) and the theta-sq cut (parameter 1)
645 should be optimized. All other values should be kept as they are.
646 If you want to do an anylsis without timing a parameters, you can
647 switch off the timing cuts by seeting parameter 7 to a very small
648 value (eg. -99). To remove the slope parameter from the disp
649 paremtrization set parameter 8 to 0.
650
651 - ganymed: The distribution of observation time versus zenith
652 angle is now shown for off- AND on-data.
653
654 - ganymed: The contents of the source position plot are no longer
655 averaged, thus a lot of (fake) events between the two wobble
656 positions have disappeared.
657
658 - ganymed: There is a new tab "CutT" it contains the VsSize plots
659 with the CutT, whihc is defined in ganymed.rc, applied. It
660 is resonable to use your theta-cut for it, to see if there is
661 something strange (sparks!) in your signal-region.
662
663 - ganymed: To choose a dataset from a collection in a dataset file
664 use the new command line option "--dataset=12345"
665
666 - optim, sponde: should now properly support three off-regions.
667 Just produce your ganymed summary files with three off-regions.
668 optim and sponde will automatically get all off events from
669 all off-regions from this file. Please do not forget to
670 set the scaling in optimwobble.C properly:
671 fit.SetScaleUser(1./3);
672 it is not yet read in automatically (will follow soon).
673 In the case of fixed Scale you can also use
674 cuts.SetThetaCut(MFMagicCuts::kOn);
675 no off-cut needed.
676 Be carefull in case of three off-regions when switching on
677 scale mode. Make sure that the scale interval is set correctly.
678
679 - sponde: sponde.rc and sponde_onoff.rc are now idetical
680
681 - sponde: the resouce files have been rewritten with a lot of
682 comments and a well working parametrization for an energy estimator
683
684 - sponde: In the estimated energy versus monte carlo energy plot the
685 contents where exchanged.... fixed.
686
687 - sponde: the so called "accurate"-mode has been removed. It didn't
688 give any improvement in accuracy, only decreased execution speed.
689
690 - sponde: the so called "simple"-mode has been removed. It didn't
691 give any improvement in simple.
692
693 - sponde: the so called "refill"-mode has been removed. It was anyhow
694 not implemented.
695
696 - sponde: now checks whether the theta distribution of your on-data
697 and the theta-distribution of your Monte Carlo sample (after
698 weighting) fits. If it doesn't fit properly (eg. the Monte Carlo
699 sample is incomplete) execution is stopped. Execution can be forced
700 using the new option --force-theta. Use this option with care!
701
702 - sponde: Proper collection areas can now be constructed also from
703 Monte Carlo samples generated with different maximum impact
704 parameters. Note that in previous version you neither got
705 a warning or failure, nor was there any obvious sign that the
706 collection area was overestimated due to usage of files with
707 different maximum impact parameters.
708
709 - sponde: If MC files with different lower energy limits are used
710 the primary MC spectrum is artificially completed down to the
711 lowest energy used at all. WARNING: that this gives correct
712 collection areas ONLY if none of the events in this region would
713 survive your cuts at all.
714
715 - sponde: the output file now contains more information about
716 the spectrum (eg. the full 2D collection area histogram).
717 Note, that this information can only be written to the file
718 if it is stored automatically via command line argument.
719 If you only store the status display from within the display
720 the information is lost.
721
722 - sponde: added a new tab "Disp". It shows the residual of the disp
723 (Disp-Dist) versus several parameters and it is meant to judge the
724 quality of the disp estimator. In the ideal case the residual is zero
725 and doesn't depend on any variable. The tab is displayed after
726 CutQ and Cut0.
727
728 - sponde: added a new tab "Energy". It shows the residual of the
729 energy (lg(estimated energy)-lg(monte carlo energy)) versus
730 several parameters and it is meant to judge the quality of the
731 energy estimator. In the ideal case the residual is zero
732 and doesn't depend on any variable. In reality even a good estimator
733 can show residuals versus Monte Carlo energy. The tab is displayed
734 after all cuts.
735
736 - sponde: added a new tab "EventDist" showing the unweighted real
737 absolute number of events of your sample after cuts. This tells
738 you how many events with this energy you had in your MC files.
739 The same information you get from the error bars of the weighted
740 histograms, but this is less intuitive.
741
742 - sponde: The spectrum plots now show the crab- and 1553-spectrum
743 for comparison. It is not meant to show these curves in
744 publications, they are only for production.
745
746 - sponde: The OriginalMC tree with the events produced by corsika
747 is now processed only once
748
749 - sponde: Finally fixed most annoying bug, which has effected the
750 last bin of the collection area. It was the problem that binnings
751 of root histograms are from 1 to n (included) but there was a C-like
752 loop in sponde from 0 to n (excluded). Now the loop also includes
753 correctly under- and overflow-bins. The worse thing with this is,
754 that for the events in the highest bin not only the bin-content
755 was wrong, but also the weights applied to these events, which could
756 in pricipal effect also other parts of the distribution (eg. due
757 to energy estimation). Fortunately it effected only a few events
758 in most cases.
759
760
761
762 *** Version 1.2 (2007/05/14)
763
764 - database: The database now has two new values Unsuitable50 and
765 Unsuitable01. They express the number of pixels which are
766 unsuitable for more than 50%, respectively more than 1%, of
767 all calibrated event. It is a more accurate number than the
768 previously used numbers, because they only take the first
769 calibration (ignoring the interleaved calibrations) into account.
770
771 - database: The database now has two other new values UnsuitableMax and
772 DeadMax. They express the maximum number of pixels which were
773 unsuitable, respectively dead, during the sequence. Because
774 of high pedestal rms (cars passing) a few events with very high
775 numbers of unsuitable pixels can happen. Not to suffer from this
776 effect we don't take the highest 0.1% of the numbers into account.
777
778 - general: fixed a bug which caused callisto and star to stop working
779 properly because the callisto output was currupted
780
781 - general: a script called scripts/makemovie has been added which
782 simplified the process of producing several movies from a single
783 sequence with different setup.
784
785 - callisto: Some more code cleanup. Started to remove old obsolete
786 code from cvs.
787
788 - callisto: The extraction of the pedestal with the extractor was
789 not random. It seems that extracting at one position is still biased
790 (for example in the first or last slices we could still suffer from
791 switching noise) Now it is completely random.
792
793 - callisto: In MPedCalcPedRun (which is the pedestal extraction from
794 pedestal files) individual pixels could be skipped due to high
795 variations. This was already the case for the pedestal extraction
796 from the lo-gains since the beginning and properly handled
797 there, but was introduced in the extraction from the pedestal files
798 a while ago. To calculate the average value it was still divided
799 by the number of events procesed not by the number of summands
800 really summed. This let to a pedestal which was a tiny amount too
801 small (for a few piels in the order of 0.1%). This led to an slightly
802 positive offset of the randomly extracted pedestal for a few pixels.
803 I doubt that this has a big effect on the result, because the effect
804 on the individual numbers is quite small. Due to this it is suggested
805 that you rerun your calibration to make sure you are without any
806 avoidable bias.
807
808 - callisto: the ArrTimeRmsLimit is now is a check of the deviation from
809 the median rms of the absolute arrival time and expressed in significance
810 levels. This replaces the old meaning of an abolute upper limit. An
811 absolute upper limit doesn't make much sense, because in our data
812 all arrival times are shifted at the same time (in fact it might be
813 a shift of the artificial trigger w.r.t. to the light flash).
814
815 - callisto: Added a new tab "BadPixTm" which shows the time evolution
816 of the number of unsuitable pixels over the whole sequence. This
817 is usefull mainly to judge if an intermediate calibration had
818 problems.
819
820 - callisto: Added a new tab "DeadPixTm" which shows the time evolution
821 of the number of dead pixels over the whole sequence. Dead pixels
822 in this context are unmapped pixels, i.e. pixels which could not
823 be interpolated, and thus are ignored in the further analysis.
824
825 - callisto: It is now possible to use the position of the maximum
826 of the spline as arrival time instead of the leading edge even
827 when using the integral for the signal. Therefor set the extraction
828 type to kIntegralRel ("IntegralRelative") and the relative height
829 ("HeightTm") to -1:
830 MJPedestalC1.ExtractSignal.ExtractionType: IntegralRelative
831 MJPedestalC1.ExtractSignal.HeightTm: -1
832
833
834
835
836 *** Version 1.1 (2007/04/27)
837
838 - general: The new class MGeomCamDwarf contains the camera geometry
839 for our prefered Dwarf camera and can be used to create general
840 geometries of roundish or hexagonal cameras.
841
842 - mars: The default cleaning is now abolute 8.5/4.0.
843
844 - mars: The resource file mars.rc now contains examples for MUX data
845
846 - merpp: Implemented file format version 8 (MUX FADC data). The 16-bit
847 data containing only 10-bit information is still cooked down to
848 8-bit, by cutting away the lowest 8-bit.
849
850 - merpp: When reading raw data the data is now stored in a single
851 array. The lo-gain array is obsolete. The interface stays the same.
852
853 - callisto: To process the new MUX data use the resource file
854 callisto_mux.rc
855
856 - callisto: The -root and -raw options to read merpped raw data have
857 been removed
858
859 - callisto: If the -mc option is given the sequence-name can now be
860 replaced by the MC sequence number
861
862 - callisto: If the sequence file contains "MonteCarlo: Yes" the
863 -mc option can now be omitted
864
865 - callisto: Started further simplification by removing obsolete
866 dependancies on MCalibIntensity*Cams.
867
868 - callisto: removed unsused intensity calibration from MJCalibration
869 for further simplification
870
871 - callisto: for simplification removed references to
872 MBadPixelsIntensityCam, MCalibrationIntensityQECam,
873 MCalibrationIntensityRelTimeCam, MCalibrationIntensityTestCam,
874 MCalibrationIntensityChargeCam, and MCalibrationIntensityBlindCam
875 (this should at minimum change nothing at all, and at maximum
876 improve thing if these containers where somewhere not handled
877 properly)
878
879 - callisto: Added the option to write an event movie. Please use
880 this option with care (huge files) but exessively to understand
881 our events. For further documentation please refer to the
882 IACT wiki
883 (currently at http://www.astro.uni.wuerzburg.de/mediawiki-1.9.0)
884
885 - callisto: Improved binning for the pulse position check histogram
886
887 - callisto: The code calculating the pulse position checknow takes
888 the pedestal into account
889
890 - callisto: The arrival time is now stored with full precision this
891 helps to get rid of artefacts in histograms. For the signal this
892 is not necessray because it is displayed in log-scale anyhow
893
894 - callisto: Fixed a problem with internal exclusions. Pixels which
895 have once been marked as unsuitable didn't get the necessary
896 histograms filled anymore to be rechecked with each interleaved
897 calibration.
898
899 - callisto: The relative arrival time resolution (the rms of the
900 relative arrival time offset) is now checked against its
901 median and the median deviation, instead of the average
902 plus an absolute offset.
903
904 - callisto: The relative arrival time offset is now calculated
905 w.r.t. its median not w.r.t. to an artificial reference pixel.
906
907 - callisto: The relative time calibration now marks pixels with
908 outlaying offset as unsuitable
909
910 - callisto: The interleaved relative time calibration has been switched
911 on. The advantage is that pixels which are marked as outliers
912 now can recover. An improvement over time is not expected, because
913 the relative time calibration seems stable.
914
915 - ganymed: If the dataset file containes "MonteCarlo: Yes" the "-mc"
916 option can now be omitted.
917
918 - ganymed: If either the dataset file containes "MonteCarlo: Yes"
919 or the option "-mc" is specified as default the monte carlo datacenter
920 paths (/magic/montecarlo/...) are used if not overwritten in the
921 dataset file.
922
923 - ganymed: The output files now contain run- and event-number for all
924 events, accessible as RunNumber.fVal and EvtNumber.fVal
925
926 - ganymed: Added a plot showing the source position in the camera also
927 for wobble mode
928
929 - ganymed: In addition to the existing task which can be setup to
930 be executed after Cut1 a final task called "EstimateEnergy"
931 has been added, executed before writing the final output
932 (ganymed00000000.root). The task setup in all three cases
933 can be choosen individually. (For all three(!) cases you
934 can for example choose MRanForestCalc. For examples see all
935 sponde*.rc and all ganymed*rc)
936
937 - ganymed: If a container "MEstimatedEnergy" is found in the
938 parameter list (eg. because it was setup by MEstimateEnergy)
939 it will be written to the output file.
940
941
942
943 *** Version 1.0 (2007/02/16)
944
945 - database: Website to plot values from the database has been added.
946
947 - database: The rate of spark events as found by star is now kept
948 and the rate after cleaning is now with spark events subtracted
949
950 - general: The changes to the interpretation of phrases lead to
951 a problem with the access of MHMatrix objects (eg. "M[0]")... fixed.
952
953 - general: Added example files how you can create your own calendar
954 (eg. as christmas present) with Mars. Just run
955 root macros/tutorials/calendar.C
956
957 - general: Added a possibility to display grouped data in the plotdb.C
958 macro (and similar macros). This allows to plot hourly, nightly,
959 weekly, monthly and yearly averages.
960 For more details see the plotall function of the macro
961
962 - general: fixed the error display of the camera display. It showed
963 wrong results.
964
965 - general: fixed a memory leak when reading many MStatusDisplays
966
967 - general: added a macro (macros/tutorials/mirrordelay.C) plotting the delay
968 between a spherical and a parabolic mirror
969
970 - callisto: We have a new pulse position check which takes the properties
971 of the extractor automatically into account. So no need to set
972 ExtractWinLeft/Right anymore. Again a check for pulses too much to the
973 left is done. If possible the lo-gain extraction start and hi-gain
974 extraction end is changed accordingly. If no proper extraction range
975 can be set (hi-gain too much to the left) an error is raised.
976
977 - callisto: New swapped pixels have been found and corrected
978
979 - callisto: Redone the signal extraction this includes:
980 + Unified the algorithms to extract the pedestal for all pedestal
981 extractions done
982 + Unification of hi- and lo-gain into one array
983 + Unification of hi- and lo-gain extraction for Spline and
984 Digital Filter (means now exactly the same algorithm is used,
985 not a copy-and-pasted one)
986 + Store pedestal subtracted data in a common place
987 + Improved extraction algorithms. If the algorithms search a
988 maximum but don't find one they don't return the maximum anymore
989 + Improved the extraction such that a information for signal
990 and time which is consistent is returned
991 + replaced the numerical spline with a (not slower) analytical
992 solution
993 + Lowered the saturation limit from 250 to 245 to make sure that
994 we are far away in all pixels from problems with the clock-noise
995 + The start of the lo-gain extraction is calculated from the hi-gain
996 arrival time. In case of saturation an estimation is used.
997 + the hi-gain window was extended to slice 16. This allows extraction
998 of very late pulses in single pixels or of huge hadron showers.
999 + Now uses the lo-gain extraction range for pedestal extraction,
1000 not the hi-gain range in the lo-gain
1001
1002 - callisto: New hi-/lo-gain calibration constants have been produced
1003 for all periods from the statistic of the whole period. They are
1004 now used automatically depending on the periods. The old constants
1005 where deviation in avarega about 2%-3%. The constants are very
1006 stable from period to period (<<1%) except for exchanged channels.
1007 In a few cases the constants used so far were off by 1%-2% (maybe
1008 temperature effects?)
1009
1010 - callisto: To gain obsolete space we do not write the
1011 MPedestalFundamental anymore. Also calibration and bad pixel
1012 treatment is not done for it anymore because it has never been used.
1013
1014 - callisto: Fixed a bug in the seuqence handling which caused the
1015 light condition to be ignored
1016
1017 - star: Added two new tabs "Sparkless" and "Sparks" these tabs show
1018 basically the same as "Cleaned" but the distribution devided into
1019 the events fullfilling a spark cut or being rejected by it.
1020 This cut can be changed from star.rc (see example inside) by
1021 the "SparkCut" directive
1022
1023 - star: Star displays now the average individual pixel-rate (IPR) versus
1024 time and the average discriminator threshold (DT) of all pixels.
1025
1026 - optim: fixed a problem with the optim-macros which was due to a bug
1027 in the new phrase parsing
1028
1029 - ganymed: To get a nice FalseSource plot (instead of the all-information
1030 debug plot displayed as a standard plot) use the context menu
1031 somewhere between the two upper plots, click on "DrawNicePlot"
1032 and enjoy the result. (It is the same context menu which contains
1033 the other options)
1034 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
1035
1036 - ganymed/optim/train: The cut program, trainings- and optimization
1037 macros could run with less files found than expected from the
1038 sequence-files. No the execution is stopped in this case.
1039
1040 - ganymed: now stores the dataset in the output file with all information
1041 contained (as sequence number, sequence path, data path) so that the
1042 used dataset file can be recreated complete from the output
1043
1044 - sponde: now also allows the uasge of random forest
1045
1046 - sponde: added a plot showing the cut efficiency
1047
1048 - sponde: Using root versions < 5.13/04 still resulted in wrong binomial
1049 errors (eg. effecting the collection area) because the errors of the
1050 two histograms were swapped in the calculation, which makes a difference
1051 in the case the histograms contains weighted events. Aditionally the
1052 totalarea was incorrectly taken into account, which results in too small
1053 errors, which makes a difference at low statistics were the errors
1054 or the collection area dominate.
1055
1056
1057
1058 *** Version 0.10.3 (2006/10/23)
1059
1060 - database: Implemented ObservationMode flag in websites.
1061
1062 - database: For sequences there is now also the stoptime available on the
1063 websites.
1064
1065 - database: Removed ManuallyChanged flag from sequence-info websites,
1066 as it is not needed anymore with the new sequence building algorithm.
1067
1068 - general: MRolke.[cc,h]: Modification of TRolke from root_v5.12.00b.
1069 Class for calculation of confidence intervals (upper limits).
1070 Use model 3 or 4 for upper limit calculation for MAGIC observations.
1071 Please read the class instruction of TRolke for more information.
1072
1073 - general: The programs now return 0xfe if the requested resource file
1074 doesn't exist.
1075
1076 - general: Errors comming from root itself are now not output to
1077 stderr anymore but to our default (colored) log-stream.
1078
1079 - general: Changed the interface to TFormula such that now everything
1080 is parsed by TFormula, which should allow to use phrases even
1081 without paranthesis correctly parsed.
1082
1083 - callisto: replaced the AdHoc number of effective integration slices
1084 in the digital filter by an average of the correct number, averaged
1085 over all possible set of weights. This also gives correct numbers
1086 for the lo-gains which were totally wrong before.
1087
1088 - callisto: drastically reduced memory consumption by not storing
1089 all intermediate calibration results in memory anymore (we might
1090 write them into a file in the future)
1091
1092 - ganymed: To get a nice Theta-Sq plot (instead of the all-information
1093 debug plot displayed as a standard plot) use the context menu
1094 somewhere between the two upper plots, click on "DrawNicePlot"
1095 and enjoy the result. (It is the same context menu which contains
1096 the "DrawAll" option)
1097 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
1098
1099
1100
1101 *** Version 0.10.2 (2006/10/15)
1102
1103 - general: changed the building of the sequence files such, that
1104 the source-/project name in case of wobble-sources is not the
1105 source/project of the first data run anymore but the new generalized
1106 wobble source/project
1107
1108 - general: Added some functions to MAstro to calculate sun and
1109 moon properties
1110
1111 - general: Added two new macros (starvisday.C and starvisyear.C)
1112 which allow to plot the visibility of several stars in one day
1113 or of one star along one year
1114
1115
1116
1117 *** Version 0.10.1 (2006/10/11)
1118
1119 - general: HTML logging output was distorted... fixed.
1120
1121 - general: Changed the writing of the sequencefiles such that only
1122 as many pedestal files as giving at least 1000 pedestal events which
1123 are nearby the first calibration run are used as pedestal runs
1124
1125 - sponde: In the calculation of the collection area(s) and the
1126 distribution for MOnte Carlo and estimated energy the error
1127 calculation was wrong because root didn't take the errors
1128 properly into account... fixed.
1129
1130
1131
1132 *** Version 0.10 (2006/10/10)
1133
1134 - general: all executables now check consistency of the root version
1135 installed with the root version used for compilation. The return
1136 code in this case is 255.
1137
1138 - general: The algorithm to build seqeunces has been redesigned
1139 completly. It is now more flexible in terms of a resource file
1140 resources/sequences.rc which can be used to partly overwrite
1141 the default algorithm and defined the important part of the
1142 algorithm. It also takes correctly into account several ways
1143 of taking wobble-data. Currently the new algorithm doesn't take
1144 the number of pedestal events anymore into account (so a sequence
1145 could have much less than 1000 pedestal events and data runs are
1146 no-more used instead)
1147
1148 - general: a lot of small changes to make the code compatible with
1149 root 5.12/00 and gcc 4.1
1150
1151 - general: Fixed some warnings thrown if more warnings are switched
1152 on in the compiler
1153
1154 - general: Added a function to MMath which returns the Median of
1155 the distribution abs(y[i]-median) but at 68:32 division instead
1156 of 50:50, which is somehow the median counterpart of the rms.
1157
1158 - general: MAstroCatalog allows now to read calatog files (as bsc5)
1159 even if they are compressed with gzip (recommended compression
1160 is with "-1")
1161
1162 - showplot:
1163 + batch mode creation of image files now works with root 5.12/00
1164 + added support for writing bmp (though it never produces
1165 bmp which can be read by programs like xv or gimp)
1166 + added support for xml
1167 + added new option to start the display with a different size, by
1168 --display-width=nnn or --display-height=nnn
1169 + added options to define the canvas size when the display is started
1170 --canvas-width=nnn or --canvas-height=nnn
1171 the option can also be used for batch-mode conversion
1172 + added an option which automatically fits the display size to the
1173 desktop-size: --auto-size
1174
1175 - merpp: didn't recognize files with the extension .raw.gz - fixed.
1176
1177 - merpp: allow the reports to have 1000ms due to a bug in the camera
1178 program.
1179
1180 - callisto: New swapped pixels have been found and corrected. For
1181 details see MRawRunHeader::FixAssignment()
1182
1183 - callisto: Callisto now raises an error if one of the input files could
1184 not be opened.
1185
1186 - callisto: In some rare cases it could happen that in the signal
1187 extraction of the digital filter the extractor returned nonsense
1188 results due a wrong initializion of a variable (this happens in
1189 cases in which the extracted signal is exactly zero or the
1190 digital filter couldn't slide because of a too small extraction
1191 window, which could happen in the lo-gain extraction)
1192
1193 - callisto: The lo-gains have been marked as valid in some cases
1194 when they got not extracted at all (deltsumlo=deltatimelo=0) because
1195 the allowed extraction range (fLoGainLast-fLoGainFirst) was
1196 smaller than the number of slices (fLoGainWindowSize) needed
1197 by the lo-gain extractor
1198
1199 - callisto: Updated absolute calibration constants (muon calibration)
1200
1201 - callisto: fixed a bug which caused the hi-gain saturation not
1202 to be handled properly in the spline (the position of the
1203 saturation was calculated incorrectly)
1204
1205 - callisto: fixed a bug which gave weird results if hi- _and_
1206 lo-gain could not be extracted properly. In some cases hi-
1207 and lo-gain have not been extracted at all and the random result
1208 got calibrated. In other cases the hi-gain was saturating and the
1209 lo-gain has not been extracted. For this a completly arbitraty
1210 scale factor was applied to the result from extracting the
1211 charge of the saturating hi-gain.
1212
1213 - callisto: improves handling of extracted signal if lo- and/or
1214 hi-gain could not be extracted properly. If no appropriate
1215 calibration of either the signal or the arrival time is possible
1216 the pixel is now markes as unsuitable instead of estimated.
1217
1218 - callisto: Fixed a problem in the spline extraction which gave
1219 weird results if the signal was extracted from the first (and
1220 highest) slice (as a workaround extraction from the first
1221 slice has been forbidden)
1222
1223 - callisto: Fixed a bug regarding the use of the QE which doesn't
1224 effect the result because the default is used anyhow.
1225 (The bug was there since 14/07/2005)
1226
1227 - callisto: Changed the default for fgLoGainStartShift to -2.4
1228
1229 - callisto: Fixed a bug which caused all hi-/lo-gain calibration
1230 factors to be always 10 for all pixels as soon as the first
1231 calibration update has happend.
1232
1233 - callisto: Fixed the hi-/lo-gain offset for the Digital Filter. It
1234 was off by more than one slice (which gives wrong values for
1235 pixels which have saturated the hi-gain) This was a problem
1236 mainly for timing studies, not so much for the automatic standard
1237 analysis. Also the values for the Spline have been changed slightly:
1238 + Digital Filter from 1.70 to 0.95
1239 + Spline from 1.39 to 1.30
1240 The numbers were sorted out by an extensive test in the
1241 test-database.
1242
1243 - callisto: Removed the tab showing the average calibrated arrival
1244 time. It never gave useful information.
1245
1246 - callisto: Now tab "HiLoCal" which shows the ratio between hi- and
1247 lo-gain pulse for data pulses if hi- and lo-gain have saturated
1248 and both were extracted because the hi-gain was above the
1249 LoGainSwitch.
1250
1251 - callisto: Now tab "HiLoOff" which shows the offset between hi- and
1252 lo-gain pulse position (after application of LoGainOffset, which
1253 means in the ideal case it is 0) for data pulses if hi- and lo-gain
1254 have saturated and both were extracted because the hi-gain was above
1255 the LoGainSwitch.
1256
1257 - callisto: After extensive tests a new threshold level for determination
1258 of the pulse position has been found at 50phe. This is due to the
1259 fact that for lower pulses the arrival time changes its average
1260 behaviour dramatically. It tends to the average of the extraction
1261 range and starts sticking to non-floating point numbers (5, 6, 7, ...)
1262
1263 - callisto: Added two more plots to the calibration part. The average
1264 extracted signal and the average extracted arrival time as
1265 extracted by the signal extractor (This can help debugging problems
1266 because it doesn't involve a fit)
1267
1268 - star: changed the fit for the effective on time such that initial
1269 values are calculated automatically now instead of using build
1270 in values. This makes the fit more indepedant of the underlaying
1271 rates. With a test of ~350 sequences in the test database it could
1272 be shown that the new fit gives the same result +/-1sek.
1273 The highest deviation was +5s the lowest -10s. You can now control
1274 the bahaviour with two resource values:
1275 MHEffectiveOnTime.FistBin: 3
1276 MHEffectiveOnTime.NumEvents: 12000
1277 Use FirstBin=1 and NumEvents=120 to fit the effective on time
1278 from the resulting gamma candidates
1279
1280 - star: The Center histogram in MHHillas is now by default displayed
1281 with the colz draw-option
1282
1283 - ganymed: now produces valid error codes if failed
1284
1285 - ganymed: MFMagicCuts now supports a hadronness cut. Switch it on
1286 with the option "hadronness" instead of "area" or "both" if
1287 you want to use both cuts. The hadronness cut includes a fixed
1288 cut in hadronness (index 8) and a fixed cut in size (index 9).
1289
1290 - ganymed: MFMagicCuts: fixed abug introduced 2005/7/14 which caused
1291 the M3Long of the anti source to be not properly evaluated
1292 (actually is was evaluated as a unique random number) in case
1293 of optimization with anti-theta cut switched on. This might have
1294 lead to improper, but not necessarily wrong, optimization results.
1295
1296 - ganymed: ganymed_onoff.rc, ganymed_wobble.rc - updated with comments
1297 how to use random forest
1298
1299 - ganymed: use the same spark cuts as in ganymed_wobble.rc as in
1300 ganymed_onoff.rc. Seems to be unintentional that they were different.
1301
1302 - sponde: Since the introduction of the possibility to define a
1303 normalization energy instead of using the integral the default
1304 was not using the integral anymore but a normalization energy of
1305 1GeV. It is now the integral again.
1306
1307 - sponde: Fixed a problem in the weighting which did not allow
1308 a MC slope of -1.
1309
1310
1311
1312 *** Version 0.9.6 (2006/05/24)
1313
1314 - general: changed the binning of the azimuthal profile of the camera
1315 such that it is aligned with the 60deg boundaries.
1316
1317 - merpp: better handling of problems with the TH, TD part of the
1318 CC-REPORT for files older than 200507190 and 200412210
1319 respectively
1320
1321 - merpp: improved handling of RECEIVERS-COM-ERROR in CC-REPORT
1322
1323 - merpp: implementd latest changes in starguider reports (sinc 9th May)
1324
1325 - callisto: if an arrival time is extracted outside the fadc range is
1326 was set to the boundary before. Now a random number is assigned
1327 instead to avoid unfortunate coincidences of arrival times just
1328 by this arbitrary value.
1329
1330 - callisto: added a new option to callisto.rc which allows
1331 to set the maximum arrival time difference allowed for the
1332 badpixel algorithm to determin whether a pixels belongs to a shower:
1333 MJCalibrateSignal.MBadPixelsTreat.MaxArrivalTimeDiff: 0.9
1334
1335 - callisto: changed the old value (0.5) for MaxArrivalTimeDiff
1336 to 0.9 as suggested by Stefan due to a recent study on the fraction
1337 of pixels surviving the image cleaning
1338
1339 - callisto: switched off error in case of "pulse is too much to the left"
1340
1341 - callisto: The extraction window is not adapted anymore. This means that
1342 the pulse is extracted from the full range. The draw-back is that the
1343 background (pedestal) will become slightly higher. Switching on/off
1344 the PulsePosCheck in the callisto.rc only effects filling the
1345 histograms.
1346 WARNING: If the pulse is too much to the left data is calibrated!
1347 Check the PulsePosCheck-PulsePosition AND the Inhomogeneity parameter
1348 in the database to make sure that your data is valid!
1349
1350 - star: Show also the number of stars correlated correctly by the
1351 starguider
1352
1353 - ganymed: implemented a new class (MHThetaSqN) which allows to use more
1354 than one off-source region in wobble-mode. To use it add the following to
1355 your ganymed_wobble.rc:
1356 + MJCut.NameHist: MHThetaSqN (switch the new feature on)
1357 + MHThetaSqN.NumOffSourcePos: 3 (define number of off-regions)
1358 + MHThetaSqN.DoOffCut: Yes,No (switch on/off the off-cut)
1359 + Cut1.ThetaCut: None
1360 + MHThetaSqN.SignificanceCutLevel: 2.0 (increase off-cut by 2.0/1.7)
1361
1362 - ganymed: in the case the latest report is older than a default (currently
1363 one minute) and the current report will be skip the starguider
1364 correction and calibration will be reset. The maximum age can be
1365 setup from ganymed.rc by (minutes):
1366 MPointingDevCalc.MaxAge: 1.5
1367
1368 - ganymed: A first implementation showing all size-bins for the theta-sq
1369 resp. alpha-plots in a single tab automatically
1370
1371
1372
1373 *** Version 0.9.5.1 (2006/05/05)
1374
1375 - general: Added a new option "zdiff" to the Makefile which runs
1376 "cvs diff" as "make diff" would do, but with compression
1377
1378 - general: accelerated MTFillMatrix (used for eample in all training
1379 and optimization macros) by skipping some obsolete calles in the
1380 eventloop the first and second loop could be accelerated by ~20%
1381
1382 - general: Added a missing feature in the MFilterList class which
1383 prevented MFEnergySlope from working correctly in trainenergy.C
1384
1385 - general: Accelerated the random forest training and usage a bit
1386
1387 - merpp: Adapted to new raw data file format version 6
1388
1389 - merpp: fixed a problem with reading the starguider reports
1390 after 6.3.2006
1391
1392 - callisto: At some times six pixels had to be exchanged manually in the
1393 data. If the pixels to be swaped are both not found, an error was raised
1394 and calibration was stopped. Now it is assumed they are intentially not
1395 mapped and the Error has been changed to a Warning.
1396
1397 - star: Added new image cleaning based on the arrival time of the shower.
1398 The new cleaning can be accessed using the parameter "Time" instead of
1399 the the old one (like "Absolute) in the star.rc-file.
1400 Recommended parameters:
1401 + MImgCleanStd.CleanLevel1: 8.2
1402 + MImgCleanStd.CleanLevel2: 5
1403 + MImgCleanStd.CleanRings: 2
1404 + MImgCleanStd.KeepSinglePixels: No
1405
1406 - star: Simplified the calculation of the effective on time. By letting
1407 the fit start in the third bin the result should become more stable.
1408 The fit quality is now ignored for the theta-plot which is not used
1409 in the analysis later. Still better pre-cut which, for example,
1410 remove events triggered by car-light (rate changing on a short
1411 time-scale) are missing.
1412
1413 - macros: optimonoff.C, optimwobble.C: implemented a new strategy
1414 for optimization (kWeakSource) which is suggested by the Berlin
1415 people for weak sources.
1416
1417 - macros: plotdb.C:
1418 + if no dataset and no time-interval is given only sequences with
1419 an effective on-time above five minutes are plotted anymore
1420 + added a new tab "RelTime" displaying the relative on-time
1421 (effective on-time divided by the observation time)
1422
1423 - macros: optim*.C: by skipping some obsolete calles in the eventloop
1424 the optimization became a lot faster
1425
1426 - ganymed: In the second loop the MHNewImagePar histograms disapeared.
1427 To display them just delete the pads displayed on top.
1428
1429 - ganymed: fixed a bug which could cause strange behaviour in wobble
1430 mode if no starguider information was available due to an incorrect
1431 initialization of the starguider calibration
1432
1433 - ganymed: The scale region in the False Source Plot (MHDisp) can now
1434 be changed from within the plot. It can also be setup from the
1435 resource file using:
1436 + MHDisp.fScaleMin: 0.325
1437 + MHDisp.fScaleMax: 0.475
1438
1439 - ganymed, showplot: Fixed a problem with the fit to the off-data
1440 (HistOff) which could cause a time lag or an inifinite loop.
1441 The bug did not effect the results at all.
1442
1443 - sponde: Added a new tab showing the effective collection area after
1444 trigger (including the software trigger)
1445
1446 - sponde: MMcSpectrumWeight has a new option which allows to define
1447 the scaling factor not by the integral of the events but at
1448 a defined energy:
1449 e.g. MMcSpectrumWeight.NormEnergy: 200
1450
1451 - MTFillMatrix, sponde: by skipping some obsolete calles in the
1452 eventloops the loop could be accelerated by ~20%
1453
1454
1455
1456 *** Version 0.9.5 (2006/03/13)
1457
1458 - macros: fixed a typo optimwoble.C (SetThetaCut instead SetAlphaCut)
1459 and added the standard Disp-parametrization
1460
1461 - macros: added a new macro datacenter/macros/plotstat.C allowing
1462 to plot statistics about the data processing
1463
1464 - macros: added a new macro to plot the muon correction coefficients
1465 versus period (macros/plot/mucal.C)
1466
1467 - showplot: path inflation for ganymed files was broken
1468
1469 - callisto: Fixed an important bug. When the number of saturating pixels
1470 were calculated the bad pixel information already available from the
1471 calibration was ignored. This yields wrong values in case pixels
1472 are broken and saturate all the time or randomly.
1473
1474 - callisto: Updated Muon calibration constants. Spline data now also uses
1475 different values for different periods
1476
1477 - star: The time-evolution shown in the effective on-time plot now displays
1478 the axis range (if there are no holes it should be similar to the
1479 effective on-time)
1480
1481 - star: Added two new image parameters:
1482 + MNewImagePar.fConcCOG: The ratio of the equivalent signals of
1483 the three pixels next to the center of gravity and the size
1484 + MNewImagePar.fConcCore: The ratio of the signals of all
1485 pixels inside or touching the ellipse and the size
1486
1487 - ganymed: now stops in requested source isn't found in catalog file
1488
1489 - ganymed: Many improvements to the phi-plot in wobble mode:
1490 + with a template the ideal background is displayed
1491 + a possible camera inhomogeneity is taken into account
1492 + the anti theta cut is better supported
1493 + the phi cut is automatically calculated from the theta cut
1494 See the examples in ganymed_wobble.rc for more details.
1495
1496 - ganymed: fixed plot for E^2*dN/dE. The spectrum was multiplied with two
1497 times the bin-width instead of the absolute energy
1498
1499 - ganymed: New cuts for on/off and wobble mode
1500
1501 - ganymed: The smearing of the False Source plot has been increased
1502 to 0.06
1503
1504 - ganymed: The starguider calibration can now be changed from the
1505 resource file.
1506 See the examples in ganymed*.rc for more details.
1507
1508 - ganymed: added a new option for on-/off-observations
1509 MJCut.RandomSourcePosition
1510 If switched on the distribution of observation time of the source
1511 position in the camera is calculated from the on-data and randomly
1512 applied with this distrbution to the off-data.
1513
1514 - ganymed: by skipping some obsolete calles in the eventloop the
1515 first and second loop could be accelerated by ~20%
1516
1517 - ganymed: The default in ganymed_onoff.rc is now to determin the source
1518 position in the off-data randomly according to its distribution in the
1519 on-data.
1520
1521
1522
1523 *** Version 0.9.4.3 (2006/02/13)
1524
1525 - general: Fixed a bug in most of the programs which prevented the
1526 compile date in the startup message to be displayed
1527
1528 - general: Simplified program calls. The following abbreviations
1529 are now possible:
1530 showlog callisto 55599
1531 showplot signal 55599
1532 star 55599
1533 callisto 55999
1534 ganymed 2
1535 In this cases the corrsponding root-, log-, sequence- or dataset-
1536 filename is automatically compiled using the default datacenter
1537 paths ("/magic/*")
1538
1539 - general: Fixed a long outstanding bug which made axis tick marks
1540 disappear if MDataFormula was used (eg. abs(x))
1541
1542 - general: Updated MMath with new functions to calculate the results of
1543 a exponential, logarithmic and powerlaw fits analytically.
1544
1545 - general: Updated some macros with comments:
1546 + macros/optim/optimdisp.C
1547 + macros/optim/optimenergy.C
1548 + macros/optim/optimwobble.C:
1549
1550 - general: MTFillMatrix (the class to fill one or two MHMatrix from
1551 files) now allows adding a pre-cut like in the optimization. E.g. this
1552 is useful to perform g/h-separation cuts before training the random
1553 forest.
1554
1555 - general: Between the rund 53300 and 68754 the pixels 553-558 were not
1556 correctly assigned in the raw data assignement table. A fix to correct
1557 the assignment tabel have been implemented.
1558
1559 - general: MAstroCatalog now allows rotating of the sky-grid and stars
1560 by 90, 180 and 270 deg.
1561
1562 - general: the macro plotdb.C now allows to highlight sequences belonging
1563 to a datset. For more details see the descritions in the macro.
1564
1565 - StatusDisplay: Fixed the algorithm to calculate the size ratio
1566 of the display, it gave wrong results espacially for big sizes.
1567 Now the embedded canvas should always have a ratio width/height=3/2.
1568 The "Size" options have been updated with values fitting the 3/2
1569 size ratio.
1570
1571 - RanForest:
1572 + Updated the random forest classes to support also the
1573 regression method implemented by Thomas H.
1574 + added new tutorial macro how to train the random forest
1575 for energy estimation (macros/optim/rfenergyest.C)
1576 + new classes to train the random forest (still in development)
1577 mjtrain/MJTrainEnergy, mjtrain/MJTrainDisp, mjtrain/MJTrainSeparation
1578 + new tutorial macros for random forest training in macros/train
1579 trainenergy.C, traindisp.C, trainseparation.C
1580
1581 - mars: now allows to setup a cut in the resource file mars.rc to choose
1582 the events to be displayed, eg:
1583 Cut.Condition: {0} && {1}
1584 Cut.0: MHillas.fSize>100
1585 Cut.1: MHillas.fSize<900
1586
1587 - merpp: Made aware of the new .rep format 200510250. This includes
1588 interpretation of the Receiver Board Temperatures (MCameraRecTemp),
1589 the discriminator thresholds (MCameraTD) and the disciminator
1590 delays (MCameraTD). All of them come with the CC report and are therefor
1591 written to the CC tree.
1592
1593 - callisto: fixed a bug in the calculation of the arrival times in
1594 the Digital Filter. They were all shifted by the same amount
1595 fHiGainFirst. This caused an offset in the order of the position of
1596 the left border of the extraction window in the times calculated
1597 from high-gain and from low-gain. The bug effected only the absolute
1598 arrival times. The bug was there since 30.1.2005.
1599
1600 - callisto: Changed the ExtractionWindow for the pulse position check
1601 such that the camera inhomogeneity becomes as less as possible and
1602 comparable to the pulso position check switched off. More details
1603 on the study will be given at our result web-page.
1604
1605 - ganymed: ganymed.rc, ganymed_onoff.rc:
1606 changed to new cuts trained with 1ES1218 and Crab-data
1607 for maximum sigma*log10(excess)
1608
1609 - ganymed: In addition to the Hadronness calculator (CalcHadronness)
1610 a new option was implemented to estimate Disp (CalcDisp)
1611
1612 - ganymed: Implemented two new options which allow
1613 to overwrite the default path to search for the sequence files
1614 --ins=/magic/sequences
1615 and where to search for the image data
1616 --ind=/magic/data/star
1617
1618 - ganymed: MSrcPosCorrect now allows overwriting of the misfocussing
1619 dx/dy from the resource file by
1620 MSrcPosCorrect.Dx
1621 MSrcPosCorrect.Dy
1622
1623 - ganymed: fixed reading the source catalog. Only as many chars
1624 as the requested source name had were compared (If a source
1625 "1ES1218" and "1ES1218+304" were in the catalog and "1ES1218+304"
1626 were requested it could happen that the coordinates of
1627 "1ES1218" were read) The source coordinates are now printed
1628 in addition to its name to the logging output.
1629
1630 - ganymed: changed the background fit in the case of a ThetaSq function
1631 from a polynomial to a exponential, this should give a big improvement
1632 for on-only analysis'
1633
1634 - ganymed/sponde: Calculation of the error of single size-/energy-
1635 bins now uses Li/Ma (5) instead of LiMa (17)
1636
1637 - sponde: Added a plot E^2*dN/dE
1638
1639 - sponde: The energy estimator plot should now show values like
1640 they are commonly used.
1641
1642 - sponde: Now MMcSpectrumWeight also excepts formulas with two X
1643 (a powerlaw with cutoff didn't work before)
1644
1645
1646
1647 *** Version 0.9.4.2 (2005/10/01)
1648
1649 - general: added new tutorial macro macros/tutorials/threshold.C:
1650 how to calculate the threshold
1651
1652 - general: added a new game. Start it from the interpreter with
1653 MagicJam j; (other games are: MineSweeper, MagicSnake, MagicDomino
1654 and MagicReversi)
1655
1656 - general: neighbor pixels in MGeoms are now sorted clockwise
1657
1658 - merpp: made aware of new format 20050829-0
1659
1660 - callisto: New scale factors from muon analysis, stored in new
1661 resource file resources/calibration.rc
1662
1663 - callisto: MBadPixelsCalc now raises an error instead of simply stopping
1664 the eventloop if something went wrong. This is necessary for the
1665 automatic processing
1666
1667 - callisto: Implemented a new treatment for the time information
1668 developed by S.Ruegamer, this should give much better response than
1669 the old very primitive algorithm. This is especially important
1670 for bad pixels due to bright stars as Ceta-Tauri (btw: the old
1671 treatment was buggy! As neighbor pixels to interpolate the
1672 arrival times always the pixels 0 to 5 were taken)
1673
1674 - callisto: In addition to the new treatment of arrival times the
1675 decision of the treatment whether a pixel contains shower
1676 information or not is used to improve the signal interpolation
1677 further. Previously interpolated pixels showed a non-zero signal
1678 do the peak searching signal extractors. Having a signal pixel
1679 beside raised the signal above the cleaning level. Thus the
1680 pixel survived cleaning to often but with a too low mean signal.
1681 By replacing empty pixels with a gaus (mean and rms from the
1682 corresponding Area entries in MPedPhotCam) this effect can
1683 be supressed.
1684
1685 - callisto: The status "unmapped" (for pixel which cannot be interpolated)
1686 got lost when the events were stored by the calibration... fixed.
1687 (This was no problem for normal image cleaning because the pixel
1688 content was artificially set to 0 not surviving standard cleaning
1689 algorithm)
1690
1691 - callisto: Fixed a bug which caused the random and peak-search pedestal
1692 extracted with an extractor to be exchanged for the first (roughly)
1693 500 events (*Extractor and *ExtractorRndm).
1694 (They were simply exchanged in callisto.cc) This bug might have been
1695 introduced in Mars 0.9.4 when the order of calculation of the two
1696 types of pedestal in callisto got exchanged. The bug only effects
1697 the first seconds of data of each sequence.
1698
1699 - star: Taking the arrival time of Muons into account the calculation
1700 of the parameters could be made independant of the noise
1701 (pedestal rms). The dependance was due to the bias of the peak search
1702 extractor. Now only a ZA dependamcy is left which is not yet fully
1703 understood.
1704
1705 - ganymed: The sequences were still not sorted correctly in any case,
1706 because they were sorted by the full qualified path name. Now they
1707 are sorted by their sequence number.
1708
1709 - ganymed: new values for the spark-event-cut
1710
1711 - sponde: required missing MEnergyEst from ganymed.root... fixed.
1712
1713
1714
1715 *** Version 0.9.4.1 (2005/08/18)
1716
1717 - callisto: fixed some problems with the calibration in case of
1718 inteleaved events. Therefor the final and some intermediate
1719 fits are skipped which would take place on partly filled #
1720 histograms and gave wrong results or failed completely.
1721
1722 - callisto: If the intermediate finalization of the histograms
1723 calculating the mean charge of the calibration signal fails
1724 it is counted now and printed in PostProcess of MCalibCalcFromPast.
1725
1726 - ganymed: Fixed some bugs which caused problems in On-only mode.
1727 Still the false source plot doesn't give reasonable results.
1728
1729
1730
1731 *** Version 0.9.4 (2005/08/05)
1732
1733 - general: Fixed the ZA binning. It did not correctly fit the
1734 MC binning
1735
1736 - general: Added a class to correct for the missfocussing in
1737 April (MSrcPosCorrect)
1738
1739 - general: Random Forest energy estimator should now work properly
1740
1741 - general: MHCamera now displays the profiles in deg instead of mm
1742
1743 - general: MH::SetPalette offers a lot of new palettes
1744
1745 - general: MHillas - the case of CorrXY==0 is now handled properly
1746
1747 - general: implemented the possibility to change the line and
1748 marker style of a sky-grid drawn by MAstroCatalog
1749
1750 - general: Runs in sequences and datasets are now automatically
1751 ordered (it is assumed that the order of their filenames correctly
1752 represents the order of observations) to ensure correct reading
1753 of the subsystem data
1754
1755 - general: Runs cannot be added to a sequence twice anymore. Also
1756 Sequences cannot be added twice anymore to a dataset.
1757
1758 - general: fixed a bug in MAstro::Deg2Hms reported by Abelardo.
1759 It gave wrong results by 1./2pi
1760
1761 - showplot: got a new option to start a root interpreter, too
1762
1763 - mars: now displays a rough estimate of Disp and the third moment
1764
1765 - mars: now displays the event time MTime if available
1766
1767 - mars: show muon parameters graphically
1768
1769 - mars: now the file to open can be given as commandline
1770 argument
1771
1772 - merpp: Added support for new arehucas version >= 200507190
1773 implementing values for three temperature sensors in the
1774 counting house (MCameraAUX) and the name of the HV settings file
1775 (MCameraHV).
1776
1777 - merrp: Also fixed some problems with wrong versions numbers stated
1778 by arehucas and implemented some fixed for old versions (<200407070)
1779
1780 - callisto: MCalibrationHiLoCam can now be printed from its context
1781 menu, eg in the TBrowser
1782
1783 - callisto: fixed logain offset (fgOffsetLoGain) from 1.7 to
1784 - 1.39 (MExtractTimeAndChargeSpline)
1785 - 1.40 (MExtractTimeAndChargeDigitalFilter)
1786 This is important mainly for timing studies.
1787
1788 - callisto: Changed limits in MHCalibrationChargeCalc from
1789 - -100.125 to -98 (fgChargeHiGainFirst)
1790 - 1899.875 to 1902. (fgChargeHiGainLast)
1791 - -100.25 to -99 (fgChargeLoGainFirst)
1792 - 899.75 to 901. (fgChargeLoGainLast)
1793 Introduced new limits:
1794 - fgNumLoGainBlackoutLimit: 0.05
1795 - fgLoGainBlackoutLimit: 3.5
1796 - fgLoGainPickupLimit: 3.5
1797
1798 - callisto: The handling of automatic weights for the digital filter
1799 has been improved. There are now new calibration weights special
1800 for Monte Carlo calibrations.
1801
1802 - callisto: Updated Muon scale with latest results (1% difference
1803 for most data, 5% for Mar/Apr'05)
1804
1805 - callisto: use a new criterium to exclude bad pixels: If the high-gain
1806 was saturated and the blackout-events in the low-gain exceed the
1807 fNumLoGainBlackoutLimit, the pixel is declared unsuitable.
1808 This excludes those pixels which have a saturating high-gain
1809 channel, but the low-gain switch does not switch often enough
1810 to make the distribution reliable.
1811
1812 - callisto: fix a bug counting the number of saturated events. Up to now,
1813 the number of saturated slices was counted (which is one for a not too
1814 high number), but for some (pathological) pixels, many more slices
1815 saturated and produced wrong limits.
1816
1817 - callisto: New options in in callisto.rc for MCalibrationRelTimeCalc:
1818 + MCalibrationRelTimeCam.CheckFitResults: Yes
1819 + MCalibrationRelTimeCam.CheckDeviatingBehavior: Yes
1820 + MCalibrationRelTimeCam.CheckHistOverflow: Yes
1821 + MCalibrationRelTimeCam.CheckOscillations: Yes
1822
1823 - callisto: introduce max. number of events for intercalibration,
1824 the rest gets skipped. Default: 4096
1825 The calibration causes too many un-reliable pixels if more
1826 than about 5000 events are treated (@500 Hz) because of the
1827 mode hopping of the VCSels. However, in the past, some
1828 calibration runs have been taken (erroneously) with more
1829 than 5000 events, especially the intensity scans where
1830 a good precision is needed.
1831
1832 - callisto: Set UseExtractorRes to kTRUE, will raise the number of
1833 photo-electrons for the spline extractor by 1-2% (correctly).
1834
1835 - callisto: The intercalibration is now done using a full f-factor
1836 method instead of a simple update. This makes things slower but
1837 more reliable in terms of gain-fluctuations and sudden VCSEL gain
1838 changes.
1839
1840 - callisto: MPedestalY3 now uses the same extraction range as the data
1841 as calculated by MPedestalY2
1842
1843 - callisto: A check of the fraction of allowed unsuitable (10%) and
1844 unreliable (30%) pixels has been addded when the conversion is
1845 calculated from interleaved events
1846
1847 - star: fixed a bug which caused MEffectiveOnTime containers not to
1848 be written. In the worst case they were skipped almost all, in the
1849 best case they were all ok. It depends on how often the new value
1850 was assigned just with an event which was skipped later by another
1851 task
1852
1853 - star: new histograms MHPointing and MHRate
1854
1855 - star: New tab (Currents) displaying the time evolution of the mean
1856 DC currents
1857
1858 - star: New tab (MeanRms) displaying the time volution of the mean
1859 Pedestal Rms
1860
1861 - star: Output now contains MReportStarguider
1862
1863 - star: Improved muon analysis. Due to the absense of a constant
1864 for the gaus fit for arc width and the fact that the arcwidth
1865 plot was a histogram instead of a profile the resulting psf
1866 became pedestal rms dependant
1867
1868 - ganymed: added new plot (MHPhi) for wobble mode as described in
1869 http://www.astro.uni-wuerzburg.de/results/ringmethod/
1870
1871 - ganymed: corrects now (correctly?) for the misspointing in
1872 May/April 05
1873
1874 - ganymed: Two new default templates for ganymed.rc are avilable:
1875 ganymed_onoff.rc and ganymed_wobble.rc
1876
1877 - ganymed: The first version of MFMagicCuts has been released
1878
1879 - ganymed: the Conc1 plot was incorrectly scaled in MHVsSize
1880
1881 - ganymed, sponde: There are two new options to determin the number
1882 of bins for the signal region (NumBinsSignal) and the number of
1883 total bins (NumBinsTotal) in the MHThetaSq histogram
1884
1885 - ganymed: optimized palettes for MHDisp
1886
1887 - ganymed: Fixed an important bug when using ThetaSq as fit function:
1888 The result for the sigma of the gauss(sqrt(x)) fit was a factor
1889 sqrt(2) to large
1890
1891 - ganymed: The false source plot (MHDisp) is now based on Disp
1892 and a background model determined in the first loop is
1893 subtracted
1894
1895 - ganymed: MFMagicCuts are now available in the cvs. The correct
1896 solution for the disp ambiguity problem is now calculated using
1897 the third moment. The third moment cut therefor is skipped.
1898
1899 - ganymed: Output now contains "Disp [MParameterD]" which sign is
1900 already determined by the third moment along the major axis and
1901 so its actual sign is aligned along the major axis of the shower.
1902
1903 - ganymed: If starguider data is available it is taken into account
1904 when calculating the source position. This is especially important
1905 for wobble data at high zenith angles and culmination data.
1906
1907 - ganymed: If available the starguider data is taken into account as
1908 good as it is possible without a starguider calibration. To switch
1909 it off add
1910 MPointingDevCalc.MaxAbsDev: -1
1911 to your ganymed.rc
1912
1913 - sponde: the zenith angle distribution is now weighted instead of
1914 choosen by default. This gurantees higher statistics in the highest
1915 and lowest energy bins. To switch this behaviour off use...
1916
1917 - sponde: now automatically displays the energy threshold
1918
1919
1920
1921 *** Version 0.9.3 (2005/06/03)
1922
1923 - general: MMcEvt now derived from MMcEvtBasic which should
1924 have no influence on compatibility with older camera files
1925
1926 - general: Implemented a new option to MReadReports which allows
1927 to force reading of the first event of some trees (eg. Drive-tree)
1928 before any other tree.
1929
1930 - general: Made a fix to MPointingPosCalc which assumes that the
1931 run-type is real-data if Process is called before ReInit, such
1932 that also the very first Drive-events in a run are treated
1933 correctly.
1934
1935 - shoplot now displays the filename in the title bar of the window
1936
1937 - merpp: new options: --auto-time-start --auto-time-stop which
1938 allow to cut updating with slow-control at the start- or
1939 (previousle --auto-time only allowed: and) stop-time of
1940 the run stored in the runheader.
1941
1942 - callisto: changed default of fgFallTimeHiGain in
1943 MExtractTimeAndChargeSpline from 1.5 to 0.5. 0.5 was
1944 already set as default in callisto_Dec04Jan05.rc
1945
1946 - callisto: the digital filter (MExtractTimeAndChargeDigitalFilter)
1947 now changes the filename for new weights automatically for
1948 cosmics, MC and for different calibration colors.
1949
1950 - callisto: a problem with the order of some code cause the
1951 name of the weights file in MPedestalY2 to be ignored.
1952 Wrongly the calibration_UV weights were used instead
1953 of the cosmics weights set in callisto.rc.
1954
1955 - callisto: should allow ct1 pulser data when the color is
1956 explicitly set also for pretty new runs
1957
1958 - callisto: a new option (MCalibrateData.ScaleFactor) allows
1959 to introduce an additional scale factor (should be around 1)
1960 to adapt for slight deviations in different extractors from
1961 the MC calibration. For MC calibrations the scale factor
1962 is fixed to 1
1963
1964 - callisto: MFCosmics should handle very high signals a bit
1965 more accurate now
1966
1967 - callisto: when calculating the mean pedestal rms for different
1968 pixel sizes or sectors also kUnsuitableEvt is now taken into
1969 account - not only kUnsuitableRun
1970
1971 - callisto: '-raw' option is now the default
1972
1973 - callisto: A dead pixel check has been implemented in MJPedestalC2.
1974 This has the advantage that mean values in the calibration (eg
1975 arrival times) are calculated more accuratly.
1976
1977 - callisto: In the resource file callisto_Dec04Jan05.rc
1978 MJPedestalY2.ExtractWinRight has been reduced from 4.0 to 2.0
1979
1980 - callisto: new Hi-/Lo-Gain intercalibration constants
1981 hilocalib_sp1.root and hilocalib_sp1_mc.root
1982
1983 - callisto: changed default for MJPedestalY2.MaxEvents
1984 from 2000 to 5000 like in callisto_Dec04Jan05.txt
1985
1986 - callisto: in MCalibrationChargeCalc the limit fgPheErrLowerLimit
1987 has changed from 9.0 to 6.0. This is necessary to exclude two very
1988 ringing pixels in September which - when kept - destroy the image
1989 cleaning around them (Markus G.)
1990
1991 - callisto: (!) The Muon analysis of all data taken so far has
1992 suggested that different extractors give slightly different
1993 absolute results after calibration, due to there different
1994 handling of the calibration- and cosmics pulse shape. Although
1995 the over all calibration seems to be a bit to pesimistic (or
1996 the MC seems to be a little bit - 3-5% - too much attenuated).
1997 There for correction factors have been introduced which correct
1998 the calibration constants by
1999 0.956937799 for Digital Filter (callisto.rc)
2000 and
2001 0.904159132 for Spline (callisto_Dec04Jan05.rc)
2002 calibration. The main advantage is, that both data types can
2003 be easily analysed together and compared to the same MC sample.
2004 The factors are choosen such, that the reference is now a
2005 Monte Carlo sample calibrated with Digital Filter (callisto.rc)
2006
2007 - star: fixed a bug which caused the first bin of the histograms
2008 vs time to disapear in PostProcess. This gave wrong results
2009 on the screen. The output and all following programs not
2010 directly accessing the histograms haven't been affected
2011
2012 - star, ganymed: Made sure that always the first Drive-tree event
2013 is read and Processed before the first data event was read.
2014
2015 - ganymed: implemented the possibility to replace the standard
2016 false source plot with a different one. For example: If
2017 you want to use a Disp based FS plot use the resource:
2018 NameHistFS: MHDisp
2019 For details about the requirements of these plots look
2020 at the corresponding classes
2021
2022 - MJOptimize: For On/Off and Wobble optimization MJOptimize
2023 has been replaced by MJOptimizeCuts. To use MHThetaSq instead
2024 of MHAlpha call MJOptimizeCuts("MHThetaSq"). Make sure in this
2025 case MAlphaFitter is setup correctly. For On-Only optimization
2026 MJOptimize has been Replaced by MJOptimizeCuts, too. Call
2027 RunOn() instead of Run(). For energy estimation MJOptimize
2028 has been replaced by MJOptimizeEnergy
2029
2030 - sponde: The input MC spectrum can now be weighted to fake a
2031 different spectrum. This is done via MMcSpectrumWeight. For
2032 more details see the class description and sponde.rc
2033
2034 - sponde: The paremeter comparsion plots are not scaled by
2035 their entries anymore. Instead the MC plot is scaled by using
2036 the result spectrum of the analysis. If the input MC spectrum
2037 and the result spectrum has different slopes the absolut
2038 normalization is normally wrong.
2039
2040
2041
2042 *** Version 0.9.2 (2005/05/20)
2043
2044 - general: Changed the default paths for calibrated data and image
2045 files. (The implemented access to these files doesn't yet exist)
2046
2047 - general: support for MRunIter has been removed from the job classes
2048 (use the setter functions of MSeqeunce instead)
2049
2050 - general: ProcessFile has been renamed to Process in all job classes,
2051 because ProcessFile is missleading
2052
2053 - general: The storage of the palette in MHCamera is now possible
2054
2055 - general: new bits describing unsuitable and unreliable pixels have
2056 been introduced in MBadPixelsPix: kPreviouslyExcluded,
2057 kDeadPedestalRms, kFluctuatingArrivalTimes
2058
2059 - general: fixed reading of CC-REPORTS (weather data) for Arehucas file
2060 versions newer than V200404070
2061
2062 - general: support for cc file versions newer than V200504130. Added
2063 support for active loads (MCameraActiveLoad) and central pixel
2064 (MCameraCentralPixel)
2065
2066 - general: added new histograms for image parameters versus size
2067 (MHVsSize)
2068
2069 - general: The eventloop now automatically calls PrintStatistics
2070
2071 - Status Display: Improved support for printing:
2072 + A default can now be set in .rootrc (for more details see
2073 MStatusDisplay::PrintPS)
2074 + A print dialog is opened so that printer and command line
2075 can be canged
2076
2077 - showlog: improved such that it handles different verbosity levels
2078 more accurate now. This mean you can suppress output when
2079 using showlog.
2080
2081 - showplot: improved
2082 + The new graphics formats have been implemented
2083 (pdf, svg, png, jpg and xpm)
2084 + Implemented an interface for printing. Because you can change
2085 the printing command from the command line you can use all
2086 the nice postscript tool. To print a booklet for example call:
2087 showplot -b --print --print-cmd="cat %f" filename.root | lpr
2088 showplot -b --print --print-cmd="psbook %f | psnup -2 | lpr" filename.root
2089 showplot -b --null --print --print-cmd="psbook %f" filename.root > book.ps
2090
2091 - callisto: fixed a bug in the recognition of the calibration bit
2092 pattern. Concerns only intensity calibration. (The strength of the
2093 intensity has been updated in some cases)
2094
2095 - callisto: add a filter against PIN Diode events when running over
2096 calibration runs since some of the recent calibration runs have
2097 been taken with Pin Diode.
2098
2099 - callisto: added support for the runs 39942, 39944, 44834, 39941,
2100 39943, 44833 in the calibration (MCalibColorSet)
2101
2102 - callisto: MJCalibration.MHCalibrationChargeCam.ProbLimit has
2103 been set to 1e-18 in callisto_Dec04_Jan05.rc
2104
2105 - callisto: in callisto_Dec04Jan05.rc: set value for
2106 MJPedestalY2.MaxEvents from 2000 to 5000 to get better
2107 statistics for the calculation of the mean pulse time
2108 of the cosmisc
2109
2110 - callisto: the charge limit in the calibration has been raised
2111 from 2.5 to 4.5
2112
2113 - callisto: new setup read from callisto.rc
2114 + MCalibCalcFromPast.fNumEventsDump
2115 + MHCalibrationChargeCam.NumHiGainSaturationLimit
2116 + MHCalibrationChargeCam.NumLoGainSaturationLimit
2117
2118 - callisto: MExtractTimeAndChargeSpline extractor:
2119 + The integration ranges were shifted by 0.2 FADC slices to the right.
2120 + unreliable handling of floating point values caused different
2121 results on different platform or with different compiler options:
2122 The new algorithm is numerically exact and more accurate because
2123 it doesn't calculate the integration position by multiple times
2124 adding the step-size (which results in numerical uncertanties
2125 exspecially if multiplied with large numbers)
2126 + A lot of fixes have been introduced which effects integrating the
2127 spline at the edges of the valid range. In this case any memory
2128 was randomly accessed. This behaviour can be tested replacing
2129 all MArrayF by TArrayF which perform a range check (but of course
2130 they are a lot slower)
2131 ! No result obtained with the Spline before can be trusted! Due to
2132 random memory access it might by completely random!
2133
2134 - callisto: set new defaults in MExtractTimeAndChargeDigitalFilter:
2135 + extraction range in the high gain to 4.
2136 + weights file to cosmics_weights46.dat
2137
2138 - callisto:
2139 + introduce the check for fluctuating arrival times.
2140 + set charge limit to from 2.5 to 4.5
2141 + introduce asymmetric exclusion due to "deviating number of phes":
2142 Default: -9.0 +4.5
2143 + make deviating number of phes unsuitable (see David's findings).
2144
2145 - callisto: fixed the display of unsuitable pixels. The old change
2146 to a real profile in MHCamera broke it.
2147
2148 - callisto: The cosmics filter is used in MJCalibration now
2149 independant of the pulser color (formaly it was used only for
2150 CT1-pulser data). The threshold of number of max empty pixels
2151 has been raised from 2% to 5% in MJCalibration. The maximum
2152 fraction of rejected event is 50% otherwise the calibration has
2153 failed. The filter now ignores unsuitable pixels.
2154 Setup the filter from callisto.rc using "ContCosmics"
2155 (see MFCosmics::ReadEnv)
2156
2157 - callisto: changed default for fgOffsetFromLogain back
2158 from -2.8 to -1.8 in digital filter.
2159
2160 - callisto: for the common extractors
2161 + MExtractFixedWindow
2162 * MExtractTimeAndChargeSlidingWindow
2163 * MExtractTimeAndChargeSpline
2164 * MExtractTimeAndChargeDigitalFilter
2165 the hi- and lo-gain reolution is stored in fResolutionPerPheHiGain
2166 and fResolutionPerPheLoGain
2167
2168 - callisto: Updated the hi-/lo-gain intercalibration constants
2169 hilocalib_sp1.root, hilocalib_df46_mc.root, hilocalib_df4.root,
2170 hilocalib_df6.root
2171
2172 - callisto: The default lo-gain extraction window for the
2173 MExtractTimeAndChargeSlidingWindow extractor has been increased
2174 from 6 to 8 to take the stretch of the pusle into account
2175
2176 - callisto (!!!): fixed an important bug in the setting of the
2177 incoming pedestal pointer to the signal extractor extracting
2178 pedestals. This bug caused the pedestals not to be subtracted
2179 correctly in the calibration afterwards. The effect was about 10%
2180 too high conversion factors for the digital filter and the spline
2181 and more than 40% for the sliding window.
2182 The bug existed since end of February! (Markus G.)
2183
2184 - star: added muon support to star. A new tab "MHMuonPar" is
2185 displayed. The lower right plot is an estimate of the point spread
2186 function. A reference value is displayed. To get the real PSF
2187 you must compare with MC. The setup for the muon analysis
2188 is done in star.rc. More informations can be found in
2189 MHSingleMuon and MHCalibParCalc
2190
2191 - star: The weather data is now displayed in star
2192
2193 - star: MEventRateCalc handles the calculation of the event rate more
2194 accurate now in case of the start of a new run inside a sequence
2195
2196 - ganymed: a bug in MSrcPosCalc has been fixed (The changes were taken
2197 from a bugfix of Wolfgang to Loc0LocToCam; Wolfgang: the results are
2198 changed only minimally
2199
2200 - ganymed: (MJCut and MJOptimize) now displayes the number of
2201 excess events versus size. The energy estimation is done in
2202 MJSpectrum (sponde)
2203
2204 - ganymed: got support for using other variables than Alpha, eg. Theta.
2205 Therefor you need a class deriving from MHAlpha which supports
2206 this variable (one is already existing: MHTheta, which is now the
2207 default in ganymed). It is setup through ganymed.rc
2208
2209 - added a full featured spectrum program (sponde) which reads
2210 ganymed output and monte carlos and compiles a spectrum
2211
2212
2213
2214 *** Version 0.9.1 (2005/04/14)
2215
2216 - Fix bug on the arrival time reconstruction when using Digital
2217 Filter (in some marginal cases (10%) times were reconstructed shifted
2218 by 0.2 slices)
2219
2220 - all executables now return 2 where in previous versions -1 has
2221 been returned (gave problems with shell-scripts)
2222
2223 - the Hi-/Lo-Gain intercalibration for monte carlo files is now
2224 also done with a intercalibration input file
2225
2226 - a bug in the time fine adjustment of the digital filter has been fixed
2227
2228 - a lot of small fixes to calling TPad::Divide with a margin==0
2229
2230 - MStatusDisplay now shows the memory usage
2231
2232 - added a memory leak statistic after the eventloop
2233
2234 - MHadronness replaced by MParameterD
2235
2236 - MEnergyEst replaced by MParameterD
2237
2238 - wobble mode can now be switched on from the data-set
2239
2240 - switched on bad pixel detection for a pedestal level
2241 which is more than 5 times the variance
2242
2243 - Fixed default paths to be correct for the new data center
2244
2245 - Fixed handling of drive data. The pointing position in now
2246 copied to MPointingPos inside star for real and MC events
2247
2248 - made sure, that the sequences in a dataset are sorted by
2249 their number to ensure the correct synchronization
2250
2251 - added all resource files necessary to handle spline extraction
2252 of signal for the late 2004 and the early 2005 data
2253
2254 - update the reference lines for the december data
2255
2256 - changed default for fgHiGainFirst from 2 to 0 in spline extractor
2257 This is important for the Dec. and Jan. data where the calibration
2258 pulse position changes much.
2259
2260 - changed default for fgOffsetFromLogain from -1.8 to -2.8 in digital
2261 filter. This corrects only an defective extraction of the MC at
2262 low-gain signals lower than 90 phes.
2263
2264 - fixed some slowdown in calibrating data with interleaved events from
2265 Jan and Dec. As a workaround made the pretty palette the default.
2266 The inverse Deep Blue Sea has a bug which slows down long calibration
2267 runs a lot.
2268
2269 - implemented new values from new starguider report as defined
2270 in TDAS00-07 V7.1 (eg SkyBrighness)
2271
2272 - Fixed the formerly wrong unit of azimuth and zenith angle deviation
2273 in starguider report (If you merpp the same reports with this version
2274 you'll get the correct units (arcmin) but a different result
2275 than with old versions (wrong units))
2276
2277 - Now the status display can also write PNG, JPEG and XPM (other file
2278 formats are still unsupported by root)
2279
2280 - added a lot of scripts and macros in directory datacenter used
2281 for automatic processing
2282
2283
2284
2285 *** Version 0.9 (2005/03/23)
2286
2287 - Calibration is now done autmatically into photo-electrons like
2288 decided by the Collaboration Board
2289
2290 - Reference lines in the display can be read from resource file
2291
2292 - Interlaced calibration events can be handled by callisto
2293
2294 - Hi-Gain vs. Lo-Gain calibration constants can be calculated
2295 and applied in callisto.
2296
2297 - class MJCalibTest can be called by callisto
2298
2299 - callisto can now run with three data types: rawdata, rootdata, MC
2300
2301 - added two classes mreport/MReportStarguider.cc and
2302 mreport/MReportStarguider.h for implementing starguider-data
2303
2304 - the output of merpp-update now contains starguider information:
2305 MReportStarguider and MTimeStarguider
2306
2307 - Fixed bug in MHHadronness.cc which made that the displayed Q-factor
2308 values were lower than they should. This was more visible for high
2309 energy (Size) events.
2310
2311 - Made MExtractTimeAndChargeDigitalFilter the default for callisto
2312
2313 - added a new loop to callisto to support the correct extraction of
2314 the pedestal and pedestal rms through the signal extractor
2315
2316 - added class to perform fourier tranformation of a hexagonal structure
2317 (MHexagonalFT)
2318
2319 - added class to perform fourier tranformation of a hexagonal structure
2320 in a tasklist (MHexagonalFTCalc) example: hft.C
2321
2322 - added class to enhance the MCerPhotEvt from the Magic camera geometry
2323 MGeomCamMagic to a enhanced geometry MGeomCamMagicXT having only
2324 small pixels, example: extendcam.C
2325
2326 - added possibility to write data to memory (TTree) using MWriteRootFile
2327
2328 - added possibility to read a TTree stored only in memory by MReadTree
2329
2330 - new classes to deal with the interleaved calibration events:
2331 MTriggerPattern, MTriggerPatternDecode and MFTriggerPattern
2332
2333 - implemented filters to callisto to skip calibration events
2334
2335 - changed callisto to calculate three kinds of pedestals and pedestal rms:
2336 + fundamental pedestal (MPedPhotFundamental): extracted directly from
2337 the slices by statistics
2338 + pedestal from extractor (MPedPhotFromExtractor): extracted with the
2339 signal extractor without randomization
2340 + random pedestal from extractor (MPedPhotFromExtractorRndm): extracted
2341 with the signal extractor with randomization (extraction window is
2342 randomly fixed)
2343 The three kind of pedestal is not yet implemented (for speed reasons) as
2344 long as nobody really needs it:
2345 + pedestal from extractor with randomizatiuon (MPedPhotFromExtractorRndm):
2346 extracted with the signal extractor with randomization
2347
2348 - callisto now finds the pulse position in the data automatically
2349
2350 - implemented data reduction in calibrated data by reducing the precision
2351 of the stored floating point values (pedestal, rms and signal) to
2352 roughly 0.5%
2353
2354 - fixed showplot to make file format conversion (eg. converting a
2355 status display stored in a root file into a postscript file) in
2356 batch mode possible:
2357 showplot -b --save-as-ps[=outfile.ps] infile.root
2358
2359 - Allow class names as part of filter rules, eg
2360 (MFSupercuts) && (MHillas.fSize>100)
2361
2362 - fixed a lot of stuff to allow all programs to process MonteCarlo
2363 camera files.
2364
2365 - enhanced possibility to debug reading of resource file
2366
2367 - MDataChain should handle priorities of operator more
2368 accurate now
2369
2370 - completely revised the container in which the signal is stored
2371 MCerPhotEvt/Pix, MArrivalTime --> MSignalCam/Pix
2372 * the new implementation is faster and
2373 * needs less storage space
2374
2375 - FIRST version which can process Monte Carlos through the
2376 whole chain of programs (callisto, star, etc)
2377
2378 - implemented new image parameters for the border length of
2379 the shower image (MNewImagePar2)
2380
2381 - implemented wobble-mode in ganymed
2382
2383 - new class (MJOptimize) taking care of all optimization processes
2384
2385
2386
2387 *** Version 0.8.6 (2004/10/05)
2388
2389 - New combined signal and time extractor
2390 MExtractTimeAndChargeDigitalFilter
2391
2392 - The Report for the trigger section in the CC run summary has been
2393 updated, and now the IPRs (Individual Pixel Rates) are available.
2394
2395 - new macros for database interaction: filldotrun.C, filldotrbk.C
2396
2397 - added new program which can convert colored output which was redirected
2398 into a file back into colored text (for example to display it with
2399 more): showlog
2400
2401 - added new program to display an MStatusArray of plots (stored with
2402 MStatusDisplay) from a file: showplot
2403
2404 - Added support for Sequences (MSequence). Sequences are blocks of run
2405 files containing the same calibration and belonging to the same
2406 source
2407
2408 - Added a new task (MTaskEnv) which can be used in setup files to switch
2409 between different tasks (for example to choose a signal extractor)
2410
2411 - Implemented automatic file splitting in MWriteRootFile
2412
2413 - After image cleaning an island index is assigned to all used pixels.
2414 The index corresponds to the order of the islands in size.
2415
2416 - added a cleaning which takes signal height _and_ arrival time into
2417 account: probability cleaning (for more details see MImgCleanStd)
2418
2419 - added a cleaning which takes takes the absolute number of photons
2420 times the area ratio as cleaning level
2421 (for more details see MImgCleanStd)
2422
2423 - Changed calculation of image parameters such, that it can be done
2424 for all used pixels or the pixels with a defined island index only
2425
2426 - implemented new image parameters displaying the number of islands,
2427 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
2428
2429 - event display in executable changed to support also calibrated files
2430 (done with MJCalibrateSignal)
2431
2432 - added program doing the calibration and the signal extraction
2433 and signal calibration: callisto Most part of the setup is done
2434 by a resource file: callisto.rc
2435
2436 - implemented support for pixels with negative IDs (Raw file format
2437 version 4)
2438
2439 - implemented an new option in merpp (--auto-time) to get the time
2440 range for cc and/or caco data from the run header of the raw data
2441
2442 - New star-program (star and MJStar). Taking calibrated data from
2443 callisto/MJCalibrateSignal as input. The setup is done through
2444 a resource file: star.rc
2445
2446 - Added possibility to setup the eventloop in the mars-executable
2447 Camera Display by a resource file: mars.rc
2448
2449 - The the mars-executable Camera Display can now also read
2450 calibrated data files written by callisto/MJCalibrateSignal
2451
2452 - Added a new class which can calculate the source position in
2453 the camera from a pointing model known to be correct and
2454 the pointing model used for observations (MSrcPosFromModel)
2455
2456 - added a new version of the class calculating the effective on-time
2457 MHEffectiveOnTime. It unifies the old classes MHEffOnTime,
2458 MHEffOnTimeTime, MHEffOnTimeTheta, MHTimeDiff, MHTimeDiffTime and
2459 MHTimeDiffTheta.
2460
2461 - added the possibility to count how often a signal is above (or
2462 below) a certain threshold in MHCamEvent and MHCamEventRot (this
2463 can replace MHTriggerLvl0)
2464
2465 - added ore convinient ways to set the axis-titles of your histograms
2466 in your macro to some MH-classes like: MH3, MHVsTime, MHSectorVsTime,
2467 MHPixVsTime, MHVsTime, MHCamEvent and MHCamEventRot
2468
2469
2470
2471 *** Version 0.8.5 (2004/08/06)
2472
2473 - new Signal Extractors: MExtractFixedWindowSpline
2474 and MExtractAmplitudeSpline
2475
2476 - implementes interleave in merpp to be able to merpp parts of a file
2477
2478 - implemented force-functionality to merpp
2479
2480 - star display to display star catalogs (MAstroCatalog)
2481
2482 - star display to 'mirror' stars to the camera (MAstroCamera)
2483
2484 - implemented a new cleaning option which allows cleaning scaled with
2485 the real ratio of the rms depending on the pixel size, not only the
2486 square root of the pixelsize (MImgCleanStd, MCameraData)
2487
2488 - removed obsolete MBlind* classes
2489
2490 - Signal extractor taking the AB flag into account implemented (this makes
2491 an odd number of slices for signal extraction possible
2492 (MExtractSignalABcorr)
2493
2494 - implemented a class extracting the pedestal from the raw-data (events)
2495 itself using empty lo-gain (MpedCalcFromLoGain)
2496
2497 - Added mean values to MPedPhotCam
2498
2499 - Added Makefile for Darwin (this OS is NOT officially supported!)
2500
2501
2502
2503 *** Version 0.8.4 (2004/04/19)
2504
2505 - new fast arrival time extractor using cubic splines:
2506 MExtractTimeFastSpline
2507
2508 - implementes multi-argument support in MDataChain
2509 ("pow(a, b)")
2510
2511 - implemented double reference support in MDataChain
2512 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
2513
2514 - added support in MF for expressiond like
2515 "MHillas.fWidth<2*<MHillas.fLength"
2516
2517 - MDataChain is now able to support variables like [0], [1], ...
2518 which can be used in fit functions as parameters. The interface
2519 is implemented through the new virtual function
2520 MParContainer::SetVariables
2521
2522 - added new class MArrivalTimeCam/MArrivalTimePix:
2523 Storage containers to hold the ArrivalTime of the camera/pixel
2524
2525 - added new classes for the calibration of relative arrival times:
2526 MCalibrationRelTimePix and MCalibrationRelTimeCam
2527
2528 - added new classes to extract the signal of the blind pixel and the
2529 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
2530
2531 - added new classes for the bad-pixels treatment (MBadPixels*)
2532 which are more powerfull than the old ones (MBlindPixel*)
2533 and will replace them.
2534
2535 - added filter against cosmics: MFCosmics
2536
2537 - added new class MArrivalTimeCalc2:
2538 Calculates the arrival time as the signal weighted mean of the time
2539 slices in the maximum window
2540
2541 - added a new macro call pointspreadfucntion.C that fits with a 2D
2542 gaussian the DC spot for an star. It gives you the RMS of
2543 the PSF and the center of the star, very useful for misspointing
2544 studies.
2545
2546 - added support for multi-telescope camera files. Added classes
2547 MStereoCalc and MStereoPar, classes to calculate and store shower
2548 parameters calculated from the data of two telescopes, for the MC
2549 studies regarding the MAGIC clone.
2550
2551 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
2552 MC data calibrated in photons instead of ADC counts.
2553
2554 - added three macros to show the calibration and analysis chain of
2555 MC data. The macro starmc.C does both calibration and analysis, producing
2556 an output containing Hillas parameters for each event. The macro
2557 mccalibrate.C does just the calibration and writes out a file containing
2558 pixel information in photons instead of FADC data. The macro starmc2.C
2559 reads in such a file and produces an output with Hillas parameters.
2560
2561 - added MPedPhotCalc to compute pedestals in units of photons, see
2562 macro pedphotcalc.C
2563
2564 - added all class to perform the calibration, see macro calibration.C
2565
2566 - added class MFFT to perform Fast Fourier Transforms
2567
2568 - added class MSimulatedAnnealing to perform simulated annealing
2569 minimizations
2570
2571 - added new macro bootcampstandardanalysis.C which holds the skeleton
2572 of the analysis chain discussed in the december bootcamp.
2573
2574 - added support for DAQ raw data file format V2
2575
2576 - implemented an arbitrary time stamp for the events from raw-data
2577 files with file version<3. It is calculated from the run number,
2578 the date of start and the FADC clock tick from the first module
2579
2580 - implemented the correct decoding of the event time-stamp
2581 coming from the DAQ for raw-data files with file-version>2
2582
2583 - added a new classes storing the pedestals in units of photons:
2584 MPedPhotPix, MPedPhotCam
2585
2586 - added support for DC current files from the camera control
2587
2588 - added support for start- and stop-time when merpping report files
2589
2590 - added MReportCC storing the weather data from the CC-REPORT
2591
2592 - added class to fill trainings and test matrices (MTFillMatrix)
2593
2594 - added a filter performing a software trigger (MFSoftwareTrigger)
2595
2596 - Added classes to perform parts of the standard analysis (Jobs):
2597 + MJPedestals
2598 + MJCalibration
2599 + MJExtractSignal
2600 Note: All of them are preliminary!
2601
2602 - Added Iterator to iterate over files giving only the run-number
2603
2604 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
2605 the evolution of a sector vs time
2606
2607
2608
2609 *** Version 0.8.3 (2003/12/05)
2610
2611 - adapted Random Forest classes to allow the use with MC
2612 multi-telescope files which can be produced with the coming
2613 camera version 0.7.
2614
2615 - added classes to read and interprete central control report files
2616 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
2617
2618 - enhanced merpp (the executable) to support .raw and .rep files.
2619
2620 - added classes for light calibration (MCalibration* and
2621 MHCalibration*) by Markus Gaug. Further work has to be and will
2622 be done soon.
2623
2624 - Added a preliminary 'synchronizer' (MReadReports) which will
2625 replace MReadMarsFile as soon as it is finished.
2626
2627 - Added a tutorial macro demonstrating how report files are merpped
2628 and how they can be read from the root file in the correct order
2629 of time (readrep.C)
2630
2631 - Added a generalized histogram (similar to MH3) called MVsTime
2632 which allows to plot variables (or rules - MDataChain - of
2633 variables) vs time. For an example have a look at tempvstime.C.
2634
2635 - Changed the name of the event trees:
2636 + Events --> Events
2637 + PedEvents --> Pedestals
2638 + CalEvents --> Calibration
2639
2640 - changed name of MTime in the event trees from MRawEvtTime to MTime
2641
2642 - added displaying the sector indices to the mars event display
2643
2644 - Magic Online Analysis (MOnA) implemented in a first version
2645 (see mona.cc, MOnlineDump and MOnlineDisplay)
2646
2647 - added classes to calculate event rate
2648 (preliminary: MEventRateCalc, MEventRate)
2649
2650 - added new executable 'readdaq' to read *.raw files from the DAQ directly
2651
2652 - added classes dealing with the telescope pointing position (MPointing*)
2653
2654 - implemented the 'final' Mars time stamp based on some experiences with
2655 the new 'Synchonizer'
2656
2657
2658
2659 *** Version 0.8.2 (2003/11/10)
2660
2661 - accelerated standard analysis by a factor of 6-8 ...
2662 + doing precalculations in MGeomCam for the pixel area ratio
2663 + creating a look up table for the single pixels in MCerPhotEvt
2664
2665 - added task to calculates weights in case you want to 'change'
2666 the energy spectrum of a monte carlo file
2667 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
2668
2669 - added a new executable star which implements the
2670 star.C macro as precompiled executable. Currently a flexible
2671 setup is not possible, but a 'input card' setup will follow.
2672
2673 - Starting to implement Multi-Telescope-Support based on the
2674 upcomming camera version 0.7. The base for a general support
2675 is implemented and the star-functionality is proven to work.
2676
2677 - Replaced Event-Display in and Camera-Display in the Mars GUI
2678 executable by a more convinient display base on MStatusDisplay.
2679
2680 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
2681
2682
2683
2684 *** Version 0.8.1 (2003/10/20)
2685
2686 - added signal subtraction for pure on data by means of fitting
2687 the background in the off region or by performing a combined
2688 signal/background fit. Provides necessary histograms for
2689 obtaining energy spectra and a light curve.
2690
2691 - added classes to perform and study the selection of the
2692 2nd Level Trigger on MC data (example in triglvl2.C macro)
2693
2694 - added pedestal calculation
2695
2696 - implemented "democratic cleaning" (tail cut value proportional
2697 to pixel area) according to Wolfgang's suggestion.
2698
2699 - added Sigmabar treatment (calculation and basic histogramming)
2700
2701 - added basic routines to apply padding
2702
2703 - added first implementation of MARS-based source visibility plotter
2704 (needs to be linked against slalib, preliminary version)
2705
2706 - enhanced functionality of data chains: random numbers, conversion
2707 functions and access to MHMatrix objects
2708
2709 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
2710 numbers under certain circumstances (runs with 0 events included)
2711
2712 - fixed a bug in the general filter MF (didn't work on some systems
2713 at all)
2714
2715 - fixed a bug in chaining files, which caused the analysis to crash or
2716 ignore files
2717
2718 - implemented more geometry classes describing the parameters used
2719 to simulate the PMT camera
2720
2721 - added new Monte Carlo classes containing the setup of the different
2722 programs in the MC chain.
2723
2724 - added a (preliminary) general task to evaluate chi-square of a given
2725 parameter in an eventloop.
2726
2727 - first implementation of a container describing the observatory
2728 location (Long, Lat, etc)
2729
2730 - added Random Forest - method for g/h-separation
2731
2732 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
2733 (this means, that it is compiling, but not yet fully tested)
2734
2735 - added a new status display which can show the present status
2736 of histograms while an eventloop is running (MStatusDisplay,
2737 an example can be found at status.C)
2738
2739 - reorganized directories:
2740 classes describing the image --> mimage
2741 classes containing Monte Carlo Histograms --> mhistmc
2742 classes for Random Forest method --> mranforest
2743
2744 - added (event-)weights to fill histograms
2745
2746 - colors in logging output to screen
2747
2748 - changes to the Image Parameter declaration:
2749 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
2750 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
2751 + MHillasExt now derives from MParContainer instead of MHillas
2752 --> Files written with the old definition are more or less unreadable
2753
2754 - reading of reflector files
2755
2756 - display data from reflector files in the camera
2757
2758 - implemented currents (and display them in the camera)
2759
2760 - logarithmic scale in camera
2761
2762 - added class to iterate through directory contents (MDirIter)
2763
2764
2765
2766 *** Version 0.8 (2002/11/18)
2767
2768 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
2769
2770 - corrected 48(!) wrong entries in the Next Neighbor table of the
2771 Magic Camera (all in the inner part of the outer ring, mostly
2772 missing a single NN)
2773
2774 - Fixed a bug in the table describing the Next Neighbours of the
2775 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
2776 have any neighbour)
2777
2778 - changed trigrate.C: now it calculates the pure NSB triggers from
2779 a camera file (generated with no showers), so there is no need
2780 to introduce them by hand in the BgR array (for more details
2781 please ask Abelardo)
2782
2783 - added MHHadronness (and MHadronness) as a general facility to evaluate
2784 the quality of a gamma-hadron seperation method
2785
2786 - changed MWriteAsciiFile to accept rules (MDataChain)
2787
2788 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
2789 must be replaced by calles to MWriteAsciiFile::AddColumn and
2790 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
2791 changed.
2792
2793 - Implemented generalized event-matrices (one row per event)
2794 (MHMatrix)
2795
2796 - implemented the one dimensional composite probabilities
2797 (MHCompProb, MCompProbCalc, comprob.C)
2798
2799 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
2800 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
2801
2802 - Added a camera display displaying the pixel numbers to the
2803 event display gui.
2804
2805 - Added Monte Carlo Informations to event display gui
2806
2807 - Changed the camera display to display the pixel numbering
2808
2809 - Added three buttons to the camera display to change the palette
2810
2811 - Added the number of used and core pixels after image cleaning
2812 to MHillas
2813
2814 - Changed the algorithm used in MHillas according to TDAS 02-03
2815
2816 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
2817
2818 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
2819
2820 - Added fCosDeltaAlpha to MHillasSrc
2821
2822 - The numbers of photons used to calculate fConc and fConc1 in
2823 MHillasExt are now scaled with the pixel size, so that one get
2824 a four times smaller value for the bigger pixels in the outer ring.
2825
2826 - added new task to smooth the camera contents (MCameraSmooth)
2827
2828 - added possibility to use interpolated pixel values for blind pixels
2829 instead of removing it completely from the analysis
2830
2831 - Implemented the possibility to save the whole eventloop with
2832 its setup to a file. This information can be read and from
2833 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
2834 and MEvtLoop::MakeMacro. If you find something not working, please
2835 report - this stuff is still in a beta phase.
2836
2837 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
2838 file having crab starfield, but also for all following files - fixed
2839
2840 - MTaskList::PrintStatistics can now be instructud to print also the
2841 title, too: use PrintStatistics(0, kTRUE)
2842
2843 - Changed the image cleaning so that pixels with to many 'used'
2844 neighbors are left used (to get rid of 'holes' in events)
2845
2846 - Introduced more output to the camera displays
2847
2848 - Added an array of histograms (eg one hist per run), MHArray
2849
2850 - Added a _preliminary_ version of the reader for CT1 PreProc files
2851 (MCT1ReadPreProc)
2852
2853 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
2854 (thanks to Raquel)
2855
2856 - added the first energy estimator (MEnergyEstParam, estimate.C,
2857 estfit.C) using a parametrization
2858
2859 - Added some new Monte Carlo paremeter containers used to store
2860 setup information from the MC chain (MMcConfigRunHeader,
2861 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
2862
2863
2864
2865 *** Version 0.7 (2002/04/30)
2866
2867 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
2868 the pedestal mean value was saved incorrectly. For files from
2869 this versions we substract 0.5 from the pedestal mean.
2870 WARNING: This may effect your results, so don't wonder...
2871
2872 - First implementation of an algorithm using only triggered events
2873 for the collection area calculation
2874
2875 - Ascii Output can now also be used for parameter containers which
2876 doesn't overload MParCointainer::AsciiWrite
2877
2878 - The Ascii Output is now also capable of writing single data members
2879 of one container
2880
2881 - You are now able to change the order of the values written to the
2882 ascii file
2883
2884 - You can now specify a conversion factor for each data member written
2885 to an ascii file. This may be usefull to change the units of the
2886 data member (eg. degrees instead of millimeters in case of the
2887 hillas parameters)
2888
2889 - Replaced old MHillas by a new structure which allows you to extend
2890 the parameters stored in MHillas very easily:
2891 see MHillas and MHillasExt
2892
2893 - Added classes to handle source dependancy of image parameters:
2894 see MHillasSrc
2895
2896 - Added container (MBinning) to have a standard input for the binning
2897 in different histograms (eg. the Energy bins should be the same in
2898 all histograms)
2899
2900 - Changed Hillas histograms from mm to deg
2901
2902 - Added the flexible binning to the hillas histograms
2903
2904 - Added a filter for the alpha parameter (MFAlpha)
2905
2906 - It is now possible to write single data members of a class object to
2907 an output stream instead of the whole container only
2908
2909 - Added a generalized filter for a data member:
2910 MFDataMember filter("MHillas.fWidth", '<', 0.5);
2911
2912 - Added a generalized Filter parser for more difficult filter rules
2913 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
2914
2915 - Added new Monte Carlo histograms:
2916 MHMcEnergyImpact and MHMcEfficiency
2917
2918 - Added many new histograms needed for the flux calculation.
2919
2920 - Added a generalized histograms which can fill and show up to three
2921 data members in either a one-, two- or three-dimensional histogram, eg:
2922 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
2923
2924 - Added:
2925 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
2926 * calculation of <Theta> as a function of time (MHThetabarTime)
2927 they are needed in the flux calculation in
2928 order to select for a given bin in Theta (or time) the appropriate
2929 effective collection area, which is assumed to be given as a function
2930 of Theta and the true energy
2931
2932 - Added calculation of the migration matrix in the energy
2933 (MHMcEnergyMigration):
2934 the migration matrix describes the migration from the true (E_true)
2935 to the estimated energy (E_est); it is needed to determine the
2936 distribution of E_true from the measured distribution of E_est
2937 by unfolding
2938
2939 - changed the color palette in the camera display to DeapSea.
2940
2941
2942
2943 *** Version 0.6 (2002/01/15)
2944
2945 - Introduce the option of disable pixels (MBlindPixels and
2946 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
2947 able to deal with Star Field NSB.
2948
2949 - Fixed a bug in the pedestals substraction
2950
2951 - Introduced verbosity levels
2952
2953 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
2954
2955 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
2956 work correctly (thanks to Abelardo)
2957
2958 - Introduced correct treatment of the diffuse Night Sky Background
2959 and NSB (MMcPedestalNSB)
2960
2961 - Corrected treatment of the electronic noise (MMcPedestalCopy)
2962
2963 - Introduced MMcRunHeaders which contains monte carlo run informations
2964
2965 - Added a 'Print'-Task (MPrint) which calls the Print function
2966 of a parameter container for each event
2967
2968 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
2969
2970 - changes to be more efficient with root 3.02/06
2971
2972 - root 3.02/06 fixes:
2973 + the memory leak when reading MRawEvtData
2974 + loosing more time than necessary to update the progress bar
2975
2976 - MWriteAsciiFile is now capable of writing more than one container
2977 in a line. For example: To be able to write Monte Carlo and
2978 Hillas values (energy and alpha) in one line.
2979
2980
2981
2982 *** Version 0.5 (2001/11/06)
2983
2984 - Added new GUI functionality (Analysis)
2985
2986 - Added a camera display to be able to display events in the camera
2987 together with the calculated hillas ellipse
2988
2989 - Added a 'Clone'-Task (MClone) which can clone a parameter container
2990 object at any state of the analysis, so that the output are several
2991 states
2992
2993 - Fixed a bug in the collection area error calculation
2994 (Thanks to Ciro and Abelardo)
2995
2996 - Fixed a bug which causes merpp to crash in some environments
2997
2998 - Implemented auto enabling scheme for Branches to speed up reading
2999 a lot (see MReadTree and MTask)
3000
3001 - Fixed a bug in the Histogram classes which caused histograms to
3002 be written to a file by MWriteRootFile without request
3003
3004 - changed the object I/O from the old stylish root I/O to the new
3005 'auto evolution scheme' This was done only for classes which are not
3006 yet used in Monte Carlo files, so that these files are still readable.
3007
3008 - Added support for a progress bar in MEvtLoop and MReadTree
3009 (see the Analysis Window in Mars for an example)
3010
3011 - Fixed a bug in the package creation which disturbed the conversion
3012 between a mars version unpacked from a tar file and the repository.
3013
3014 - Changed the code to writer merpped (converted into root format)
3015 raw files, to get faster (around 10%)
3016
3017
3018
3019 *** Version 0.4 (2001/09/20)
3020
3021 - This release is made to compile on a root version >= 3.00
3022
3023 - Fixed a bug which causes MReadTree to read the first file only
3024
3025 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
3026
3027 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
3028
3029 - Added a task to write several container to a root file (MWriteRootFile)
3030
3031 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
3032
3033 - Added calculation of the collection area (MMcCollectionAreaCalc)
3034
3035 - fixed some bugs in the Hillas calculation
3036
3037 - added filters to be able to control the task execution dependent on
3038 a parameter (for example: the number of level 1 triggers in a MC-file)
3039
3040
3041
3042 *** Version 0.3 (2001/04/23)
3043
3044 - Many demo macros added
3045
3046 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
3047
3048 - Hillas Calculation added
3049
3050 - Standard image cleaning available
3051
3052 - MReadTree is now able to handle more than one file
3053 (Remark: of the same structure)
3054
3055 - Now we are able to display events in a first version of the
3056 Camera event display. To do this we must run the macro
3057 "macros/readCT1.C" to read data from CT1.
3058
3059
3060
3061 *** Version 0.2 (2001/01/24)
3062
3063 - First Implementation of a Gui to read the raw data. Start the
3064 gui with the command mars.
3065
3066
3067
3068 *** Version 0.1 (2000/12/20)
3069
3070 - First official release 0.1
3071
3072 - Changes:
3073
3074 + changed calling style of MRawPixelIterator from do...while to
3075 while-loop
Note: See TracBrowser for help on using the repository browser.