source: trunk/MagicSoft/Mars/NEWS@ 9083

Last change on this file since 9083 was 9083, checked in by tbretz, 16 years ago
*** empty log message ***
File size: 122.4 KB
Line 
1 -*-*- END -*-*-
2
3== <cvs> ==
4
5 ;Database
6
7 * Added the median number of photo electrons from the calibration
8 pulses to the db (fMedNumPheInner, fMedNumPheOuter) and the relative
9 error of their raw counts (fRelChargeRmsInner, fRelChargeRmsOuter)
10
11 * Added fTotOnTime, which is the on-time as given by the run-headers
12 (in contradiction to fAbsOnTime which comes from CC)
13
14 * Added new primaries for the new data structure (Magic II): for the
15 tables dealing with sequences (SequenceBuild Status, Sequences,
16 SequenceProcessStatus, Calibration, Star and DataSetSequenceProcessing)
17 this is the telescope number (fTelescopeNumber) for the tables dealing
18 with runs (RunData and RunProcessStatus) this is in addition the file
19 number (fFileNumber)
20
21 * Added column fPriority to the status tables to be able to steer the order
22 in which the data is processed. As default the run, sequence and dataset
23 number are used.
24
25 ;automatic analyis
26
27 * Adapted scripts to the new data structure: They can handle now different
28 telescopes (getting the information as usual from the database).
29 The paths for Magic 2 are not yet implemented.
30
31 ;general
32
33 * should work now with root 5.20/00 (please note that root 5.20/00
34 we encounter crahses in the status display which are ot yet
35 understood)
36
37 * Sequences and Datasets are now stored as "MDataSet" and "MSequence"
38 instead of the base name of the file. This makes them easier to
39 access from the code
40
41 * Default Monte Carlo names in MSequence do not require the _E at
42 the end anymore
43
44 * where abrrevating a sequence file with a sequence number is possible
45 also "telescope:sequence" is now accepted, e.g.:
46 star 2:2000123 --out=output
47 see the programs' help for more details.
48
49 * sequences (MSequence or MSequenceSQL) can now directly be retrieved
50 from the database. See the constructors for more details.
51
52 * MReadTree now supports friends
53
54 * MReadTree can now read also files not written by MARS and store
55 the data encapsulated in emulated MParContainers
56
57 * added a new starguider calibration valid since 15.1.08
58
59 ;showplot
60
61 * showplot can now read more than one file at once. This is especially
62 inetersting if reading files containing pure canvases
63
64 ;merpp
65
66 * we merpp the dc currents now also from the camera reports (they have
67 just a lower rate than the current reports, 0.1Hz instead of 1Hz)
68
69 * In the automatic analysis we omit merpping of the currents from the
70 caco files and use the lower rate camera reports from the cc files
71 instead
72
73 * merpp has been redisigned to allow merpping of the cc-reports
74 of a whole sequence. This allows to design a very simple analysis:
75 mkdir output
76 ./callisto 100776 --out=output
77 ./merpp 100776 output
78 ./star 100776 --ind=output --out=output
79 Instead of the sequence number also sequence files are accepted.
80
81 * Implemented a fix for run-numbers between 1001348 and 1001396
82 which were incorrectly assigned by the cc.
83
84
85 ;callisto
86
87 * added a filter again which was was removed in the last release.
88 it removed the most brightest events. This should not change
89 any analysis result because these events are so bright that
90 they cannot be analysed anyway, but the bad-pixel plots doesn't
91 show outliers.
92
93 * updated muon calibration constants for the periods 51-57,
94 58-63 and 67-
95
96 ;star
97
98 * The camera currents are now displayed with the rate of the camera
99 reports instead of the caco reports
100
101 ;ganymed
102
103 * if mc camera files are new enough (>=8) the source position in the
104 camera is now calculated from the stored telscope and shower
105 orientation (Note, that this might not be suitable in all cases
106 depending on the aim of the study. These case still needs
107 implementation)
108
109
110
111== Version 2.1 (2007/09/03) ==
112
113 ;Database
114
115 * introduced average temperature and wind speed from star-files
116
117 * introduced average values from Pyrometer (mainly Cloudiness)
118
119 * introduced the ratio of accepted calibration events in the
120 calibration run
121
122 * introduced the average rates of the different trigger pattern,
123 e.g. the rate of pedestal and calibration events, from the signal-file
124
125 ;general
126
127 * fixed GroupBy options in plot*.C macros
128
129 * only display KVA points (not the Tuorla points) in plotoptical.C
130
131 * all programs now allow to add resources to the ones from the resource
132 file or overwrite them from the command line. This can be done like this
133 ganymed --config=ganymed.rc --rc=Cut1.Param1:0.25 --rc=Cut1.Param3:5.5
134 if something seems to be wrong you can debug what the program is doing
135 using the option --debug-env=3
136
137 * increased the diversity of debug levels. That also means that with -v3
138 you get now less output, i.e. only the output which is important for
139 an analysis. To get more output which helps for debugging try 4, 5 and 6.
140
141 * fixed a problem in the task synchronizing the reading of the reports
142 and the data stream. The effect was that in some circumstances the last
143 events of some trees could have been skipped. Since this is only a
144 very tiny part of the data no severe effect to your analysis results
145 is expected (an exception might be very short, i.e. singel runs,
146 datasets).
147
148 * Dataset file now allow to include the sequence file directly within
149 the dataset file and also allow to exclude single runs from the dataset.
150 (for more details see Class reference of MDataSet)
151
152 * Sequence files now allow for excluding runs from the analysis
153 (for more details see Class reference of MSequence)
154
155 * added code to process the sum-trigger flag
156
157 * the histogram classes MH3 and MHn now support profile histograms
158
159 * the histogram classes MH3 and MHn now support labels at the axis
160
161 * the Random Forest Train-classes (MJTRain*) now store the used datasets
162 in the output file
163
164 * the MFMagicCuts have a new option to allow a linear area cut (for
165 special studies)
166
167 * The liniking of the shared object is now done into a file defined
168 by 'mktemp'. This should be a local file system which accelerates
169 liniking a lot.
170
171 * The code has been prepared for compilation with root 5.18/00d
172
173 * The MHEnergyEst histogram now shows the distribution of
174 (Eest-Emc)/Est and the distributions (Eest-Emc)/Eest vs. Eest
175 and (Eest-Emc)/Emc vs Emc.
176
177 * fixed mars (event display) for merpped raw-data and MC data
178
179 * adapted the synatx of sequence files to allow for the new run/file
180 scheme. For more details see class description of MSequence
181
182 ;showplot
183
184 * Added support for tiff files
185
186 * Added support for csv files (tables containing tab number,
187 name and title)
188
189 * Tabs now can have a title which is displayed in the postscript file
190
191 * When multiple file are written at once (e.g. pngs from a display)
192 it is now possible to use the tab name and or tab number in the
193 file name. For details see showplos's help.
194
195 ;merpp
196
197 * Implemented cc file version 2008-02-20/0
198
199 * Implemented cc file version 2008-05-19/0
200
201 * With new options merpping can be restricted (in addition to the
202 run-number) also by telescope and file number.
203 For details see "merpp --help"
204
205 * Implemented raw data format 11 (the most important change, except
206 from plenty of changes in the format definition, is the addition
207 of the file-number in the header) If nobody makes a mistake this
208 format should have the advantage that it is by definition forward
209 compatible, so old programs will be able to read newer formats.
210
211 * Added Pyrometer information to default output (stored in a new Tree
212 Pyrometer, needs a complete new merpp, i.e. new calibration)
213
214 * Merpping (also update) can now be restricted to one single report.
215 For example:
216 If you want to update an old file with Pyrometer information call
217 merpp --only=Pyrometer --update
218
219 ;callisto
220
221 * in the pedestal processing now at least 50 processed events are
222 required for succeeding.
223
224 * the signal and calib files now contain also the sequence information
225
226 * the two MPedestalCam in the calib file now have proper names
227 to distinguish them from each other (MPedestalCam, MPedestalExtracted)
228
229 * Both pedestal cams now contain the number of events processed
230
231 * In Mars V2.0 the extraction of the fundamental pedestal was broken,
232 i.e. for the extraction of the calibration pulses basically the average
233 over all events of the first slice instead of all slices was used.
234 Since pedestal and calibration constants are continously recalculated
235 this only effected the very first events of every sequence.
236
237 * For the extraction of the position of the maximum sample now the
238 extraction range is set automatically to the extraction window,
239 before the whole accessible range was used.
240
241 * If the number of samples in the events and the number of samples
242 in the run-header disagrees now an error is raised (this can
243 happen in not well simulated Monte Carlo files)
244
245 * In the case of MUX-data pedestal events with the lvl1 trigger flag
246 could survive into the pedestal calculation -- fixed.
247
248 * Tab "TrigPat" added showing the distribution of the trigger pattern
249 as found in the run-files (normalized with the run length)
250
251 * The selection of events from the trigger pattern has been improved.
252 If the trigger pattern is corrupted events won't pass anymore.
253
254 * Added a new command line option --dev-null to suppress output of
255 Y-files (this is useful for test cases)
256
257 * added a new tab "CalPos" showing the arrival time of extracted
258 interleaved calibration events
259
260 ;star
261
262 * the star file now contains also the sequence information
263
264 * Added a new command line option --dev-null to suppress output of
265 I-files (this is useful for test cases)
266
267 * Tab "Rate" added showing the distribution of the trigger pattern
268 (should only be Trig (Lvl1/Lvl2) and Sum (Sum only)) as found in
269 the Y-files (normalized with the run length)
270
271 * The effective on-time calculation doesn't use events with only
272 sum-trigger anymore
273
274 * The data in the MHWeather tab has been reorganized. The never
275 working solar radiation has been removed and the data from
276 the pyrometer (cloudiness, air and sky temperature) is
277 displayed in addition.
278
279 ;ganymed/sponde
280
281 * Now data points are even shown correctly if they have error bars larger
282 than one sigma. Points with null or negative significances are omitted.
283
284 * DrawNicePlot now allows to set a projection range
285
286 * Updates pointing models. One is applied after the implementation
287 of the new LUTS in August, the other one is applied after the
288 next major change of the pointing model in October. Note that
289 these models are preliminary and give wrong results below Zd=65deg
290
291 ;sponde
292
293 * fixed resource files ('''Spectrum''' instead of '''MJSpectrum''')
294
295 * a new option "--force-runtime" is available. In case of very short
296 datasets (for light-curves) which are in the order of a few
297 minutes the calculated effective on-time is not very acurate because
298 it is quantizised in the order of a minute. Therefore you can switch
299 to using the real run-time instead (remakrt: this ignores any
300 dead-time!)
301
302 * a more analytical way is used to "fill" Monte Carlos into regions
303 of impact parameters which have not been simulated because the
304 trigger efficiency is assumed to be 0.
305
306 * estimated sensitivity curves for hi and lo zenith angles are shown
307 scaled to the correct observation time and collection area
308
309 * the Monte Carlo events after cuts are now written to the output file
310 if an output file given
311
312
313
314 *** Version 2.0 (2007/09/03)
315
316 - database: the position used for the pulse pos check was missing
317 in the callisto output and could thus not be filled into the DB.
318 Also the old values seemed not exactly the PulsePos used for
319 teh check.
320
321 - general: Resource file now allow an Include-Resource, i.e. you can
322 read a resource file with default settings, include it in your
323 resource file and overwrite the settings in your file. More than
324 one include file is allowed. Inclusions can be iterative.
325 Include: mydefaults.rc yourdefaults.rc
326 The resources in the first file have higher priority than the
327 second file.
328
329 - general: Now the output files (calib*.root, etc) also contain the
330 resource file (to check it open it in the TBrowser and choose Print()
331 from the context menu)
332
333 - general: Dataset files now allow to overwrite the default path
334 to search for sequence and data files. Note, that the program
335 option and individual resources will overwrite it. For example:
336 SequencePath: /magic/montecarlo/sequences
337 DataPath: /magic/montecarlo/star
338
339 - general: Fixed a problem with variables in MDataPhrase. It seems
340 that only optimdisp (didn't work) was effected.
341
342 - general: Some improvements to the optim and train processing. For
343 example the ststud window now got a proper title.
344
345 - general: The "Status Display: " was removed from the window title
346 within an Eventloop.
347
348 - general: added a new flexible histogram-class (MHn) which can be used
349 for example in testing after optimizations or training to produce
350 user defined histograms.
351
352 - general: The Random Forest now allows attaching an evaluation
353 function which is applied to its output. This allows to train
354 on whatever you like (eg. train on log10(energy), but return
355 energy)
356
357 - general: The Random Forest training of energy (trainenergy.c) and
358 disp (traindisp.C) has been improved by more graphical output to
359 judge the result.
360
361 - general: The training of energy (trainenergy.C) has been improved
362 a lot by training on a different quantity than energy. It gives
363 a result which is highly independant of the source spectrum
364 and shows lower bias than all other options.
365
366 - general: Dataset files are allowed to contain collections of
367 datasets. For more details see the class reference of MDataSet.
368
369 - general: The default WobbleMode in a datset file now (if not
370 overwritten) is "auto", i.e. wobble mode is set if the dataset
371 doesn't contain off-sequences.
372
373 - merpp: Merpp can read file format version 9 now. Please realize
374 that for file format version 9 the extraction range is different
375 and must be set to 0/49 instead of 15/64 in callisto_mux.rc until
376 the first and last 15 slices have been removed from all MUX data.
377
378 - mars: Similar to writing movies you can now select events which
379 should be displayed in your display. Therefore add the following
380 lines to your mars.rc:
381 MFEvtNumber.FileName: ganymed00223552.root
382 MFEvtNumber.Selector: ThetaSquared.fVal<0.04 && DataType.fVal>0.5
383 The input file can be a ganymed-file after (ganymed*.root) or
384 before (ganymed*-summary.root) file. For example to select all events
385 from your on sample after cuts (excluding the ThetaSq cut) use
386 MFEvtNumber.Selector: DataType.fVal>0.5
387 To show all events from your on-sample after quality cuts
388 use the summary file instead.
389
390 - mars: new ways to call mars are implemented. Instead
391 of calling
392 mars filename.root
393 you can now also use
394 mars sequence.txt
395 or
396 mars sequence.txt inputpath
397 or replace sequence.txt by the sequence number if the default
398 sequence file should be used.
399
400 - mars: The default size has been increased
401
402 - mars: There are two new heckboxes which allow to switch off
403 the calculated image parameters
404
405 - callisto: was broken for MCs... fixed.
406
407 - callisto: improved calculation of spline coefficients a lot. This
408 leads to a further improvement of the event rate calibrating MUX
409 data of about 15% (175evt/s instead of 150evt/s)
410
411 - callisto: finally the raw data we read is now real 16bit (with
412 10bit precision) for MUX data and not a stripped 8bit number
413 anymore. Due to scaling of the numbers (without precision loss
414 into an [0-256[ range, the final numbers for pedestal, pedestalrms
415 and extacted signal don't change. However, at all places where
416 raw data is directly accessed (eg. saturation and variation
417 limits in the signal- and pedestal-extraction) the numbers
418 refer still to the data's 16bit range.
419
420 - callisto: The maximum arrival time difference used in the bad
421 pixel treatment is now in units of nanoseconds, which leads to 3.0ns
422 for both, old FADC and MUX-FADC, data.
423
424 - callisto: Be aware that callisto is now calibrating the arrival time
425 in nanoseconds rather than time slices. Also all following tasks
426 have been changed to assume ns units now. If you star data
427 calibrated with an older version it might be necessary to adapt
428 some timimng parameters (Muon Analysis and MFSoftwareTrigger)
429 to obtain optimal results. The plot in the PulsePos tab
430 will now be in ns, too. This might also mean that the Muon
431 analysis in star might not work as perfect as expected as long
432 as old files read in.
433
434 - callisto: The calibration constants of earlier updates got lost
435 somehow. All constants have been updated.
436
437 - star: The PSF is now determined from the profile of the ArcWidth
438 instead of arcwidth/radius. The old way gave to much weight
439 to the bins with low statistics. The reference lines have been
440 updated.
441
442 - star: For speed reasons events suitable for the muon analysis
443 are now also preselected by fConcCOG<0.1 which seems to be a very
444 good preselector for muons.
445
446 - star: is now calculating a new timing parameter the Slope along
447 the major and minor axis of the shower. Therefore a numerical
448 solution of a line-fit is used. To use MHillasExt.fSlopeLong
449 and MHillasExt.fSlopeTrans don't forget to multiply it with
450 the sign stored in MHillasSrc.fCosDeltaAlpha as usual.
451
452 - star: The parameters fInnerSize, fInnerLeakage1 and fInnerLeakage2
453 have been removed from MNewImagePar. They have never been good for
454 anything.
455
456 - star: Implemented a new recursive algorithm which is supposed to be
457 faster. Also implemented new cleaning oiptions, which are:
458 + CleanLevel0:
459 The cleaning level above single core pixels can be kept
460 + KeepIsolatedPixels:
461 Define whether single core pixels should be kept
462 + TimeLevel1:
463 The coincidence window in nanoseconds to single used neighbors
464 + TimeLevel2:
465 The coincidence window in nanoseconds to two used neighbors
466 + PostCleanType:
467 MOde in which a time dependent post cleaning should be applied
468 0: No post cleaning
469 1: Require for each used pixels at least one used neighbor
470 within a time-window of CleanLevel1
471 2: Require for each used pixels at least two used neighbor
472 within a time-window of CleanLevel2
473 3: Require first two and second one used neighbor
474 within a time-window of CleanLevel1 and fCleanLevel2
475 respectively
476 + RecoverIsolatedPixels:
477 - recoveres isolated core pixels if they have a used neighbor
478
479 - mars/star: The new default cleaning is:
480 + CleanLevel1: 6.0
481 + CleanLevel2: 3.0
482 + CleanTime1: 1.75
483 + CleanTime2: 1.75
484 + PostCleanType: 3
485
486 - star/ganymed: The old spark-cuts have been replaced by new ones.
487 These new spark cuts have been cross checked with the sequences
488 84720 (before splitter), 101041 (after splitter) and 223539 (new
489 FADCs). In all cases they seperate pretty well, but of course not
490 perfect. Monte Carlos have suggested to tighten the cuts a little
491 bit further at low sizes. This has been done.
492
493 - ganymed: IMPORTANT - The spark cuts have been changed to match
494 all available data more or less well. This might mean that for
495 YOUR data there are still sparks visible.
496 Whenever you do an analysis you have to make sure that NO sparks
497 survive your cuts!
498
499 - ganymed: The old hadronness and size cuts have gotten new indices
500 (10, 11). The old indices 8 and 9 now mean an additional condition
501 for ghostbusting based on the formula (dist-c[9])*c[8]-slope.
502 If you want to switch off this cut just move the line far away enough,
503 e.g. by setting c[9] to -500. Please update your ganymed.rc files
504 accordingly!
505 The unit of c[9] is deg. It is the dist at which your cut will
506 cross the slope==0. The unit of the slope is ns/deg. So if
507 you readin files calibrated with an older Mars-version you
508 have to adapt the default value for c[9] to the FADCs:
509 - Multiply by two for the MUX FADCs (run number > 200.000)
510 - Multiply by 0.3 for the Siegen FADCs (run number < 200.000)
511 - Multiply by 42 for the meaning of life (run number = 200.000)
512
513 - ganymed: The old Cut0 is now called CutQ and is calculated before
514 the source position is caluclated. If you need a quality cut
515 including source dependant data (be very carefull with this!)
516 you have to use Cut0 instead.
517
518 - ganymed: now properly supports three off regions in wobble mode.
519 It will be the default from now on in ganymed_wobble.rc. To change
520 the number of off-regions use
521 NumOffSourcePositions: 1
522 in your ganymed.rc. Also by default no off-theta cut will be done
523 anymore so that you will get a background level higher than the
524 signal level in your ThetaSq plot for ThetaSq>0.2.
525 Due to this be carefull changing the scaling mode away from
526 "None". You will underestimate your signal if your scale interval
527 is not properly set.
528 (Rem: ThetaSqN is no longer needed)
529
530 - ganymed: is now storing the events of all (on- and off-)
531 source positions even in the case of more than one off-source
532 position. This should allow sponde to work properly and the
533 energy estimation is done correctly in all cases (without any
534 "nearest position" trick)
535
536 - ganymed: From 85340 (19.3.2006) on a real starguider calibration
537 with a real pointing model for the starguider is done, calibrated
538 with more than thousand tpoints taken from this date on.
539
540 - ganymed: was broken for Wobble-MCs... fixed.
541
542 - ganymed: The default cuts (MFMagicCuts) and the disp-parametrization
543 has changed. Note that your old ganymed.rc will be incompatible
544 with the new algorithms! Please check the ganymed.rc files and
545 the class description of MFMagicCuts for more information.
546 It is recommended at the moment to use identical Disp-Parametrizations
547 for on/off- and wobble-mode. If cuts are optimized only
548 the Area-Cut (parameters 2,3,4) and the theta-sq cut (parameter 1)
549 should be optimized. All other values should be kept as they are.
550 If you want to do an anylsis without timing a parameters, you can
551 switch off the timing cuts by seeting parameter 7 to a very small
552 value (eg. -99). To remove the slope parameter from the disp
553 paremtrization set parameter 8 to 0.
554
555 - ganymed: The distribution of observation time versus zenith
556 angle is now shown for off- AND on-data.
557
558 - ganymed: The contents of the source position plot are no longer
559 averaged, thus a lot of (fake) events between the two wobble
560 positions have disappeared.
561
562 - ganymed: There is a new tab "CutT" it contains the VsSize plots
563 with the CutT, whihc is defined in ganymed.rc, applied. It
564 is resonable to use your theta-cut for it, to see if there is
565 something strange (sparks!) in your signal-region.
566
567 - ganymed: To choose a dataset from a collection in a dataset file
568 use the new command line option "--dataset=12345"
569
570 - optim, sponde: should now properly support three off-regions.
571 Just produce your ganymed summary files with three off-regions.
572 optim and sponde will automatically get all off events from
573 all off-regions from this file. Please do not forget to
574 set the scaling in optimwobble.C properly:
575 fit.SetScaleUser(1./3);
576 it is not yet read in automatically (will follow soon).
577 In the case of fixed Scale you can also use
578 cuts.SetThetaCut(MFMagicCuts::kOn);
579 no off-cut needed.
580 Be carefull in case of three off-regions when switching on
581 scale mode. Make sure that the scale interval is set correctly.
582
583 - sponde: sponde.rc and sponde_onoff.rc are now idetical
584
585 - sponde: the resouce files have been rewritten with a lot of
586 comments and a well working parametrization for an energy estimator
587
588 - sponde: In the estimated energy versus monte carlo energy plot the
589 contents where exchanged.... fixed.
590
591 - sponde: the so called "accurate"-mode has been removed. It didn't
592 give any improvement in accuracy, only decreased execution speed.
593
594 - sponde: the so called "simple"-mode has been removed. It didn't
595 give any improvement in simple.
596
597 - sponde: the so called "refill"-mode has been removed. It was anyhow
598 not implemented.
599
600 - sponde: now checks whether the theta distribution of your on-data
601 and the theta-distribution of your Monte Carlo sample (after
602 weighting) fits. If it doesn't fit properly (eg. the Monte Carlo
603 sample is incomplete) execution is stopped. Execution can be forced
604 using the new option --force-theta. Use this option with care!
605
606 - sponde: Proper collection areas can now be constructed also from
607 Monte Carlo samples generated with different maximum impact
608 parameters. Note that in previous version you neither got
609 a warning or failure, nor was there any obvious sign that the
610 collection area was overestimated due to usage of files with
611 different maximum impact parameters.
612
613 - sponde: If MC files with different lower energy limits are used
614 the primary MC spectrum is artificially completed down to the
615 lowest energy used at all. WARNING: that this gives correct
616 collection areas ONLY if none of the events in this region would
617 survive your cuts at all.
618
619 - sponde: the output file now contains more information about
620 the spectrum (eg. the full 2D collection area histogram).
621 Note, that this information can only be written to the file
622 if it is stored automatically via command line argument.
623 If you only store the status display from within the display
624 the information is lost.
625
626 - sponde: added a new tab "Disp". It shows the residual of the disp
627 (Disp-Dist) versus several parameters and it is meant to judge the
628 quality of the disp estimator. In the ideal case the residual is zero
629 and doesn't depend on any variable. The tab is displayed after
630 CutQ and Cut0.
631
632 - sponde: added a new tab "Energy". It shows the residual of the
633 energy (lg(estimated energy)-lg(monte carlo energy)) versus
634 several parameters and it is meant to judge the quality of the
635 energy estimator. In the ideal case the residual is zero
636 and doesn't depend on any variable. In reality even a good estimator
637 can show residuals versus Monte Carlo energy. The tab is displayed
638 after all cuts.
639
640 - sponde: added a new tab "EventDist" showing the unweighted real
641 absolute number of events of your sample after cuts. This tells
642 you how many events with this energy you had in your MC files.
643 The same information you get from the error bars of the weighted
644 histograms, but this is less intuitive.
645
646 - sponde: The spectrum plots now show the crab- and 1553-spectrum
647 for comparison. It is not meant to show these curves in
648 publications, they are only for production.
649
650 - sponde: The OriginalMC tree with the events produced by corsika
651 is now processed only once
652
653 - sponde: Finally fixed most annoying bug, which has effected the
654 last bin of the collection area. It was the problem that binnings
655 of root histograms are from 1 to n (included) but there was a C-like
656 loop in sponde from 0 to n (excluded). Now the loop also includes
657 correctly under- and overflow-bins. The worse thing with this is,
658 that for the events in the highest bin not only the bin-content
659 was wrong, but also the weights applied to these events, which could
660 in pricipal effect also other parts of the distribution (eg. due
661 to energy estimation). Fortunately it effected only a few events
662 in most cases.
663
664
665
666 *** Version 1.2 (2007/05/14)
667
668 - database: The database now has two new values Unsuitable50 and
669 Unsuitable01. They express the number of pixels which are
670 unsuitable for more than 50%, respectively more than 1%, of
671 all calibrated event. It is a more accurate number than the
672 previously used numbers, because they only take the first
673 calibration (ignoring the interleaved calibrations) into account.
674
675 - database: The database now has two other new values UnsuitableMax and
676 DeadMax. They express the maximum number of pixels which were
677 unsuitable, respectively dead, during the sequence. Because
678 of high pedestal rms (cars passing) a few events with very high
679 numbers of unsuitable pixels can happen. Not to suffer from this
680 effect we don't take the highest 0.1% of the numbers into account.
681
682 - general: fixed a bug which caused callisto and star to stop working
683 properly because the callisto output was currupted
684
685 - general: a script called scripts/makemovie has been added which
686 simplified the process of producing several movies from a single
687 sequence with different setup.
688
689 - callisto: Some more code cleanup. Started to remove old obsolete
690 code from cvs.
691
692 - callisto: The extraction of the pedestal with the extractor was
693 not random. It seems that extracting at one position is still biased
694 (for example in the first or last slices we could still suffer from
695 switching noise) Now it is completely random.
696
697 - callisto: In MPedCalcPedRun (which is the pedestal extraction from
698 pedestal files) individual pixels could be skipped due to high
699 variations. This was already the case for the pedestal extraction
700 from the lo-gains since the beginning and properly handled
701 there, but was introduced in the extraction from the pedestal files
702 a while ago. To calculate the average value it was still divided
703 by the number of events procesed not by the number of summands
704 really summed. This let to a pedestal which was a tiny amount too
705 small (for a few piels in the order of 0.1%). This led to an slightly
706 positive offset of the randomly extracted pedestal for a few pixels.
707 I doubt that this has a big effect on the result, because the effect
708 on the individual numbers is quite small. Due to this it is suggested
709 that you rerun your calibration to make sure you are without any
710 avoidable bias.
711
712 - callisto: the ArrTimeRmsLimit is now is a check of the deviation from
713 the median rms of the absolute arrival time and expressed in significance
714 levels. This replaces the old meaning of an abolute upper limit. An
715 absolute upper limit doesn't make much sense, because in our data
716 all arrival times are shifted at the same time (in fact it might be
717 a shift of the artificial trigger w.r.t. to the light flash).
718
719 - callisto: Added a new tab "BadPixTm" which shows the time evolution
720 of the number of unsuitable pixels over the whole sequence. This
721 is usefull mainly to judge if an intermediate calibration had
722 problems.
723
724 - callisto: Added a new tab "DeadPixTm" which shows the time evolution
725 of the number of dead pixels over the whole sequence. Dead pixels
726 in this context are unmapped pixels, i.e. pixels which could not
727 be interpolated, and thus are ignored in the further analysis.
728
729 - callisto: It is now possible to use the position of the maximum
730 of the spline as arrival time instead of the leading edge even
731 when using the integral for the signal. Therefor set the extraction
732 type to kIntegralRel ("IntegralRelative") and the relative height
733 ("HeightTm") to -1:
734 MJPedestalC1.ExtractSignal.ExtractionType: IntegralRelative
735 MJPedestalC1.ExtractSignal.HeightTm: -1
736
737
738
739
740 *** Version 1.1 (2007/04/27)
741
742 - general: The new class MGeomCamDwarf contains the camera geometry
743 for our prefered Dwarf camera and can be used to create general
744 geometries of roundish or hexagonal cameras.
745
746 - mars: The default cleaning is now abolute 8.5/4.0.
747
748 - mars: The resource file mars.rc now contains examples for MUX data
749
750 - merpp: Implemented file format version 8 (MUX FADC data). The 16-bit
751 data containing only 10-bit information is still cooked down to
752 8-bit, by cutting away the lowest 8-bit.
753
754 - merpp: When reading raw data the data is now stored in a single
755 array. The lo-gain array is obsolete. The interface stays the same.
756
757 - callisto: To process the new MUX data use the resource file
758 callisto_mux.rc
759
760 - callisto: The -root and -raw options to read merpped raw data have
761 been removed
762
763 - callisto: If the -mc option is given the sequence-name can now be
764 replaced by the MC sequence number
765
766 - callisto: If the sequence file contains "MonteCarlo: Yes" the
767 -mc option can now be omitted
768
769 - callisto: Started further simplification by removing obsolete
770 dependancies on MCalibIntensity*Cams.
771
772 - callisto: removed unsused intensity calibration from MJCalibration
773 for further simplification
774
775 - callisto: for simplification removed references to
776 MBadPixelsIntensityCam, MCalibrationIntensityQECam,
777 MCalibrationIntensityRelTimeCam, MCalibrationIntensityTestCam,
778 MCalibrationIntensityChargeCam, and MCalibrationIntensityBlindCam
779 (this should at minimum change nothing at all, and at maximum
780 improve thing if these containers where somewhere not handled
781 properly)
782
783 - callisto: Added the option to write an event movie. Please use
784 this option with care (huge files) but exessively to understand
785 our events. For further documentation please refer to the
786 IACT wiki
787 (currently at http://www.astro.uni.wuerzburg.de/mediawiki-1.9.0)
788
789 - callisto: Improved binning for the pulse position check histogram
790
791 - callisto: The code calculating the pulse position checknow takes
792 the pedestal into account
793
794 - callisto: The arrival time is now stored with full precision this
795 helps to get rid of artefacts in histograms. For the signal this
796 is not necessray because it is displayed in log-scale anyhow
797
798 - callisto: Fixed a problem with internal exclusions. Pixels which
799 have once been marked as unsuitable didn't get the necessary
800 histograms filled anymore to be rechecked with each interleaved
801 calibration.
802
803 - callisto: The relative arrival time resolution (the rms of the
804 relative arrival time offset) is now checked against its
805 median and the median deviation, instead of the average
806 plus an absolute offset.
807
808 - callisto: The relative arrival time offset is now calculated
809 w.r.t. its median not w.r.t. to an artificial reference pixel.
810
811 - callisto: The relative time calibration now marks pixels with
812 outlaying offset as unsuitable
813
814 - callisto: The interleaved relative time calibration has been switched
815 on. The advantage is that pixels which are marked as outliers
816 now can recover. An improvement over time is not expected, because
817 the relative time calibration seems stable.
818
819 - ganymed: If the dataset file containes "MonteCarlo: Yes" the "-mc"
820 option can now be omitted.
821
822 - ganymed: If either the dataset file containes "MonteCarlo: Yes"
823 or the option "-mc" is specified as default the monte carlo datacenter
824 paths (/magic/montecarlo/...) are used if not overwritten in the
825 dataset file.
826
827 - ganymed: The output files now contain run- and event-number for all
828 events, accessible as RunNumber.fVal and EvtNumber.fVal
829
830 - ganymed: Added a plot showing the source position in the camera also
831 for wobble mode
832
833 - ganymed: In addition to the existing task which can be setup to
834 be executed after Cut1 a final task called "EstimateEnergy"
835 has been added, executed before writing the final output
836 (ganymed00000000.root). The task setup in all three cases
837 can be choosen individually. (For all three(!) cases you
838 can for example choose MRanForestCalc. For examples see all
839 sponde*.rc and all ganymed*rc)
840
841 - ganymed: If a container "MEstimatedEnergy" is found in the
842 parameter list (eg. because it was setup by MEstimateEnergy)
843 it will be written to the output file.
844
845
846
847 *** Version 1.0 (2007/02/16)
848
849 - database: Website to plot values from the database has been added.
850
851 - database: The rate of spark events as found by star is now kept
852 and the rate after cleaning is now with spark events subtracted
853
854 - general: The changes to the interpretation of phrases lead to
855 a problem with the access of MHMatrix objects (eg. "M[0]")... fixed.
856
857 - general: Added example files how you can create your own calendar
858 (eg. as christmas present) with Mars. Just run
859 root macros/tutorials/calendar.C
860
861 - general: Added a possibility to display grouped data in the plotdb.C
862 macro (and similar macros). This allows to plot hourly, nightly,
863 weekly, monthly and yearly averages.
864 For more details see the plotall function of the macro
865
866 - general: fixed the error display of the camera display. It showed
867 wrong results.
868
869 - general: fixed a memory leak when reading many MStatusDisplays
870
871 - general: added a macro (macros/tutorials/mirrordelay.C) plotting the delay
872 between a spherical and a parabolic mirror
873
874 - callisto: We have a new pulse position check which takes the properties
875 of the extractor automatically into account. So no need to set
876 ExtractWinLeft/Right anymore. Again a check for pulses too much to the
877 left is done. If possible the lo-gain extraction start and hi-gain
878 extraction end is changed accordingly. If no proper extraction range
879 can be set (hi-gain too much to the left) an error is raised.
880
881 - callisto: New swapped pixels have been found and corrected
882
883 - callisto: Redone the signal extraction this includes:
884 + Unified the algorithms to extract the pedestal for all pedestal
885 extractions done
886 + Unification of hi- and lo-gain into one array
887 + Unification of hi- and lo-gain extraction for Spline and
888 Digital Filter (means now exactly the same algorithm is used,
889 not a copy-and-pasted one)
890 + Store pedestal subtracted data in a common place
891 + Improved extraction algorithms. If the algorithms search a
892 maximum but don't find one they don't return the maximum anymore
893 + Improved the extraction such that a information for signal
894 and time which is consistent is returned
895 + replaced the numerical spline with a (not slower) analytical
896 solution
897 + Lowered the saturation limit from 250 to 245 to make sure that
898 we are far away in all pixels from problems with the clock-noise
899 + The start of the lo-gain extraction is calculated from the hi-gain
900 arrival time. In case of saturation an estimation is used.
901 + the hi-gain window was extended to slice 16. This allows extraction
902 of very late pulses in single pixels or of huge hadron showers.
903 + Now uses the lo-gain extraction range for pedestal extraction,
904 not the hi-gain range in the lo-gain
905
906 - callisto: New hi-/lo-gain calibration constants have been produced
907 for all periods from the statistic of the whole period. They are
908 now used automatically depending on the periods. The old constants
909 where deviation in avarega about 2%-3%. The constants are very
910 stable from period to period (<<1%) except for exchanged channels.
911 In a few cases the constants used so far were off by 1%-2% (maybe
912 temperature effects?)
913
914 - callisto: To gain obsolete space we do not write the
915 MPedestalFundamental anymore. Also calibration and bad pixel
916 treatment is not done for it anymore because it has never been used.
917
918 - callisto: Fixed a bug in the seuqence handling which caused the
919 light condition to be ignored
920
921 - star: Added two new tabs "Sparkless" and "Sparks" these tabs show
922 basically the same as "Cleaned" but the distribution devided into
923 the events fullfilling a spark cut or being rejected by it.
924 This cut can be changed from star.rc (see example inside) by
925 the "SparkCut" directive
926
927 - star: Star displays now the average individual pixel-rate (IPR) versus
928 time and the average discriminator threshold (DT) of all pixels.
929
930 - optim: fixed a problem with the optim-macros which was due to a bug
931 in the new phrase parsing
932
933 - ganymed: To get a nice FalseSource plot (instead of the all-information
934 debug plot displayed as a standard plot) use the context menu
935 somewhere between the two upper plots, click on "DrawNicePlot"
936 and enjoy the result. (It is the same context menu which contains
937 the other options)
938 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
939
940 - ganymed/optim/train: The cut program, trainings- and optimization
941 macros could run with less files found than expected from the
942 sequence-files. No the execution is stopped in this case.
943
944 - ganymed: now stores the dataset in the output file with all information
945 contained (as sequence number, sequence path, data path) so that the
946 used dataset file can be recreated complete from the output
947
948 - sponde: now also allows the uasge of random forest
949
950 - sponde: added a plot showing the cut efficiency
951
952 - sponde: Using root versions < 5.13/04 still resulted in wrong binomial
953 errors (eg. effecting the collection area) because the errors of the
954 two histograms were swapped in the calculation, which makes a difference
955 in the case the histograms contains weighted events. Aditionally the
956 totalarea was incorrectly taken into account, which results in too small
957 errors, which makes a difference at low statistics were the errors
958 or the collection area dominate.
959
960
961
962 *** Version 0.10.3 (2006/10/23)
963
964 - database: Implemented ObservationMode flag in websites.
965
966 - database: For sequences there is now also the stoptime available on the
967 websites.
968
969 - database: Removed ManuallyChanged flag from sequence-info websites,
970 as it is not needed anymore with the new sequence building algorithm.
971
972 - general: MRolke.[cc,h]: Modification of TRolke from root_v5.12.00b.
973 Class for calculation of confidence intervals (upper limits).
974 Use model 3 or 4 for upper limit calculation for MAGIC observations.
975 Please read the class instruction of TRolke for more information.
976
977 - general: The programs now return 0xfe if the requested resource file
978 doesn't exist.
979
980 - general: Errors comming from root itself are now not output to
981 stderr anymore but to our default (colored) log-stream.
982
983 - general: Changed the interface to TFormula such that now everything
984 is parsed by TFormula, which should allow to use phrases even
985 without paranthesis correctly parsed.
986
987 - callisto: replaced the AdHoc number of effective integration slices
988 in the digital filter by an average of the correct number, averaged
989 over all possible set of weights. This also gives correct numbers
990 for the lo-gains which were totally wrong before.
991
992 - callisto: drastically reduced memory consumption by not storing
993 all intermediate calibration results in memory anymore (we might
994 write them into a file in the future)
995
996 - ganymed: To get a nice Theta-Sq plot (instead of the all-information
997 debug plot displayed as a standard plot) use the context menu
998 somewhere between the two upper plots, click on "DrawNicePlot"
999 and enjoy the result. (It is the same context menu which contains
1000 the "DrawAll" option)
1001 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
1002
1003
1004
1005 *** Version 0.10.2 (2006/10/15)
1006
1007 - general: changed the building of the sequence files such, that
1008 the source-/project name in case of wobble-sources is not the
1009 source/project of the first data run anymore but the new generalized
1010 wobble source/project
1011
1012 - general: Added some functions to MAstro to calculate sun and
1013 moon properties
1014
1015 - general: Added two new macros (starvisday.C and starvisyear.C)
1016 which allow to plot the visibility of several stars in one day
1017 or of one star along one year
1018
1019
1020
1021 *** Version 0.10.1 (2006/10/11)
1022
1023 - general: HTML logging output was distorted... fixed.
1024
1025 - general: Changed the writing of the sequencefiles such that only
1026 as many pedestal files as giving at least 1000 pedestal events which
1027 are nearby the first calibration run are used as pedestal runs
1028
1029 - sponde: In the calculation of the collection area(s) and the
1030 distribution for MOnte Carlo and estimated energy the error
1031 calculation was wrong because root didn't take the errors
1032 properly into account... fixed.
1033
1034
1035
1036 *** Version 0.10 (2006/10/10)
1037
1038 - general: all executables now check consistency of the root version
1039 installed with the root version used for compilation. The return
1040 code in this case is 255.
1041
1042 - general: The algorithm to build seqeunces has been redesigned
1043 completly. It is now more flexible in terms of a resource file
1044 resources/sequences.rc which can be used to partly overwrite
1045 the default algorithm and defined the important part of the
1046 algorithm. It also takes correctly into account several ways
1047 of taking wobble-data. Currently the new algorithm doesn't take
1048 the number of pedestal events anymore into account (so a sequence
1049 could have much less than 1000 pedestal events and data runs are
1050 no-more used instead)
1051
1052 - general: a lot of small changes to make the code compatible with
1053 root 5.12/00 and gcc 4.1
1054
1055 - general: Fixed some warnings thrown if more warnings are switched
1056 on in the compiler
1057
1058 - general: Added a function to MMath which returns the Median of
1059 the distribution abs(y[i]-median) but at 68:32 division instead
1060 of 50:50, which is somehow the median counterpart of the rms.
1061
1062 - general: MAstroCatalog allows now to read calatog files (as bsc5)
1063 even if they are compressed with gzip (recommended compression
1064 is with "-1")
1065
1066 - showplot:
1067 + batch mode creation of image files now works with root 5.12/00
1068 + added support for writing bmp (though it never produces
1069 bmp which can be read by programs like xv or gimp)
1070 + added support for xml
1071 + added new option to start the display with a different size, by
1072 --display-width=nnn or --display-height=nnn
1073 + added options to define the canvas size when the display is started
1074 --canvas-width=nnn or --canvas-height=nnn
1075 the option can also be used for batch-mode conversion
1076 + added an option which automatically fits the display size to the
1077 desktop-size: --auto-size
1078
1079 - merpp: didn't recognize files with the extension .raw.gz - fixed.
1080
1081 - merpp: allow the reports to have 1000ms due to a bug in the camera
1082 program.
1083
1084 - callisto: New swapped pixels have been found and corrected. For
1085 details see MRawRunHeader::FixAssignment()
1086
1087 - callisto: Callisto now raises an error if one of the input files could
1088 not be opened.
1089
1090 - callisto: In some rare cases it could happen that in the signal
1091 extraction of the digital filter the extractor returned nonsense
1092 results due a wrong initializion of a variable (this happens in
1093 cases in which the extracted signal is exactly zero or the
1094 digital filter couldn't slide because of a too small extraction
1095 window, which could happen in the lo-gain extraction)
1096
1097 - callisto: The lo-gains have been marked as valid in some cases
1098 when they got not extracted at all (deltsumlo=deltatimelo=0) because
1099 the allowed extraction range (fLoGainLast-fLoGainFirst) was
1100 smaller than the number of slices (fLoGainWindowSize) needed
1101 by the lo-gain extractor
1102
1103 - callisto: Updated absolute calibration constants (muon calibration)
1104
1105 - callisto: fixed a bug which caused the hi-gain saturation not
1106 to be handled properly in the spline (the position of the
1107 saturation was calculated incorrectly)
1108
1109 - callisto: fixed a bug which gave weird results if hi- _and_
1110 lo-gain could not be extracted properly. In some cases hi-
1111 and lo-gain have not been extracted at all and the random result
1112 got calibrated. In other cases the hi-gain was saturating and the
1113 lo-gain has not been extracted. For this a completly arbitraty
1114 scale factor was applied to the result from extracting the
1115 charge of the saturating hi-gain.
1116
1117 - callisto: improves handling of extracted signal if lo- and/or
1118 hi-gain could not be extracted properly. If no appropriate
1119 calibration of either the signal or the arrival time is possible
1120 the pixel is now markes as unsuitable instead of estimated.
1121
1122 - callisto: Fixed a problem in the spline extraction which gave
1123 weird results if the signal was extracted from the first (and
1124 highest) slice (as a workaround extraction from the first
1125 slice has been forbidden)
1126
1127 - callisto: Fixed a bug regarding the use of the QE which doesn't
1128 effect the result because the default is used anyhow.
1129 (The bug was there since 14/07/2005)
1130
1131 - callisto: Changed the default for fgLoGainStartShift to -2.4
1132
1133 - callisto: Fixed a bug which caused all hi-/lo-gain calibration
1134 factors to be always 10 for all pixels as soon as the first
1135 calibration update has happend.
1136
1137 - callisto: Fixed the hi-/lo-gain offset for the Digital Filter. It
1138 was off by more than one slice (which gives wrong values for
1139 pixels which have saturated the hi-gain) This was a problem
1140 mainly for timing studies, not so much for the automatic standard
1141 analysis. Also the values for the Spline have been changed slightly:
1142 + Digital Filter from 1.70 to 0.95
1143 + Spline from 1.39 to 1.30
1144 The numbers were sorted out by an extensive test in the
1145 test-database.
1146
1147 - callisto: Removed the tab showing the average calibrated arrival
1148 time. It never gave useful information.
1149
1150 - callisto: Now tab "HiLoCal" which shows the ratio between hi- and
1151 lo-gain pulse for data pulses if hi- and lo-gain have saturated
1152 and both were extracted because the hi-gain was above the
1153 LoGainSwitch.
1154
1155 - callisto: Now tab "HiLoOff" which shows the offset between hi- and
1156 lo-gain pulse position (after application of LoGainOffset, which
1157 means in the ideal case it is 0) for data pulses if hi- and lo-gain
1158 have saturated and both were extracted because the hi-gain was above
1159 the LoGainSwitch.
1160
1161 - callisto: After extensive tests a new threshold level for determination
1162 of the pulse position has been found at 50phe. This is due to the
1163 fact that for lower pulses the arrival time changes its average
1164 behaviour dramatically. It tends to the average of the extraction
1165 range and starts sticking to non-floating point numbers (5, 6, 7, ...)
1166
1167 - callisto: Added two more plots to the calibration part. The average
1168 extracted signal and the average extracted arrival time as
1169 extracted by the signal extractor (This can help debugging problems
1170 because it doesn't involve a fit)
1171
1172 - star: changed the fit for the effective on time such that initial
1173 values are calculated automatically now instead of using build
1174 in values. This makes the fit more indepedant of the underlaying
1175 rates. With a test of ~350 sequences in the test database it could
1176 be shown that the new fit gives the same result +/-1sek.
1177 The highest deviation was +5s the lowest -10s. You can now control
1178 the bahaviour with two resource values:
1179 MHEffectiveOnTime.FistBin: 3
1180 MHEffectiveOnTime.NumEvents: 12000
1181 Use FirstBin=1 and NumEvents=120 to fit the effective on time
1182 from the resulting gamma candidates
1183
1184 - star: The Center histogram in MHHillas is now by default displayed
1185 with the colz draw-option
1186
1187 - ganymed: now produces valid error codes if failed
1188
1189 - ganymed: MFMagicCuts now supports a hadronness cut. Switch it on
1190 with the option "hadronness" instead of "area" or "both" if
1191 you want to use both cuts. The hadronness cut includes a fixed
1192 cut in hadronness (index 8) and a fixed cut in size (index 9).
1193
1194 - ganymed: MFMagicCuts: fixed abug introduced 2005/7/14 which caused
1195 the M3Long of the anti source to be not properly evaluated
1196 (actually is was evaluated as a unique random number) in case
1197 of optimization with anti-theta cut switched on. This might have
1198 lead to improper, but not necessarily wrong, optimization results.
1199
1200 - ganymed: ganymed_onoff.rc, ganymed_wobble.rc - updated with comments
1201 how to use random forest
1202
1203 - ganymed: use the same spark cuts as in ganymed_wobble.rc as in
1204 ganymed_onoff.rc. Seems to be unintentional that they were different.
1205
1206 - sponde: Since the introduction of the possibility to define a
1207 normalization energy instead of using the integral the default
1208 was not using the integral anymore but a normalization energy of
1209 1GeV. It is now the integral again.
1210
1211 - sponde: Fixed a problem in the weighting which did not allow
1212 a MC slope of -1.
1213
1214
1215
1216 *** Version 0.9.6 (2006/05/24)
1217
1218 - general: changed the binning of the azimuthal profile of the camera
1219 such that it is aligned with the 60deg boundaries.
1220
1221 - merpp: better handling of problems with the TH, TD part of the
1222 CC-REPORT for files older than 200507190 and 200412210
1223 respectively
1224
1225 - merpp: improved handling of RECEIVERS-COM-ERROR in CC-REPORT
1226
1227 - merpp: implementd latest changes in starguider reports (sinc 9th May)
1228
1229 - callisto: if an arrival time is extracted outside the fadc range is
1230 was set to the boundary before. Now a random number is assigned
1231 instead to avoid unfortunate coincidences of arrival times just
1232 by this arbitrary value.
1233
1234 - callisto: added a new option to callisto.rc which allows
1235 to set the maximum arrival time difference allowed for the
1236 badpixel algorithm to determin whether a pixels belongs to a shower:
1237 MJCalibrateSignal.MBadPixelsTreat.MaxArrivalTimeDiff: 0.9
1238
1239 - callisto: changed the old value (0.5) for MaxArrivalTimeDiff
1240 to 0.9 as suggested by Stefan due to a recent study on the fraction
1241 of pixels surviving the image cleaning
1242
1243 - callisto: switched off error in case of "pulse is too much to the left"
1244
1245 - callisto: The extraction window is not adapted anymore. This means that
1246 the pulse is extracted from the full range. The draw-back is that the
1247 background (pedestal) will become slightly higher. Switching on/off
1248 the PulsePosCheck in the callisto.rc only effects filling the
1249 histograms.
1250 WARNING: If the pulse is too much to the left data is calibrated!
1251 Check the PulsePosCheck-PulsePosition AND the Inhomogeneity parameter
1252 in the database to make sure that your data is valid!
1253
1254 - star: Show also the number of stars correlated correctly by the
1255 starguider
1256
1257 - ganymed: implemented a new class (MHThetaSqN) which allows to use more
1258 than one off-source region in wobble-mode. To use it add the following to
1259 your ganymed_wobble.rc:
1260 + MJCut.NameHist: MHThetaSqN (switch the new feature on)
1261 + MHThetaSqN.NumOffSourcePos: 3 (define number of off-regions)
1262 + MHThetaSqN.DoOffCut: Yes,No (switch on/off the off-cut)
1263 + Cut1.ThetaCut: None
1264 + MHThetaSqN.SignificanceCutLevel: 2.0 (increase off-cut by 2.0/1.7)
1265
1266 - ganymed: in the case the latest report is older than a default (currently
1267 one minute) and the current report will be skip the starguider
1268 correction and calibration will be reset. The maximum age can be
1269 setup from ganymed.rc by (minutes):
1270 MPointingDevCalc.MaxAge: 1.5
1271
1272 - ganymed: A first implementation showing all size-bins for the theta-sq
1273 resp. alpha-plots in a single tab automatically
1274
1275
1276
1277 *** Version 0.9.5.1 (2006/05/05)
1278
1279 - general: Added a new option "zdiff" to the Makefile which runs
1280 "cvs diff" as "make diff" would do, but with compression
1281
1282 - general: accelerated MTFillMatrix (used for eample in all training
1283 and optimization macros) by skipping some obsolete calles in the
1284 eventloop the first and second loop could be accelerated by ~20%
1285
1286 - general: Added a missing feature in the MFilterList class which
1287 prevented MFEnergySlope from working correctly in trainenergy.C
1288
1289 - general: Accelerated the random forest training and usage a bit
1290
1291 - merpp: Adapted to new raw data file format version 6
1292
1293 - merpp: fixed a problem with reading the starguider reports
1294 after 6.3.2006
1295
1296 - callisto: At some times six pixels had to be exchanged manually in the
1297 data. If the pixels to be swaped are both not found, an error was raised
1298 and calibration was stopped. Now it is assumed they are intentially not
1299 mapped and the Error has been changed to a Warning.
1300
1301 - star: Added new image cleaning based on the arrival time of the shower.
1302 The new cleaning can be accessed using the parameter "Time" instead of
1303 the the old one (like "Absolute) in the star.rc-file.
1304 Recommended parameters:
1305 + MImgCleanStd.CleanLevel1: 8.2
1306 + MImgCleanStd.CleanLevel2: 5
1307 + MImgCleanStd.CleanRings: 2
1308 + MImgCleanStd.KeepSinglePixels: No
1309
1310 - star: Simplified the calculation of the effective on time. By letting
1311 the fit start in the third bin the result should become more stable.
1312 The fit quality is now ignored for the theta-plot which is not used
1313 in the analysis later. Still better pre-cut which, for example,
1314 remove events triggered by car-light (rate changing on a short
1315 time-scale) are missing.
1316
1317 - macros: optimonoff.C, optimwobble.C: implemented a new strategy
1318 for optimization (kWeakSource) which is suggested by the Berlin
1319 people for weak sources.
1320
1321 - macros: plotdb.C:
1322 + if no dataset and no time-interval is given only sequences with
1323 an effective on-time above five minutes are plotted anymore
1324 + added a new tab "RelTime" displaying the relative on-time
1325 (effective on-time divided by the observation time)
1326
1327 - macros: optim*.C: by skipping some obsolete calles in the eventloop
1328 the optimization became a lot faster
1329
1330 - ganymed: In the second loop the MHNewImagePar histograms disapeared.
1331 To display them just delete the pads displayed on top.
1332
1333 - ganymed: fixed a bug which could cause strange behaviour in wobble
1334 mode if no starguider information was available due to an incorrect
1335 initialization of the starguider calibration
1336
1337 - ganymed: The scale region in the False Source Plot (MHDisp) can now
1338 be changed from within the plot. It can also be setup from the
1339 resource file using:
1340 + MHDisp.fScaleMin: 0.325
1341 + MHDisp.fScaleMax: 0.475
1342
1343 - ganymed, showplot: Fixed a problem with the fit to the off-data
1344 (HistOff) which could cause a time lag or an inifinite loop.
1345 The bug did not effect the results at all.
1346
1347 - sponde: Added a new tab showing the effective collection area after
1348 trigger (including the software trigger)
1349
1350 - sponde: MMcSpectrumWeight has a new option which allows to define
1351 the scaling factor not by the integral of the events but at
1352 a defined energy:
1353 e.g. MMcSpectrumWeight.NormEnergy: 200
1354
1355 - MTFillMatrix, sponde: by skipping some obsolete calles in the
1356 eventloops the loop could be accelerated by ~20%
1357
1358
1359
1360 *** Version 0.9.5 (2006/03/13)
1361
1362 - macros: fixed a typo optimwoble.C (SetThetaCut instead SetAlphaCut)
1363 and added the standard Disp-parametrization
1364
1365 - macros: added a new macro datacenter/macros/plotstat.C allowing
1366 to plot statistics about the data processing
1367
1368 - macros: added a new macro to plot the muon correction coefficients
1369 versus period (macros/plot/mucal.C)
1370
1371 - showplot: path inflation for ganymed files was broken
1372
1373 - callisto: Fixed an important bug. When the number of saturating pixels
1374 were calculated the bad pixel information already available from the
1375 calibration was ignored. This yields wrong values in case pixels
1376 are broken and saturate all the time or randomly.
1377
1378 - callisto: Updated Muon calibration constants. Spline data now also uses
1379 different values for different periods
1380
1381 - star: The time-evolution shown in the effective on-time plot now displays
1382 the axis range (if there are no holes it should be similar to the
1383 effective on-time)
1384
1385 - star: Added two new image parameters:
1386 + MNewImagePar.fConcCOG: The ratio of the equivalent signals of
1387 the three pixels next to the center of gravity and the size
1388 + MNewImagePar.fConcCore: The ratio of the signals of all
1389 pixels inside or touching the ellipse and the size
1390
1391 - ganymed: now stops in requested source isn't found in catalog file
1392
1393 - ganymed: Many improvements to the phi-plot in wobble mode:
1394 + with a template the ideal background is displayed
1395 + a possible camera inhomogeneity is taken into account
1396 + the anti theta cut is better supported
1397 + the phi cut is automatically calculated from the theta cut
1398 See the examples in ganymed_wobble.rc for more details.
1399
1400 - ganymed: fixed plot for E^2*dN/dE. The spectrum was multiplied with two
1401 times the bin-width instead of the absolute energy
1402
1403 - ganymed: New cuts for on/off and wobble mode
1404
1405 - ganymed: The smearing of the False Source plot has been increased
1406 to 0.06
1407
1408 - ganymed: The starguider calibration can now be changed from the
1409 resource file.
1410 See the examples in ganymed*.rc for more details.
1411
1412 - ganymed: added a new option for on-/off-observations
1413 MJCut.RandomSourcePosition
1414 If switched on the distribution of observation time of the source
1415 position in the camera is calculated from the on-data and randomly
1416 applied with this distrbution to the off-data.
1417
1418 - ganymed: by skipping some obsolete calles in the eventloop the
1419 first and second loop could be accelerated by ~20%
1420
1421 - ganymed: The default in ganymed_onoff.rc is now to determin the source
1422 position in the off-data randomly according to its distribution in the
1423 on-data.
1424
1425
1426
1427 *** Version 0.9.4.3 (2006/02/13)
1428
1429 - general: Fixed a bug in most of the programs which prevented the
1430 compile date in the startup message to be displayed
1431
1432 - general: Simplified program calls. The following abbreviations
1433 are now possible:
1434 showlog callisto 55599
1435 showplot signal 55599
1436 star 55599
1437 callisto 55999
1438 ganymed 2
1439 In this cases the corrsponding root-, log-, sequence- or dataset-
1440 filename is automatically compiled using the default datacenter
1441 paths ("/magic/*")
1442
1443 - general: Fixed a long outstanding bug which made axis tick marks
1444 disappear if MDataFormula was used (eg. abs(x))
1445
1446 - general: Updated MMath with new functions to calculate the results of
1447 a exponential, logarithmic and powerlaw fits analytically.
1448
1449 - general: Updated some macros with comments:
1450 + macros/optim/optimdisp.C
1451 + macros/optim/optimenergy.C
1452 + macros/optim/optimwobble.C:
1453
1454 - general: MTFillMatrix (the class to fill one or two MHMatrix from
1455 files) now allows adding a pre-cut like in the optimization. E.g. this
1456 is useful to perform g/h-separation cuts before training the random
1457 forest.
1458
1459 - general: Between the rund 53300 and 68754 the pixels 553-558 were not
1460 correctly assigned in the raw data assignement table. A fix to correct
1461 the assignment tabel have been implemented.
1462
1463 - general: MAstroCatalog now allows rotating of the sky-grid and stars
1464 by 90, 180 and 270 deg.
1465
1466 - general: the macro plotdb.C now allows to highlight sequences belonging
1467 to a datset. For more details see the descritions in the macro.
1468
1469 - StatusDisplay: Fixed the algorithm to calculate the size ratio
1470 of the display, it gave wrong results espacially for big sizes.
1471 Now the embedded canvas should always have a ratio width/height=3/2.
1472 The "Size" options have been updated with values fitting the 3/2
1473 size ratio.
1474
1475 - RanForest:
1476 + Updated the random forest classes to support also the
1477 regression method implemented by Thomas H.
1478 + added new tutorial macro how to train the random forest
1479 for energy estimation (macros/optim/rfenergyest.C)
1480 + new classes to train the random forest (still in development)
1481 mjtrain/MJTrainEnergy, mjtrain/MJTrainDisp, mjtrain/MJTrainSeparation
1482 + new tutorial macros for random forest training in macros/train
1483 trainenergy.C, traindisp.C, trainseparation.C
1484
1485 - mars: now allows to setup a cut in the resource file mars.rc to choose
1486 the events to be displayed, eg:
1487 Cut.Condition: {0} && {1}
1488 Cut.0: MHillas.fSize>100
1489 Cut.1: MHillas.fSize<900
1490
1491 - merpp: Made aware of the new .rep format 200510250. This includes
1492 interpretation of the Receiver Board Temperatures (MCameraRecTemp),
1493 the discriminator thresholds (MCameraTD) and the disciminator
1494 delays (MCameraTD). All of them come with the CC report and are therefor
1495 written to the CC tree.
1496
1497 - callisto: fixed a bug in the calculation of the arrival times in
1498 the Digital Filter. They were all shifted by the same amount
1499 fHiGainFirst. This caused an offset in the order of the position of
1500 the left border of the extraction window in the times calculated
1501 from high-gain and from low-gain. The bug effected only the absolute
1502 arrival times. The bug was there since 30.1.2005.
1503
1504 - callisto: Changed the ExtractionWindow for the pulse position check
1505 such that the camera inhomogeneity becomes as less as possible and
1506 comparable to the pulso position check switched off. More details
1507 on the study will be given at our result web-page.
1508
1509 - ganymed: ganymed.rc, ganymed_onoff.rc:
1510 changed to new cuts trained with 1ES1218 and Crab-data
1511 for maximum sigma*log10(excess)
1512
1513 - ganymed: In addition to the Hadronness calculator (CalcHadronness)
1514 a new option was implemented to estimate Disp (CalcDisp)
1515
1516 - ganymed: Implemented two new options which allow
1517 to overwrite the default path to search for the sequence files
1518 --ins=/magic/sequences
1519 and where to search for the image data
1520 --ind=/magic/data/star
1521
1522 - ganymed: MSrcPosCorrect now allows overwriting of the misfocussing
1523 dx/dy from the resource file by
1524 MSrcPosCorrect.Dx
1525 MSrcPosCorrect.Dy
1526
1527 - ganymed: fixed reading the source catalog. Only as many chars
1528 as the requested source name had were compared (If a source
1529 "1ES1218" and "1ES1218+304" were in the catalog and "1ES1218+304"
1530 were requested it could happen that the coordinates of
1531 "1ES1218" were read) The source coordinates are now printed
1532 in addition to its name to the logging output.
1533
1534 - ganymed: changed the background fit in the case of a ThetaSq function
1535 from a polynomial to a exponential, this should give a big improvement
1536 for on-only analysis'
1537
1538 - ganymed/sponde: Calculation of the error of single size-/energy-
1539 bins now uses Li/Ma (5) instead of LiMa (17)
1540
1541 - sponde: Added a plot E^2*dN/dE
1542
1543 - sponde: The energy estimator plot should now show values like
1544 they are commonly used.
1545
1546 - sponde: Now MMcSpectrumWeight also excepts formulas with two X
1547 (a powerlaw with cutoff didn't work before)
1548
1549
1550
1551 *** Version 0.9.4.2 (2005/10/01)
1552
1553 - general: added new tutorial macro macros/tutorials/threshold.C:
1554 how to calculate the threshold
1555
1556 - general: added a new game. Start it from the interpreter with
1557 MagicJam j; (other games are: MineSweeper, MagicSnake, MagicDomino
1558 and MagicReversi)
1559
1560 - general: neighbor pixels in MGeoms are now sorted clockwise
1561
1562 - merpp: made aware of new format 20050829-0
1563
1564 - callisto: New scale factors from muon analysis, stored in new
1565 resource file resources/calibration.rc
1566
1567 - callisto: MBadPixelsCalc now raises an error instead of simply stopping
1568 the eventloop if something went wrong. This is necessary for the
1569 automatic processing
1570
1571 - callisto: Implemented a new treatment for the time information
1572 developed by S.Ruegamer, this should give much better response than
1573 the old very primitive algorithm. This is especially important
1574 for bad pixels due to bright stars as Ceta-Tauri (btw: the old
1575 treatment was buggy! As neighbor pixels to interpolate the
1576 arrival times always the pixels 0 to 5 were taken)
1577
1578 - callisto: In addition to the new treatment of arrival times the
1579 decision of the treatment whether a pixel contains shower
1580 information or not is used to improve the signal interpolation
1581 further. Previously interpolated pixels showed a non-zero signal
1582 do the peak searching signal extractors. Having a signal pixel
1583 beside raised the signal above the cleaning level. Thus the
1584 pixel survived cleaning to often but with a too low mean signal.
1585 By replacing empty pixels with a gaus (mean and rms from the
1586 corresponding Area entries in MPedPhotCam) this effect can
1587 be supressed.
1588
1589 - callisto: The status "unmapped" (for pixel which cannot be interpolated)
1590 got lost when the events were stored by the calibration... fixed.
1591 (This was no problem for normal image cleaning because the pixel
1592 content was artificially set to 0 not surviving standard cleaning
1593 algorithm)
1594
1595 - callisto: Fixed a bug which caused the random and peak-search pedestal
1596 extracted with an extractor to be exchanged for the first (roughly)
1597 500 events (*Extractor and *ExtractorRndm).
1598 (They were simply exchanged in callisto.cc) This bug might have been
1599 introduced in Mars 0.9.4 when the order of calculation of the two
1600 types of pedestal in callisto got exchanged. The bug only effects
1601 the first seconds of data of each sequence.
1602
1603 - star: Taking the arrival time of Muons into account the calculation
1604 of the parameters could be made independant of the noise
1605 (pedestal rms). The dependance was due to the bias of the peak search
1606 extractor. Now only a ZA dependamcy is left which is not yet fully
1607 understood.
1608
1609 - ganymed: The sequences were still not sorted correctly in any case,
1610 because they were sorted by the full qualified path name. Now they
1611 are sorted by their sequence number.
1612
1613 - ganymed: new values for the spark-event-cut
1614
1615 - sponde: required missing MEnergyEst from ganymed.root... fixed.
1616
1617
1618
1619 *** Version 0.9.4.1 (2005/08/18)
1620
1621 - callisto: fixed some problems with the calibration in case of
1622 inteleaved events. Therefor the final and some intermediate
1623 fits are skipped which would take place on partly filled #
1624 histograms and gave wrong results or failed completely.
1625
1626 - callisto: If the intermediate finalization of the histograms
1627 calculating the mean charge of the calibration signal fails
1628 it is counted now and printed in PostProcess of MCalibCalcFromPast.
1629
1630 - ganymed: Fixed some bugs which caused problems in On-only mode.
1631 Still the false source plot doesn't give reasonable results.
1632
1633
1634
1635 *** Version 0.9.4 (2005/08/05)
1636
1637 - general: Fixed the ZA binning. It did not correctly fit the
1638 MC binning
1639
1640 - general: Added a class to correct for the missfocussing in
1641 April (MSrcPosCorrect)
1642
1643 - general: Random Forest energy estimator should now work properly
1644
1645 - general: MHCamera now displays the profiles in deg instead of mm
1646
1647 - general: MH::SetPalette offers a lot of new palettes
1648
1649 - general: MHillas - the case of CorrXY==0 is now handled properly
1650
1651 - general: implemented the possibility to change the line and
1652 marker style of a sky-grid drawn by MAstroCatalog
1653
1654 - general: Runs in sequences and datasets are now automatically
1655 ordered (it is assumed that the order of their filenames correctly
1656 represents the order of observations) to ensure correct reading
1657 of the subsystem data
1658
1659 - general: Runs cannot be added to a sequence twice anymore. Also
1660 Sequences cannot be added twice anymore to a dataset.
1661
1662 - general: fixed a bug in MAstro::Deg2Hms reported by Abelardo.
1663 It gave wrong results by 1./2pi
1664
1665 - showplot: got a new option to start a root interpreter, too
1666
1667 - mars: now displays a rough estimate of Disp and the third moment
1668
1669 - mars: now displays the event time MTime if available
1670
1671 - mars: show muon parameters graphically
1672
1673 - mars: now the file to open can be given as commandline
1674 argument
1675
1676 - merpp: Added support for new arehucas version >= 200507190
1677 implementing values for three temperature sensors in the
1678 counting house (MCameraAUX) and the name of the HV settings file
1679 (MCameraHV).
1680
1681 - merrp: Also fixed some problems with wrong versions numbers stated
1682 by arehucas and implemented some fixed for old versions (<200407070)
1683
1684 - callisto: MCalibrationHiLoCam can now be printed from its context
1685 menu, eg in the TBrowser
1686
1687 - callisto: fixed logain offset (fgOffsetLoGain) from 1.7 to
1688 - 1.39 (MExtractTimeAndChargeSpline)
1689 - 1.40 (MExtractTimeAndChargeDigitalFilter)
1690 This is important mainly for timing studies.
1691
1692 - callisto: Changed limits in MHCalibrationChargeCalc from
1693 - -100.125 to -98 (fgChargeHiGainFirst)
1694 - 1899.875 to 1902. (fgChargeHiGainLast)
1695 - -100.25 to -99 (fgChargeLoGainFirst)
1696 - 899.75 to 901. (fgChargeLoGainLast)
1697 Introduced new limits:
1698 - fgNumLoGainBlackoutLimit: 0.05
1699 - fgLoGainBlackoutLimit: 3.5
1700 - fgLoGainPickupLimit: 3.5
1701
1702 - callisto: The handling of automatic weights for the digital filter
1703 has been improved. There are now new calibration weights special
1704 for Monte Carlo calibrations.
1705
1706 - callisto: Updated Muon scale with latest results (1% difference
1707 for most data, 5% for Mar/Apr'05)
1708
1709 - callisto: use a new criterium to exclude bad pixels: If the high-gain
1710 was saturated and the blackout-events in the low-gain exceed the
1711 fNumLoGainBlackoutLimit, the pixel is declared unsuitable.
1712 This excludes those pixels which have a saturating high-gain
1713 channel, but the low-gain switch does not switch often enough
1714 to make the distribution reliable.
1715
1716 - callisto: fix a bug counting the number of saturated events. Up to now,
1717 the number of saturated slices was counted (which is one for a not too
1718 high number), but for some (pathological) pixels, many more slices
1719 saturated and produced wrong limits.
1720
1721 - callisto: New options in in callisto.rc for MCalibrationRelTimeCalc:
1722 + MCalibrationRelTimeCam.CheckFitResults: Yes
1723 + MCalibrationRelTimeCam.CheckDeviatingBehavior: Yes
1724 + MCalibrationRelTimeCam.CheckHistOverflow: Yes
1725 + MCalibrationRelTimeCam.CheckOscillations: Yes
1726
1727 - callisto: introduce max. number of events for intercalibration,
1728 the rest gets skipped. Default: 4096
1729 The calibration causes too many un-reliable pixels if more
1730 than about 5000 events are treated (@500 Hz) because of the
1731 mode hopping of the VCSels. However, in the past, some
1732 calibration runs have been taken (erroneously) with more
1733 than 5000 events, especially the intensity scans where
1734 a good precision is needed.
1735
1736 - callisto: Set UseExtractorRes to kTRUE, will raise the number of
1737 photo-electrons for the spline extractor by 1-2% (correctly).
1738
1739 - callisto: The intercalibration is now done using a full f-factor
1740 method instead of a simple update. This makes things slower but
1741 more reliable in terms of gain-fluctuations and sudden VCSEL gain
1742 changes.
1743
1744 - callisto: MPedestalY3 now uses the same extraction range as the data
1745 as calculated by MPedestalY2
1746
1747 - callisto: A check of the fraction of allowed unsuitable (10%) and
1748 unreliable (30%) pixels has been addded when the conversion is
1749 calculated from interleaved events
1750
1751 - star: fixed a bug which caused MEffectiveOnTime containers not to
1752 be written. In the worst case they were skipped almost all, in the
1753 best case they were all ok. It depends on how often the new value
1754 was assigned just with an event which was skipped later by another
1755 task
1756
1757 - star: new histograms MHPointing and MHRate
1758
1759 - star: New tab (Currents) displaying the time evolution of the mean
1760 DC currents
1761
1762 - star: New tab (MeanRms) displaying the time volution of the mean
1763 Pedestal Rms
1764
1765 - star: Output now contains MReportStarguider
1766
1767 - star: Improved muon analysis. Due to the absense of a constant
1768 for the gaus fit for arc width and the fact that the arcwidth
1769 plot was a histogram instead of a profile the resulting psf
1770 became pedestal rms dependant
1771
1772 - ganymed: added new plot (MHPhi) for wobble mode as described in
1773 http://www.astro.uni-wuerzburg.de/results/ringmethod/
1774
1775 - ganymed: corrects now (correctly?) for the misspointing in
1776 May/April 05
1777
1778 - ganymed: Two new default templates for ganymed.rc are avilable:
1779 ganymed_onoff.rc and ganymed_wobble.rc
1780
1781 - ganymed: The first version of MFMagicCuts has been released
1782
1783 - ganymed: the Conc1 plot was incorrectly scaled in MHVsSize
1784
1785 - ganymed, sponde: There are two new options to determin the number
1786 of bins for the signal region (NumBinsSignal) and the number of
1787 total bins (NumBinsTotal) in the MHThetaSq histogram
1788
1789 - ganymed: optimized palettes for MHDisp
1790
1791 - ganymed: Fixed an important bug when using ThetaSq as fit function:
1792 The result for the sigma of the gauss(sqrt(x)) fit was a factor
1793 sqrt(2) to large
1794
1795 - ganymed: The false source plot (MHDisp) is now based on Disp
1796 and a background model determined in the first loop is
1797 subtracted
1798
1799 - ganymed: MFMagicCuts are now available in the cvs. The correct
1800 solution for the disp ambiguity problem is now calculated using
1801 the third moment. The third moment cut therefor is skipped.
1802
1803 - ganymed: Output now contains "Disp [MParameterD]" which sign is
1804 already determined by the third moment along the major axis and
1805 so its actual sign is aligned along the major axis of the shower.
1806
1807 - ganymed: If starguider data is available it is taken into account
1808 when calculating the source position. This is especially important
1809 for wobble data at high zenith angles and culmination data.
1810
1811 - ganymed: If available the starguider data is taken into account as
1812 good as it is possible without a starguider calibration. To switch
1813 it off add
1814 MPointingDevCalc.MaxAbsDev: -1
1815 to your ganymed.rc
1816
1817 - sponde: the zenith angle distribution is now weighted instead of
1818 choosen by default. This gurantees higher statistics in the highest
1819 and lowest energy bins. To switch this behaviour off use...
1820
1821 - sponde: now automatically displays the energy threshold
1822
1823
1824
1825 *** Version 0.9.3 (2005/06/03)
1826
1827 - general: MMcEvt now derived from MMcEvtBasic which should
1828 have no influence on compatibility with older camera files
1829
1830 - general: Implemented a new option to MReadReports which allows
1831 to force reading of the first event of some trees (eg. Drive-tree)
1832 before any other tree.
1833
1834 - general: Made a fix to MPointingPosCalc which assumes that the
1835 run-type is real-data if Process is called before ReInit, such
1836 that also the very first Drive-events in a run are treated
1837 correctly.
1838
1839 - shoplot now displays the filename in the title bar of the window
1840
1841 - merpp: new options: --auto-time-start --auto-time-stop which
1842 allow to cut updating with slow-control at the start- or
1843 (previousle --auto-time only allowed: and) stop-time of
1844 the run stored in the runheader.
1845
1846 - callisto: changed default of fgFallTimeHiGain in
1847 MExtractTimeAndChargeSpline from 1.5 to 0.5. 0.5 was
1848 already set as default in callisto_Dec04Jan05.rc
1849
1850 - callisto: the digital filter (MExtractTimeAndChargeDigitalFilter)
1851 now changes the filename for new weights automatically for
1852 cosmics, MC and for different calibration colors.
1853
1854 - callisto: a problem with the order of some code cause the
1855 name of the weights file in MPedestalY2 to be ignored.
1856 Wrongly the calibration_UV weights were used instead
1857 of the cosmics weights set in callisto.rc.
1858
1859 - callisto: should allow ct1 pulser data when the color is
1860 explicitly set also for pretty new runs
1861
1862 - callisto: a new option (MCalibrateData.ScaleFactor) allows
1863 to introduce an additional scale factor (should be around 1)
1864 to adapt for slight deviations in different extractors from
1865 the MC calibration. For MC calibrations the scale factor
1866 is fixed to 1
1867
1868 - callisto: MFCosmics should handle very high signals a bit
1869 more accurate now
1870
1871 - callisto: when calculating the mean pedestal rms for different
1872 pixel sizes or sectors also kUnsuitableEvt is now taken into
1873 account - not only kUnsuitableRun
1874
1875 - callisto: '-raw' option is now the default
1876
1877 - callisto: A dead pixel check has been implemented in MJPedestalC2.
1878 This has the advantage that mean values in the calibration (eg
1879 arrival times) are calculated more accuratly.
1880
1881 - callisto: In the resource file callisto_Dec04Jan05.rc
1882 MJPedestalY2.ExtractWinRight has been reduced from 4.0 to 2.0
1883
1884 - callisto: new Hi-/Lo-Gain intercalibration constants
1885 hilocalib_sp1.root and hilocalib_sp1_mc.root
1886
1887 - callisto: changed default for MJPedestalY2.MaxEvents
1888 from 2000 to 5000 like in callisto_Dec04Jan05.txt
1889
1890 - callisto: in MCalibrationChargeCalc the limit fgPheErrLowerLimit
1891 has changed from 9.0 to 6.0. This is necessary to exclude two very
1892 ringing pixels in September which - when kept - destroy the image
1893 cleaning around them (Markus G.)
1894
1895 - callisto: (!) The Muon analysis of all data taken so far has
1896 suggested that different extractors give slightly different
1897 absolute results after calibration, due to there different
1898 handling of the calibration- and cosmics pulse shape. Although
1899 the over all calibration seems to be a bit to pesimistic (or
1900 the MC seems to be a little bit - 3-5% - too much attenuated).
1901 There for correction factors have been introduced which correct
1902 the calibration constants by
1903 0.956937799 for Digital Filter (callisto.rc)
1904 and
1905 0.904159132 for Spline (callisto_Dec04Jan05.rc)
1906 calibration. The main advantage is, that both data types can
1907 be easily analysed together and compared to the same MC sample.
1908 The factors are choosen such, that the reference is now a
1909 Monte Carlo sample calibrated with Digital Filter (callisto.rc)
1910
1911 - star: fixed a bug which caused the first bin of the histograms
1912 vs time to disapear in PostProcess. This gave wrong results
1913 on the screen. The output and all following programs not
1914 directly accessing the histograms haven't been affected
1915
1916 - star, ganymed: Made sure that always the first Drive-tree event
1917 is read and Processed before the first data event was read.
1918
1919 - ganymed: implemented the possibility to replace the standard
1920 false source plot with a different one. For example: If
1921 you want to use a Disp based FS plot use the resource:
1922 NameHistFS: MHDisp
1923 For details about the requirements of these plots look
1924 at the corresponding classes
1925
1926 - MJOptimize: For On/Off and Wobble optimization MJOptimize
1927 has been replaced by MJOptimizeCuts. To use MHThetaSq instead
1928 of MHAlpha call MJOptimizeCuts("MHThetaSq"). Make sure in this
1929 case MAlphaFitter is setup correctly. For On-Only optimization
1930 MJOptimize has been Replaced by MJOptimizeCuts, too. Call
1931 RunOn() instead of Run(). For energy estimation MJOptimize
1932 has been replaced by MJOptimizeEnergy
1933
1934 - sponde: The input MC spectrum can now be weighted to fake a
1935 different spectrum. This is done via MMcSpectrumWeight. For
1936 more details see the class description and sponde.rc
1937
1938 - sponde: The paremeter comparsion plots are not scaled by
1939 their entries anymore. Instead the MC plot is scaled by using
1940 the result spectrum of the analysis. If the input MC spectrum
1941 and the result spectrum has different slopes the absolut
1942 normalization is normally wrong.
1943
1944
1945
1946 *** Version 0.9.2 (2005/05/20)
1947
1948 - general: Changed the default paths for calibrated data and image
1949 files. (The implemented access to these files doesn't yet exist)
1950
1951 - general: support for MRunIter has been removed from the job classes
1952 (use the setter functions of MSeqeunce instead)
1953
1954 - general: ProcessFile has been renamed to Process in all job classes,
1955 because ProcessFile is missleading
1956
1957 - general: The storage of the palette in MHCamera is now possible
1958
1959 - general: new bits describing unsuitable and unreliable pixels have
1960 been introduced in MBadPixelsPix: kPreviouslyExcluded,
1961 kDeadPedestalRms, kFluctuatingArrivalTimes
1962
1963 - general: fixed reading of CC-REPORTS (weather data) for Arehucas file
1964 versions newer than V200404070
1965
1966 - general: support for cc file versions newer than V200504130. Added
1967 support for active loads (MCameraActiveLoad) and central pixel
1968 (MCameraCentralPixel)
1969
1970 - general: added new histograms for image parameters versus size
1971 (MHVsSize)
1972
1973 - general: The eventloop now automatically calls PrintStatistics
1974
1975 - Status Display: Improved support for printing:
1976 + A default can now be set in .rootrc (for more details see
1977 MStatusDisplay::PrintPS)
1978 + A print dialog is opened so that printer and command line
1979 can be canged
1980
1981 - showlog: improved such that it handles different verbosity levels
1982 more accurate now. This mean you can suppress output when
1983 using showlog.
1984
1985 - showplot: improved
1986 + The new graphics formats have been implemented
1987 (pdf, svg, png, jpg and xpm)
1988 + Implemented an interface for printing. Because you can change
1989 the printing command from the command line you can use all
1990 the nice postscript tool. To print a booklet for example call:
1991 showplot -b --print --print-cmd="cat %f" filename.root | lpr
1992 showplot -b --print --print-cmd="psbook %f | psnup -2 | lpr" filename.root
1993 showplot -b --null --print --print-cmd="psbook %f" filename.root > book.ps
1994
1995 - callisto: fixed a bug in the recognition of the calibration bit
1996 pattern. Concerns only intensity calibration. (The strength of the
1997 intensity has been updated in some cases)
1998
1999 - callisto: add a filter against PIN Diode events when running over
2000 calibration runs since some of the recent calibration runs have
2001 been taken with Pin Diode.
2002
2003 - callisto: added support for the runs 39942, 39944, 44834, 39941,
2004 39943, 44833 in the calibration (MCalibColorSet)
2005
2006 - callisto: MJCalibration.MHCalibrationChargeCam.ProbLimit has
2007 been set to 1e-18 in callisto_Dec04_Jan05.rc
2008
2009 - callisto: in callisto_Dec04Jan05.rc: set value for
2010 MJPedestalY2.MaxEvents from 2000 to 5000 to get better
2011 statistics for the calculation of the mean pulse time
2012 of the cosmisc
2013
2014 - callisto: the charge limit in the calibration has been raised
2015 from 2.5 to 4.5
2016
2017 - callisto: new setup read from callisto.rc
2018 + MCalibCalcFromPast.fNumEventsDump
2019 + MHCalibrationChargeCam.NumHiGainSaturationLimit
2020 + MHCalibrationChargeCam.NumLoGainSaturationLimit
2021
2022 - callisto: MExtractTimeAndChargeSpline extractor:
2023 + The integration ranges were shifted by 0.2 FADC slices to the right.
2024 + unreliable handling of floating point values caused different
2025 results on different platform or with different compiler options:
2026 The new algorithm is numerically exact and more accurate because
2027 it doesn't calculate the integration position by multiple times
2028 adding the step-size (which results in numerical uncertanties
2029 exspecially if multiplied with large numbers)
2030 + A lot of fixes have been introduced which effects integrating the
2031 spline at the edges of the valid range. In this case any memory
2032 was randomly accessed. This behaviour can be tested replacing
2033 all MArrayF by TArrayF which perform a range check (but of course
2034 they are a lot slower)
2035 ! No result obtained with the Spline before can be trusted! Due to
2036 random memory access it might by completely random!
2037
2038 - callisto: set new defaults in MExtractTimeAndChargeDigitalFilter:
2039 + extraction range in the high gain to 4.
2040 + weights file to cosmics_weights46.dat
2041
2042 - callisto:
2043 + introduce the check for fluctuating arrival times.
2044 + set charge limit to from 2.5 to 4.5
2045 + introduce asymmetric exclusion due to "deviating number of phes":
2046 Default: -9.0 +4.5
2047 + make deviating number of phes unsuitable (see David's findings).
2048
2049 - callisto: fixed the display of unsuitable pixels. The old change
2050 to a real profile in MHCamera broke it.
2051
2052 - callisto: The cosmics filter is used in MJCalibration now
2053 independant of the pulser color (formaly it was used only for
2054 CT1-pulser data). The threshold of number of max empty pixels
2055 has been raised from 2% to 5% in MJCalibration. The maximum
2056 fraction of rejected event is 50% otherwise the calibration has
2057 failed. The filter now ignores unsuitable pixels.
2058 Setup the filter from callisto.rc using "ContCosmics"
2059 (see MFCosmics::ReadEnv)
2060
2061 - callisto: changed default for fgOffsetFromLogain back
2062 from -2.8 to -1.8 in digital filter.
2063
2064 - callisto: for the common extractors
2065 + MExtractFixedWindow
2066 * MExtractTimeAndChargeSlidingWindow
2067 * MExtractTimeAndChargeSpline
2068 * MExtractTimeAndChargeDigitalFilter
2069 the hi- and lo-gain reolution is stored in fResolutionPerPheHiGain
2070 and fResolutionPerPheLoGain
2071
2072 - callisto: Updated the hi-/lo-gain intercalibration constants
2073 hilocalib_sp1.root, hilocalib_df46_mc.root, hilocalib_df4.root,
2074 hilocalib_df6.root
2075
2076 - callisto: The default lo-gain extraction window for the
2077 MExtractTimeAndChargeSlidingWindow extractor has been increased
2078 from 6 to 8 to take the stretch of the pusle into account
2079
2080 - callisto (!!!): fixed an important bug in the setting of the
2081 incoming pedestal pointer to the signal extractor extracting
2082 pedestals. This bug caused the pedestals not to be subtracted
2083 correctly in the calibration afterwards. The effect was about 10%
2084 too high conversion factors for the digital filter and the spline
2085 and more than 40% for the sliding window.
2086 The bug existed since end of February! (Markus G.)
2087
2088 - star: added muon support to star. A new tab "MHMuonPar" is
2089 displayed. The lower right plot is an estimate of the point spread
2090 function. A reference value is displayed. To get the real PSF
2091 you must compare with MC. The setup for the muon analysis
2092 is done in star.rc. More informations can be found in
2093 MHSingleMuon and MHCalibParCalc
2094
2095 - star: The weather data is now displayed in star
2096
2097 - star: MEventRateCalc handles the calculation of the event rate more
2098 accurate now in case of the start of a new run inside a sequence
2099
2100 - ganymed: a bug in MSrcPosCalc has been fixed (The changes were taken
2101 from a bugfix of Wolfgang to Loc0LocToCam; Wolfgang: the results are
2102 changed only minimally
2103
2104 - ganymed: (MJCut and MJOptimize) now displayes the number of
2105 excess events versus size. The energy estimation is done in
2106 MJSpectrum (sponde)
2107
2108 - ganymed: got support for using other variables than Alpha, eg. Theta.
2109 Therefor you need a class deriving from MHAlpha which supports
2110 this variable (one is already existing: MHTheta, which is now the
2111 default in ganymed). It is setup through ganymed.rc
2112
2113 - added a full featured spectrum program (sponde) which reads
2114 ganymed output and monte carlos and compiles a spectrum
2115
2116
2117
2118 *** Version 0.9.1 (2005/04/14)
2119
2120 - Fix bug on the arrival time reconstruction when using Digital
2121 Filter (in some marginal cases (10%) times were reconstructed shifted
2122 by 0.2 slices)
2123
2124 - all executables now return 2 where in previous versions -1 has
2125 been returned (gave problems with shell-scripts)
2126
2127 - the Hi-/Lo-Gain intercalibration for monte carlo files is now
2128 also done with a intercalibration input file
2129
2130 - a bug in the time fine adjustment of the digital filter has been fixed
2131
2132 - a lot of small fixes to calling TPad::Divide with a margin==0
2133
2134 - MStatusDisplay now shows the memory usage
2135
2136 - added a memory leak statistic after the eventloop
2137
2138 - MHadronness replaced by MParameterD
2139
2140 - MEnergyEst replaced by MParameterD
2141
2142 - wobble mode can now be switched on from the data-set
2143
2144 - switched on bad pixel detection for a pedestal level
2145 which is more than 5 times the variance
2146
2147 - Fixed default paths to be correct for the new data center
2148
2149 - Fixed handling of drive data. The pointing position in now
2150 copied to MPointingPos inside star for real and MC events
2151
2152 - made sure, that the sequences in a dataset are sorted by
2153 their number to ensure the correct synchronization
2154
2155 - added all resource files necessary to handle spline extraction
2156 of signal for the late 2004 and the early 2005 data
2157
2158 - update the reference lines for the december data
2159
2160 - changed default for fgHiGainFirst from 2 to 0 in spline extractor
2161 This is important for the Dec. and Jan. data where the calibration
2162 pulse position changes much.
2163
2164 - changed default for fgOffsetFromLogain from -1.8 to -2.8 in digital
2165 filter. This corrects only an defective extraction of the MC at
2166 low-gain signals lower than 90 phes.
2167
2168 - fixed some slowdown in calibrating data with interleaved events from
2169 Jan and Dec. As a workaround made the pretty palette the default.
2170 The inverse Deep Blue Sea has a bug which slows down long calibration
2171 runs a lot.
2172
2173 - implemented new values from new starguider report as defined
2174 in TDAS00-07 V7.1 (eg SkyBrighness)
2175
2176 - Fixed the formerly wrong unit of azimuth and zenith angle deviation
2177 in starguider report (If you merpp the same reports with this version
2178 you'll get the correct units (arcmin) but a different result
2179 than with old versions (wrong units))
2180
2181 - Now the status display can also write PNG, JPEG and XPM (other file
2182 formats are still unsupported by root)
2183
2184 - added a lot of scripts and macros in directory datacenter used
2185 for automatic processing
2186
2187
2188
2189 *** Version 0.9 (2005/03/23)
2190
2191 - Calibration is now done autmatically into photo-electrons like
2192 decided by the Collaboration Board
2193
2194 - Reference lines in the display can be read from resource file
2195
2196 - Interlaced calibration events can be handled by callisto
2197
2198 - Hi-Gain vs. Lo-Gain calibration constants can be calculated
2199 and applied in callisto.
2200
2201 - class MJCalibTest can be called by callisto
2202
2203 - callisto can now run with three data types: rawdata, rootdata, MC
2204
2205 - added two classes mreport/MReportStarguider.cc and
2206 mreport/MReportStarguider.h for implementing starguider-data
2207
2208 - the output of merpp-update now contains starguider information:
2209 MReportStarguider and MTimeStarguider
2210
2211 - Fixed bug in MHHadronness.cc which made that the displayed Q-factor
2212 values were lower than they should. This was more visible for high
2213 energy (Size) events.
2214
2215 - Made MExtractTimeAndChargeDigitalFilter the default for callisto
2216
2217 - added a new loop to callisto to support the correct extraction of
2218 the pedestal and pedestal rms through the signal extractor
2219
2220 - added class to perform fourier tranformation of a hexagonal structure
2221 (MHexagonalFT)
2222
2223 - added class to perform fourier tranformation of a hexagonal structure
2224 in a tasklist (MHexagonalFTCalc) example: hft.C
2225
2226 - added class to enhance the MCerPhotEvt from the Magic camera geometry
2227 MGeomCamMagic to a enhanced geometry MGeomCamMagicXT having only
2228 small pixels, example: extendcam.C
2229
2230 - added possibility to write data to memory (TTree) using MWriteRootFile
2231
2232 - added possibility to read a TTree stored only in memory by MReadTree
2233
2234 - new classes to deal with the interleaved calibration events:
2235 MTriggerPattern, MTriggerPatternDecode and MFTriggerPattern
2236
2237 - implemented filters to callisto to skip calibration events
2238
2239 - changed callisto to calculate three kinds of pedestals and pedestal rms:
2240 + fundamental pedestal (MPedPhotFundamental): extracted directly from
2241 the slices by statistics
2242 + pedestal from extractor (MPedPhotFromExtractor): extracted with the
2243 signal extractor without randomization
2244 + random pedestal from extractor (MPedPhotFromExtractorRndm): extracted
2245 with the signal extractor with randomization (extraction window is
2246 randomly fixed)
2247 The three kind of pedestal is not yet implemented (for speed reasons) as
2248 long as nobody really needs it:
2249 + pedestal from extractor with randomizatiuon (MPedPhotFromExtractorRndm):
2250 extracted with the signal extractor with randomization
2251
2252 - callisto now finds the pulse position in the data automatically
2253
2254 - implemented data reduction in calibrated data by reducing the precision
2255 of the stored floating point values (pedestal, rms and signal) to
2256 roughly 0.5%
2257
2258 - fixed showplot to make file format conversion (eg. converting a
2259 status display stored in a root file into a postscript file) in
2260 batch mode possible:
2261 showplot -b --save-as-ps[=outfile.ps] infile.root
2262
2263 - Allow class names as part of filter rules, eg
2264 (MFSupercuts) && (MHillas.fSize>100)
2265
2266 - fixed a lot of stuff to allow all programs to process MonteCarlo
2267 camera files.
2268
2269 - enhanced possibility to debug reading of resource file
2270
2271 - MDataChain should handle priorities of operator more
2272 accurate now
2273
2274 - completely revised the container in which the signal is stored
2275 MCerPhotEvt/Pix, MArrivalTime --> MSignalCam/Pix
2276 * the new implementation is faster and
2277 * needs less storage space
2278
2279 - FIRST version which can process Monte Carlos through the
2280 whole chain of programs (callisto, star, etc)
2281
2282 - implemented new image parameters for the border length of
2283 the shower image (MNewImagePar2)
2284
2285 - implemented wobble-mode in ganymed
2286
2287 - new class (MJOptimize) taking care of all optimization processes
2288
2289
2290
2291 *** Version 0.8.6 (2004/10/05)
2292
2293 - New combined signal and time extractor
2294 MExtractTimeAndChargeDigitalFilter
2295
2296 - The Report for the trigger section in the CC run summary has been
2297 updated, and now the IPRs (Individual Pixel Rates) are available.
2298
2299 - new macros for database interaction: filldotrun.C, filldotrbk.C
2300
2301 - added new program which can convert colored output which was redirected
2302 into a file back into colored text (for example to display it with
2303 more): showlog
2304
2305 - added new program to display an MStatusArray of plots (stored with
2306 MStatusDisplay) from a file: showplot
2307
2308 - Added support for Sequences (MSequence). Sequences are blocks of run
2309 files containing the same calibration and belonging to the same
2310 source
2311
2312 - Added a new task (MTaskEnv) which can be used in setup files to switch
2313 between different tasks (for example to choose a signal extractor)
2314
2315 - Implemented automatic file splitting in MWriteRootFile
2316
2317 - After image cleaning an island index is assigned to all used pixels.
2318 The index corresponds to the order of the islands in size.
2319
2320 - added a cleaning which takes signal height _and_ arrival time into
2321 account: probability cleaning (for more details see MImgCleanStd)
2322
2323 - added a cleaning which takes takes the absolute number of photons
2324 times the area ratio as cleaning level
2325 (for more details see MImgCleanStd)
2326
2327 - Changed calculation of image parameters such, that it can be done
2328 for all used pixels or the pixels with a defined island index only
2329
2330 - implemented new image parameters displaying the number of islands,
2331 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
2332
2333 - event display in executable changed to support also calibrated files
2334 (done with MJCalibrateSignal)
2335
2336 - added program doing the calibration and the signal extraction
2337 and signal calibration: callisto Most part of the setup is done
2338 by a resource file: callisto.rc
2339
2340 - implemented support for pixels with negative IDs (Raw file format
2341 version 4)
2342
2343 - implemented an new option in merpp (--auto-time) to get the time
2344 range for cc and/or caco data from the run header of the raw data
2345
2346 - New star-program (star and MJStar). Taking calibrated data from
2347 callisto/MJCalibrateSignal as input. The setup is done through
2348 a resource file: star.rc
2349
2350 - Added possibility to setup the eventloop in the mars-executable
2351 Camera Display by a resource file: mars.rc
2352
2353 - The the mars-executable Camera Display can now also read
2354 calibrated data files written by callisto/MJCalibrateSignal
2355
2356 - Added a new class which can calculate the source position in
2357 the camera from a pointing model known to be correct and
2358 the pointing model used for observations (MSrcPosFromModel)
2359
2360 - added a new version of the class calculating the effective on-time
2361 MHEffectiveOnTime. It unifies the old classes MHEffOnTime,
2362 MHEffOnTimeTime, MHEffOnTimeTheta, MHTimeDiff, MHTimeDiffTime and
2363 MHTimeDiffTheta.
2364
2365 - added the possibility to count how often a signal is above (or
2366 below) a certain threshold in MHCamEvent and MHCamEventRot (this
2367 can replace MHTriggerLvl0)
2368
2369 - added ore convinient ways to set the axis-titles of your histograms
2370 in your macro to some MH-classes like: MH3, MHVsTime, MHSectorVsTime,
2371 MHPixVsTime, MHVsTime, MHCamEvent and MHCamEventRot
2372
2373
2374
2375 *** Version 0.8.5 (2004/08/06)
2376
2377 - new Signal Extractors: MExtractFixedWindowSpline
2378 and MExtractAmplitudeSpline
2379
2380 - implementes interleave in merpp to be able to merpp parts of a file
2381
2382 - implemented force-functionality to merpp
2383
2384 - star display to display star catalogs (MAstroCatalog)
2385
2386 - star display to 'mirror' stars to the camera (MAstroCamera)
2387
2388 - implemented a new cleaning option which allows cleaning scaled with
2389 the real ratio of the rms depending on the pixel size, not only the
2390 square root of the pixelsize (MImgCleanStd, MCameraData)
2391
2392 - removed obsolete MBlind* classes
2393
2394 - Signal extractor taking the AB flag into account implemented (this makes
2395 an odd number of slices for signal extraction possible
2396 (MExtractSignalABcorr)
2397
2398 - implemented a class extracting the pedestal from the raw-data (events)
2399 itself using empty lo-gain (MpedCalcFromLoGain)
2400
2401 - Added mean values to MPedPhotCam
2402
2403 - Added Makefile for Darwin (this OS is NOT officially supported!)
2404
2405
2406
2407 *** Version 0.8.4 (2004/04/19)
2408
2409 - new fast arrival time extractor using cubic splines:
2410 MExtractTimeFastSpline
2411
2412 - implementes multi-argument support in MDataChain
2413 ("pow(a, b)")
2414
2415 - implemented double reference support in MDataChain
2416 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
2417
2418 - added support in MF for expressiond like
2419 "MHillas.fWidth<2*<MHillas.fLength"
2420
2421 - MDataChain is now able to support variables like [0], [1], ...
2422 which can be used in fit functions as parameters. The interface
2423 is implemented through the new virtual function
2424 MParContainer::SetVariables
2425
2426 - added new class MArrivalTimeCam/MArrivalTimePix:
2427 Storage containers to hold the ArrivalTime of the camera/pixel
2428
2429 - added new classes for the calibration of relative arrival times:
2430 MCalibrationRelTimePix and MCalibrationRelTimeCam
2431
2432 - added new classes to extract the signal of the blind pixel and the
2433 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
2434
2435 - added new classes for the bad-pixels treatment (MBadPixels*)
2436 which are more powerfull than the old ones (MBlindPixel*)
2437 and will replace them.
2438
2439 - added filter against cosmics: MFCosmics
2440
2441 - added new class MArrivalTimeCalc2:
2442 Calculates the arrival time as the signal weighted mean of the time
2443 slices in the maximum window
2444
2445 - added a new macro call pointspreadfucntion.C that fits with a 2D
2446 gaussian the DC spot for an star. It gives you the RMS of
2447 the PSF and the center of the star, very useful for misspointing
2448 studies.
2449
2450 - added support for multi-telescope camera files. Added classes
2451 MStereoCalc and MStereoPar, classes to calculate and store shower
2452 parameters calculated from the data of two telescopes, for the MC
2453 studies regarding the MAGIC clone.
2454
2455 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
2456 MC data calibrated in photons instead of ADC counts.
2457
2458 - added three macros to show the calibration and analysis chain of
2459 MC data. The macro starmc.C does both calibration and analysis, producing
2460 an output containing Hillas parameters for each event. The macro
2461 mccalibrate.C does just the calibration and writes out a file containing
2462 pixel information in photons instead of FADC data. The macro starmc2.C
2463 reads in such a file and produces an output with Hillas parameters.
2464
2465 - added MPedPhotCalc to compute pedestals in units of photons, see
2466 macro pedphotcalc.C
2467
2468 - added all class to perform the calibration, see macro calibration.C
2469
2470 - added class MFFT to perform Fast Fourier Transforms
2471
2472 - added class MSimulatedAnnealing to perform simulated annealing
2473 minimizations
2474
2475 - added new macro bootcampstandardanalysis.C which holds the skeleton
2476 of the analysis chain discussed in the december bootcamp.
2477
2478 - added support for DAQ raw data file format V2
2479
2480 - implemented an arbitrary time stamp for the events from raw-data
2481 files with file version<3. It is calculated from the run number,
2482 the date of start and the FADC clock tick from the first module
2483
2484 - implemented the correct decoding of the event time-stamp
2485 coming from the DAQ for raw-data files with file-version>2
2486
2487 - added a new classes storing the pedestals in units of photons:
2488 MPedPhotPix, MPedPhotCam
2489
2490 - added support for DC current files from the camera control
2491
2492 - added support for start- and stop-time when merpping report files
2493
2494 - added MReportCC storing the weather data from the CC-REPORT
2495
2496 - added class to fill trainings and test matrices (MTFillMatrix)
2497
2498 - added a filter performing a software trigger (MFSoftwareTrigger)
2499
2500 - Added classes to perform parts of the standard analysis (Jobs):
2501 + MJPedestals
2502 + MJCalibration
2503 + MJExtractSignal
2504 Note: All of them are preliminary!
2505
2506 - Added Iterator to iterate over files giving only the run-number
2507
2508 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
2509 the evolution of a sector vs time
2510
2511
2512
2513 *** Version 0.8.3 (2003/12/05)
2514
2515 - adapted Random Forest classes to allow the use with MC
2516 multi-telescope files which can be produced with the coming
2517 camera version 0.7.
2518
2519 - added classes to read and interprete central control report files
2520 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
2521
2522 - enhanced merpp (the executable) to support .raw and .rep files.
2523
2524 - added classes for light calibration (MCalibration* and
2525 MHCalibration*) by Markus Gaug. Further work has to be and will
2526 be done soon.
2527
2528 - Added a preliminary 'synchronizer' (MReadReports) which will
2529 replace MReadMarsFile as soon as it is finished.
2530
2531 - Added a tutorial macro demonstrating how report files are merpped
2532 and how they can be read from the root file in the correct order
2533 of time (readrep.C)
2534
2535 - Added a generalized histogram (similar to MH3) called MVsTime
2536 which allows to plot variables (or rules - MDataChain - of
2537 variables) vs time. For an example have a look at tempvstime.C.
2538
2539 - Changed the name of the event trees:
2540 + Events --> Events
2541 + PedEvents --> Pedestals
2542 + CalEvents --> Calibration
2543
2544 - changed name of MTime in the event trees from MRawEvtTime to MTime
2545
2546 - added displaying the sector indices to the mars event display
2547
2548 - Magic Online Analysis (MOnA) implemented in a first version
2549 (see mona.cc, MOnlineDump and MOnlineDisplay)
2550
2551 - added classes to calculate event rate
2552 (preliminary: MEventRateCalc, MEventRate)
2553
2554 - added new executable 'readdaq' to read *.raw files from the DAQ directly
2555
2556 - added classes dealing with the telescope pointing position (MPointing*)
2557
2558 - implemented the 'final' Mars time stamp based on some experiences with
2559 the new 'Synchonizer'
2560
2561
2562
2563 *** Version 0.8.2 (2003/11/10)
2564
2565 - accelerated standard analysis by a factor of 6-8 ...
2566 + doing precalculations in MGeomCam for the pixel area ratio
2567 + creating a look up table for the single pixels in MCerPhotEvt
2568
2569 - added task to calculates weights in case you want to 'change'
2570 the energy spectrum of a monte carlo file
2571 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
2572
2573 - added a new executable star which implements the
2574 star.C macro as precompiled executable. Currently a flexible
2575 setup is not possible, but a 'input card' setup will follow.
2576
2577 - Starting to implement Multi-Telescope-Support based on the
2578 upcomming camera version 0.7. The base for a general support
2579 is implemented and the star-functionality is proven to work.
2580
2581 - Replaced Event-Display in and Camera-Display in the Mars GUI
2582 executable by a more convinient display base on MStatusDisplay.
2583
2584 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
2585
2586
2587
2588 *** Version 0.8.1 (2003/10/20)
2589
2590 - added signal subtraction for pure on data by means of fitting
2591 the background in the off region or by performing a combined
2592 signal/background fit. Provides necessary histograms for
2593 obtaining energy spectra and a light curve.
2594
2595 - added classes to perform and study the selection of the
2596 2nd Level Trigger on MC data (example in triglvl2.C macro)
2597
2598 - added pedestal calculation
2599
2600 - implemented "democratic cleaning" (tail cut value proportional
2601 to pixel area) according to Wolfgang's suggestion.
2602
2603 - added Sigmabar treatment (calculation and basic histogramming)
2604
2605 - added basic routines to apply padding
2606
2607 - added first implementation of MARS-based source visibility plotter
2608 (needs to be linked against slalib, preliminary version)
2609
2610 - enhanced functionality of data chains: random numbers, conversion
2611 functions and access to MHMatrix objects
2612
2613 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
2614 numbers under certain circumstances (runs with 0 events included)
2615
2616 - fixed a bug in the general filter MF (didn't work on some systems
2617 at all)
2618
2619 - fixed a bug in chaining files, which caused the analysis to crash or
2620 ignore files
2621
2622 - implemented more geometry classes describing the parameters used
2623 to simulate the PMT camera
2624
2625 - added new Monte Carlo classes containing the setup of the different
2626 programs in the MC chain.
2627
2628 - added a (preliminary) general task to evaluate chi-square of a given
2629 parameter in an eventloop.
2630
2631 - first implementation of a container describing the observatory
2632 location (Long, Lat, etc)
2633
2634 - added Random Forest - method for g/h-separation
2635
2636 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
2637 (this means, that it is compiling, but not yet fully tested)
2638
2639 - added a new status display which can show the present status
2640 of histograms while an eventloop is running (MStatusDisplay,
2641 an example can be found at status.C)
2642
2643 - reorganized directories:
2644 classes describing the image --> mimage
2645 classes containing Monte Carlo Histograms --> mhistmc
2646 classes for Random Forest method --> mranforest
2647
2648 - added (event-)weights to fill histograms
2649
2650 - colors in logging output to screen
2651
2652 - changes to the Image Parameter declaration:
2653 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
2654 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
2655 + MHillasExt now derives from MParContainer instead of MHillas
2656 --> Files written with the old definition are more or less unreadable
2657
2658 - reading of reflector files
2659
2660 - display data from reflector files in the camera
2661
2662 - implemented currents (and display them in the camera)
2663
2664 - logarithmic scale in camera
2665
2666 - added class to iterate through directory contents (MDirIter)
2667
2668
2669
2670 *** Version 0.8 (2002/11/18)
2671
2672 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
2673
2674 - corrected 48(!) wrong entries in the Next Neighbor table of the
2675 Magic Camera (all in the inner part of the outer ring, mostly
2676 missing a single NN)
2677
2678 - Fixed a bug in the table describing the Next Neighbours of the
2679 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
2680 have any neighbour)
2681
2682 - changed trigrate.C: now it calculates the pure NSB triggers from
2683 a camera file (generated with no showers), so there is no need
2684 to introduce them by hand in the BgR array (for more details
2685 please ask Abelardo)
2686
2687 - added MHHadronness (and MHadronness) as a general facility to evaluate
2688 the quality of a gamma-hadron seperation method
2689
2690 - changed MWriteAsciiFile to accept rules (MDataChain)
2691
2692 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
2693 must be replaced by calles to MWriteAsciiFile::AddColumn and
2694 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
2695 changed.
2696
2697 - Implemented generalized event-matrices (one row per event)
2698 (MHMatrix)
2699
2700 - implemented the one dimensional composite probabilities
2701 (MHCompProb, MCompProbCalc, comprob.C)
2702
2703 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
2704 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
2705
2706 - Added a camera display displaying the pixel numbers to the
2707 event display gui.
2708
2709 - Added Monte Carlo Informations to event display gui
2710
2711 - Changed the camera display to display the pixel numbering
2712
2713 - Added three buttons to the camera display to change the palette
2714
2715 - Added the number of used and core pixels after image cleaning
2716 to MHillas
2717
2718 - Changed the algorithm used in MHillas according to TDAS 02-03
2719
2720 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
2721
2722 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
2723
2724 - Added fCosDeltaAlpha to MHillasSrc
2725
2726 - The numbers of photons used to calculate fConc and fConc1 in
2727 MHillasExt are now scaled with the pixel size, so that one get
2728 a four times smaller value for the bigger pixels in the outer ring.
2729
2730 - added new task to smooth the camera contents (MCameraSmooth)
2731
2732 - added possibility to use interpolated pixel values for blind pixels
2733 instead of removing it completely from the analysis
2734
2735 - Implemented the possibility to save the whole eventloop with
2736 its setup to a file. This information can be read and from
2737 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
2738 and MEvtLoop::MakeMacro. If you find something not working, please
2739 report - this stuff is still in a beta phase.
2740
2741 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
2742 file having crab starfield, but also for all following files - fixed
2743
2744 - MTaskList::PrintStatistics can now be instructud to print also the
2745 title, too: use PrintStatistics(0, kTRUE)
2746
2747 - Changed the image cleaning so that pixels with to many 'used'
2748 neighbors are left used (to get rid of 'holes' in events)
2749
2750 - Introduced more output to the camera displays
2751
2752 - Added an array of histograms (eg one hist per run), MHArray
2753
2754 - Added a _preliminary_ version of the reader for CT1 PreProc files
2755 (MCT1ReadPreProc)
2756
2757 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
2758 (thanks to Raquel)
2759
2760 - added the first energy estimator (MEnergyEstParam, estimate.C,
2761 estfit.C) using a parametrization
2762
2763 - Added some new Monte Carlo paremeter containers used to store
2764 setup information from the MC chain (MMcConfigRunHeader,
2765 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
2766
2767
2768
2769 *** Version 0.7 (2002/04/30)
2770
2771 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
2772 the pedestal mean value was saved incorrectly. For files from
2773 this versions we substract 0.5 from the pedestal mean.
2774 WARNING: This may effect your results, so don't wonder...
2775
2776 - First implementation of an algorithm using only triggered events
2777 for the collection area calculation
2778
2779 - Ascii Output can now also be used for parameter containers which
2780 doesn't overload MParCointainer::AsciiWrite
2781
2782 - The Ascii Output is now also capable of writing single data members
2783 of one container
2784
2785 - You are now able to change the order of the values written to the
2786 ascii file
2787
2788 - You can now specify a conversion factor for each data member written
2789 to an ascii file. This may be usefull to change the units of the
2790 data member (eg. degrees instead of millimeters in case of the
2791 hillas parameters)
2792
2793 - Replaced old MHillas by a new structure which allows you to extend
2794 the parameters stored in MHillas very easily:
2795 see MHillas and MHillasExt
2796
2797 - Added classes to handle source dependancy of image parameters:
2798 see MHillasSrc
2799
2800 - Added container (MBinning) to have a standard input for the binning
2801 in different histograms (eg. the Energy bins should be the same in
2802 all histograms)
2803
2804 - Changed Hillas histograms from mm to deg
2805
2806 - Added the flexible binning to the hillas histograms
2807
2808 - Added a filter for the alpha parameter (MFAlpha)
2809
2810 - It is now possible to write single data members of a class object to
2811 an output stream instead of the whole container only
2812
2813 - Added a generalized filter for a data member:
2814 MFDataMember filter("MHillas.fWidth", '<', 0.5);
2815
2816 - Added a generalized Filter parser for more difficult filter rules
2817 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
2818
2819 - Added new Monte Carlo histograms:
2820 MHMcEnergyImpact and MHMcEfficiency
2821
2822 - Added many new histograms needed for the flux calculation.
2823
2824 - Added a generalized histograms which can fill and show up to three
2825 data members in either a one-, two- or three-dimensional histogram, eg:
2826 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
2827
2828 - Added:
2829 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
2830 * calculation of <Theta> as a function of time (MHThetabarTime)
2831 they are needed in the flux calculation in
2832 order to select for a given bin in Theta (or time) the appropriate
2833 effective collection area, which is assumed to be given as a function
2834 of Theta and the true energy
2835
2836 - Added calculation of the migration matrix in the energy
2837 (MHMcEnergyMigration):
2838 the migration matrix describes the migration from the true (E_true)
2839 to the estimated energy (E_est); it is needed to determine the
2840 distribution of E_true from the measured distribution of E_est
2841 by unfolding
2842
2843 - changed the color palette in the camera display to DeapSea.
2844
2845
2846
2847 *** Version 0.6 (2002/01/15)
2848
2849 - Introduce the option of disable pixels (MBlindPixels and
2850 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
2851 able to deal with Star Field NSB.
2852
2853 - Fixed a bug in the pedestals substraction
2854
2855 - Introduced verbosity levels
2856
2857 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
2858
2859 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
2860 work correctly (thanks to Abelardo)
2861
2862 - Introduced correct treatment of the diffuse Night Sky Background
2863 and NSB (MMcPedestalNSB)
2864
2865 - Corrected treatment of the electronic noise (MMcPedestalCopy)
2866
2867 - Introduced MMcRunHeaders which contains monte carlo run informations
2868
2869 - Added a 'Print'-Task (MPrint) which calls the Print function
2870 of a parameter container for each event
2871
2872 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
2873
2874 - changes to be more efficient with root 3.02/06
2875
2876 - root 3.02/06 fixes:
2877 + the memory leak when reading MRawEvtData
2878 + loosing more time than necessary to update the progress bar
2879
2880 - MWriteAsciiFile is now capable of writing more than one container
2881 in a line. For example: To be able to write Monte Carlo and
2882 Hillas values (energy and alpha) in one line.
2883
2884
2885
2886 *** Version 0.5 (2001/11/06)
2887
2888 - Added new GUI functionality (Analysis)
2889
2890 - Added a camera display to be able to display events in the camera
2891 together with the calculated hillas ellipse
2892
2893 - Added a 'Clone'-Task (MClone) which can clone a parameter container
2894 object at any state of the analysis, so that the output are several
2895 states
2896
2897 - Fixed a bug in the collection area error calculation
2898 (Thanks to Ciro and Abelardo)
2899
2900 - Fixed a bug which causes merpp to crash in some environments
2901
2902 - Implemented auto enabling scheme for Branches to speed up reading
2903 a lot (see MReadTree and MTask)
2904
2905 - Fixed a bug in the Histogram classes which caused histograms to
2906 be written to a file by MWriteRootFile without request
2907
2908 - changed the object I/O from the old stylish root I/O to the new
2909 'auto evolution scheme' This was done only for classes which are not
2910 yet used in Monte Carlo files, so that these files are still readable.
2911
2912 - Added support for a progress bar in MEvtLoop and MReadTree
2913 (see the Analysis Window in Mars for an example)
2914
2915 - Fixed a bug in the package creation which disturbed the conversion
2916 between a mars version unpacked from a tar file and the repository.
2917
2918 - Changed the code to writer merpped (converted into root format)
2919 raw files, to get faster (around 10%)
2920
2921
2922
2923 *** Version 0.4 (2001/09/20)
2924
2925 - This release is made to compile on a root version >= 3.00
2926
2927 - Fixed a bug which causes MReadTree to read the first file only
2928
2929 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
2930
2931 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
2932
2933 - Added a task to write several container to a root file (MWriteRootFile)
2934
2935 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
2936
2937 - Added calculation of the collection area (MMcCollectionAreaCalc)
2938
2939 - fixed some bugs in the Hillas calculation
2940
2941 - added filters to be able to control the task execution dependent on
2942 a parameter (for example: the number of level 1 triggers in a MC-file)
2943
2944
2945
2946 *** Version 0.3 (2001/04/23)
2947
2948 - Many demo macros added
2949
2950 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
2951
2952 - Hillas Calculation added
2953
2954 - Standard image cleaning available
2955
2956 - MReadTree is now able to handle more than one file
2957 (Remark: of the same structure)
2958
2959 - Now we are able to display events in a first version of the
2960 Camera event display. To do this we must run the macro
2961 "macros/readCT1.C" to read data from CT1.
2962
2963
2964
2965 *** Version 0.2 (2001/01/24)
2966
2967 - First Implementation of a Gui to read the raw data. Start the
2968 gui with the command mars.
2969
2970
2971
2972 *** Version 0.1 (2000/12/20)
2973
2974 - First official release 0.1
2975
2976 - Changes:
2977
2978 + changed calling style of MRawPixelIterator from do...while to
2979 while-loop
Note: See TracBrowser for help on using the repository browser.