source: trunk/MagicSoft/Mars/NEWS@ 9144

Last change on this file since 9144 was 9143, checked in by tbretz, 17 years ago
*** empty log message ***
File size: 124.1 KB
Line 
1 -*-*- END -*-*-
2
3== <cvs> ==
4
5 ;general
6
7 * All command line options after -- are now interpreted as
8 arguments (usually everything which doesn't start with a minus)
9 rather than options (usually everything which starts with a
10 minus). This allows to use file names starting with a -
11
12 ;Database
13
14 * Added informations about the DC currents (fMinCurrents, fMedCurrents
15 and fMaxCurrents). The values are retrieved from the plots showing
16 the average DC currents of all pixels versus time.
17
18 ;automatic analyis
19
20 * Rewritten producing plots in the web.
21 New plots, namely the output of plotoptical.C (extinction curve from
22 KVA), plotstat.C (status of the automatic analysis (percentage of
23 processed, analysed data etc.)) and plotusage.C (statistics of the
24 condor usage in the data center) has been are available now next to the
25 plots of plotdb.C
26 Mean values from the plots (output of the macro) are provided in a
27 txt file now.
28 The creation of the plots for callisto, star and ganymed in the web is
29 now steered via database. Consequently the plots are faster and
30 reliable up-to-date.
31
32 ;merpp
33
34 * Fixed merpping of raw-files (the runheader tree got the name RunHeader
35 instead of RunHeaders)
36
37 * Now allows to merpp files newer than 2008/09/03.
38
39 ;callisto
40
41 * Extracting the pulse position for the pulse position check events
42 with sum trigger were denied. This decreased the statistics
43 extremely and therefor the resulting puse position was calculated
44 quite weak. Now sum events pass the calculation if and only if they
45 have also a level 1 trigger.
46
47
48
49== Version 2.1.1 (2008/08/04) ==
50
51 ;Database
52
53 * Added the median number of photo electrons from the calibration
54 pulses to the db (fMedNumPheInner, fMedNumPheOuter) and the relative
55 error of their raw counts (fRelChargeRmsInner, fRelChargeRmsOuter)
56
57 * Added fTotOnTime, which is the on-time as given by the run-headers
58 (in contradiction to fAbsOnTime which comes from CC)
59
60 * Added new primaries for the new data structure (Magic II): for the
61 tables dealing with sequences (SequenceBuild Status, Sequences,
62 SequenceProcessStatus, Calibration, Star and DataSetSequenceProcessing)
63 this is the telescope number (fTelescopeNumber) for the tables dealing
64 with runs (RunData and RunProcessStatus) this is in addition the file
65 number (fFileNumber)
66
67 * Added column fPriority to the status tables to be able to steer the order
68 in which the data is processed. As default the run, sequence and dataset
69 number are used.
70
71 ;automatic analyis
72
73 * Adapted scripts to the new data structure: They can handle now different
74 telescopes (getting the information as usual from the database).
75 The paths for Magic 2 are not yet implemented.
76
77 ;general
78
79 * should work now with root 5.20/00 (please note that root 5.20/00
80 we encounter crahses in the status display which are ot yet
81 understood)
82
83 * Sequences and Datasets are now stored as "MDataSet" and "MSequence"
84 instead of the base name of the file. This makes them easier to
85 access from the code
86
87 * Default Monte Carlo names in MSequence do not require the _E at
88 the end anymore
89
90 * where abrrevating a sequence file with a sequence number is possible
91 also "telescope:sequence" is now accepted, e.g.:
92 star 2:2000123 --out=output
93 see the programs' help for more details.
94
95 * sequences (MSequence or MSequenceSQL) can now directly be retrieved
96 from the database. See the constructors for more details.
97
98 * MReadTree now supports friends
99
100 * MReadTree can now read also files not written by MARS and store
101 the data encapsulated in emulated MParContainers
102
103 * added a new starguider calibration valid since 15.1.08
104
105 ;showplot
106
107 * showplot can now read more than one file at once. This is especially
108 inetersting if reading files containing pure canvases
109
110 ;merpp
111
112 * we merpp the dc currents now also from the camera reports (they have
113 just a lower rate than the current reports, 0.1Hz instead of 1Hz)
114
115 * In the automatic analysis we omit merpping of the currents from the
116 caco files and use the lower rate camera reports from the cc files
117 instead
118
119 * merpp has been redisigned to allow merpping of the cc-reports
120 of a whole sequence. This allows to design a very simple analysis:
121 mkdir output
122 ./callisto 100776 --out=output
123 ./merpp 100776 output
124 ./star 100776 --ind=output --out=output
125 Instead of the sequence number also sequence files are accepted.
126
127 * Implemented a fix for run-numbers between 1001348 and 1001396
128 which were incorrectly assigned by the cc.
129
130
131 ;callisto
132
133 * added a filter again which was was removed in the last release.
134 it removed the most brightest events. This should not change
135 any analysis result because these events are so bright that
136 they cannot be analysed anyway, but the bad-pixel plots doesn't
137 show outliers.
138
139 * updated muon calibration constants for the periods 51-57,
140 58-63 and 67-
141
142 ;star
143
144 * The camera currents are now displayed with the rate of the camera
145 reports instead of the caco reports
146
147 ;ganymed
148
149 * if mc camera files are new enough (>=8) the source position in the
150 camera is now calculated from the stored telscope and shower
151 orientation (Note, that this might not be suitable in all cases
152 depending on the aim of the study. These case still needs
153 implementation)
154
155
156
157== Version 2.1 (2008/06/18) ==
158
159 ;Database
160
161 * introduced average temperature and wind speed from star-files
162
163 * introduced average values from Pyrometer (mainly Cloudiness)
164
165 * introduced the ratio of accepted calibration events in the
166 calibration run
167
168 * introduced the average rates of the different trigger pattern,
169 e.g. the rate of pedestal and calibration events, from the signal-file
170
171 ;general
172
173 * fixed GroupBy options in plot*.C macros
174
175 * only display KVA points (not the Tuorla points) in plotoptical.C
176
177 * all programs now allow to add resources to the ones from the resource
178 file or overwrite them from the command line. This can be done like this
179 ganymed --config=ganymed.rc --rc=Cut1.Param1:0.25 --rc=Cut1.Param3:5.5
180 if something seems to be wrong you can debug what the program is doing
181 using the option --debug-env=3
182
183 * increased the diversity of debug levels. That also means that with -v3
184 you get now less output, i.e. only the output which is important for
185 an analysis. To get more output which helps for debugging try 4, 5 and 6.
186
187 * fixed a problem in the task synchronizing the reading of the reports
188 and the data stream. The effect was that in some circumstances the last
189 events of some trees could have been skipped. Since this is only a
190 very tiny part of the data no severe effect to your analysis results
191 is expected (an exception might be very short, i.e. singel runs,
192 datasets).
193
194 * Dataset file now allow to include the sequence file directly within
195 the dataset file and also allow to exclude single runs from the dataset.
196 (for more details see Class reference of MDataSet)
197
198 * Sequence files now allow for excluding runs from the analysis
199 (for more details see Class reference of MSequence)
200
201 * added code to process the sum-trigger flag
202
203 * the histogram classes MH3 and MHn now support profile histograms
204
205 * the histogram classes MH3 and MHn now support labels at the axis
206
207 * the Random Forest Train-classes (MJTRain*) now store the used datasets
208 in the output file
209
210 * the MFMagicCuts have a new option to allow a linear area cut (for
211 special studies)
212
213 * The liniking of the shared object is now done into a file defined
214 by 'mktemp'. This should be a local file system which accelerates
215 liniking a lot.
216
217 * The code has been prepared for compilation with root 5.18/00d
218
219 * The MHEnergyEst histogram now shows the distribution of
220 (Eest-Emc)/Est and the distributions (Eest-Emc)/Eest vs. Eest
221 and (Eest-Emc)/Emc vs Emc.
222
223 * fixed mars (event display) for merpped raw-data and MC data
224
225 * adapted the synatx of sequence files to allow for the new run/file
226 scheme. For more details see class description of MSequence
227
228 ;showplot
229
230 * Added support for tiff files
231
232 * Added support for csv files (tables containing tab number,
233 name and title)
234
235 * Tabs now can have a title which is displayed in the postscript file
236
237 * When multiple file are written at once (e.g. pngs from a display)
238 it is now possible to use the tab name and or tab number in the
239 file name. For details see showplos's help.
240
241 ;merpp
242
243 * Implemented cc file version 2008-02-20/0
244
245 * Implemented cc file version 2008-05-19/0
246
247 * With new options merpping can be restricted (in addition to the
248 run-number) also by telescope and file number.
249 For details see "merpp --help"
250
251 * Implemented raw data format 11 (the most important change, except
252 from plenty of changes in the format definition, is the addition
253 of the file-number in the header) If nobody makes a mistake this
254 format should have the advantage that it is by definition forward
255 compatible, so old programs will be able to read newer formats.
256
257 * Added Pyrometer information to default output (stored in a new Tree
258 Pyrometer, needs a complete new merpp, i.e. new calibration)
259
260 * Merpping (also update) can now be restricted to one single report.
261 For example:
262 If you want to update an old file with Pyrometer information call
263 merpp --only=Pyrometer --update
264
265 ;callisto
266
267 * in the pedestal processing now at least 50 processed events are
268 required for succeeding.
269
270 * the signal and calib files now contain also the sequence information
271
272 * the two MPedestalCam in the calib file now have proper names
273 to distinguish them from each other (MPedestalCam, MPedestalExtracted)
274
275 * Both pedestal cams now contain the number of events processed
276
277 * In Mars V2.0 the extraction of the fundamental pedestal was broken,
278 i.e. for the extraction of the calibration pulses basically the average
279 over all events of the first slice instead of all slices was used.
280 Since pedestal and calibration constants are continously recalculated
281 this only effected the very first events of every sequence.
282
283 * For the extraction of the position of the maximum sample now the
284 extraction range is set automatically to the extraction window,
285 before the whole accessible range was used.
286
287 * If the number of samples in the events and the number of samples
288 in the run-header disagrees now an error is raised (this can
289 happen in not well simulated Monte Carlo files)
290
291 * In the case of MUX-data pedestal events with the lvl1 trigger flag
292 could survive into the pedestal calculation -- fixed.
293
294 * Tab "TrigPat" added showing the distribution of the trigger pattern
295 as found in the run-files (normalized with the run length)
296
297 * The selection of events from the trigger pattern has been improved.
298 If the trigger pattern is corrupted events won't pass anymore.
299
300 * Added a new command line option --dev-null to suppress output of
301 Y-files (this is useful for test cases)
302
303 * added a new tab "CalPos" showing the arrival time of extracted
304 interleaved calibration events
305
306 ;star
307
308 * the star file now contains also the sequence information
309
310 * Added a new command line option --dev-null to suppress output of
311 I-files (this is useful for test cases)
312
313 * Tab "Rate" added showing the distribution of the trigger pattern
314 (should only be Trig (Lvl1/Lvl2) and Sum (Sum only)) as found in
315 the Y-files (normalized with the run length)
316
317 * The effective on-time calculation doesn't use events with only
318 sum-trigger anymore
319
320 * The data in the MHWeather tab has been reorganized. The never
321 working solar radiation has been removed and the data from
322 the pyrometer (cloudiness, air and sky temperature) is
323 displayed in addition.
324
325 ;ganymed/sponde
326
327 * Now data points are even shown correctly if they have error bars larger
328 than one sigma. Points with null or negative significances are omitted.
329
330 * DrawNicePlot now allows to set a projection range
331
332 * Updates pointing models. One is applied after the implementation
333 of the new LUTS in August, the other one is applied after the
334 next major change of the pointing model in October. Note that
335 these models are preliminary and give wrong results below Zd=65deg
336
337 ;sponde
338
339 * fixed resource files ('''Spectrum''' instead of '''MJSpectrum''')
340
341 * a new option "--force-runtime" is available. In case of very short
342 datasets (for light-curves) which are in the order of a few
343 minutes the calculated effective on-time is not very acurate because
344 it is quantizised in the order of a minute. Therefore you can switch
345 to using the real run-time instead (remakrt: this ignores any
346 dead-time!)
347
348 * a more analytical way is used to "fill" Monte Carlos into regions
349 of impact parameters which have not been simulated because the
350 trigger efficiency is assumed to be 0.
351
352 * estimated sensitivity curves for hi and lo zenith angles are shown
353 scaled to the correct observation time and collection area
354
355 * the Monte Carlo events after cuts are now written to the output file
356 if an output file given
357
358
359
360 *** Version 2.0 (2007/09/03)
361
362 - database: the position used for the pulse pos check was missing
363 in the callisto output and could thus not be filled into the DB.
364 Also the old values seemed not exactly the PulsePos used for
365 teh check.
366
367 - general: Resource file now allow an Include-Resource, i.e. you can
368 read a resource file with default settings, include it in your
369 resource file and overwrite the settings in your file. More than
370 one include file is allowed. Inclusions can be iterative.
371 Include: mydefaults.rc yourdefaults.rc
372 The resources in the first file have higher priority than the
373 second file.
374
375 - general: Now the output files (calib*.root, etc) also contain the
376 resource file (to check it open it in the TBrowser and choose Print()
377 from the context menu)
378
379 - general: Dataset files now allow to overwrite the default path
380 to search for sequence and data files. Note, that the program
381 option and individual resources will overwrite it. For example:
382 SequencePath: /magic/montecarlo/sequences
383 DataPath: /magic/montecarlo/star
384
385 - general: Fixed a problem with variables in MDataPhrase. It seems
386 that only optimdisp (didn't work) was effected.
387
388 - general: Some improvements to the optim and train processing. For
389 example the ststud window now got a proper title.
390
391 - general: The "Status Display: " was removed from the window title
392 within an Eventloop.
393
394 - general: added a new flexible histogram-class (MHn) which can be used
395 for example in testing after optimizations or training to produce
396 user defined histograms.
397
398 - general: The Random Forest now allows attaching an evaluation
399 function which is applied to its output. This allows to train
400 on whatever you like (eg. train on log10(energy), but return
401 energy)
402
403 - general: The Random Forest training of energy (trainenergy.c) and
404 disp (traindisp.C) has been improved by more graphical output to
405 judge the result.
406
407 - general: The training of energy (trainenergy.C) has been improved
408 a lot by training on a different quantity than energy. It gives
409 a result which is highly independant of the source spectrum
410 and shows lower bias than all other options.
411
412 - general: Dataset files are allowed to contain collections of
413 datasets. For more details see the class reference of MDataSet.
414
415 - general: The default WobbleMode in a datset file now (if not
416 overwritten) is "auto", i.e. wobble mode is set if the dataset
417 doesn't contain off-sequences.
418
419 - merpp: Merpp can read file format version 9 now. Please realize
420 that for file format version 9 the extraction range is different
421 and must be set to 0/49 instead of 15/64 in callisto_mux.rc until
422 the first and last 15 slices have been removed from all MUX data.
423
424 - mars: Similar to writing movies you can now select events which
425 should be displayed in your display. Therefore add the following
426 lines to your mars.rc:
427 MFEvtNumber.FileName: ganymed00223552.root
428 MFEvtNumber.Selector: ThetaSquared.fVal<0.04 && DataType.fVal>0.5
429 The input file can be a ganymed-file after (ganymed*.root) or
430 before (ganymed*-summary.root) file. For example to select all events
431 from your on sample after cuts (excluding the ThetaSq cut) use
432 MFEvtNumber.Selector: DataType.fVal>0.5
433 To show all events from your on-sample after quality cuts
434 use the summary file instead.
435
436 - mars: new ways to call mars are implemented. Instead
437 of calling
438 mars filename.root
439 you can now also use
440 mars sequence.txt
441 or
442 mars sequence.txt inputpath
443 or replace sequence.txt by the sequence number if the default
444 sequence file should be used.
445
446 - mars: The default size has been increased
447
448 - mars: There are two new heckboxes which allow to switch off
449 the calculated image parameters
450
451 - callisto: was broken for MCs... fixed.
452
453 - callisto: improved calculation of spline coefficients a lot. This
454 leads to a further improvement of the event rate calibrating MUX
455 data of about 15% (175evt/s instead of 150evt/s)
456
457 - callisto: finally the raw data we read is now real 16bit (with
458 10bit precision) for MUX data and not a stripped 8bit number
459 anymore. Due to scaling of the numbers (without precision loss
460 into an [0-256[ range, the final numbers for pedestal, pedestalrms
461 and extacted signal don't change. However, at all places where
462 raw data is directly accessed (eg. saturation and variation
463 limits in the signal- and pedestal-extraction) the numbers
464 refer still to the data's 16bit range.
465
466 - callisto: The maximum arrival time difference used in the bad
467 pixel treatment is now in units of nanoseconds, which leads to 3.0ns
468 for both, old FADC and MUX-FADC, data.
469
470 - callisto: Be aware that callisto is now calibrating the arrival time
471 in nanoseconds rather than time slices. Also all following tasks
472 have been changed to assume ns units now. If you star data
473 calibrated with an older version it might be necessary to adapt
474 some timimng parameters (Muon Analysis and MFSoftwareTrigger)
475 to obtain optimal results. The plot in the PulsePos tab
476 will now be in ns, too. This might also mean that the Muon
477 analysis in star might not work as perfect as expected as long
478 as old files read in.
479
480 - callisto: The calibration constants of earlier updates got lost
481 somehow. All constants have been updated.
482
483 - star: The PSF is now determined from the profile of the ArcWidth
484 instead of arcwidth/radius. The old way gave to much weight
485 to the bins with low statistics. The reference lines have been
486 updated.
487
488 - star: For speed reasons events suitable for the muon analysis
489 are now also preselected by fConcCOG<0.1 which seems to be a very
490 good preselector for muons.
491
492 - star: is now calculating a new timing parameter the Slope along
493 the major and minor axis of the shower. Therefore a numerical
494 solution of a line-fit is used. To use MHillasExt.fSlopeLong
495 and MHillasExt.fSlopeTrans don't forget to multiply it with
496 the sign stored in MHillasSrc.fCosDeltaAlpha as usual.
497
498 - star: The parameters fInnerSize, fInnerLeakage1 and fInnerLeakage2
499 have been removed from MNewImagePar. They have never been good for
500 anything.
501
502 - star: Implemented a new recursive algorithm which is supposed to be
503 faster. Also implemented new cleaning oiptions, which are:
504 + CleanLevel0:
505 The cleaning level above single core pixels can be kept
506 + KeepIsolatedPixels:
507 Define whether single core pixels should be kept
508 + TimeLevel1:
509 The coincidence window in nanoseconds to single used neighbors
510 + TimeLevel2:
511 The coincidence window in nanoseconds to two used neighbors
512 + PostCleanType:
513 MOde in which a time dependent post cleaning should be applied
514 0: No post cleaning
515 1: Require for each used pixels at least one used neighbor
516 within a time-window of CleanLevel1
517 2: Require for each used pixels at least two used neighbor
518 within a time-window of CleanLevel2
519 3: Require first two and second one used neighbor
520 within a time-window of CleanLevel1 and fCleanLevel2
521 respectively
522 + RecoverIsolatedPixels:
523 - recoveres isolated core pixels if they have a used neighbor
524
525 - mars/star: The new default cleaning is:
526 + CleanLevel1: 6.0
527 + CleanLevel2: 3.0
528 + CleanTime1: 1.75
529 + CleanTime2: 1.75
530 + PostCleanType: 3
531
532 - star/ganymed: The old spark-cuts have been replaced by new ones.
533 These new spark cuts have been cross checked with the sequences
534 84720 (before splitter), 101041 (after splitter) and 223539 (new
535 FADCs). In all cases they seperate pretty well, but of course not
536 perfect. Monte Carlos have suggested to tighten the cuts a little
537 bit further at low sizes. This has been done.
538
539 - ganymed: IMPORTANT - The spark cuts have been changed to match
540 all available data more or less well. This might mean that for
541 YOUR data there are still sparks visible.
542 Whenever you do an analysis you have to make sure that NO sparks
543 survive your cuts!
544
545 - ganymed: The old hadronness and size cuts have gotten new indices
546 (10, 11). The old indices 8 and 9 now mean an additional condition
547 for ghostbusting based on the formula (dist-c[9])*c[8]-slope.
548 If you want to switch off this cut just move the line far away enough,
549 e.g. by setting c[9] to -500. Please update your ganymed.rc files
550 accordingly!
551 The unit of c[9] is deg. It is the dist at which your cut will
552 cross the slope==0. The unit of the slope is ns/deg. So if
553 you readin files calibrated with an older Mars-version you
554 have to adapt the default value for c[9] to the FADCs:
555 - Multiply by two for the MUX FADCs (run number > 200.000)
556 - Multiply by 0.3 for the Siegen FADCs (run number < 200.000)
557 - Multiply by 42 for the meaning of life (run number = 200.000)
558
559 - ganymed: The old Cut0 is now called CutQ and is calculated before
560 the source position is caluclated. If you need a quality cut
561 including source dependant data (be very carefull with this!)
562 you have to use Cut0 instead.
563
564 - ganymed: now properly supports three off regions in wobble mode.
565 It will be the default from now on in ganymed_wobble.rc. To change
566 the number of off-regions use
567 NumOffSourcePositions: 1
568 in your ganymed.rc. Also by default no off-theta cut will be done
569 anymore so that you will get a background level higher than the
570 signal level in your ThetaSq plot for ThetaSq>0.2.
571 Due to this be carefull changing the scaling mode away from
572 "None". You will underestimate your signal if your scale interval
573 is not properly set.
574 (Rem: ThetaSqN is no longer needed)
575
576 - ganymed: is now storing the events of all (on- and off-)
577 source positions even in the case of more than one off-source
578 position. This should allow sponde to work properly and the
579 energy estimation is done correctly in all cases (without any
580 "nearest position" trick)
581
582 - ganymed: From 85340 (19.3.2006) on a real starguider calibration
583 with a real pointing model for the starguider is done, calibrated
584 with more than thousand tpoints taken from this date on.
585
586 - ganymed: was broken for Wobble-MCs... fixed.
587
588 - ganymed: The default cuts (MFMagicCuts) and the disp-parametrization
589 has changed. Note that your old ganymed.rc will be incompatible
590 with the new algorithms! Please check the ganymed.rc files and
591 the class description of MFMagicCuts for more information.
592 It is recommended at the moment to use identical Disp-Parametrizations
593 for on/off- and wobble-mode. If cuts are optimized only
594 the Area-Cut (parameters 2,3,4) and the theta-sq cut (parameter 1)
595 should be optimized. All other values should be kept as they are.
596 If you want to do an anylsis without timing a parameters, you can
597 switch off the timing cuts by seeting parameter 7 to a very small
598 value (eg. -99). To remove the slope parameter from the disp
599 paremtrization set parameter 8 to 0.
600
601 - ganymed: The distribution of observation time versus zenith
602 angle is now shown for off- AND on-data.
603
604 - ganymed: The contents of the source position plot are no longer
605 averaged, thus a lot of (fake) events between the two wobble
606 positions have disappeared.
607
608 - ganymed: There is a new tab "CutT" it contains the VsSize plots
609 with the CutT, whihc is defined in ganymed.rc, applied. It
610 is resonable to use your theta-cut for it, to see if there is
611 something strange (sparks!) in your signal-region.
612
613 - ganymed: To choose a dataset from a collection in a dataset file
614 use the new command line option "--dataset=12345"
615
616 - optim, sponde: should now properly support three off-regions.
617 Just produce your ganymed summary files with three off-regions.
618 optim and sponde will automatically get all off events from
619 all off-regions from this file. Please do not forget to
620 set the scaling in optimwobble.C properly:
621 fit.SetScaleUser(1./3);
622 it is not yet read in automatically (will follow soon).
623 In the case of fixed Scale you can also use
624 cuts.SetThetaCut(MFMagicCuts::kOn);
625 no off-cut needed.
626 Be carefull in case of three off-regions when switching on
627 scale mode. Make sure that the scale interval is set correctly.
628
629 - sponde: sponde.rc and sponde_onoff.rc are now idetical
630
631 - sponde: the resouce files have been rewritten with a lot of
632 comments and a well working parametrization for an energy estimator
633
634 - sponde: In the estimated energy versus monte carlo energy plot the
635 contents where exchanged.... fixed.
636
637 - sponde: the so called "accurate"-mode has been removed. It didn't
638 give any improvement in accuracy, only decreased execution speed.
639
640 - sponde: the so called "simple"-mode has been removed. It didn't
641 give any improvement in simple.
642
643 - sponde: the so called "refill"-mode has been removed. It was anyhow
644 not implemented.
645
646 - sponde: now checks whether the theta distribution of your on-data
647 and the theta-distribution of your Monte Carlo sample (after
648 weighting) fits. If it doesn't fit properly (eg. the Monte Carlo
649 sample is incomplete) execution is stopped. Execution can be forced
650 using the new option --force-theta. Use this option with care!
651
652 - sponde: Proper collection areas can now be constructed also from
653 Monte Carlo samples generated with different maximum impact
654 parameters. Note that in previous version you neither got
655 a warning or failure, nor was there any obvious sign that the
656 collection area was overestimated due to usage of files with
657 different maximum impact parameters.
658
659 - sponde: If MC files with different lower energy limits are used
660 the primary MC spectrum is artificially completed down to the
661 lowest energy used at all. WARNING: that this gives correct
662 collection areas ONLY if none of the events in this region would
663 survive your cuts at all.
664
665 - sponde: the output file now contains more information about
666 the spectrum (eg. the full 2D collection area histogram).
667 Note, that this information can only be written to the file
668 if it is stored automatically via command line argument.
669 If you only store the status display from within the display
670 the information is lost.
671
672 - sponde: added a new tab "Disp". It shows the residual of the disp
673 (Disp-Dist) versus several parameters and it is meant to judge the
674 quality of the disp estimator. In the ideal case the residual is zero
675 and doesn't depend on any variable. The tab is displayed after
676 CutQ and Cut0.
677
678 - sponde: added a new tab "Energy". It shows the residual of the
679 energy (lg(estimated energy)-lg(monte carlo energy)) versus
680 several parameters and it is meant to judge the quality of the
681 energy estimator. In the ideal case the residual is zero
682 and doesn't depend on any variable. In reality even a good estimator
683 can show residuals versus Monte Carlo energy. The tab is displayed
684 after all cuts.
685
686 - sponde: added a new tab "EventDist" showing the unweighted real
687 absolute number of events of your sample after cuts. This tells
688 you how many events with this energy you had in your MC files.
689 The same information you get from the error bars of the weighted
690 histograms, but this is less intuitive.
691
692 - sponde: The spectrum plots now show the crab- and 1553-spectrum
693 for comparison. It is not meant to show these curves in
694 publications, they are only for production.
695
696 - sponde: The OriginalMC tree with the events produced by corsika
697 is now processed only once
698
699 - sponde: Finally fixed most annoying bug, which has effected the
700 last bin of the collection area. It was the problem that binnings
701 of root histograms are from 1 to n (included) but there was a C-like
702 loop in sponde from 0 to n (excluded). Now the loop also includes
703 correctly under- and overflow-bins. The worse thing with this is,
704 that for the events in the highest bin not only the bin-content
705 was wrong, but also the weights applied to these events, which could
706 in pricipal effect also other parts of the distribution (eg. due
707 to energy estimation). Fortunately it effected only a few events
708 in most cases.
709
710
711
712 *** Version 1.2 (2007/05/14)
713
714 - database: The database now has two new values Unsuitable50 and
715 Unsuitable01. They express the number of pixels which are
716 unsuitable for more than 50%, respectively more than 1%, of
717 all calibrated event. It is a more accurate number than the
718 previously used numbers, because they only take the first
719 calibration (ignoring the interleaved calibrations) into account.
720
721 - database: The database now has two other new values UnsuitableMax and
722 DeadMax. They express the maximum number of pixels which were
723 unsuitable, respectively dead, during the sequence. Because
724 of high pedestal rms (cars passing) a few events with very high
725 numbers of unsuitable pixels can happen. Not to suffer from this
726 effect we don't take the highest 0.1% of the numbers into account.
727
728 - general: fixed a bug which caused callisto and star to stop working
729 properly because the callisto output was currupted
730
731 - general: a script called scripts/makemovie has been added which
732 simplified the process of producing several movies from a single
733 sequence with different setup.
734
735 - callisto: Some more code cleanup. Started to remove old obsolete
736 code from cvs.
737
738 - callisto: The extraction of the pedestal with the extractor was
739 not random. It seems that extracting at one position is still biased
740 (for example in the first or last slices we could still suffer from
741 switching noise) Now it is completely random.
742
743 - callisto: In MPedCalcPedRun (which is the pedestal extraction from
744 pedestal files) individual pixels could be skipped due to high
745 variations. This was already the case for the pedestal extraction
746 from the lo-gains since the beginning and properly handled
747 there, but was introduced in the extraction from the pedestal files
748 a while ago. To calculate the average value it was still divided
749 by the number of events procesed not by the number of summands
750 really summed. This let to a pedestal which was a tiny amount too
751 small (for a few piels in the order of 0.1%). This led to an slightly
752 positive offset of the randomly extracted pedestal for a few pixels.
753 I doubt that this has a big effect on the result, because the effect
754 on the individual numbers is quite small. Due to this it is suggested
755 that you rerun your calibration to make sure you are without any
756 avoidable bias.
757
758 - callisto: the ArrTimeRmsLimit is now is a check of the deviation from
759 the median rms of the absolute arrival time and expressed in significance
760 levels. This replaces the old meaning of an abolute upper limit. An
761 absolute upper limit doesn't make much sense, because in our data
762 all arrival times are shifted at the same time (in fact it might be
763 a shift of the artificial trigger w.r.t. to the light flash).
764
765 - callisto: Added a new tab "BadPixTm" which shows the time evolution
766 of the number of unsuitable pixels over the whole sequence. This
767 is usefull mainly to judge if an intermediate calibration had
768 problems.
769
770 - callisto: Added a new tab "DeadPixTm" which shows the time evolution
771 of the number of dead pixels over the whole sequence. Dead pixels
772 in this context are unmapped pixels, i.e. pixels which could not
773 be interpolated, and thus are ignored in the further analysis.
774
775 - callisto: It is now possible to use the position of the maximum
776 of the spline as arrival time instead of the leading edge even
777 when using the integral for the signal. Therefor set the extraction
778 type to kIntegralRel ("IntegralRelative") and the relative height
779 ("HeightTm") to -1:
780 MJPedestalC1.ExtractSignal.ExtractionType: IntegralRelative
781 MJPedestalC1.ExtractSignal.HeightTm: -1
782
783
784
785
786 *** Version 1.1 (2007/04/27)
787
788 - general: The new class MGeomCamDwarf contains the camera geometry
789 for our prefered Dwarf camera and can be used to create general
790 geometries of roundish or hexagonal cameras.
791
792 - mars: The default cleaning is now abolute 8.5/4.0.
793
794 - mars: The resource file mars.rc now contains examples for MUX data
795
796 - merpp: Implemented file format version 8 (MUX FADC data). The 16-bit
797 data containing only 10-bit information is still cooked down to
798 8-bit, by cutting away the lowest 8-bit.
799
800 - merpp: When reading raw data the data is now stored in a single
801 array. The lo-gain array is obsolete. The interface stays the same.
802
803 - callisto: To process the new MUX data use the resource file
804 callisto_mux.rc
805
806 - callisto: The -root and -raw options to read merpped raw data have
807 been removed
808
809 - callisto: If the -mc option is given the sequence-name can now be
810 replaced by the MC sequence number
811
812 - callisto: If the sequence file contains "MonteCarlo: Yes" the
813 -mc option can now be omitted
814
815 - callisto: Started further simplification by removing obsolete
816 dependancies on MCalibIntensity*Cams.
817
818 - callisto: removed unsused intensity calibration from MJCalibration
819 for further simplification
820
821 - callisto: for simplification removed references to
822 MBadPixelsIntensityCam, MCalibrationIntensityQECam,
823 MCalibrationIntensityRelTimeCam, MCalibrationIntensityTestCam,
824 MCalibrationIntensityChargeCam, and MCalibrationIntensityBlindCam
825 (this should at minimum change nothing at all, and at maximum
826 improve thing if these containers where somewhere not handled
827 properly)
828
829 - callisto: Added the option to write an event movie. Please use
830 this option with care (huge files) but exessively to understand
831 our events. For further documentation please refer to the
832 IACT wiki
833 (currently at http://www.astro.uni.wuerzburg.de/mediawiki-1.9.0)
834
835 - callisto: Improved binning for the pulse position check histogram
836
837 - callisto: The code calculating the pulse position checknow takes
838 the pedestal into account
839
840 - callisto: The arrival time is now stored with full precision this
841 helps to get rid of artefacts in histograms. For the signal this
842 is not necessray because it is displayed in log-scale anyhow
843
844 - callisto: Fixed a problem with internal exclusions. Pixels which
845 have once been marked as unsuitable didn't get the necessary
846 histograms filled anymore to be rechecked with each interleaved
847 calibration.
848
849 - callisto: The relative arrival time resolution (the rms of the
850 relative arrival time offset) is now checked against its
851 median and the median deviation, instead of the average
852 plus an absolute offset.
853
854 - callisto: The relative arrival time offset is now calculated
855 w.r.t. its median not w.r.t. to an artificial reference pixel.
856
857 - callisto: The relative time calibration now marks pixels with
858 outlaying offset as unsuitable
859
860 - callisto: The interleaved relative time calibration has been switched
861 on. The advantage is that pixels which are marked as outliers
862 now can recover. An improvement over time is not expected, because
863 the relative time calibration seems stable.
864
865 - ganymed: If the dataset file containes "MonteCarlo: Yes" the "-mc"
866 option can now be omitted.
867
868 - ganymed: If either the dataset file containes "MonteCarlo: Yes"
869 or the option "-mc" is specified as default the monte carlo datacenter
870 paths (/magic/montecarlo/...) are used if not overwritten in the
871 dataset file.
872
873 - ganymed: The output files now contain run- and event-number for all
874 events, accessible as RunNumber.fVal and EvtNumber.fVal
875
876 - ganymed: Added a plot showing the source position in the camera also
877 for wobble mode
878
879 - ganymed: In addition to the existing task which can be setup to
880 be executed after Cut1 a final task called "EstimateEnergy"
881 has been added, executed before writing the final output
882 (ganymed00000000.root). The task setup in all three cases
883 can be choosen individually. (For all three(!) cases you
884 can for example choose MRanForestCalc. For examples see all
885 sponde*.rc and all ganymed*rc)
886
887 - ganymed: If a container "MEstimatedEnergy" is found in the
888 parameter list (eg. because it was setup by MEstimateEnergy)
889 it will be written to the output file.
890
891
892
893 *** Version 1.0 (2007/02/16)
894
895 - database: Website to plot values from the database has been added.
896
897 - database: The rate of spark events as found by star is now kept
898 and the rate after cleaning is now with spark events subtracted
899
900 - general: The changes to the interpretation of phrases lead to
901 a problem with the access of MHMatrix objects (eg. "M[0]")... fixed.
902
903 - general: Added example files how you can create your own calendar
904 (eg. as christmas present) with Mars. Just run
905 root macros/tutorials/calendar.C
906
907 - general: Added a possibility to display grouped data in the plotdb.C
908 macro (and similar macros). This allows to plot hourly, nightly,
909 weekly, monthly and yearly averages.
910 For more details see the plotall function of the macro
911
912 - general: fixed the error display of the camera display. It showed
913 wrong results.
914
915 - general: fixed a memory leak when reading many MStatusDisplays
916
917 - general: added a macro (macros/tutorials/mirrordelay.C) plotting the delay
918 between a spherical and a parabolic mirror
919
920 - callisto: We have a new pulse position check which takes the properties
921 of the extractor automatically into account. So no need to set
922 ExtractWinLeft/Right anymore. Again a check for pulses too much to the
923 left is done. If possible the lo-gain extraction start and hi-gain
924 extraction end is changed accordingly. If no proper extraction range
925 can be set (hi-gain too much to the left) an error is raised.
926
927 - callisto: New swapped pixels have been found and corrected
928
929 - callisto: Redone the signal extraction this includes:
930 + Unified the algorithms to extract the pedestal for all pedestal
931 extractions done
932 + Unification of hi- and lo-gain into one array
933 + Unification of hi- and lo-gain extraction for Spline and
934 Digital Filter (means now exactly the same algorithm is used,
935 not a copy-and-pasted one)
936 + Store pedestal subtracted data in a common place
937 + Improved extraction algorithms. If the algorithms search a
938 maximum but don't find one they don't return the maximum anymore
939 + Improved the extraction such that a information for signal
940 and time which is consistent is returned
941 + replaced the numerical spline with a (not slower) analytical
942 solution
943 + Lowered the saturation limit from 250 to 245 to make sure that
944 we are far away in all pixels from problems with the clock-noise
945 + The start of the lo-gain extraction is calculated from the hi-gain
946 arrival time. In case of saturation an estimation is used.
947 + the hi-gain window was extended to slice 16. This allows extraction
948 of very late pulses in single pixels or of huge hadron showers.
949 + Now uses the lo-gain extraction range for pedestal extraction,
950 not the hi-gain range in the lo-gain
951
952 - callisto: New hi-/lo-gain calibration constants have been produced
953 for all periods from the statistic of the whole period. They are
954 now used automatically depending on the periods. The old constants
955 where deviation in avarega about 2%-3%. The constants are very
956 stable from period to period (<<1%) except for exchanged channels.
957 In a few cases the constants used so far were off by 1%-2% (maybe
958 temperature effects?)
959
960 - callisto: To gain obsolete space we do not write the
961 MPedestalFundamental anymore. Also calibration and bad pixel
962 treatment is not done for it anymore because it has never been used.
963
964 - callisto: Fixed a bug in the seuqence handling which caused the
965 light condition to be ignored
966
967 - star: Added two new tabs "Sparkless" and "Sparks" these tabs show
968 basically the same as "Cleaned" but the distribution devided into
969 the events fullfilling a spark cut or being rejected by it.
970 This cut can be changed from star.rc (see example inside) by
971 the "SparkCut" directive
972
973 - star: Star displays now the average individual pixel-rate (IPR) versus
974 time and the average discriminator threshold (DT) of all pixels.
975
976 - optim: fixed a problem with the optim-macros which was due to a bug
977 in the new phrase parsing
978
979 - ganymed: To get a nice FalseSource plot (instead of the all-information
980 debug plot displayed as a standard plot) use the context menu
981 somewhere between the two upper plots, click on "DrawNicePlot"
982 and enjoy the result. (It is the same context menu which contains
983 the other options)
984 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
985
986 - ganymed/optim/train: The cut program, trainings- and optimization
987 macros could run with less files found than expected from the
988 sequence-files. No the execution is stopped in this case.
989
990 - ganymed: now stores the dataset in the output file with all information
991 contained (as sequence number, sequence path, data path) so that the
992 used dataset file can be recreated complete from the output
993
994 - sponde: now also allows the uasge of random forest
995
996 - sponde: added a plot showing the cut efficiency
997
998 - sponde: Using root versions < 5.13/04 still resulted in wrong binomial
999 errors (eg. effecting the collection area) because the errors of the
1000 two histograms were swapped in the calculation, which makes a difference
1001 in the case the histograms contains weighted events. Aditionally the
1002 totalarea was incorrectly taken into account, which results in too small
1003 errors, which makes a difference at low statistics were the errors
1004 or the collection area dominate.
1005
1006
1007
1008 *** Version 0.10.3 (2006/10/23)
1009
1010 - database: Implemented ObservationMode flag in websites.
1011
1012 - database: For sequences there is now also the stoptime available on the
1013 websites.
1014
1015 - database: Removed ManuallyChanged flag from sequence-info websites,
1016 as it is not needed anymore with the new sequence building algorithm.
1017
1018 - general: MRolke.[cc,h]: Modification of TRolke from root_v5.12.00b.
1019 Class for calculation of confidence intervals (upper limits).
1020 Use model 3 or 4 for upper limit calculation for MAGIC observations.
1021 Please read the class instruction of TRolke for more information.
1022
1023 - general: The programs now return 0xfe if the requested resource file
1024 doesn't exist.
1025
1026 - general: Errors comming from root itself are now not output to
1027 stderr anymore but to our default (colored) log-stream.
1028
1029 - general: Changed the interface to TFormula such that now everything
1030 is parsed by TFormula, which should allow to use phrases even
1031 without paranthesis correctly parsed.
1032
1033 - callisto: replaced the AdHoc number of effective integration slices
1034 in the digital filter by an average of the correct number, averaged
1035 over all possible set of weights. This also gives correct numbers
1036 for the lo-gains which were totally wrong before.
1037
1038 - callisto: drastically reduced memory consumption by not storing
1039 all intermediate calibration results in memory anymore (we might
1040 write them into a file in the future)
1041
1042 - ganymed: To get a nice Theta-Sq plot (instead of the all-information
1043 debug plot displayed as a standard plot) use the context menu
1044 somewhere between the two upper plots, click on "DrawNicePlot"
1045 and enjoy the result. (It is the same context menu which contains
1046 the "DrawAll" option)
1047 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
1048
1049
1050
1051 *** Version 0.10.2 (2006/10/15)
1052
1053 - general: changed the building of the sequence files such, that
1054 the source-/project name in case of wobble-sources is not the
1055 source/project of the first data run anymore but the new generalized
1056 wobble source/project
1057
1058 - general: Added some functions to MAstro to calculate sun and
1059 moon properties
1060
1061 - general: Added two new macros (starvisday.C and starvisyear.C)
1062 which allow to plot the visibility of several stars in one day
1063 or of one star along one year
1064
1065
1066
1067 *** Version 0.10.1 (2006/10/11)
1068
1069 - general: HTML logging output was distorted... fixed.
1070
1071 - general: Changed the writing of the sequencefiles such that only
1072 as many pedestal files as giving at least 1000 pedestal events which
1073 are nearby the first calibration run are used as pedestal runs
1074
1075 - sponde: In the calculation of the collection area(s) and the
1076 distribution for MOnte Carlo and estimated energy the error
1077 calculation was wrong because root didn't take the errors
1078 properly into account... fixed.
1079
1080
1081
1082 *** Version 0.10 (2006/10/10)
1083
1084 - general: all executables now check consistency of the root version
1085 installed with the root version used for compilation. The return
1086 code in this case is 255.
1087
1088 - general: The algorithm to build seqeunces has been redesigned
1089 completly. It is now more flexible in terms of a resource file
1090 resources/sequences.rc which can be used to partly overwrite
1091 the default algorithm and defined the important part of the
1092 algorithm. It also takes correctly into account several ways
1093 of taking wobble-data. Currently the new algorithm doesn't take
1094 the number of pedestal events anymore into account (so a sequence
1095 could have much less than 1000 pedestal events and data runs are
1096 no-more used instead)
1097
1098 - general: a lot of small changes to make the code compatible with
1099 root 5.12/00 and gcc 4.1
1100
1101 - general: Fixed some warnings thrown if more warnings are switched
1102 on in the compiler
1103
1104 - general: Added a function to MMath which returns the Median of
1105 the distribution abs(y[i]-median) but at 68:32 division instead
1106 of 50:50, which is somehow the median counterpart of the rms.
1107
1108 - general: MAstroCatalog allows now to read calatog files (as bsc5)
1109 even if they are compressed with gzip (recommended compression
1110 is with "-1")
1111
1112 - showplot:
1113 + batch mode creation of image files now works with root 5.12/00
1114 + added support for writing bmp (though it never produces
1115 bmp which can be read by programs like xv or gimp)
1116 + added support for xml
1117 + added new option to start the display with a different size, by
1118 --display-width=nnn or --display-height=nnn
1119 + added options to define the canvas size when the display is started
1120 --canvas-width=nnn or --canvas-height=nnn
1121 the option can also be used for batch-mode conversion
1122 + added an option which automatically fits the display size to the
1123 desktop-size: --auto-size
1124
1125 - merpp: didn't recognize files with the extension .raw.gz - fixed.
1126
1127 - merpp: allow the reports to have 1000ms due to a bug in the camera
1128 program.
1129
1130 - callisto: New swapped pixels have been found and corrected. For
1131 details see MRawRunHeader::FixAssignment()
1132
1133 - callisto: Callisto now raises an error if one of the input files could
1134 not be opened.
1135
1136 - callisto: In some rare cases it could happen that in the signal
1137 extraction of the digital filter the extractor returned nonsense
1138 results due a wrong initializion of a variable (this happens in
1139 cases in which the extracted signal is exactly zero or the
1140 digital filter couldn't slide because of a too small extraction
1141 window, which could happen in the lo-gain extraction)
1142
1143 - callisto: The lo-gains have been marked as valid in some cases
1144 when they got not extracted at all (deltsumlo=deltatimelo=0) because
1145 the allowed extraction range (fLoGainLast-fLoGainFirst) was
1146 smaller than the number of slices (fLoGainWindowSize) needed
1147 by the lo-gain extractor
1148
1149 - callisto: Updated absolute calibration constants (muon calibration)
1150
1151 - callisto: fixed a bug which caused the hi-gain saturation not
1152 to be handled properly in the spline (the position of the
1153 saturation was calculated incorrectly)
1154
1155 - callisto: fixed a bug which gave weird results if hi- _and_
1156 lo-gain could not be extracted properly. In some cases hi-
1157 and lo-gain have not been extracted at all and the random result
1158 got calibrated. In other cases the hi-gain was saturating and the
1159 lo-gain has not been extracted. For this a completly arbitraty
1160 scale factor was applied to the result from extracting the
1161 charge of the saturating hi-gain.
1162
1163 - callisto: improves handling of extracted signal if lo- and/or
1164 hi-gain could not be extracted properly. If no appropriate
1165 calibration of either the signal or the arrival time is possible
1166 the pixel is now markes as unsuitable instead of estimated.
1167
1168 - callisto: Fixed a problem in the spline extraction which gave
1169 weird results if the signal was extracted from the first (and
1170 highest) slice (as a workaround extraction from the first
1171 slice has been forbidden)
1172
1173 - callisto: Fixed a bug regarding the use of the QE which doesn't
1174 effect the result because the default is used anyhow.
1175 (The bug was there since 14/07/2005)
1176
1177 - callisto: Changed the default for fgLoGainStartShift to -2.4
1178
1179 - callisto: Fixed a bug which caused all hi-/lo-gain calibration
1180 factors to be always 10 for all pixels as soon as the first
1181 calibration update has happend.
1182
1183 - callisto: Fixed the hi-/lo-gain offset for the Digital Filter. It
1184 was off by more than one slice (which gives wrong values for
1185 pixels which have saturated the hi-gain) This was a problem
1186 mainly for timing studies, not so much for the automatic standard
1187 analysis. Also the values for the Spline have been changed slightly:
1188 + Digital Filter from 1.70 to 0.95
1189 + Spline from 1.39 to 1.30
1190 The numbers were sorted out by an extensive test in the
1191 test-database.
1192
1193 - callisto: Removed the tab showing the average calibrated arrival
1194 time. It never gave useful information.
1195
1196 - callisto: Now tab "HiLoCal" which shows the ratio between hi- and
1197 lo-gain pulse for data pulses if hi- and lo-gain have saturated
1198 and both were extracted because the hi-gain was above the
1199 LoGainSwitch.
1200
1201 - callisto: Now tab "HiLoOff" which shows the offset between hi- and
1202 lo-gain pulse position (after application of LoGainOffset, which
1203 means in the ideal case it is 0) for data pulses if hi- and lo-gain
1204 have saturated and both were extracted because the hi-gain was above
1205 the LoGainSwitch.
1206
1207 - callisto: After extensive tests a new threshold level for determination
1208 of the pulse position has been found at 50phe. This is due to the
1209 fact that for lower pulses the arrival time changes its average
1210 behaviour dramatically. It tends to the average of the extraction
1211 range and starts sticking to non-floating point numbers (5, 6, 7, ...)
1212
1213 - callisto: Added two more plots to the calibration part. The average
1214 extracted signal and the average extracted arrival time as
1215 extracted by the signal extractor (This can help debugging problems
1216 because it doesn't involve a fit)
1217
1218 - star: changed the fit for the effective on time such that initial
1219 values are calculated automatically now instead of using build
1220 in values. This makes the fit more indepedant of the underlaying
1221 rates. With a test of ~350 sequences in the test database it could
1222 be shown that the new fit gives the same result +/-1sek.
1223 The highest deviation was +5s the lowest -10s. You can now control
1224 the bahaviour with two resource values:
1225 MHEffectiveOnTime.FistBin: 3
1226 MHEffectiveOnTime.NumEvents: 12000
1227 Use FirstBin=1 and NumEvents=120 to fit the effective on time
1228 from the resulting gamma candidates
1229
1230 - star: The Center histogram in MHHillas is now by default displayed
1231 with the colz draw-option
1232
1233 - ganymed: now produces valid error codes if failed
1234
1235 - ganymed: MFMagicCuts now supports a hadronness cut. Switch it on
1236 with the option "hadronness" instead of "area" or "both" if
1237 you want to use both cuts. The hadronness cut includes a fixed
1238 cut in hadronness (index 8) and a fixed cut in size (index 9).
1239
1240 - ganymed: MFMagicCuts: fixed abug introduced 2005/7/14 which caused
1241 the M3Long of the anti source to be not properly evaluated
1242 (actually is was evaluated as a unique random number) in case
1243 of optimization with anti-theta cut switched on. This might have
1244 lead to improper, but not necessarily wrong, optimization results.
1245
1246 - ganymed: ganymed_onoff.rc, ganymed_wobble.rc - updated with comments
1247 how to use random forest
1248
1249 - ganymed: use the same spark cuts as in ganymed_wobble.rc as in
1250 ganymed_onoff.rc. Seems to be unintentional that they were different.
1251
1252 - sponde: Since the introduction of the possibility to define a
1253 normalization energy instead of using the integral the default
1254 was not using the integral anymore but a normalization energy of
1255 1GeV. It is now the integral again.
1256
1257 - sponde: Fixed a problem in the weighting which did not allow
1258 a MC slope of -1.
1259
1260
1261
1262 *** Version 0.9.6 (2006/05/24)
1263
1264 - general: changed the binning of the azimuthal profile of the camera
1265 such that it is aligned with the 60deg boundaries.
1266
1267 - merpp: better handling of problems with the TH, TD part of the
1268 CC-REPORT for files older than 200507190 and 200412210
1269 respectively
1270
1271 - merpp: improved handling of RECEIVERS-COM-ERROR in CC-REPORT
1272
1273 - merpp: implementd latest changes in starguider reports (sinc 9th May)
1274
1275 - callisto: if an arrival time is extracted outside the fadc range is
1276 was set to the boundary before. Now a random number is assigned
1277 instead to avoid unfortunate coincidences of arrival times just
1278 by this arbitrary value.
1279
1280 - callisto: added a new option to callisto.rc which allows
1281 to set the maximum arrival time difference allowed for the
1282 badpixel algorithm to determin whether a pixels belongs to a shower:
1283 MJCalibrateSignal.MBadPixelsTreat.MaxArrivalTimeDiff: 0.9
1284
1285 - callisto: changed the old value (0.5) for MaxArrivalTimeDiff
1286 to 0.9 as suggested by Stefan due to a recent study on the fraction
1287 of pixels surviving the image cleaning
1288
1289 - callisto: switched off error in case of "pulse is too much to the left"
1290
1291 - callisto: The extraction window is not adapted anymore. This means that
1292 the pulse is extracted from the full range. The draw-back is that the
1293 background (pedestal) will become slightly higher. Switching on/off
1294 the PulsePosCheck in the callisto.rc only effects filling the
1295 histograms.
1296 WARNING: If the pulse is too much to the left data is calibrated!
1297 Check the PulsePosCheck-PulsePosition AND the Inhomogeneity parameter
1298 in the database to make sure that your data is valid!
1299
1300 - star: Show also the number of stars correlated correctly by the
1301 starguider
1302
1303 - ganymed: implemented a new class (MHThetaSqN) which allows to use more
1304 than one off-source region in wobble-mode. To use it add the following to
1305 your ganymed_wobble.rc:
1306 + MJCut.NameHist: MHThetaSqN (switch the new feature on)
1307 + MHThetaSqN.NumOffSourcePos: 3 (define number of off-regions)
1308 + MHThetaSqN.DoOffCut: Yes,No (switch on/off the off-cut)
1309 + Cut1.ThetaCut: None
1310 + MHThetaSqN.SignificanceCutLevel: 2.0 (increase off-cut by 2.0/1.7)
1311
1312 - ganymed: in the case the latest report is older than a default (currently
1313 one minute) and the current report will be skip the starguider
1314 correction and calibration will be reset. The maximum age can be
1315 setup from ganymed.rc by (minutes):
1316 MPointingDevCalc.MaxAge: 1.5
1317
1318 - ganymed: A first implementation showing all size-bins for the theta-sq
1319 resp. alpha-plots in a single tab automatically
1320
1321
1322
1323 *** Version 0.9.5.1 (2006/05/05)
1324
1325 - general: Added a new option "zdiff" to the Makefile which runs
1326 "cvs diff" as "make diff" would do, but with compression
1327
1328 - general: accelerated MTFillMatrix (used for eample in all training
1329 and optimization macros) by skipping some obsolete calles in the
1330 eventloop the first and second loop could be accelerated by ~20%
1331
1332 - general: Added a missing feature in the MFilterList class which
1333 prevented MFEnergySlope from working correctly in trainenergy.C
1334
1335 - general: Accelerated the random forest training and usage a bit
1336
1337 - merpp: Adapted to new raw data file format version 6
1338
1339 - merpp: fixed a problem with reading the starguider reports
1340 after 6.3.2006
1341
1342 - callisto: At some times six pixels had to be exchanged manually in the
1343 data. If the pixels to be swaped are both not found, an error was raised
1344 and calibration was stopped. Now it is assumed they are intentially not
1345 mapped and the Error has been changed to a Warning.
1346
1347 - star: Added new image cleaning based on the arrival time of the shower.
1348 The new cleaning can be accessed using the parameter "Time" instead of
1349 the the old one (like "Absolute) in the star.rc-file.
1350 Recommended parameters:
1351 + MImgCleanStd.CleanLevel1: 8.2
1352 + MImgCleanStd.CleanLevel2: 5
1353 + MImgCleanStd.CleanRings: 2
1354 + MImgCleanStd.KeepSinglePixels: No
1355
1356 - star: Simplified the calculation of the effective on time. By letting
1357 the fit start in the third bin the result should become more stable.
1358 The fit quality is now ignored for the theta-plot which is not used
1359 in the analysis later. Still better pre-cut which, for example,
1360 remove events triggered by car-light (rate changing on a short
1361 time-scale) are missing.
1362
1363 - macros: optimonoff.C, optimwobble.C: implemented a new strategy
1364 for optimization (kWeakSource) which is suggested by the Berlin
1365 people for weak sources.
1366
1367 - macros: plotdb.C:
1368 + if no dataset and no time-interval is given only sequences with
1369 an effective on-time above five minutes are plotted anymore
1370 + added a new tab "RelTime" displaying the relative on-time
1371 (effective on-time divided by the observation time)
1372
1373 - macros: optim*.C: by skipping some obsolete calles in the eventloop
1374 the optimization became a lot faster
1375
1376 - ganymed: In the second loop the MHNewImagePar histograms disapeared.
1377 To display them just delete the pads displayed on top.
1378
1379 - ganymed: fixed a bug which could cause strange behaviour in wobble
1380 mode if no starguider information was available due to an incorrect
1381 initialization of the starguider calibration
1382
1383 - ganymed: The scale region in the False Source Plot (MHDisp) can now
1384 be changed from within the plot. It can also be setup from the
1385 resource file using:
1386 + MHDisp.fScaleMin: 0.325
1387 + MHDisp.fScaleMax: 0.475
1388
1389 - ganymed, showplot: Fixed a problem with the fit to the off-data
1390 (HistOff) which could cause a time lag or an inifinite loop.
1391 The bug did not effect the results at all.
1392
1393 - sponde: Added a new tab showing the effective collection area after
1394 trigger (including the software trigger)
1395
1396 - sponde: MMcSpectrumWeight has a new option which allows to define
1397 the scaling factor not by the integral of the events but at
1398 a defined energy:
1399 e.g. MMcSpectrumWeight.NormEnergy: 200
1400
1401 - MTFillMatrix, sponde: by skipping some obsolete calles in the
1402 eventloops the loop could be accelerated by ~20%
1403
1404
1405
1406 *** Version 0.9.5 (2006/03/13)
1407
1408 - macros: fixed a typo optimwoble.C (SetThetaCut instead SetAlphaCut)
1409 and added the standard Disp-parametrization
1410
1411 - macros: added a new macro datacenter/macros/plotstat.C allowing
1412 to plot statistics about the data processing
1413
1414 - macros: added a new macro to plot the muon correction coefficients
1415 versus period (macros/plot/mucal.C)
1416
1417 - showplot: path inflation for ganymed files was broken
1418
1419 - callisto: Fixed an important bug. When the number of saturating pixels
1420 were calculated the bad pixel information already available from the
1421 calibration was ignored. This yields wrong values in case pixels
1422 are broken and saturate all the time or randomly.
1423
1424 - callisto: Updated Muon calibration constants. Spline data now also uses
1425 different values for different periods
1426
1427 - star: The time-evolution shown in the effective on-time plot now displays
1428 the axis range (if there are no holes it should be similar to the
1429 effective on-time)
1430
1431 - star: Added two new image parameters:
1432 + MNewImagePar.fConcCOG: The ratio of the equivalent signals of
1433 the three pixels next to the center of gravity and the size
1434 + MNewImagePar.fConcCore: The ratio of the signals of all
1435 pixels inside or touching the ellipse and the size
1436
1437 - ganymed: now stops in requested source isn't found in catalog file
1438
1439 - ganymed: Many improvements to the phi-plot in wobble mode:
1440 + with a template the ideal background is displayed
1441 + a possible camera inhomogeneity is taken into account
1442 + the anti theta cut is better supported
1443 + the phi cut is automatically calculated from the theta cut
1444 See the examples in ganymed_wobble.rc for more details.
1445
1446 - ganymed: fixed plot for E^2*dN/dE. The spectrum was multiplied with two
1447 times the bin-width instead of the absolute energy
1448
1449 - ganymed: New cuts for on/off and wobble mode
1450
1451 - ganymed: The smearing of the False Source plot has been increased
1452 to 0.06
1453
1454 - ganymed: The starguider calibration can now be changed from the
1455 resource file.
1456 See the examples in ganymed*.rc for more details.
1457
1458 - ganymed: added a new option for on-/off-observations
1459 MJCut.RandomSourcePosition
1460 If switched on the distribution of observation time of the source
1461 position in the camera is calculated from the on-data and randomly
1462 applied with this distrbution to the off-data.
1463
1464 - ganymed: by skipping some obsolete calles in the eventloop the
1465 first and second loop could be accelerated by ~20%
1466
1467 - ganymed: The default in ganymed_onoff.rc is now to determin the source
1468 position in the off-data randomly according to its distribution in the
1469 on-data.
1470
1471
1472
1473 *** Version 0.9.4.3 (2006/02/13)
1474
1475 - general: Fixed a bug in most of the programs which prevented the
1476 compile date in the startup message to be displayed
1477
1478 - general: Simplified program calls. The following abbreviations
1479 are now possible:
1480 showlog callisto 55599
1481 showplot signal 55599
1482 star 55599
1483 callisto 55999
1484 ganymed 2
1485 In this cases the corrsponding root-, log-, sequence- or dataset-
1486 filename is automatically compiled using the default datacenter
1487 paths ("/magic/*")
1488
1489 - general: Fixed a long outstanding bug which made axis tick marks
1490 disappear if MDataFormula was used (eg. abs(x))
1491
1492 - general: Updated MMath with new functions to calculate the results of
1493 a exponential, logarithmic and powerlaw fits analytically.
1494
1495 - general: Updated some macros with comments:
1496 + macros/optim/optimdisp.C
1497 + macros/optim/optimenergy.C
1498 + macros/optim/optimwobble.C:
1499
1500 - general: MTFillMatrix (the class to fill one or two MHMatrix from
1501 files) now allows adding a pre-cut like in the optimization. E.g. this
1502 is useful to perform g/h-separation cuts before training the random
1503 forest.
1504
1505 - general: Between the rund 53300 and 68754 the pixels 553-558 were not
1506 correctly assigned in the raw data assignement table. A fix to correct
1507 the assignment tabel have been implemented.
1508
1509 - general: MAstroCatalog now allows rotating of the sky-grid and stars
1510 by 90, 180 and 270 deg.
1511
1512 - general: the macro plotdb.C now allows to highlight sequences belonging
1513 to a datset. For more details see the descritions in the macro.
1514
1515 - StatusDisplay: Fixed the algorithm to calculate the size ratio
1516 of the display, it gave wrong results espacially for big sizes.
1517 Now the embedded canvas should always have a ratio width/height=3/2.
1518 The "Size" options have been updated with values fitting the 3/2
1519 size ratio.
1520
1521 - RanForest:
1522 + Updated the random forest classes to support also the
1523 regression method implemented by Thomas H.
1524 + added new tutorial macro how to train the random forest
1525 for energy estimation (macros/optim/rfenergyest.C)
1526 + new classes to train the random forest (still in development)
1527 mjtrain/MJTrainEnergy, mjtrain/MJTrainDisp, mjtrain/MJTrainSeparation
1528 + new tutorial macros for random forest training in macros/train
1529 trainenergy.C, traindisp.C, trainseparation.C
1530
1531 - mars: now allows to setup a cut in the resource file mars.rc to choose
1532 the events to be displayed, eg:
1533 Cut.Condition: {0} && {1}
1534 Cut.0: MHillas.fSize>100
1535 Cut.1: MHillas.fSize<900
1536
1537 - merpp: Made aware of the new .rep format 200510250. This includes
1538 interpretation of the Receiver Board Temperatures (MCameraRecTemp),
1539 the discriminator thresholds (MCameraTD) and the disciminator
1540 delays (MCameraTD). All of them come with the CC report and are therefor
1541 written to the CC tree.
1542
1543 - callisto: fixed a bug in the calculation of the arrival times in
1544 the Digital Filter. They were all shifted by the same amount
1545 fHiGainFirst. This caused an offset in the order of the position of
1546 the left border of the extraction window in the times calculated
1547 from high-gain and from low-gain. The bug effected only the absolute
1548 arrival times. The bug was there since 30.1.2005.
1549
1550 - callisto: Changed the ExtractionWindow for the pulse position check
1551 such that the camera inhomogeneity becomes as less as possible and
1552 comparable to the pulso position check switched off. More details
1553 on the study will be given at our result web-page.
1554
1555 - ganymed: ganymed.rc, ganymed_onoff.rc:
1556 changed to new cuts trained with 1ES1218 and Crab-data
1557 for maximum sigma*log10(excess)
1558
1559 - ganymed: In addition to the Hadronness calculator (CalcHadronness)
1560 a new option was implemented to estimate Disp (CalcDisp)
1561
1562 - ganymed: Implemented two new options which allow
1563 to overwrite the default path to search for the sequence files
1564 --ins=/magic/sequences
1565 and where to search for the image data
1566 --ind=/magic/data/star
1567
1568 - ganymed: MSrcPosCorrect now allows overwriting of the misfocussing
1569 dx/dy from the resource file by
1570 MSrcPosCorrect.Dx
1571 MSrcPosCorrect.Dy
1572
1573 - ganymed: fixed reading the source catalog. Only as many chars
1574 as the requested source name had were compared (If a source
1575 "1ES1218" and "1ES1218+304" were in the catalog and "1ES1218+304"
1576 were requested it could happen that the coordinates of
1577 "1ES1218" were read) The source coordinates are now printed
1578 in addition to its name to the logging output.
1579
1580 - ganymed: changed the background fit in the case of a ThetaSq function
1581 from a polynomial to a exponential, this should give a big improvement
1582 for on-only analysis'
1583
1584 - ganymed/sponde: Calculation of the error of single size-/energy-
1585 bins now uses Li/Ma (5) instead of LiMa (17)
1586
1587 - sponde: Added a plot E^2*dN/dE
1588
1589 - sponde: The energy estimator plot should now show values like
1590 they are commonly used.
1591
1592 - sponde: Now MMcSpectrumWeight also excepts formulas with two X
1593 (a powerlaw with cutoff didn't work before)
1594
1595
1596
1597 *** Version 0.9.4.2 (2005/10/01)
1598
1599 - general: added new tutorial macro macros/tutorials/threshold.C:
1600 how to calculate the threshold
1601
1602 - general: added a new game. Start it from the interpreter with
1603 MagicJam j; (other games are: MineSweeper, MagicSnake, MagicDomino
1604 and MagicReversi)
1605
1606 - general: neighbor pixels in MGeoms are now sorted clockwise
1607
1608 - merpp: made aware of new format 20050829-0
1609
1610 - callisto: New scale factors from muon analysis, stored in new
1611 resource file resources/calibration.rc
1612
1613 - callisto: MBadPixelsCalc now raises an error instead of simply stopping
1614 the eventloop if something went wrong. This is necessary for the
1615 automatic processing
1616
1617 - callisto: Implemented a new treatment for the time information
1618 developed by S.Ruegamer, this should give much better response than
1619 the old very primitive algorithm. This is especially important
1620 for bad pixels due to bright stars as Ceta-Tauri (btw: the old
1621 treatment was buggy! As neighbor pixels to interpolate the
1622 arrival times always the pixels 0 to 5 were taken)
1623
1624 - callisto: In addition to the new treatment of arrival times the
1625 decision of the treatment whether a pixel contains shower
1626 information or not is used to improve the signal interpolation
1627 further. Previously interpolated pixels showed a non-zero signal
1628 do the peak searching signal extractors. Having a signal pixel
1629 beside raised the signal above the cleaning level. Thus the
1630 pixel survived cleaning to often but with a too low mean signal.
1631 By replacing empty pixels with a gaus (mean and rms from the
1632 corresponding Area entries in MPedPhotCam) this effect can
1633 be supressed.
1634
1635 - callisto: The status "unmapped" (for pixel which cannot be interpolated)
1636 got lost when the events were stored by the calibration... fixed.
1637 (This was no problem for normal image cleaning because the pixel
1638 content was artificially set to 0 not surviving standard cleaning
1639 algorithm)
1640
1641 - callisto: Fixed a bug which caused the random and peak-search pedestal
1642 extracted with an extractor to be exchanged for the first (roughly)
1643 500 events (*Extractor and *ExtractorRndm).
1644 (They were simply exchanged in callisto.cc) This bug might have been
1645 introduced in Mars 0.9.4 when the order of calculation of the two
1646 types of pedestal in callisto got exchanged. The bug only effects
1647 the first seconds of data of each sequence.
1648
1649 - star: Taking the arrival time of Muons into account the calculation
1650 of the parameters could be made independant of the noise
1651 (pedestal rms). The dependance was due to the bias of the peak search
1652 extractor. Now only a ZA dependamcy is left which is not yet fully
1653 understood.
1654
1655 - ganymed: The sequences were still not sorted correctly in any case,
1656 because they were sorted by the full qualified path name. Now they
1657 are sorted by their sequence number.
1658
1659 - ganymed: new values for the spark-event-cut
1660
1661 - sponde: required missing MEnergyEst from ganymed.root... fixed.
1662
1663
1664
1665 *** Version 0.9.4.1 (2005/08/18)
1666
1667 - callisto: fixed some problems with the calibration in case of
1668 inteleaved events. Therefor the final and some intermediate
1669 fits are skipped which would take place on partly filled #
1670 histograms and gave wrong results or failed completely.
1671
1672 - callisto: If the intermediate finalization of the histograms
1673 calculating the mean charge of the calibration signal fails
1674 it is counted now and printed in PostProcess of MCalibCalcFromPast.
1675
1676 - ganymed: Fixed some bugs which caused problems in On-only mode.
1677 Still the false source plot doesn't give reasonable results.
1678
1679
1680
1681 *** Version 0.9.4 (2005/08/05)
1682
1683 - general: Fixed the ZA binning. It did not correctly fit the
1684 MC binning
1685
1686 - general: Added a class to correct for the missfocussing in
1687 April (MSrcPosCorrect)
1688
1689 - general: Random Forest energy estimator should now work properly
1690
1691 - general: MHCamera now displays the profiles in deg instead of mm
1692
1693 - general: MH::SetPalette offers a lot of new palettes
1694
1695 - general: MHillas - the case of CorrXY==0 is now handled properly
1696
1697 - general: implemented the possibility to change the line and
1698 marker style of a sky-grid drawn by MAstroCatalog
1699
1700 - general: Runs in sequences and datasets are now automatically
1701 ordered (it is assumed that the order of their filenames correctly
1702 represents the order of observations) to ensure correct reading
1703 of the subsystem data
1704
1705 - general: Runs cannot be added to a sequence twice anymore. Also
1706 Sequences cannot be added twice anymore to a dataset.
1707
1708 - general: fixed a bug in MAstro::Deg2Hms reported by Abelardo.
1709 It gave wrong results by 1./2pi
1710
1711 - showplot: got a new option to start a root interpreter, too
1712
1713 - mars: now displays a rough estimate of Disp and the third moment
1714
1715 - mars: now displays the event time MTime if available
1716
1717 - mars: show muon parameters graphically
1718
1719 - mars: now the file to open can be given as commandline
1720 argument
1721
1722 - merpp: Added support for new arehucas version >= 200507190
1723 implementing values for three temperature sensors in the
1724 counting house (MCameraAUX) and the name of the HV settings file
1725 (MCameraHV).
1726
1727 - merrp: Also fixed some problems with wrong versions numbers stated
1728 by arehucas and implemented some fixed for old versions (<200407070)
1729
1730 - callisto: MCalibrationHiLoCam can now be printed from its context
1731 menu, eg in the TBrowser
1732
1733 - callisto: fixed logain offset (fgOffsetLoGain) from 1.7 to
1734 - 1.39 (MExtractTimeAndChargeSpline)
1735 - 1.40 (MExtractTimeAndChargeDigitalFilter)
1736 This is important mainly for timing studies.
1737
1738 - callisto: Changed limits in MHCalibrationChargeCalc from
1739 - -100.125 to -98 (fgChargeHiGainFirst)
1740 - 1899.875 to 1902. (fgChargeHiGainLast)
1741 - -100.25 to -99 (fgChargeLoGainFirst)
1742 - 899.75 to 901. (fgChargeLoGainLast)
1743 Introduced new limits:
1744 - fgNumLoGainBlackoutLimit: 0.05
1745 - fgLoGainBlackoutLimit: 3.5
1746 - fgLoGainPickupLimit: 3.5
1747
1748 - callisto: The handling of automatic weights for the digital filter
1749 has been improved. There are now new calibration weights special
1750 for Monte Carlo calibrations.
1751
1752 - callisto: Updated Muon scale with latest results (1% difference
1753 for most data, 5% for Mar/Apr'05)
1754
1755 - callisto: use a new criterium to exclude bad pixels: If the high-gain
1756 was saturated and the blackout-events in the low-gain exceed the
1757 fNumLoGainBlackoutLimit, the pixel is declared unsuitable.
1758 This excludes those pixels which have a saturating high-gain
1759 channel, but the low-gain switch does not switch often enough
1760 to make the distribution reliable.
1761
1762 - callisto: fix a bug counting the number of saturated events. Up to now,
1763 the number of saturated slices was counted (which is one for a not too
1764 high number), but for some (pathological) pixels, many more slices
1765 saturated and produced wrong limits.
1766
1767 - callisto: New options in in callisto.rc for MCalibrationRelTimeCalc:
1768 + MCalibrationRelTimeCam.CheckFitResults: Yes
1769 + MCalibrationRelTimeCam.CheckDeviatingBehavior: Yes
1770 + MCalibrationRelTimeCam.CheckHistOverflow: Yes
1771 + MCalibrationRelTimeCam.CheckOscillations: Yes
1772
1773 - callisto: introduce max. number of events for intercalibration,
1774 the rest gets skipped. Default: 4096
1775 The calibration causes too many un-reliable pixels if more
1776 than about 5000 events are treated (@500 Hz) because of the
1777 mode hopping of the VCSels. However, in the past, some
1778 calibration runs have been taken (erroneously) with more
1779 than 5000 events, especially the intensity scans where
1780 a good precision is needed.
1781
1782 - callisto: Set UseExtractorRes to kTRUE, will raise the number of
1783 photo-electrons for the spline extractor by 1-2% (correctly).
1784
1785 - callisto: The intercalibration is now done using a full f-factor
1786 method instead of a simple update. This makes things slower but
1787 more reliable in terms of gain-fluctuations and sudden VCSEL gain
1788 changes.
1789
1790 - callisto: MPedestalY3 now uses the same extraction range as the data
1791 as calculated by MPedestalY2
1792
1793 - callisto: A check of the fraction of allowed unsuitable (10%) and
1794 unreliable (30%) pixels has been addded when the conversion is
1795 calculated from interleaved events
1796
1797 - star: fixed a bug which caused MEffectiveOnTime containers not to
1798 be written. In the worst case they were skipped almost all, in the
1799 best case they were all ok. It depends on how often the new value
1800 was assigned just with an event which was skipped later by another
1801 task
1802
1803 - star: new histograms MHPointing and MHRate
1804
1805 - star: New tab (Currents) displaying the time evolution of the mean
1806 DC currents
1807
1808 - star: New tab (MeanRms) displaying the time volution of the mean
1809 Pedestal Rms
1810
1811 - star: Output now contains MReportStarguider
1812
1813 - star: Improved muon analysis. Due to the absense of a constant
1814 for the gaus fit for arc width and the fact that the arcwidth
1815 plot was a histogram instead of a profile the resulting psf
1816 became pedestal rms dependant
1817
1818 - ganymed: added new plot (MHPhi) for wobble mode as described in
1819 http://www.astro.uni-wuerzburg.de/results/ringmethod/
1820
1821 - ganymed: corrects now (correctly?) for the misspointing in
1822 May/April 05
1823
1824 - ganymed: Two new default templates for ganymed.rc are avilable:
1825 ganymed_onoff.rc and ganymed_wobble.rc
1826
1827 - ganymed: The first version of MFMagicCuts has been released
1828
1829 - ganymed: the Conc1 plot was incorrectly scaled in MHVsSize
1830
1831 - ganymed, sponde: There are two new options to determin the number
1832 of bins for the signal region (NumBinsSignal) and the number of
1833 total bins (NumBinsTotal) in the MHThetaSq histogram
1834
1835 - ganymed: optimized palettes for MHDisp
1836
1837 - ganymed: Fixed an important bug when using ThetaSq as fit function:
1838 The result for the sigma of the gauss(sqrt(x)) fit was a factor
1839 sqrt(2) to large
1840
1841 - ganymed: The false source plot (MHDisp) is now based on Disp
1842 and a background model determined in the first loop is
1843 subtracted
1844
1845 - ganymed: MFMagicCuts are now available in the cvs. The correct
1846 solution for the disp ambiguity problem is now calculated using
1847 the third moment. The third moment cut therefor is skipped.
1848
1849 - ganymed: Output now contains "Disp [MParameterD]" which sign is
1850 already determined by the third moment along the major axis and
1851 so its actual sign is aligned along the major axis of the shower.
1852
1853 - ganymed: If starguider data is available it is taken into account
1854 when calculating the source position. This is especially important
1855 for wobble data at high zenith angles and culmination data.
1856
1857 - ganymed: If available the starguider data is taken into account as
1858 good as it is possible without a starguider calibration. To switch
1859 it off add
1860 MPointingDevCalc.MaxAbsDev: -1
1861 to your ganymed.rc
1862
1863 - sponde: the zenith angle distribution is now weighted instead of
1864 choosen by default. This gurantees higher statistics in the highest
1865 and lowest energy bins. To switch this behaviour off use...
1866
1867 - sponde: now automatically displays the energy threshold
1868
1869
1870
1871 *** Version 0.9.3 (2005/06/03)
1872
1873 - general: MMcEvt now derived from MMcEvtBasic which should
1874 have no influence on compatibility with older camera files
1875
1876 - general: Implemented a new option to MReadReports which allows
1877 to force reading of the first event of some trees (eg. Drive-tree)
1878 before any other tree.
1879
1880 - general: Made a fix to MPointingPosCalc which assumes that the
1881 run-type is real-data if Process is called before ReInit, such
1882 that also the very first Drive-events in a run are treated
1883 correctly.
1884
1885 - shoplot now displays the filename in the title bar of the window
1886
1887 - merpp: new options: --auto-time-start --auto-time-stop which
1888 allow to cut updating with slow-control at the start- or
1889 (previousle --auto-time only allowed: and) stop-time of
1890 the run stored in the runheader.
1891
1892 - callisto: changed default of fgFallTimeHiGain in
1893 MExtractTimeAndChargeSpline from 1.5 to 0.5. 0.5 was
1894 already set as default in callisto_Dec04Jan05.rc
1895
1896 - callisto: the digital filter (MExtractTimeAndChargeDigitalFilter)
1897 now changes the filename for new weights automatically for
1898 cosmics, MC and for different calibration colors.
1899
1900 - callisto: a problem with the order of some code cause the
1901 name of the weights file in MPedestalY2 to be ignored.
1902 Wrongly the calibration_UV weights were used instead
1903 of the cosmics weights set in callisto.rc.
1904
1905 - callisto: should allow ct1 pulser data when the color is
1906 explicitly set also for pretty new runs
1907
1908 - callisto: a new option (MCalibrateData.ScaleFactor) allows
1909 to introduce an additional scale factor (should be around 1)
1910 to adapt for slight deviations in different extractors from
1911 the MC calibration. For MC calibrations the scale factor
1912 is fixed to 1
1913
1914 - callisto: MFCosmics should handle very high signals a bit
1915 more accurate now
1916
1917 - callisto: when calculating the mean pedestal rms for different
1918 pixel sizes or sectors also kUnsuitableEvt is now taken into
1919 account - not only kUnsuitableRun
1920
1921 - callisto: '-raw' option is now the default
1922
1923 - callisto: A dead pixel check has been implemented in MJPedestalC2.
1924 This has the advantage that mean values in the calibration (eg
1925 arrival times) are calculated more accuratly.
1926
1927 - callisto: In the resource file callisto_Dec04Jan05.rc
1928 MJPedestalY2.ExtractWinRight has been reduced from 4.0 to 2.0
1929
1930 - callisto: new Hi-/Lo-Gain intercalibration constants
1931 hilocalib_sp1.root and hilocalib_sp1_mc.root
1932
1933 - callisto: changed default for MJPedestalY2.MaxEvents
1934 from 2000 to 5000 like in callisto_Dec04Jan05.txt
1935
1936 - callisto: in MCalibrationChargeCalc the limit fgPheErrLowerLimit
1937 has changed from 9.0 to 6.0. This is necessary to exclude two very
1938 ringing pixels in September which - when kept - destroy the image
1939 cleaning around them (Markus G.)
1940
1941 - callisto: (!) The Muon analysis of all data taken so far has
1942 suggested that different extractors give slightly different
1943 absolute results after calibration, due to there different
1944 handling of the calibration- and cosmics pulse shape. Although
1945 the over all calibration seems to be a bit to pesimistic (or
1946 the MC seems to be a little bit - 3-5% - too much attenuated).
1947 There for correction factors have been introduced which correct
1948 the calibration constants by
1949 0.956937799 for Digital Filter (callisto.rc)
1950 and
1951 0.904159132 for Spline (callisto_Dec04Jan05.rc)
1952 calibration. The main advantage is, that both data types can
1953 be easily analysed together and compared to the same MC sample.
1954 The factors are choosen such, that the reference is now a
1955 Monte Carlo sample calibrated with Digital Filter (callisto.rc)
1956
1957 - star: fixed a bug which caused the first bin of the histograms
1958 vs time to disapear in PostProcess. This gave wrong results
1959 on the screen. The output and all following programs not
1960 directly accessing the histograms haven't been affected
1961
1962 - star, ganymed: Made sure that always the first Drive-tree event
1963 is read and Processed before the first data event was read.
1964
1965 - ganymed: implemented the possibility to replace the standard
1966 false source plot with a different one. For example: If
1967 you want to use a Disp based FS plot use the resource:
1968 NameHistFS: MHDisp
1969 For details about the requirements of these plots look
1970 at the corresponding classes
1971
1972 - MJOptimize: For On/Off and Wobble optimization MJOptimize
1973 has been replaced by MJOptimizeCuts. To use MHThetaSq instead
1974 of MHAlpha call MJOptimizeCuts("MHThetaSq"). Make sure in this
1975 case MAlphaFitter is setup correctly. For On-Only optimization
1976 MJOptimize has been Replaced by MJOptimizeCuts, too. Call
1977 RunOn() instead of Run(). For energy estimation MJOptimize
1978 has been replaced by MJOptimizeEnergy
1979
1980 - sponde: The input MC spectrum can now be weighted to fake a
1981 different spectrum. This is done via MMcSpectrumWeight. For
1982 more details see the class description and sponde.rc
1983
1984 - sponde: The paremeter comparsion plots are not scaled by
1985 their entries anymore. Instead the MC plot is scaled by using
1986 the result spectrum of the analysis. If the input MC spectrum
1987 and the result spectrum has different slopes the absolut
1988 normalization is normally wrong.
1989
1990
1991
1992 *** Version 0.9.2 (2005/05/20)
1993
1994 - general: Changed the default paths for calibrated data and image
1995 files. (The implemented access to these files doesn't yet exist)
1996
1997 - general: support for MRunIter has been removed from the job classes
1998 (use the setter functions of MSeqeunce instead)
1999
2000 - general: ProcessFile has been renamed to Process in all job classes,
2001 because ProcessFile is missleading
2002
2003 - general: The storage of the palette in MHCamera is now possible
2004
2005 - general: new bits describing unsuitable and unreliable pixels have
2006 been introduced in MBadPixelsPix: kPreviouslyExcluded,
2007 kDeadPedestalRms, kFluctuatingArrivalTimes
2008
2009 - general: fixed reading of CC-REPORTS (weather data) for Arehucas file
2010 versions newer than V200404070
2011
2012 - general: support for cc file versions newer than V200504130. Added
2013 support for active loads (MCameraActiveLoad) and central pixel
2014 (MCameraCentralPixel)
2015
2016 - general: added new histograms for image parameters versus size
2017 (MHVsSize)
2018
2019 - general: The eventloop now automatically calls PrintStatistics
2020
2021 - Status Display: Improved support for printing:
2022 + A default can now be set in .rootrc (for more details see
2023 MStatusDisplay::PrintPS)
2024 + A print dialog is opened so that printer and command line
2025 can be canged
2026
2027 - showlog: improved such that it handles different verbosity levels
2028 more accurate now. This mean you can suppress output when
2029 using showlog.
2030
2031 - showplot: improved
2032 + The new graphics formats have been implemented
2033 (pdf, svg, png, jpg and xpm)
2034 + Implemented an interface for printing. Because you can change
2035 the printing command from the command line you can use all
2036 the nice postscript tool. To print a booklet for example call:
2037 showplot -b --print --print-cmd="cat %f" filename.root | lpr
2038 showplot -b --print --print-cmd="psbook %f | psnup -2 | lpr" filename.root
2039 showplot -b --null --print --print-cmd="psbook %f" filename.root > book.ps
2040
2041 - callisto: fixed a bug in the recognition of the calibration bit
2042 pattern. Concerns only intensity calibration. (The strength of the
2043 intensity has been updated in some cases)
2044
2045 - callisto: add a filter against PIN Diode events when running over
2046 calibration runs since some of the recent calibration runs have
2047 been taken with Pin Diode.
2048
2049 - callisto: added support for the runs 39942, 39944, 44834, 39941,
2050 39943, 44833 in the calibration (MCalibColorSet)
2051
2052 - callisto: MJCalibration.MHCalibrationChargeCam.ProbLimit has
2053 been set to 1e-18 in callisto_Dec04_Jan05.rc
2054
2055 - callisto: in callisto_Dec04Jan05.rc: set value for
2056 MJPedestalY2.MaxEvents from 2000 to 5000 to get better
2057 statistics for the calculation of the mean pulse time
2058 of the cosmisc
2059
2060 - callisto: the charge limit in the calibration has been raised
2061 from 2.5 to 4.5
2062
2063 - callisto: new setup read from callisto.rc
2064 + MCalibCalcFromPast.fNumEventsDump
2065 + MHCalibrationChargeCam.NumHiGainSaturationLimit
2066 + MHCalibrationChargeCam.NumLoGainSaturationLimit
2067
2068 - callisto: MExtractTimeAndChargeSpline extractor:
2069 + The integration ranges were shifted by 0.2 FADC slices to the right.
2070 + unreliable handling of floating point values caused different
2071 results on different platform or with different compiler options:
2072 The new algorithm is numerically exact and more accurate because
2073 it doesn't calculate the integration position by multiple times
2074 adding the step-size (which results in numerical uncertanties
2075 exspecially if multiplied with large numbers)
2076 + A lot of fixes have been introduced which effects integrating the
2077 spline at the edges of the valid range. In this case any memory
2078 was randomly accessed. This behaviour can be tested replacing
2079 all MArrayF by TArrayF which perform a range check (but of course
2080 they are a lot slower)
2081 ! No result obtained with the Spline before can be trusted! Due to
2082 random memory access it might by completely random!
2083
2084 - callisto: set new defaults in MExtractTimeAndChargeDigitalFilter:
2085 + extraction range in the high gain to 4.
2086 + weights file to cosmics_weights46.dat
2087
2088 - callisto:
2089 + introduce the check for fluctuating arrival times.
2090 + set charge limit to from 2.5 to 4.5
2091 + introduce asymmetric exclusion due to "deviating number of phes":
2092 Default: -9.0 +4.5
2093 + make deviating number of phes unsuitable (see David's findings).
2094
2095 - callisto: fixed the display of unsuitable pixels. The old change
2096 to a real profile in MHCamera broke it.
2097
2098 - callisto: The cosmics filter is used in MJCalibration now
2099 independant of the pulser color (formaly it was used only for
2100 CT1-pulser data). The threshold of number of max empty pixels
2101 has been raised from 2% to 5% in MJCalibration. The maximum
2102 fraction of rejected event is 50% otherwise the calibration has
2103 failed. The filter now ignores unsuitable pixels.
2104 Setup the filter from callisto.rc using "ContCosmics"
2105 (see MFCosmics::ReadEnv)
2106
2107 - callisto: changed default for fgOffsetFromLogain back
2108 from -2.8 to -1.8 in digital filter.
2109
2110 - callisto: for the common extractors
2111 + MExtractFixedWindow
2112 * MExtractTimeAndChargeSlidingWindow
2113 * MExtractTimeAndChargeSpline
2114 * MExtractTimeAndChargeDigitalFilter
2115 the hi- and lo-gain reolution is stored in fResolutionPerPheHiGain
2116 and fResolutionPerPheLoGain
2117
2118 - callisto: Updated the hi-/lo-gain intercalibration constants
2119 hilocalib_sp1.root, hilocalib_df46_mc.root, hilocalib_df4.root,
2120 hilocalib_df6.root
2121
2122 - callisto: The default lo-gain extraction window for the
2123 MExtractTimeAndChargeSlidingWindow extractor has been increased
2124 from 6 to 8 to take the stretch of the pusle into account
2125
2126 - callisto (!!!): fixed an important bug in the setting of the
2127 incoming pedestal pointer to the signal extractor extracting
2128 pedestals. This bug caused the pedestals not to be subtracted
2129 correctly in the calibration afterwards. The effect was about 10%
2130 too high conversion factors for the digital filter and the spline
2131 and more than 40% for the sliding window.
2132 The bug existed since end of February! (Markus G.)
2133
2134 - star: added muon support to star. A new tab "MHMuonPar" is
2135 displayed. The lower right plot is an estimate of the point spread
2136 function. A reference value is displayed. To get the real PSF
2137 you must compare with MC. The setup for the muon analysis
2138 is done in star.rc. More informations can be found in
2139 MHSingleMuon and MHCalibParCalc
2140
2141 - star: The weather data is now displayed in star
2142
2143 - star: MEventRateCalc handles the calculation of the event rate more
2144 accurate now in case of the start of a new run inside a sequence
2145
2146 - ganymed: a bug in MSrcPosCalc has been fixed (The changes were taken
2147 from a bugfix of Wolfgang to Loc0LocToCam; Wolfgang: the results are
2148 changed only minimally
2149
2150 - ganymed: (MJCut and MJOptimize) now displayes the number of
2151 excess events versus size. The energy estimation is done in
2152 MJSpectrum (sponde)
2153
2154 - ganymed: got support for using other variables than Alpha, eg. Theta.
2155 Therefor you need a class deriving from MHAlpha which supports
2156 this variable (one is already existing: MHTheta, which is now the
2157 default in ganymed). It is setup through ganymed.rc
2158
2159 - added a full featured spectrum program (sponde) which reads
2160 ganymed output and monte carlos and compiles a spectrum
2161
2162
2163
2164 *** Version 0.9.1 (2005/04/14)
2165
2166 - Fix bug on the arrival time reconstruction when using Digital
2167 Filter (in some marginal cases (10%) times were reconstructed shifted
2168 by 0.2 slices)
2169
2170 - all executables now return 2 where in previous versions -1 has
2171 been returned (gave problems with shell-scripts)
2172
2173 - the Hi-/Lo-Gain intercalibration for monte carlo files is now
2174 also done with a intercalibration input file
2175
2176 - a bug in the time fine adjustment of the digital filter has been fixed
2177
2178 - a lot of small fixes to calling TPad::Divide with a margin==0
2179
2180 - MStatusDisplay now shows the memory usage
2181
2182 - added a memory leak statistic after the eventloop
2183
2184 - MHadronness replaced by MParameterD
2185
2186 - MEnergyEst replaced by MParameterD
2187
2188 - wobble mode can now be switched on from the data-set
2189
2190 - switched on bad pixel detection for a pedestal level
2191 which is more than 5 times the variance
2192
2193 - Fixed default paths to be correct for the new data center
2194
2195 - Fixed handling of drive data. The pointing position in now
2196 copied to MPointingPos inside star for real and MC events
2197
2198 - made sure, that the sequences in a dataset are sorted by
2199 their number to ensure the correct synchronization
2200
2201 - added all resource files necessary to handle spline extraction
2202 of signal for the late 2004 and the early 2005 data
2203
2204 - update the reference lines for the december data
2205
2206 - changed default for fgHiGainFirst from 2 to 0 in spline extractor
2207 This is important for the Dec. and Jan. data where the calibration
2208 pulse position changes much.
2209
2210 - changed default for fgOffsetFromLogain from -1.8 to -2.8 in digital
2211 filter. This corrects only an defective extraction of the MC at
2212 low-gain signals lower than 90 phes.
2213
2214 - fixed some slowdown in calibrating data with interleaved events from
2215 Jan and Dec. As a workaround made the pretty palette the default.
2216 The inverse Deep Blue Sea has a bug which slows down long calibration
2217 runs a lot.
2218
2219 - implemented new values from new starguider report as defined
2220 in TDAS00-07 V7.1 (eg SkyBrighness)
2221
2222 - Fixed the formerly wrong unit of azimuth and zenith angle deviation
2223 in starguider report (If you merpp the same reports with this version
2224 you'll get the correct units (arcmin) but a different result
2225 than with old versions (wrong units))
2226
2227 - Now the status display can also write PNG, JPEG and XPM (other file
2228 formats are still unsupported by root)
2229
2230 - added a lot of scripts and macros in directory datacenter used
2231 for automatic processing
2232
2233
2234
2235 *** Version 0.9 (2005/03/23)
2236
2237 - Calibration is now done autmatically into photo-electrons like
2238 decided by the Collaboration Board
2239
2240 - Reference lines in the display can be read from resource file
2241
2242 - Interlaced calibration events can be handled by callisto
2243
2244 - Hi-Gain vs. Lo-Gain calibration constants can be calculated
2245 and applied in callisto.
2246
2247 - class MJCalibTest can be called by callisto
2248
2249 - callisto can now run with three data types: rawdata, rootdata, MC
2250
2251 - added two classes mreport/MReportStarguider.cc and
2252 mreport/MReportStarguider.h for implementing starguider-data
2253
2254 - the output of merpp-update now contains starguider information:
2255 MReportStarguider and MTimeStarguider
2256
2257 - Fixed bug in MHHadronness.cc which made that the displayed Q-factor
2258 values were lower than they should. This was more visible for high
2259 energy (Size) events.
2260
2261 - Made MExtractTimeAndChargeDigitalFilter the default for callisto
2262
2263 - added a new loop to callisto to support the correct extraction of
2264 the pedestal and pedestal rms through the signal extractor
2265
2266 - added class to perform fourier tranformation of a hexagonal structure
2267 (MHexagonalFT)
2268
2269 - added class to perform fourier tranformation of a hexagonal structure
2270 in a tasklist (MHexagonalFTCalc) example: hft.C
2271
2272 - added class to enhance the MCerPhotEvt from the Magic camera geometry
2273 MGeomCamMagic to a enhanced geometry MGeomCamMagicXT having only
2274 small pixels, example: extendcam.C
2275
2276 - added possibility to write data to memory (TTree) using MWriteRootFile
2277
2278 - added possibility to read a TTree stored only in memory by MReadTree
2279
2280 - new classes to deal with the interleaved calibration events:
2281 MTriggerPattern, MTriggerPatternDecode and MFTriggerPattern
2282
2283 - implemented filters to callisto to skip calibration events
2284
2285 - changed callisto to calculate three kinds of pedestals and pedestal rms:
2286 + fundamental pedestal (MPedPhotFundamental): extracted directly from
2287 the slices by statistics
2288 + pedestal from extractor (MPedPhotFromExtractor): extracted with the
2289 signal extractor without randomization
2290 + random pedestal from extractor (MPedPhotFromExtractorRndm): extracted
2291 with the signal extractor with randomization (extraction window is
2292 randomly fixed)
2293 The three kind of pedestal is not yet implemented (for speed reasons) as
2294 long as nobody really needs it:
2295 + pedestal from extractor with randomizatiuon (MPedPhotFromExtractorRndm):
2296 extracted with the signal extractor with randomization
2297
2298 - callisto now finds the pulse position in the data automatically
2299
2300 - implemented data reduction in calibrated data by reducing the precision
2301 of the stored floating point values (pedestal, rms and signal) to
2302 roughly 0.5%
2303
2304 - fixed showplot to make file format conversion (eg. converting a
2305 status display stored in a root file into a postscript file) in
2306 batch mode possible:
2307 showplot -b --save-as-ps[=outfile.ps] infile.root
2308
2309 - Allow class names as part of filter rules, eg
2310 (MFSupercuts) && (MHillas.fSize>100)
2311
2312 - fixed a lot of stuff to allow all programs to process MonteCarlo
2313 camera files.
2314
2315 - enhanced possibility to debug reading of resource file
2316
2317 - MDataChain should handle priorities of operator more
2318 accurate now
2319
2320 - completely revised the container in which the signal is stored
2321 MCerPhotEvt/Pix, MArrivalTime --> MSignalCam/Pix
2322 * the new implementation is faster and
2323 * needs less storage space
2324
2325 - FIRST version which can process Monte Carlos through the
2326 whole chain of programs (callisto, star, etc)
2327
2328 - implemented new image parameters for the border length of
2329 the shower image (MNewImagePar2)
2330
2331 - implemented wobble-mode in ganymed
2332
2333 - new class (MJOptimize) taking care of all optimization processes
2334
2335
2336
2337 *** Version 0.8.6 (2004/10/05)
2338
2339 - New combined signal and time extractor
2340 MExtractTimeAndChargeDigitalFilter
2341
2342 - The Report for the trigger section in the CC run summary has been
2343 updated, and now the IPRs (Individual Pixel Rates) are available.
2344
2345 - new macros for database interaction: filldotrun.C, filldotrbk.C
2346
2347 - added new program which can convert colored output which was redirected
2348 into a file back into colored text (for example to display it with
2349 more): showlog
2350
2351 - added new program to display an MStatusArray of plots (stored with
2352 MStatusDisplay) from a file: showplot
2353
2354 - Added support for Sequences (MSequence). Sequences are blocks of run
2355 files containing the same calibration and belonging to the same
2356 source
2357
2358 - Added a new task (MTaskEnv) which can be used in setup files to switch
2359 between different tasks (for example to choose a signal extractor)
2360
2361 - Implemented automatic file splitting in MWriteRootFile
2362
2363 - After image cleaning an island index is assigned to all used pixels.
2364 The index corresponds to the order of the islands in size.
2365
2366 - added a cleaning which takes signal height _and_ arrival time into
2367 account: probability cleaning (for more details see MImgCleanStd)
2368
2369 - added a cleaning which takes takes the absolute number of photons
2370 times the area ratio as cleaning level
2371 (for more details see MImgCleanStd)
2372
2373 - Changed calculation of image parameters such, that it can be done
2374 for all used pixels or the pixels with a defined island index only
2375
2376 - implemented new image parameters displaying the number of islands,
2377 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
2378
2379 - event display in executable changed to support also calibrated files
2380 (done with MJCalibrateSignal)
2381
2382 - added program doing the calibration and the signal extraction
2383 and signal calibration: callisto Most part of the setup is done
2384 by a resource file: callisto.rc
2385
2386 - implemented support for pixels with negative IDs (Raw file format
2387 version 4)
2388
2389 - implemented an new option in merpp (--auto-time) to get the time
2390 range for cc and/or caco data from the run header of the raw data
2391
2392 - New star-program (star and MJStar). Taking calibrated data from
2393 callisto/MJCalibrateSignal as input. The setup is done through
2394 a resource file: star.rc
2395
2396 - Added possibility to setup the eventloop in the mars-executable
2397 Camera Display by a resource file: mars.rc
2398
2399 - The the mars-executable Camera Display can now also read
2400 calibrated data files written by callisto/MJCalibrateSignal
2401
2402 - Added a new class which can calculate the source position in
2403 the camera from a pointing model known to be correct and
2404 the pointing model used for observations (MSrcPosFromModel)
2405
2406 - added a new version of the class calculating the effective on-time
2407 MHEffectiveOnTime. It unifies the old classes MHEffOnTime,
2408 MHEffOnTimeTime, MHEffOnTimeTheta, MHTimeDiff, MHTimeDiffTime and
2409 MHTimeDiffTheta.
2410
2411 - added the possibility to count how often a signal is above (or
2412 below) a certain threshold in MHCamEvent and MHCamEventRot (this
2413 can replace MHTriggerLvl0)
2414
2415 - added ore convinient ways to set the axis-titles of your histograms
2416 in your macro to some MH-classes like: MH3, MHVsTime, MHSectorVsTime,
2417 MHPixVsTime, MHVsTime, MHCamEvent and MHCamEventRot
2418
2419
2420
2421 *** Version 0.8.5 (2004/08/06)
2422
2423 - new Signal Extractors: MExtractFixedWindowSpline
2424 and MExtractAmplitudeSpline
2425
2426 - implementes interleave in merpp to be able to merpp parts of a file
2427
2428 - implemented force-functionality to merpp
2429
2430 - star display to display star catalogs (MAstroCatalog)
2431
2432 - star display to 'mirror' stars to the camera (MAstroCamera)
2433
2434 - implemented a new cleaning option which allows cleaning scaled with
2435 the real ratio of the rms depending on the pixel size, not only the
2436 square root of the pixelsize (MImgCleanStd, MCameraData)
2437
2438 - removed obsolete MBlind* classes
2439
2440 - Signal extractor taking the AB flag into account implemented (this makes
2441 an odd number of slices for signal extraction possible
2442 (MExtractSignalABcorr)
2443
2444 - implemented a class extracting the pedestal from the raw-data (events)
2445 itself using empty lo-gain (MpedCalcFromLoGain)
2446
2447 - Added mean values to MPedPhotCam
2448
2449 - Added Makefile for Darwin (this OS is NOT officially supported!)
2450
2451
2452
2453 *** Version 0.8.4 (2004/04/19)
2454
2455 - new fast arrival time extractor using cubic splines:
2456 MExtractTimeFastSpline
2457
2458 - implementes multi-argument support in MDataChain
2459 ("pow(a, b)")
2460
2461 - implemented double reference support in MDataChain
2462 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
2463
2464 - added support in MF for expressiond like
2465 "MHillas.fWidth<2*<MHillas.fLength"
2466
2467 - MDataChain is now able to support variables like [0], [1], ...
2468 which can be used in fit functions as parameters. The interface
2469 is implemented through the new virtual function
2470 MParContainer::SetVariables
2471
2472 - added new class MArrivalTimeCam/MArrivalTimePix:
2473 Storage containers to hold the ArrivalTime of the camera/pixel
2474
2475 - added new classes for the calibration of relative arrival times:
2476 MCalibrationRelTimePix and MCalibrationRelTimeCam
2477
2478 - added new classes to extract the signal of the blind pixel and the
2479 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
2480
2481 - added new classes for the bad-pixels treatment (MBadPixels*)
2482 which are more powerfull than the old ones (MBlindPixel*)
2483 and will replace them.
2484
2485 - added filter against cosmics: MFCosmics
2486
2487 - added new class MArrivalTimeCalc2:
2488 Calculates the arrival time as the signal weighted mean of the time
2489 slices in the maximum window
2490
2491 - added a new macro call pointspreadfucntion.C that fits with a 2D
2492 gaussian the DC spot for an star. It gives you the RMS of
2493 the PSF and the center of the star, very useful for misspointing
2494 studies.
2495
2496 - added support for multi-telescope camera files. Added classes
2497 MStereoCalc and MStereoPar, classes to calculate and store shower
2498 parameters calculated from the data of two telescopes, for the MC
2499 studies regarding the MAGIC clone.
2500
2501 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
2502 MC data calibrated in photons instead of ADC counts.
2503
2504 - added three macros to show the calibration and analysis chain of
2505 MC data. The macro starmc.C does both calibration and analysis, producing
2506 an output containing Hillas parameters for each event. The macro
2507 mccalibrate.C does just the calibration and writes out a file containing
2508 pixel information in photons instead of FADC data. The macro starmc2.C
2509 reads in such a file and produces an output with Hillas parameters.
2510
2511 - added MPedPhotCalc to compute pedestals in units of photons, see
2512 macro pedphotcalc.C
2513
2514 - added all class to perform the calibration, see macro calibration.C
2515
2516 - added class MFFT to perform Fast Fourier Transforms
2517
2518 - added class MSimulatedAnnealing to perform simulated annealing
2519 minimizations
2520
2521 - added new macro bootcampstandardanalysis.C which holds the skeleton
2522 of the analysis chain discussed in the december bootcamp.
2523
2524 - added support for DAQ raw data file format V2
2525
2526 - implemented an arbitrary time stamp for the events from raw-data
2527 files with file version<3. It is calculated from the run number,
2528 the date of start and the FADC clock tick from the first module
2529
2530 - implemented the correct decoding of the event time-stamp
2531 coming from the DAQ for raw-data files with file-version>2
2532
2533 - added a new classes storing the pedestals in units of photons:
2534 MPedPhotPix, MPedPhotCam
2535
2536 - added support for DC current files from the camera control
2537
2538 - added support for start- and stop-time when merpping report files
2539
2540 - added MReportCC storing the weather data from the CC-REPORT
2541
2542 - added class to fill trainings and test matrices (MTFillMatrix)
2543
2544 - added a filter performing a software trigger (MFSoftwareTrigger)
2545
2546 - Added classes to perform parts of the standard analysis (Jobs):
2547 + MJPedestals
2548 + MJCalibration
2549 + MJExtractSignal
2550 Note: All of them are preliminary!
2551
2552 - Added Iterator to iterate over files giving only the run-number
2553
2554 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
2555 the evolution of a sector vs time
2556
2557
2558
2559 *** Version 0.8.3 (2003/12/05)
2560
2561 - adapted Random Forest classes to allow the use with MC
2562 multi-telescope files which can be produced with the coming
2563 camera version 0.7.
2564
2565 - added classes to read and interprete central control report files
2566 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
2567
2568 - enhanced merpp (the executable) to support .raw and .rep files.
2569
2570 - added classes for light calibration (MCalibration* and
2571 MHCalibration*) by Markus Gaug. Further work has to be and will
2572 be done soon.
2573
2574 - Added a preliminary 'synchronizer' (MReadReports) which will
2575 replace MReadMarsFile as soon as it is finished.
2576
2577 - Added a tutorial macro demonstrating how report files are merpped
2578 and how they can be read from the root file in the correct order
2579 of time (readrep.C)
2580
2581 - Added a generalized histogram (similar to MH3) called MVsTime
2582 which allows to plot variables (or rules - MDataChain - of
2583 variables) vs time. For an example have a look at tempvstime.C.
2584
2585 - Changed the name of the event trees:
2586 + Events --> Events
2587 + PedEvents --> Pedestals
2588 + CalEvents --> Calibration
2589
2590 - changed name of MTime in the event trees from MRawEvtTime to MTime
2591
2592 - added displaying the sector indices to the mars event display
2593
2594 - Magic Online Analysis (MOnA) implemented in a first version
2595 (see mona.cc, MOnlineDump and MOnlineDisplay)
2596
2597 - added classes to calculate event rate
2598 (preliminary: MEventRateCalc, MEventRate)
2599
2600 - added new executable 'readdaq' to read *.raw files from the DAQ directly
2601
2602 - added classes dealing with the telescope pointing position (MPointing*)
2603
2604 - implemented the 'final' Mars time stamp based on some experiences with
2605 the new 'Synchonizer'
2606
2607
2608
2609 *** Version 0.8.2 (2003/11/10)
2610
2611 - accelerated standard analysis by a factor of 6-8 ...
2612 + doing precalculations in MGeomCam for the pixel area ratio
2613 + creating a look up table for the single pixels in MCerPhotEvt
2614
2615 - added task to calculates weights in case you want to 'change'
2616 the energy spectrum of a monte carlo file
2617 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
2618
2619 - added a new executable star which implements the
2620 star.C macro as precompiled executable. Currently a flexible
2621 setup is not possible, but a 'input card' setup will follow.
2622
2623 - Starting to implement Multi-Telescope-Support based on the
2624 upcomming camera version 0.7. The base for a general support
2625 is implemented and the star-functionality is proven to work.
2626
2627 - Replaced Event-Display in and Camera-Display in the Mars GUI
2628 executable by a more convinient display base on MStatusDisplay.
2629
2630 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
2631
2632
2633
2634 *** Version 0.8.1 (2003/10/20)
2635
2636 - added signal subtraction for pure on data by means of fitting
2637 the background in the off region or by performing a combined
2638 signal/background fit. Provides necessary histograms for
2639 obtaining energy spectra and a light curve.
2640
2641 - added classes to perform and study the selection of the
2642 2nd Level Trigger on MC data (example in triglvl2.C macro)
2643
2644 - added pedestal calculation
2645
2646 - implemented "democratic cleaning" (tail cut value proportional
2647 to pixel area) according to Wolfgang's suggestion.
2648
2649 - added Sigmabar treatment (calculation and basic histogramming)
2650
2651 - added basic routines to apply padding
2652
2653 - added first implementation of MARS-based source visibility plotter
2654 (needs to be linked against slalib, preliminary version)
2655
2656 - enhanced functionality of data chains: random numbers, conversion
2657 functions and access to MHMatrix objects
2658
2659 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
2660 numbers under certain circumstances (runs with 0 events included)
2661
2662 - fixed a bug in the general filter MF (didn't work on some systems
2663 at all)
2664
2665 - fixed a bug in chaining files, which caused the analysis to crash or
2666 ignore files
2667
2668 - implemented more geometry classes describing the parameters used
2669 to simulate the PMT camera
2670
2671 - added new Monte Carlo classes containing the setup of the different
2672 programs in the MC chain.
2673
2674 - added a (preliminary) general task to evaluate chi-square of a given
2675 parameter in an eventloop.
2676
2677 - first implementation of a container describing the observatory
2678 location (Long, Lat, etc)
2679
2680 - added Random Forest - method for g/h-separation
2681
2682 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
2683 (this means, that it is compiling, but not yet fully tested)
2684
2685 - added a new status display which can show the present status
2686 of histograms while an eventloop is running (MStatusDisplay,
2687 an example can be found at status.C)
2688
2689 - reorganized directories:
2690 classes describing the image --> mimage
2691 classes containing Monte Carlo Histograms --> mhistmc
2692 classes for Random Forest method --> mranforest
2693
2694 - added (event-)weights to fill histograms
2695
2696 - colors in logging output to screen
2697
2698 - changes to the Image Parameter declaration:
2699 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
2700 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
2701 + MHillasExt now derives from MParContainer instead of MHillas
2702 --> Files written with the old definition are more or less unreadable
2703
2704 - reading of reflector files
2705
2706 - display data from reflector files in the camera
2707
2708 - implemented currents (and display them in the camera)
2709
2710 - logarithmic scale in camera
2711
2712 - added class to iterate through directory contents (MDirIter)
2713
2714
2715
2716 *** Version 0.8 (2002/11/18)
2717
2718 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
2719
2720 - corrected 48(!) wrong entries in the Next Neighbor table of the
2721 Magic Camera (all in the inner part of the outer ring, mostly
2722 missing a single NN)
2723
2724 - Fixed a bug in the table describing the Next Neighbours of the
2725 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
2726 have any neighbour)
2727
2728 - changed trigrate.C: now it calculates the pure NSB triggers from
2729 a camera file (generated with no showers), so there is no need
2730 to introduce them by hand in the BgR array (for more details
2731 please ask Abelardo)
2732
2733 - added MHHadronness (and MHadronness) as a general facility to evaluate
2734 the quality of a gamma-hadron seperation method
2735
2736 - changed MWriteAsciiFile to accept rules (MDataChain)
2737
2738 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
2739 must be replaced by calles to MWriteAsciiFile::AddColumn and
2740 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
2741 changed.
2742
2743 - Implemented generalized event-matrices (one row per event)
2744 (MHMatrix)
2745
2746 - implemented the one dimensional composite probabilities
2747 (MHCompProb, MCompProbCalc, comprob.C)
2748
2749 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
2750 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
2751
2752 - Added a camera display displaying the pixel numbers to the
2753 event display gui.
2754
2755 - Added Monte Carlo Informations to event display gui
2756
2757 - Changed the camera display to display the pixel numbering
2758
2759 - Added three buttons to the camera display to change the palette
2760
2761 - Added the number of used and core pixels after image cleaning
2762 to MHillas
2763
2764 - Changed the algorithm used in MHillas according to TDAS 02-03
2765
2766 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
2767
2768 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
2769
2770 - Added fCosDeltaAlpha to MHillasSrc
2771
2772 - The numbers of photons used to calculate fConc and fConc1 in
2773 MHillasExt are now scaled with the pixel size, so that one get
2774 a four times smaller value for the bigger pixels in the outer ring.
2775
2776 - added new task to smooth the camera contents (MCameraSmooth)
2777
2778 - added possibility to use interpolated pixel values for blind pixels
2779 instead of removing it completely from the analysis
2780
2781 - Implemented the possibility to save the whole eventloop with
2782 its setup to a file. This information can be read and from
2783 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
2784 and MEvtLoop::MakeMacro. If you find something not working, please
2785 report - this stuff is still in a beta phase.
2786
2787 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
2788 file having crab starfield, but also for all following files - fixed
2789
2790 - MTaskList::PrintStatistics can now be instructud to print also the
2791 title, too: use PrintStatistics(0, kTRUE)
2792
2793 - Changed the image cleaning so that pixels with to many 'used'
2794 neighbors are left used (to get rid of 'holes' in events)
2795
2796 - Introduced more output to the camera displays
2797
2798 - Added an array of histograms (eg one hist per run), MHArray
2799
2800 - Added a _preliminary_ version of the reader for CT1 PreProc files
2801 (MCT1ReadPreProc)
2802
2803 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
2804 (thanks to Raquel)
2805
2806 - added the first energy estimator (MEnergyEstParam, estimate.C,
2807 estfit.C) using a parametrization
2808
2809 - Added some new Monte Carlo paremeter containers used to store
2810 setup information from the MC chain (MMcConfigRunHeader,
2811 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
2812
2813
2814
2815 *** Version 0.7 (2002/04/30)
2816
2817 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
2818 the pedestal mean value was saved incorrectly. For files from
2819 this versions we substract 0.5 from the pedestal mean.
2820 WARNING: This may effect your results, so don't wonder...
2821
2822 - First implementation of an algorithm using only triggered events
2823 for the collection area calculation
2824
2825 - Ascii Output can now also be used for parameter containers which
2826 doesn't overload MParCointainer::AsciiWrite
2827
2828 - The Ascii Output is now also capable of writing single data members
2829 of one container
2830
2831 - You are now able to change the order of the values written to the
2832 ascii file
2833
2834 - You can now specify a conversion factor for each data member written
2835 to an ascii file. This may be usefull to change the units of the
2836 data member (eg. degrees instead of millimeters in case of the
2837 hillas parameters)
2838
2839 - Replaced old MHillas by a new structure which allows you to extend
2840 the parameters stored in MHillas very easily:
2841 see MHillas and MHillasExt
2842
2843 - Added classes to handle source dependancy of image parameters:
2844 see MHillasSrc
2845
2846 - Added container (MBinning) to have a standard input for the binning
2847 in different histograms (eg. the Energy bins should be the same in
2848 all histograms)
2849
2850 - Changed Hillas histograms from mm to deg
2851
2852 - Added the flexible binning to the hillas histograms
2853
2854 - Added a filter for the alpha parameter (MFAlpha)
2855
2856 - It is now possible to write single data members of a class object to
2857 an output stream instead of the whole container only
2858
2859 - Added a generalized filter for a data member:
2860 MFDataMember filter("MHillas.fWidth", '<', 0.5);
2861
2862 - Added a generalized Filter parser for more difficult filter rules
2863 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
2864
2865 - Added new Monte Carlo histograms:
2866 MHMcEnergyImpact and MHMcEfficiency
2867
2868 - Added many new histograms needed for the flux calculation.
2869
2870 - Added a generalized histograms which can fill and show up to three
2871 data members in either a one-, two- or three-dimensional histogram, eg:
2872 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
2873
2874 - Added:
2875 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
2876 * calculation of <Theta> as a function of time (MHThetabarTime)
2877 they are needed in the flux calculation in
2878 order to select for a given bin in Theta (or time) the appropriate
2879 effective collection area, which is assumed to be given as a function
2880 of Theta and the true energy
2881
2882 - Added calculation of the migration matrix in the energy
2883 (MHMcEnergyMigration):
2884 the migration matrix describes the migration from the true (E_true)
2885 to the estimated energy (E_est); it is needed to determine the
2886 distribution of E_true from the measured distribution of E_est
2887 by unfolding
2888
2889 - changed the color palette in the camera display to DeapSea.
2890
2891
2892
2893 *** Version 0.6 (2002/01/15)
2894
2895 - Introduce the option of disable pixels (MBlindPixels and
2896 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
2897 able to deal with Star Field NSB.
2898
2899 - Fixed a bug in the pedestals substraction
2900
2901 - Introduced verbosity levels
2902
2903 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
2904
2905 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
2906 work correctly (thanks to Abelardo)
2907
2908 - Introduced correct treatment of the diffuse Night Sky Background
2909 and NSB (MMcPedestalNSB)
2910
2911 - Corrected treatment of the electronic noise (MMcPedestalCopy)
2912
2913 - Introduced MMcRunHeaders which contains monte carlo run informations
2914
2915 - Added a 'Print'-Task (MPrint) which calls the Print function
2916 of a parameter container for each event
2917
2918 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
2919
2920 - changes to be more efficient with root 3.02/06
2921
2922 - root 3.02/06 fixes:
2923 + the memory leak when reading MRawEvtData
2924 + loosing more time than necessary to update the progress bar
2925
2926 - MWriteAsciiFile is now capable of writing more than one container
2927 in a line. For example: To be able to write Monte Carlo and
2928 Hillas values (energy and alpha) in one line.
2929
2930
2931
2932 *** Version 0.5 (2001/11/06)
2933
2934 - Added new GUI functionality (Analysis)
2935
2936 - Added a camera display to be able to display events in the camera
2937 together with the calculated hillas ellipse
2938
2939 - Added a 'Clone'-Task (MClone) which can clone a parameter container
2940 object at any state of the analysis, so that the output are several
2941 states
2942
2943 - Fixed a bug in the collection area error calculation
2944 (Thanks to Ciro and Abelardo)
2945
2946 - Fixed a bug which causes merpp to crash in some environments
2947
2948 - Implemented auto enabling scheme for Branches to speed up reading
2949 a lot (see MReadTree and MTask)
2950
2951 - Fixed a bug in the Histogram classes which caused histograms to
2952 be written to a file by MWriteRootFile without request
2953
2954 - changed the object I/O from the old stylish root I/O to the new
2955 'auto evolution scheme' This was done only for classes which are not
2956 yet used in Monte Carlo files, so that these files are still readable.
2957
2958 - Added support for a progress bar in MEvtLoop and MReadTree
2959 (see the Analysis Window in Mars for an example)
2960
2961 - Fixed a bug in the package creation which disturbed the conversion
2962 between a mars version unpacked from a tar file and the repository.
2963
2964 - Changed the code to writer merpped (converted into root format)
2965 raw files, to get faster (around 10%)
2966
2967
2968
2969 *** Version 0.4 (2001/09/20)
2970
2971 - This release is made to compile on a root version >= 3.00
2972
2973 - Fixed a bug which causes MReadTree to read the first file only
2974
2975 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
2976
2977 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
2978
2979 - Added a task to write several container to a root file (MWriteRootFile)
2980
2981 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
2982
2983 - Added calculation of the collection area (MMcCollectionAreaCalc)
2984
2985 - fixed some bugs in the Hillas calculation
2986
2987 - added filters to be able to control the task execution dependent on
2988 a parameter (for example: the number of level 1 triggers in a MC-file)
2989
2990
2991
2992 *** Version 0.3 (2001/04/23)
2993
2994 - Many demo macros added
2995
2996 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
2997
2998 - Hillas Calculation added
2999
3000 - Standard image cleaning available
3001
3002 - MReadTree is now able to handle more than one file
3003 (Remark: of the same structure)
3004
3005 - Now we are able to display events in a first version of the
3006 Camera event display. To do this we must run the macro
3007 "macros/readCT1.C" to read data from CT1.
3008
3009
3010
3011 *** Version 0.2 (2001/01/24)
3012
3013 - First Implementation of a Gui to read the raw data. Start the
3014 gui with the command mars.
3015
3016
3017
3018 *** Version 0.1 (2000/12/20)
3019
3020 - First official release 0.1
3021
3022 - Changes:
3023
3024 + changed calling style of MRawPixelIterator from do...while to
3025 while-loop
Note: See TracBrowser for help on using the repository browser.