source: trunk/MagicSoft/Mars/NEWS@ 9029

Last change on this file since 9029 was 9024, checked in by tbretz, 16 years ago
*** empty log message ***
File size: 120.0 KB
Line 
1 -*-*- END -*-*-
2
3== <cvs> ==
4
5 ;general
6
7 * should work now with root 5.20/00
8
9 * Sequences and Datasets are now stored as "MDataSet" and "MSequence"
10 instead of the base name of the file. This makes them easier to
11 access from the code
12
13 * Default Monte Carlo names in MSequence do not require the _E at
14 the end anymore
15
16 * where abrrevating a sequence file with a sequence number is possible
17 also "telescope:sequence" is now accepted, e.g.:
18 star 2:2000123 --out=output
19 see the programs' help for more details.
20
21 * sequences (MSequence or MSequenceSQL) can now directly be retrieved
22 from the database. See the constructors for more details.
23
24 ;merpp
25
26 * we merpp the dc currents now also from the camera reports (they have
27 just a lower rate than the current reports, 0.1Hz instead of 1Hz)
28
29 * In the automatic analysis we omit merpping of the currents from the
30 caco files and use the lower rate camera reports from the cc files
31 instead
32
33 * merpp has been redisigned to allow merpping of the cc-reports
34 of a whole sequence. This allows to design a very simple analysis:
35 mkdir output
36 ./callisto 100776 --out=output
37 ./merpp 100776 output
38 ./star 100776 --ind=output --out=output
39 Instead of the sequence number also sequence files are accepted.
40
41 ;star
42
43 * The camera currents are now displayed with the rate of the camera
44 reports instead of the caco reports
45
46
47
48== Version 2.1 (2007/09/03) ==
49
50 ;Database
51
52 * introduced average temperature and wind speed from star-files
53
54 * introduced average values from Pyrometer (mainly Cloudiness)
55
56 * introduced the ratio of accepted calibration events in the
57 calibration run
58
59 * introduced the average rates of the different trigger pattern,
60 e.g. the rate of pedestal and calibration events, from the signal-file
61
62 ;general
63
64 * fixed GroupBy options in plot*.C macros
65
66 * only display KVA points (not the Tuorla points) in plotoptical.C
67
68 * all programs now allow to add resources to the ones from the resource
69 file or overwrite them from the command line. This can be done like this
70 ganymed --config=ganymed.rc --rc=Cut1.Param1:0.25 --rc=Cut1.Param3:5.5
71 if something seems to be wrong you can debug what the program is doing
72 using the option --debug-env=3
73
74 * increased the diversity of debug levels. That also means that with -v3
75 you get now less output, i.e. only the output which is important for
76 an analysis. To get more output which helps for debugging try 4, 5 and 6.
77
78 * fixed a problem in the task synchronizing the reading of the reports
79 and the data stream. The effect was that in some circumstances the last
80 events of some trees could have been skipped. Since this is only a
81 very tiny part of the data no severe effect to your analysis results
82 is expected (an exception might be very short, i.e. singel runs,
83 datasets).
84
85 * Dataset file now allow to include the sequence file directly within
86 the dataset file and also allow to exclude single runs from the dataset.
87 (for more details see Class reference of MDataSet)
88
89 * Sequence files now allow for excluding runs from the analysis
90 (for more details see Class reference of MSequence)
91
92 * added code to process the sum-trigger flag
93
94 * the histogram classes MH3 and MHn now support profile histograms
95
96 * the histogram classes MH3 and MHn now support labels at the axis
97
98 * the Random Forest Train-classes (MJTRain*) now store the used datasets
99 in the output file
100
101 * the MFMagicCuts have a new option to allow a linear area cut (for
102 special studies)
103
104 * The liniking of the shared object is now done into a file defined
105 by 'mktemp'. This should be a local file system which accelerates
106 liniking a lot.
107
108 * The code has been prepared for compilation with root 5.18/00d
109
110 * The MHEnergyEst histogram now shows the distribution of
111 (Eest-Emc)/Est and the distributions (Eest-Emc)/Eest vs. Eest
112 and (Eest-Emc)/Emc vs Emc.
113
114 * fixed mars (event display) for merpped raw-data and MC data
115
116 * adapted the synatx of sequence files to allow for the new run/file
117 scheme. For more details see class description of MSequence
118
119 ;showplot
120
121 * Added support for tiff files
122
123 * Added support for csv files (tables containing tab number,
124 name and title)
125
126 * Tabs now can have a title which is displayed in the postscript file
127
128 * When multiple file are written at once (e.g. pngs from a display)
129 it is now possible to use the tab name and or tab number in the
130 file name. For details see showplos's help.
131
132 ;merpp
133
134 * Implemented cc file version 2008-02-20/0
135
136 * Implemented cc file version 2008-05-19/0
137
138 * With new options merpping can be restricted (in addition to the
139 run-number) also by telescope and file number.
140 For details see "merpp --help"
141
142 * Implemented raw data format 11 (the most important change, except
143 from plenty of changes in the format definition, is the addition
144 of the file-number in the header) If nobody makes a mistake this
145 format should have the advantage that it is by definition forward
146 compatible, so old programs will be able to read newer formats.
147
148 * Added Pyrometer information to default output (stored in a new Tree
149 Pyrometer, needs a complete new merpp, i.e. new calibration)
150
151 * Merpping (also update) can now be restricted to one single report.
152 For example:
153 If you want to update an old file with Pyrometer information call
154 merpp --only=Pyrometer --update
155
156 ;callisto
157
158 * in the pedestal processing now at least 50 processed events are
159 required for succeeding.
160
161 * the signal and calib files now contain also the sequence information
162
163 * the two MPedestalCam in the calib file now have proper names
164 to distinguish them from each other (MPedestalCam, MPedestalExtracted)
165
166 * Both pedestal cams now contain the number of events processed
167
168 * In Mars V2.0 the extraction of the fundamental pedestal was broken,
169 i.e. for the extraction of the calibration pulses basically the average
170 over all events of the first slice instead of all slices was used.
171 Since pedestal and calibration constants are continously recalculated
172 this only effected the very first events of every sequence.
173
174 * For the extraction of the position of the maximum sample now the
175 extraction range is set automatically to the extraction window,
176 before the whole accessible range was used.
177
178 * If the number of samples in the events and the number of samples
179 in the run-header disagrees now an error is raised (this can
180 happen in not well simulated Monte Carlo files)
181
182 * In the case of MUX-data pedestal events with the lvl1 trigger flag
183 could survive into the pedestal calculation -- fixed.
184
185 * Tab "TrigPat" added showing the distribution of the trigger pattern
186 as found in the run-files (normalized with the run length)
187
188 * The selection of events from the trigger pattern has been improved.
189 If the trigger pattern is corrupted events won't pass anymore.
190
191 * Added a new command line option --dev-null to suppress output of
192 Y-files (this is useful for test cases)
193
194 * added a new tab "CalPos" showing the arrival time of extracted
195 interleaved calibration events
196
197 ;star
198
199 * the star file now contains also the sequence information
200
201 * Added a new command line option --dev-null to suppress output of
202 I-files (this is useful for test cases)
203
204 * Tab "Rate" added showing the distribution of the trigger pattern
205 (should only be Trig (Lvl1/Lvl2) and Sum (Sum only)) as found in
206 the Y-files (normalized with the run length)
207
208 * The effective on-time calculation doesn't use events with only
209 sum-trigger anymore
210
211 * The data in the MHWeather tab has been reorganized. The never
212 working solar radiation has been removed and the data from
213 the pyrometer (cloudiness, air and sky temperature) is
214 displayed in addition.
215
216 ;ganymed/sponde
217
218 * Now data points are even shown correctly if they have error bars larger
219 than one sigma. Points with null or negative significances are omitted.
220
221 * DrawNicePlot now allows to set a projection range
222
223 * Updates pointing models. One is applied after the implementation
224 of the new LUTS in August, the other one is applied after the
225 next major change of the pointing model in October. Note that
226 these models are preliminary and give wrong results below Zd=65deg
227
228 ;sponde
229
230 * fixed resource files ('''Spectrum''' instead of '''MJSpectrum''')
231
232 * a new option "--force-runtime" is available. In case of very short
233 datasets (for light-curves) which are in the order of a few
234 minutes the calculated effective on-time is not very acurate because
235 it is quantizised in the order of a minute. Therefore you can switch
236 to using the real run-time instead (remakrt: this ignores any
237 dead-time!)
238
239 * a more analytical way is used to "fill" Monte Carlos into regions
240 of impact parameters which have not been simulated because the
241 trigger efficiency is assumed to be 0.
242
243 * estimated sensitivity curves for hi and lo zenith angles are shown
244 scaled to the correct observation time and collection area
245
246 * the Monte Carlo events after cuts are now written to the output file
247 if an output file given
248
249
250
251 *** Version 2.0 (2007/09/03)
252
253 - database: the position used for the pulse pos check was missing
254 in the callisto output and could thus not be filled into the DB.
255 Also the old values seemed not exactly the PulsePos used for
256 teh check.
257
258 - general: Resource file now allow an Include-Resource, i.e. you can
259 read a resource file with default settings, include it in your
260 resource file and overwrite the settings in your file. More than
261 one include file is allowed. Inclusions can be iterative.
262 Include: mydefaults.rc yourdefaults.rc
263 The resources in the first file have higher priority than the
264 second file.
265
266 - general: Now the output files (calib*.root, etc) also contain the
267 resource file (to check it open it in the TBrowser and choose Print()
268 from the context menu)
269
270 - general: Dataset files now allow to overwrite the default path
271 to search for sequence and data files. Note, that the program
272 option and individual resources will overwrite it. For example:
273 SequencePath: /magic/montecarlo/sequences
274 DataPath: /magic/montecarlo/star
275
276 - general: Fixed a problem with variables in MDataPhrase. It seems
277 that only optimdisp (didn't work) was effected.
278
279 - general: Some improvements to the optim and train processing. For
280 example the ststud window now got a proper title.
281
282 - general: The "Status Display: " was removed from the window title
283 within an Eventloop.
284
285 - general: added a new flexible histogram-class (MHn) which can be used
286 for example in testing after optimizations or training to produce
287 user defined histograms.
288
289 - general: The Random Forest now allows attaching an evaluation
290 function which is applied to its output. This allows to train
291 on whatever you like (eg. train on log10(energy), but return
292 energy)
293
294 - general: The Random Forest training of energy (trainenergy.c) and
295 disp (traindisp.C) has been improved by more graphical output to
296 judge the result.
297
298 - general: The training of energy (trainenergy.C) has been improved
299 a lot by training on a different quantity than energy. It gives
300 a result which is highly independant of the source spectrum
301 and shows lower bias than all other options.
302
303 - general: Dataset files are allowed to contain collections of
304 datasets. For more details see the class reference of MDataSet.
305
306 - general: The default WobbleMode in a datset file now (if not
307 overwritten) is "auto", i.e. wobble mode is set if the dataset
308 doesn't contain off-sequences.
309
310 - merpp: Merpp can read file format version 9 now. Please realize
311 that for file format version 9 the extraction range is different
312 and must be set to 0/49 instead of 15/64 in callisto_mux.rc until
313 the first and last 15 slices have been removed from all MUX data.
314
315 - mars: Similar to writing movies you can now select events which
316 should be displayed in your display. Therefore add the following
317 lines to your mars.rc:
318 MFEvtNumber.FileName: ganymed00223552.root
319 MFEvtNumber.Selector: ThetaSquared.fVal<0.04 && DataType.fVal>0.5
320 The input file can be a ganymed-file after (ganymed*.root) or
321 before (ganymed*-summary.root) file. For example to select all events
322 from your on sample after cuts (excluding the ThetaSq cut) use
323 MFEvtNumber.Selector: DataType.fVal>0.5
324 To show all events from your on-sample after quality cuts
325 use the summary file instead.
326
327 - mars: new ways to call mars are implemented. Instead
328 of calling
329 mars filename.root
330 you can now also use
331 mars sequence.txt
332 or
333 mars sequence.txt inputpath
334 or replace sequence.txt by the sequence number if the default
335 sequence file should be used.
336
337 - mars: The default size has been increased
338
339 - mars: There are two new heckboxes which allow to switch off
340 the calculated image parameters
341
342 - callisto: was broken for MCs... fixed.
343
344 - callisto: improved calculation of spline coefficients a lot. This
345 leads to a further improvement of the event rate calibrating MUX
346 data of about 15% (175evt/s instead of 150evt/s)
347
348 - callisto: finally the raw data we read is now real 16bit (with
349 10bit precision) for MUX data and not a stripped 8bit number
350 anymore. Due to scaling of the numbers (without precision loss
351 into an [0-256[ range, the final numbers for pedestal, pedestalrms
352 and extacted signal don't change. However, at all places where
353 raw data is directly accessed (eg. saturation and variation
354 limits in the signal- and pedestal-extraction) the numbers
355 refer still to the data's 16bit range.
356
357 - callisto: The maximum arrival time difference used in the bad
358 pixel treatment is now in units of nanoseconds, which leads to 3.0ns
359 for both, old FADC and MUX-FADC, data.
360
361 - callisto: Be aware that callisto is now calibrating the arrival time
362 in nanoseconds rather than time slices. Also all following tasks
363 have been changed to assume ns units now. If you star data
364 calibrated with an older version it might be necessary to adapt
365 some timimng parameters (Muon Analysis and MFSoftwareTrigger)
366 to obtain optimal results. The plot in the PulsePos tab
367 will now be in ns, too. This might also mean that the Muon
368 analysis in star might not work as perfect as expected as long
369 as old files read in.
370
371 - callisto: The calibration constants of earlier updates got lost
372 somehow. All constants have been updated.
373
374 - star: The PSF is now determined from the profile of the ArcWidth
375 instead of arcwidth/radius. The old way gave to much weight
376 to the bins with low statistics. The reference lines have been
377 updated.
378
379 - star: For speed reasons events suitable for the muon analysis
380 are now also preselected by fConcCOG<0.1 which seems to be a very
381 good preselector for muons.
382
383 - star: is now calculating a new timing parameter the Slope along
384 the major and minor axis of the shower. Therefore a numerical
385 solution of a line-fit is used. To use MHillasExt.fSlopeLong
386 and MHillasExt.fSlopeTrans don't forget to multiply it with
387 the sign stored in MHillasSrc.fCosDeltaAlpha as usual.
388
389 - star: The parameters fInnerSize, fInnerLeakage1 and fInnerLeakage2
390 have been removed from MNewImagePar. They have never been good for
391 anything.
392
393 - star: Implemented a new recursive algorithm which is supposed to be
394 faster. Also implemented new cleaning oiptions, which are:
395 + CleanLevel0:
396 The cleaning level above single core pixels can be kept
397 + KeepIsolatedPixels:
398 Define whether single core pixels should be kept
399 + TimeLevel1:
400 The coincidence window in nanoseconds to single used neighbors
401 + TimeLevel2:
402 The coincidence window in nanoseconds to two used neighbors
403 + PostCleanType:
404 MOde in which a time dependent post cleaning should be applied
405 0: No post cleaning
406 1: Require for each used pixels at least one used neighbor
407 within a time-window of CleanLevel1
408 2: Require for each used pixels at least two used neighbor
409 within a time-window of CleanLevel2
410 3: Require first two and second one used neighbor
411 within a time-window of CleanLevel1 and fCleanLevel2
412 respectively
413 + RecoverIsolatedPixels:
414 - recoveres isolated core pixels if they have a used neighbor
415
416 - mars/star: The new default cleaning is:
417 + CleanLevel1: 6.0
418 + CleanLevel2: 3.0
419 + CleanTime1: 1.75
420 + CleanTime2: 1.75
421 + PostCleanType: 3
422
423 - star/ganymed: The old spark-cuts have been replaced by new ones.
424 These new spark cuts have been cross checked with the sequences
425 84720 (before splitter), 101041 (after splitter) and 223539 (new
426 FADCs). In all cases they seperate pretty well, but of course not
427 perfect. Monte Carlos have suggested to tighten the cuts a little
428 bit further at low sizes. This has been done.
429
430 - ganymed: IMPORTANT - The spark cuts have been changed to match
431 all available data more or less well. This might mean that for
432 YOUR data there are still sparks visible.
433 Whenever you do an analysis you have to make sure that NO sparks
434 survive your cuts!
435
436 - ganymed: The old hadronness and size cuts have gotten new indices
437 (10, 11). The old indices 8 and 9 now mean an additional condition
438 for ghostbusting based on the formula (dist-c[9])*c[8]-slope.
439 If you want to switch off this cut just move the line far away enough,
440 e.g. by setting c[9] to -500. Please update your ganymed.rc files
441 accordingly!
442 The unit of c[9] is deg. It is the dist at which your cut will
443 cross the slope==0. The unit of the slope is ns/deg. So if
444 you readin files calibrated with an older Mars-version you
445 have to adapt the default value for c[9] to the FADCs:
446 - Multiply by two for the MUX FADCs (run number > 200.000)
447 - Multiply by 0.3 for the Siegen FADCs (run number < 200.000)
448 - Multiply by 42 for the meaning of life (run number = 200.000)
449
450 - ganymed: The old Cut0 is now called CutQ and is calculated before
451 the source position is caluclated. If you need a quality cut
452 including source dependant data (be very carefull with this!)
453 you have to use Cut0 instead.
454
455 - ganymed: now properly supports three off regions in wobble mode.
456 It will be the default from now on in ganymed_wobble.rc. To change
457 the number of off-regions use
458 NumOffSourcePositions: 1
459 in your ganymed.rc. Also by default no off-theta cut will be done
460 anymore so that you will get a background level higher than the
461 signal level in your ThetaSq plot for ThetaSq>0.2.
462 Due to this be carefull changing the scaling mode away from
463 "None". You will underestimate your signal if your scale interval
464 is not properly set.
465 (Rem: ThetaSqN is no longer needed)
466
467 - ganymed: is now storing the events of all (on- and off-)
468 source positions even in the case of more than one off-source
469 position. This should allow sponde to work properly and the
470 energy estimation is done correctly in all cases (without any
471 "nearest position" trick)
472
473 - ganymed: From 85340 (19.3.2006) on a real starguider calibration
474 with a real pointing model for the starguider is done, calibrated
475 with more than thousand tpoints taken from this date on.
476
477 - ganymed: was broken for Wobble-MCs... fixed.
478
479 - ganymed: The default cuts (MFMagicCuts) and the disp-parametrization
480 has changed. Note that your old ganymed.rc will be incompatible
481 with the new algorithms! Please check the ganymed.rc files and
482 the class description of MFMagicCuts for more information.
483 It is recommended at the moment to use identical Disp-Parametrizations
484 for on/off- and wobble-mode. If cuts are optimized only
485 the Area-Cut (parameters 2,3,4) and the theta-sq cut (parameter 1)
486 should be optimized. All other values should be kept as they are.
487 If you want to do an anylsis without timing a parameters, you can
488 switch off the timing cuts by seeting parameter 7 to a very small
489 value (eg. -99). To remove the slope parameter from the disp
490 paremtrization set parameter 8 to 0.
491
492 - ganymed: The distribution of observation time versus zenith
493 angle is now shown for off- AND on-data.
494
495 - ganymed: The contents of the source position plot are no longer
496 averaged, thus a lot of (fake) events between the two wobble
497 positions have disappeared.
498
499 - ganymed: There is a new tab "CutT" it contains the VsSize plots
500 with the CutT, whihc is defined in ganymed.rc, applied. It
501 is resonable to use your theta-cut for it, to see if there is
502 something strange (sparks!) in your signal-region.
503
504 - ganymed: To choose a dataset from a collection in a dataset file
505 use the new command line option "--dataset=12345"
506
507 - optim, sponde: should now properly support three off-regions.
508 Just produce your ganymed summary files with three off-regions.
509 optim and sponde will automatically get all off events from
510 all off-regions from this file. Please do not forget to
511 set the scaling in optimwobble.C properly:
512 fit.SetScaleUser(1./3);
513 it is not yet read in automatically (will follow soon).
514 In the case of fixed Scale you can also use
515 cuts.SetThetaCut(MFMagicCuts::kOn);
516 no off-cut needed.
517 Be carefull in case of three off-regions when switching on
518 scale mode. Make sure that the scale interval is set correctly.
519
520 - sponde: sponde.rc and sponde_onoff.rc are now idetical
521
522 - sponde: the resouce files have been rewritten with a lot of
523 comments and a well working parametrization for an energy estimator
524
525 - sponde: In the estimated energy versus monte carlo energy plot the
526 contents where exchanged.... fixed.
527
528 - sponde: the so called "accurate"-mode has been removed. It didn't
529 give any improvement in accuracy, only decreased execution speed.
530
531 - sponde: the so called "simple"-mode has been removed. It didn't
532 give any improvement in simple.
533
534 - sponde: the so called "refill"-mode has been removed. It was anyhow
535 not implemented.
536
537 - sponde: now checks whether the theta distribution of your on-data
538 and the theta-distribution of your Monte Carlo sample (after
539 weighting) fits. If it doesn't fit properly (eg. the Monte Carlo
540 sample is incomplete) execution is stopped. Execution can be forced
541 using the new option --force-theta. Use this option with care!
542
543 - sponde: Proper collection areas can now be constructed also from
544 Monte Carlo samples generated with different maximum impact
545 parameters. Note that in previous version you neither got
546 a warning or failure, nor was there any obvious sign that the
547 collection area was overestimated due to usage of files with
548 different maximum impact parameters.
549
550 - sponde: If MC files with different lower energy limits are used
551 the primary MC spectrum is artificially completed down to the
552 lowest energy used at all. WARNING: that this gives correct
553 collection areas ONLY if none of the events in this region would
554 survive your cuts at all.
555
556 - sponde: the output file now contains more information about
557 the spectrum (eg. the full 2D collection area histogram).
558 Note, that this information can only be written to the file
559 if it is stored automatically via command line argument.
560 If you only store the status display from within the display
561 the information is lost.
562
563 - sponde: added a new tab "Disp". It shows the residual of the disp
564 (Disp-Dist) versus several parameters and it is meant to judge the
565 quality of the disp estimator. In the ideal case the residual is zero
566 and doesn't depend on any variable. The tab is displayed after
567 CutQ and Cut0.
568
569 - sponde: added a new tab "Energy". It shows the residual of the
570 energy (lg(estimated energy)-lg(monte carlo energy)) versus
571 several parameters and it is meant to judge the quality of the
572 energy estimator. In the ideal case the residual is zero
573 and doesn't depend on any variable. In reality even a good estimator
574 can show residuals versus Monte Carlo energy. The tab is displayed
575 after all cuts.
576
577 - sponde: added a new tab "EventDist" showing the unweighted real
578 absolute number of events of your sample after cuts. This tells
579 you how many events with this energy you had in your MC files.
580 The same information you get from the error bars of the weighted
581 histograms, but this is less intuitive.
582
583 - sponde: The spectrum plots now show the crab- and 1553-spectrum
584 for comparison. It is not meant to show these curves in
585 publications, they are only for production.
586
587 - sponde: The OriginalMC tree with the events produced by corsika
588 is now processed only once
589
590 - sponde: Finally fixed most annoying bug, which has effected the
591 last bin of the collection area. It was the problem that binnings
592 of root histograms are from 1 to n (included) but there was a C-like
593 loop in sponde from 0 to n (excluded). Now the loop also includes
594 correctly under- and overflow-bins. The worse thing with this is,
595 that for the events in the highest bin not only the bin-content
596 was wrong, but also the weights applied to these events, which could
597 in pricipal effect also other parts of the distribution (eg. due
598 to energy estimation). Fortunately it effected only a few events
599 in most cases.
600
601
602
603 *** Version 1.2 (2007/05/14)
604
605 - database: The database now has two new values Unsuitable50 and
606 Unsuitable01. They express the number of pixels which are
607 unsuitable for more than 50%, respectively more than 1%, of
608 all calibrated event. It is a more accurate number than the
609 previously used numbers, because they only take the first
610 calibration (ignoring the interleaved calibrations) into account.
611
612 - database: The database now has two other new values UnsuitableMax and
613 DeadMax. They express the maximum number of pixels which were
614 unsuitable, respectively dead, during the sequence. Because
615 of high pedestal rms (cars passing) a few events with very high
616 numbers of unsuitable pixels can happen. Not to suffer from this
617 effect we don't take the highest 0.1% of the numbers into account.
618
619 - general: fixed a bug which caused callisto and star to stop working
620 properly because the callisto output was currupted
621
622 - general: a script called scripts/makemovie has been added which
623 simplified the process of producing several movies from a single
624 sequence with different setup.
625
626 - callisto: Some more code cleanup. Started to remove old obsolete
627 code from cvs.
628
629 - callisto: The extraction of the pedestal with the extractor was
630 not random. It seems that extracting at one position is still biased
631 (for example in the first or last slices we could still suffer from
632 switching noise) Now it is completely random.
633
634 - callisto: In MPedCalcPedRun (which is the pedestal extraction from
635 pedestal files) individual pixels could be skipped due to high
636 variations. This was already the case for the pedestal extraction
637 from the lo-gains since the beginning and properly handled
638 there, but was introduced in the extraction from the pedestal files
639 a while ago. To calculate the average value it was still divided
640 by the number of events procesed not by the number of summands
641 really summed. This let to a pedestal which was a tiny amount too
642 small (for a few piels in the order of 0.1%). This led to an slightly
643 positive offset of the randomly extracted pedestal for a few pixels.
644 I doubt that this has a big effect on the result, because the effect
645 on the individual numbers is quite small. Due to this it is suggested
646 that you rerun your calibration to make sure you are without any
647 avoidable bias.
648
649 - callisto: the ArrTimeRmsLimit is now is a check of the deviation from
650 the median rms of the absolute arrival time and expressed in significance
651 levels. This replaces the old meaning of an abolute upper limit. An
652 absolute upper limit doesn't make much sense, because in our data
653 all arrival times are shifted at the same time (in fact it might be
654 a shift of the artificial trigger w.r.t. to the light flash).
655
656 - callisto: Added a new tab "BadPixTm" which shows the time evolution
657 of the number of unsuitable pixels over the whole sequence. This
658 is usefull mainly to judge if an intermediate calibration had
659 problems.
660
661 - callisto: Added a new tab "DeadPixTm" which shows the time evolution
662 of the number of dead pixels over the whole sequence. Dead pixels
663 in this context are unmapped pixels, i.e. pixels which could not
664 be interpolated, and thus are ignored in the further analysis.
665
666 - callisto: It is now possible to use the position of the maximum
667 of the spline as arrival time instead of the leading edge even
668 when using the integral for the signal. Therefor set the extraction
669 type to kIntegralRel ("IntegralRelative") and the relative height
670 ("HeightTm") to -1:
671 MJPedestalC1.ExtractSignal.ExtractionType: IntegralRelative
672 MJPedestalC1.ExtractSignal.HeightTm: -1
673
674
675
676
677 *** Version 1.1 (2007/04/27)
678
679 - general: The new class MGeomCamDwarf contains the camera geometry
680 for our prefered Dwarf camera and can be used to create general
681 geometries of roundish or hexagonal cameras.
682
683 - mars: The default cleaning is now abolute 8.5/4.0.
684
685 - mars: The resource file mars.rc now contains examples for MUX data
686
687 - merpp: Implemented file format version 8 (MUX FADC data). The 16-bit
688 data containing only 10-bit information is still cooked down to
689 8-bit, by cutting away the lowest 8-bit.
690
691 - merpp: When reading raw data the data is now stored in a single
692 array. The lo-gain array is obsolete. The interface stays the same.
693
694 - callisto: To process the new MUX data use the resource file
695 callisto_mux.rc
696
697 - callisto: The -root and -raw options to read merpped raw data have
698 been removed
699
700 - callisto: If the -mc option is given the sequence-name can now be
701 replaced by the MC sequence number
702
703 - callisto: If the sequence file contains "MonteCarlo: Yes" the
704 -mc option can now be omitted
705
706 - callisto: Started further simplification by removing obsolete
707 dependancies on MCalibIntensity*Cams.
708
709 - callisto: removed unsused intensity calibration from MJCalibration
710 for further simplification
711
712 - callisto: for simplification removed references to
713 MBadPixelsIntensityCam, MCalibrationIntensityQECam,
714 MCalibrationIntensityRelTimeCam, MCalibrationIntensityTestCam,
715 MCalibrationIntensityChargeCam, and MCalibrationIntensityBlindCam
716 (this should at minimum change nothing at all, and at maximum
717 improve thing if these containers where somewhere not handled
718 properly)
719
720 - callisto: Added the option to write an event movie. Please use
721 this option with care (huge files) but exessively to understand
722 our events. For further documentation please refer to the
723 IACT wiki
724 (currently at http://www.astro.uni.wuerzburg.de/mediawiki-1.9.0)
725
726 - callisto: Improved binning for the pulse position check histogram
727
728 - callisto: The code calculating the pulse position checknow takes
729 the pedestal into account
730
731 - callisto: The arrival time is now stored with full precision this
732 helps to get rid of artefacts in histograms. For the signal this
733 is not necessray because it is displayed in log-scale anyhow
734
735 - callisto: Fixed a problem with internal exclusions. Pixels which
736 have once been marked as unsuitable didn't get the necessary
737 histograms filled anymore to be rechecked with each interleaved
738 calibration.
739
740 - callisto: The relative arrival time resolution (the rms of the
741 relative arrival time offset) is now checked against its
742 median and the median deviation, instead of the average
743 plus an absolute offset.
744
745 - callisto: The relative arrival time offset is now calculated
746 w.r.t. its median not w.r.t. to an artificial reference pixel.
747
748 - callisto: The relative time calibration now marks pixels with
749 outlaying offset as unsuitable
750
751 - callisto: The interleaved relative time calibration has been switched
752 on. The advantage is that pixels which are marked as outliers
753 now can recover. An improvement over time is not expected, because
754 the relative time calibration seems stable.
755
756 - ganymed: If the dataset file containes "MonteCarlo: Yes" the "-mc"
757 option can now be omitted.
758
759 - ganymed: If either the dataset file containes "MonteCarlo: Yes"
760 or the option "-mc" is specified as default the monte carlo datacenter
761 paths (/magic/montecarlo/...) are used if not overwritten in the
762 dataset file.
763
764 - ganymed: The output files now contain run- and event-number for all
765 events, accessible as RunNumber.fVal and EvtNumber.fVal
766
767 - ganymed: Added a plot showing the source position in the camera also
768 for wobble mode
769
770 - ganymed: In addition to the existing task which can be setup to
771 be executed after Cut1 a final task called "EstimateEnergy"
772 has been added, executed before writing the final output
773 (ganymed00000000.root). The task setup in all three cases
774 can be choosen individually. (For all three(!) cases you
775 can for example choose MRanForestCalc. For examples see all
776 sponde*.rc and all ganymed*rc)
777
778 - ganymed: If a container "MEstimatedEnergy" is found in the
779 parameter list (eg. because it was setup by MEstimateEnergy)
780 it will be written to the output file.
781
782
783
784 *** Version 1.0 (2007/02/16)
785
786 - database: Website to plot values from the database has been added.
787
788 - database: The rate of spark events as found by star is now kept
789 and the rate after cleaning is now with spark events subtracted
790
791 - general: The changes to the interpretation of phrases lead to
792 a problem with the access of MHMatrix objects (eg. "M[0]")... fixed.
793
794 - general: Added example files how you can create your own calendar
795 (eg. as christmas present) with Mars. Just run
796 root macros/tutorials/calendar.C
797
798 - general: Added a possibility to display grouped data in the plotdb.C
799 macro (and similar macros). This allows to plot hourly, nightly,
800 weekly, monthly and yearly averages.
801 For more details see the plotall function of the macro
802
803 - general: fixed the error display of the camera display. It showed
804 wrong results.
805
806 - general: fixed a memory leak when reading many MStatusDisplays
807
808 - general: added a macro (macros/tutorials/mirrordelay.C) plotting the delay
809 between a spherical and a parabolic mirror
810
811 - callisto: We have a new pulse position check which takes the properties
812 of the extractor automatically into account. So no need to set
813 ExtractWinLeft/Right anymore. Again a check for pulses too much to the
814 left is done. If possible the lo-gain extraction start and hi-gain
815 extraction end is changed accordingly. If no proper extraction range
816 can be set (hi-gain too much to the left) an error is raised.
817
818 - callisto: New swapped pixels have been found and corrected
819
820 - callisto: Redone the signal extraction this includes:
821 + Unified the algorithms to extract the pedestal for all pedestal
822 extractions done
823 + Unification of hi- and lo-gain into one array
824 + Unification of hi- and lo-gain extraction for Spline and
825 Digital Filter (means now exactly the same algorithm is used,
826 not a copy-and-pasted one)
827 + Store pedestal subtracted data in a common place
828 + Improved extraction algorithms. If the algorithms search a
829 maximum but don't find one they don't return the maximum anymore
830 + Improved the extraction such that a information for signal
831 and time which is consistent is returned
832 + replaced the numerical spline with a (not slower) analytical
833 solution
834 + Lowered the saturation limit from 250 to 245 to make sure that
835 we are far away in all pixels from problems with the clock-noise
836 + The start of the lo-gain extraction is calculated from the hi-gain
837 arrival time. In case of saturation an estimation is used.
838 + the hi-gain window was extended to slice 16. This allows extraction
839 of very late pulses in single pixels or of huge hadron showers.
840 + Now uses the lo-gain extraction range for pedestal extraction,
841 not the hi-gain range in the lo-gain
842
843 - callisto: New hi-/lo-gain calibration constants have been produced
844 for all periods from the statistic of the whole period. They are
845 now used automatically depending on the periods. The old constants
846 where deviation in avarega about 2%-3%. The constants are very
847 stable from period to period (<<1%) except for exchanged channels.
848 In a few cases the constants used so far were off by 1%-2% (maybe
849 temperature effects?)
850
851 - callisto: To gain obsolete space we do not write the
852 MPedestalFundamental anymore. Also calibration and bad pixel
853 treatment is not done for it anymore because it has never been used.
854
855 - callisto: Fixed a bug in the seuqence handling which caused the
856 light condition to be ignored
857
858 - star: Added two new tabs "Sparkless" and "Sparks" these tabs show
859 basically the same as "Cleaned" but the distribution devided into
860 the events fullfilling a spark cut or being rejected by it.
861 This cut can be changed from star.rc (see example inside) by
862 the "SparkCut" directive
863
864 - star: Star displays now the average individual pixel-rate (IPR) versus
865 time and the average discriminator threshold (DT) of all pixels.
866
867 - optim: fixed a problem with the optim-macros which was due to a bug
868 in the new phrase parsing
869
870 - ganymed: To get a nice FalseSource plot (instead of the all-information
871 debug plot displayed as a standard plot) use the context menu
872 somewhere between the two upper plots, click on "DrawNicePlot"
873 and enjoy the result. (It is the same context menu which contains
874 the other options)
875 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
876
877 - ganymed/optim/train: The cut program, trainings- and optimization
878 macros could run with less files found than expected from the
879 sequence-files. No the execution is stopped in this case.
880
881 - ganymed: now stores the dataset in the output file with all information
882 contained (as sequence number, sequence path, data path) so that the
883 used dataset file can be recreated complete from the output
884
885 - sponde: now also allows the uasge of random forest
886
887 - sponde: added a plot showing the cut efficiency
888
889 - sponde: Using root versions < 5.13/04 still resulted in wrong binomial
890 errors (eg. effecting the collection area) because the errors of the
891 two histograms were swapped in the calculation, which makes a difference
892 in the case the histograms contains weighted events. Aditionally the
893 totalarea was incorrectly taken into account, which results in too small
894 errors, which makes a difference at low statistics were the errors
895 or the collection area dominate.
896
897
898
899 *** Version 0.10.3 (2006/10/23)
900
901 - database: Implemented ObservationMode flag in websites.
902
903 - database: For sequences there is now also the stoptime available on the
904 websites.
905
906 - database: Removed ManuallyChanged flag from sequence-info websites,
907 as it is not needed anymore with the new sequence building algorithm.
908
909 - general: MRolke.[cc,h]: Modification of TRolke from root_v5.12.00b.
910 Class for calculation of confidence intervals (upper limits).
911 Use model 3 or 4 for upper limit calculation for MAGIC observations.
912 Please read the class instruction of TRolke for more information.
913
914 - general: The programs now return 0xfe if the requested resource file
915 doesn't exist.
916
917 - general: Errors comming from root itself are now not output to
918 stderr anymore but to our default (colored) log-stream.
919
920 - general: Changed the interface to TFormula such that now everything
921 is parsed by TFormula, which should allow to use phrases even
922 without paranthesis correctly parsed.
923
924 - callisto: replaced the AdHoc number of effective integration slices
925 in the digital filter by an average of the correct number, averaged
926 over all possible set of weights. This also gives correct numbers
927 for the lo-gains which were totally wrong before.
928
929 - callisto: drastically reduced memory consumption by not storing
930 all intermediate calibration results in memory anymore (we might
931 write them into a file in the future)
932
933 - ganymed: To get a nice Theta-Sq plot (instead of the all-information
934 debug plot displayed as a standard plot) use the context menu
935 somewhere between the two upper plots, click on "DrawNicePlot"
936 and enjoy the result. (It is the same context menu which contains
937 the "DrawAll" option)
938 PLEASE ALWAYS USE THIS PLOT FOR ANY KIND OF PRESENTATION!
939
940
941
942 *** Version 0.10.2 (2006/10/15)
943
944 - general: changed the building of the sequence files such, that
945 the source-/project name in case of wobble-sources is not the
946 source/project of the first data run anymore but the new generalized
947 wobble source/project
948
949 - general: Added some functions to MAstro to calculate sun and
950 moon properties
951
952 - general: Added two new macros (starvisday.C and starvisyear.C)
953 which allow to plot the visibility of several stars in one day
954 or of one star along one year
955
956
957
958 *** Version 0.10.1 (2006/10/11)
959
960 - general: HTML logging output was distorted... fixed.
961
962 - general: Changed the writing of the sequencefiles such that only
963 as many pedestal files as giving at least 1000 pedestal events which
964 are nearby the first calibration run are used as pedestal runs
965
966 - sponde: In the calculation of the collection area(s) and the
967 distribution for MOnte Carlo and estimated energy the error
968 calculation was wrong because root didn't take the errors
969 properly into account... fixed.
970
971
972
973 *** Version 0.10 (2006/10/10)
974
975 - general: all executables now check consistency of the root version
976 installed with the root version used for compilation. The return
977 code in this case is 255.
978
979 - general: The algorithm to build seqeunces has been redesigned
980 completly. It is now more flexible in terms of a resource file
981 resources/sequences.rc which can be used to partly overwrite
982 the default algorithm and defined the important part of the
983 algorithm. It also takes correctly into account several ways
984 of taking wobble-data. Currently the new algorithm doesn't take
985 the number of pedestal events anymore into account (so a sequence
986 could have much less than 1000 pedestal events and data runs are
987 no-more used instead)
988
989 - general: a lot of small changes to make the code compatible with
990 root 5.12/00 and gcc 4.1
991
992 - general: Fixed some warnings thrown if more warnings are switched
993 on in the compiler
994
995 - general: Added a function to MMath which returns the Median of
996 the distribution abs(y[i]-median) but at 68:32 division instead
997 of 50:50, which is somehow the median counterpart of the rms.
998
999 - general: MAstroCatalog allows now to read calatog files (as bsc5)
1000 even if they are compressed with gzip (recommended compression
1001 is with "-1")
1002
1003 - showplot:
1004 + batch mode creation of image files now works with root 5.12/00
1005 + added support for writing bmp (though it never produces
1006 bmp which can be read by programs like xv or gimp)
1007 + added support for xml
1008 + added new option to start the display with a different size, by
1009 --display-width=nnn or --display-height=nnn
1010 + added options to define the canvas size when the display is started
1011 --canvas-width=nnn or --canvas-height=nnn
1012 the option can also be used for batch-mode conversion
1013 + added an option which automatically fits the display size to the
1014 desktop-size: --auto-size
1015
1016 - merpp: didn't recognize files with the extension .raw.gz - fixed.
1017
1018 - merpp: allow the reports to have 1000ms due to a bug in the camera
1019 program.
1020
1021 - callisto: New swapped pixels have been found and corrected. For
1022 details see MRawRunHeader::FixAssignment()
1023
1024 - callisto: Callisto now raises an error if one of the input files could
1025 not be opened.
1026
1027 - callisto: In some rare cases it could happen that in the signal
1028 extraction of the digital filter the extractor returned nonsense
1029 results due a wrong initializion of a variable (this happens in
1030 cases in which the extracted signal is exactly zero or the
1031 digital filter couldn't slide because of a too small extraction
1032 window, which could happen in the lo-gain extraction)
1033
1034 - callisto: The lo-gains have been marked as valid in some cases
1035 when they got not extracted at all (deltsumlo=deltatimelo=0) because
1036 the allowed extraction range (fLoGainLast-fLoGainFirst) was
1037 smaller than the number of slices (fLoGainWindowSize) needed
1038 by the lo-gain extractor
1039
1040 - callisto: Updated absolute calibration constants (muon calibration)
1041
1042 - callisto: fixed a bug which caused the hi-gain saturation not
1043 to be handled properly in the spline (the position of the
1044 saturation was calculated incorrectly)
1045
1046 - callisto: fixed a bug which gave weird results if hi- _and_
1047 lo-gain could not be extracted properly. In some cases hi-
1048 and lo-gain have not been extracted at all and the random result
1049 got calibrated. In other cases the hi-gain was saturating and the
1050 lo-gain has not been extracted. For this a completly arbitraty
1051 scale factor was applied to the result from extracting the
1052 charge of the saturating hi-gain.
1053
1054 - callisto: improves handling of extracted signal if lo- and/or
1055 hi-gain could not be extracted properly. If no appropriate
1056 calibration of either the signal or the arrival time is possible
1057 the pixel is now markes as unsuitable instead of estimated.
1058
1059 - callisto: Fixed a problem in the spline extraction which gave
1060 weird results if the signal was extracted from the first (and
1061 highest) slice (as a workaround extraction from the first
1062 slice has been forbidden)
1063
1064 - callisto: Fixed a bug regarding the use of the QE which doesn't
1065 effect the result because the default is used anyhow.
1066 (The bug was there since 14/07/2005)
1067
1068 - callisto: Changed the default for fgLoGainStartShift to -2.4
1069
1070 - callisto: Fixed a bug which caused all hi-/lo-gain calibration
1071 factors to be always 10 for all pixels as soon as the first
1072 calibration update has happend.
1073
1074 - callisto: Fixed the hi-/lo-gain offset for the Digital Filter. It
1075 was off by more than one slice (which gives wrong values for
1076 pixels which have saturated the hi-gain) This was a problem
1077 mainly for timing studies, not so much for the automatic standard
1078 analysis. Also the values for the Spline have been changed slightly:
1079 + Digital Filter from 1.70 to 0.95
1080 + Spline from 1.39 to 1.30
1081 The numbers were sorted out by an extensive test in the
1082 test-database.
1083
1084 - callisto: Removed the tab showing the average calibrated arrival
1085 time. It never gave useful information.
1086
1087 - callisto: Now tab "HiLoCal" which shows the ratio between hi- and
1088 lo-gain pulse for data pulses if hi- and lo-gain have saturated
1089 and both were extracted because the hi-gain was above the
1090 LoGainSwitch.
1091
1092 - callisto: Now tab "HiLoOff" which shows the offset between hi- and
1093 lo-gain pulse position (after application of LoGainOffset, which
1094 means in the ideal case it is 0) for data pulses if hi- and lo-gain
1095 have saturated and both were extracted because the hi-gain was above
1096 the LoGainSwitch.
1097
1098 - callisto: After extensive tests a new threshold level for determination
1099 of the pulse position has been found at 50phe. This is due to the
1100 fact that for lower pulses the arrival time changes its average
1101 behaviour dramatically. It tends to the average of the extraction
1102 range and starts sticking to non-floating point numbers (5, 6, 7, ...)
1103
1104 - callisto: Added two more plots to the calibration part. The average
1105 extracted signal and the average extracted arrival time as
1106 extracted by the signal extractor (This can help debugging problems
1107 because it doesn't involve a fit)
1108
1109 - star: changed the fit for the effective on time such that initial
1110 values are calculated automatically now instead of using build
1111 in values. This makes the fit more indepedant of the underlaying
1112 rates. With a test of ~350 sequences in the test database it could
1113 be shown that the new fit gives the same result +/-1sek.
1114 The highest deviation was +5s the lowest -10s. You can now control
1115 the bahaviour with two resource values:
1116 MHEffectiveOnTime.FistBin: 3
1117 MHEffectiveOnTime.NumEvents: 12000
1118 Use FirstBin=1 and NumEvents=120 to fit the effective on time
1119 from the resulting gamma candidates
1120
1121 - star: The Center histogram in MHHillas is now by default displayed
1122 with the colz draw-option
1123
1124 - ganymed: now produces valid error codes if failed
1125
1126 - ganymed: MFMagicCuts now supports a hadronness cut. Switch it on
1127 with the option "hadronness" instead of "area" or "both" if
1128 you want to use both cuts. The hadronness cut includes a fixed
1129 cut in hadronness (index 8) and a fixed cut in size (index 9).
1130
1131 - ganymed: MFMagicCuts: fixed abug introduced 2005/7/14 which caused
1132 the M3Long of the anti source to be not properly evaluated
1133 (actually is was evaluated as a unique random number) in case
1134 of optimization with anti-theta cut switched on. This might have
1135 lead to improper, but not necessarily wrong, optimization results.
1136
1137 - ganymed: ganymed_onoff.rc, ganymed_wobble.rc - updated with comments
1138 how to use random forest
1139
1140 - ganymed: use the same spark cuts as in ganymed_wobble.rc as in
1141 ganymed_onoff.rc. Seems to be unintentional that they were different.
1142
1143 - sponde: Since the introduction of the possibility to define a
1144 normalization energy instead of using the integral the default
1145 was not using the integral anymore but a normalization energy of
1146 1GeV. It is now the integral again.
1147
1148 - sponde: Fixed a problem in the weighting which did not allow
1149 a MC slope of -1.
1150
1151
1152
1153 *** Version 0.9.6 (2006/05/24)
1154
1155 - general: changed the binning of the azimuthal profile of the camera
1156 such that it is aligned with the 60deg boundaries.
1157
1158 - merpp: better handling of problems with the TH, TD part of the
1159 CC-REPORT for files older than 200507190 and 200412210
1160 respectively
1161
1162 - merpp: improved handling of RECEIVERS-COM-ERROR in CC-REPORT
1163
1164 - merpp: implementd latest changes in starguider reports (sinc 9th May)
1165
1166 - callisto: if an arrival time is extracted outside the fadc range is
1167 was set to the boundary before. Now a random number is assigned
1168 instead to avoid unfortunate coincidences of arrival times just
1169 by this arbitrary value.
1170
1171 - callisto: added a new option to callisto.rc which allows
1172 to set the maximum arrival time difference allowed for the
1173 badpixel algorithm to determin whether a pixels belongs to a shower:
1174 MJCalibrateSignal.MBadPixelsTreat.MaxArrivalTimeDiff: 0.9
1175
1176 - callisto: changed the old value (0.5) for MaxArrivalTimeDiff
1177 to 0.9 as suggested by Stefan due to a recent study on the fraction
1178 of pixels surviving the image cleaning
1179
1180 - callisto: switched off error in case of "pulse is too much to the left"
1181
1182 - callisto: The extraction window is not adapted anymore. This means that
1183 the pulse is extracted from the full range. The draw-back is that the
1184 background (pedestal) will become slightly higher. Switching on/off
1185 the PulsePosCheck in the callisto.rc only effects filling the
1186 histograms.
1187 WARNING: If the pulse is too much to the left data is calibrated!
1188 Check the PulsePosCheck-PulsePosition AND the Inhomogeneity parameter
1189 in the database to make sure that your data is valid!
1190
1191 - star: Show also the number of stars correlated correctly by the
1192 starguider
1193
1194 - ganymed: implemented a new class (MHThetaSqN) which allows to use more
1195 than one off-source region in wobble-mode. To use it add the following to
1196 your ganymed_wobble.rc:
1197 + MJCut.NameHist: MHThetaSqN (switch the new feature on)
1198 + MHThetaSqN.NumOffSourcePos: 3 (define number of off-regions)
1199 + MHThetaSqN.DoOffCut: Yes,No (switch on/off the off-cut)
1200 + Cut1.ThetaCut: None
1201 + MHThetaSqN.SignificanceCutLevel: 2.0 (increase off-cut by 2.0/1.7)
1202
1203 - ganymed: in the case the latest report is older than a default (currently
1204 one minute) and the current report will be skip the starguider
1205 correction and calibration will be reset. The maximum age can be
1206 setup from ganymed.rc by (minutes):
1207 MPointingDevCalc.MaxAge: 1.5
1208
1209 - ganymed: A first implementation showing all size-bins for the theta-sq
1210 resp. alpha-plots in a single tab automatically
1211
1212
1213
1214 *** Version 0.9.5.1 (2006/05/05)
1215
1216 - general: Added a new option "zdiff" to the Makefile which runs
1217 "cvs diff" as "make diff" would do, but with compression
1218
1219 - general: accelerated MTFillMatrix (used for eample in all training
1220 and optimization macros) by skipping some obsolete calles in the
1221 eventloop the first and second loop could be accelerated by ~20%
1222
1223 - general: Added a missing feature in the MFilterList class which
1224 prevented MFEnergySlope from working correctly in trainenergy.C
1225
1226 - general: Accelerated the random forest training and usage a bit
1227
1228 - merpp: Adapted to new raw data file format version 6
1229
1230 - merpp: fixed a problem with reading the starguider reports
1231 after 6.3.2006
1232
1233 - callisto: At some times six pixels had to be exchanged manually in the
1234 data. If the pixels to be swaped are both not found, an error was raised
1235 and calibration was stopped. Now it is assumed they are intentially not
1236 mapped and the Error has been changed to a Warning.
1237
1238 - star: Added new image cleaning based on the arrival time of the shower.
1239 The new cleaning can be accessed using the parameter "Time" instead of
1240 the the old one (like "Absolute) in the star.rc-file.
1241 Recommended parameters:
1242 + MImgCleanStd.CleanLevel1: 8.2
1243 + MImgCleanStd.CleanLevel2: 5
1244 + MImgCleanStd.CleanRings: 2
1245 + MImgCleanStd.KeepSinglePixels: No
1246
1247 - star: Simplified the calculation of the effective on time. By letting
1248 the fit start in the third bin the result should become more stable.
1249 The fit quality is now ignored for the theta-plot which is not used
1250 in the analysis later. Still better pre-cut which, for example,
1251 remove events triggered by car-light (rate changing on a short
1252 time-scale) are missing.
1253
1254 - macros: optimonoff.C, optimwobble.C: implemented a new strategy
1255 for optimization (kWeakSource) which is suggested by the Berlin
1256 people for weak sources.
1257
1258 - macros: plotdb.C:
1259 + if no dataset and no time-interval is given only sequences with
1260 an effective on-time above five minutes are plotted anymore
1261 + added a new tab "RelTime" displaying the relative on-time
1262 (effective on-time divided by the observation time)
1263
1264 - macros: optim*.C: by skipping some obsolete calles in the eventloop
1265 the optimization became a lot faster
1266
1267 - ganymed: In the second loop the MHNewImagePar histograms disapeared.
1268 To display them just delete the pads displayed on top.
1269
1270 - ganymed: fixed a bug which could cause strange behaviour in wobble
1271 mode if no starguider information was available due to an incorrect
1272 initialization of the starguider calibration
1273
1274 - ganymed: The scale region in the False Source Plot (MHDisp) can now
1275 be changed from within the plot. It can also be setup from the
1276 resource file using:
1277 + MHDisp.fScaleMin: 0.325
1278 + MHDisp.fScaleMax: 0.475
1279
1280 - ganymed, showplot: Fixed a problem with the fit to the off-data
1281 (HistOff) which could cause a time lag or an inifinite loop.
1282 The bug did not effect the results at all.
1283
1284 - sponde: Added a new tab showing the effective collection area after
1285 trigger (including the software trigger)
1286
1287 - sponde: MMcSpectrumWeight has a new option which allows to define
1288 the scaling factor not by the integral of the events but at
1289 a defined energy:
1290 e.g. MMcSpectrumWeight.NormEnergy: 200
1291
1292 - MTFillMatrix, sponde: by skipping some obsolete calles in the
1293 eventloops the loop could be accelerated by ~20%
1294
1295
1296
1297 *** Version 0.9.5 (2006/03/13)
1298
1299 - macros: fixed a typo optimwoble.C (SetThetaCut instead SetAlphaCut)
1300 and added the standard Disp-parametrization
1301
1302 - macros: added a new macro datacenter/macros/plotstat.C allowing
1303 to plot statistics about the data processing
1304
1305 - macros: added a new macro to plot the muon correction coefficients
1306 versus period (macros/plot/mucal.C)
1307
1308 - showplot: path inflation for ganymed files was broken
1309
1310 - callisto: Fixed an important bug. When the number of saturating pixels
1311 were calculated the bad pixel information already available from the
1312 calibration was ignored. This yields wrong values in case pixels
1313 are broken and saturate all the time or randomly.
1314
1315 - callisto: Updated Muon calibration constants. Spline data now also uses
1316 different values for different periods
1317
1318 - star: The time-evolution shown in the effective on-time plot now displays
1319 the axis range (if there are no holes it should be similar to the
1320 effective on-time)
1321
1322 - star: Added two new image parameters:
1323 + MNewImagePar.fConcCOG: The ratio of the equivalent signals of
1324 the three pixels next to the center of gravity and the size
1325 + MNewImagePar.fConcCore: The ratio of the signals of all
1326 pixels inside or touching the ellipse and the size
1327
1328 - ganymed: now stops in requested source isn't found in catalog file
1329
1330 - ganymed: Many improvements to the phi-plot in wobble mode:
1331 + with a template the ideal background is displayed
1332 + a possible camera inhomogeneity is taken into account
1333 + the anti theta cut is better supported
1334 + the phi cut is automatically calculated from the theta cut
1335 See the examples in ganymed_wobble.rc for more details.
1336
1337 - ganymed: fixed plot for E^2*dN/dE. The spectrum was multiplied with two
1338 times the bin-width instead of the absolute energy
1339
1340 - ganymed: New cuts for on/off and wobble mode
1341
1342 - ganymed: The smearing of the False Source plot has been increased
1343 to 0.06
1344
1345 - ganymed: The starguider calibration can now be changed from the
1346 resource file.
1347 See the examples in ganymed*.rc for more details.
1348
1349 - ganymed: added a new option for on-/off-observations
1350 MJCut.RandomSourcePosition
1351 If switched on the distribution of observation time of the source
1352 position in the camera is calculated from the on-data and randomly
1353 applied with this distrbution to the off-data.
1354
1355 - ganymed: by skipping some obsolete calles in the eventloop the
1356 first and second loop could be accelerated by ~20%
1357
1358 - ganymed: The default in ganymed_onoff.rc is now to determin the source
1359 position in the off-data randomly according to its distribution in the
1360 on-data.
1361
1362
1363
1364 *** Version 0.9.4.3 (2006/02/13)
1365
1366 - general: Fixed a bug in most of the programs which prevented the
1367 compile date in the startup message to be displayed
1368
1369 - general: Simplified program calls. The following abbreviations
1370 are now possible:
1371 showlog callisto 55599
1372 showplot signal 55599
1373 star 55599
1374 callisto 55999
1375 ganymed 2
1376 In this cases the corrsponding root-, log-, sequence- or dataset-
1377 filename is automatically compiled using the default datacenter
1378 paths ("/magic/*")
1379
1380 - general: Fixed a long outstanding bug which made axis tick marks
1381 disappear if MDataFormula was used (eg. abs(x))
1382
1383 - general: Updated MMath with new functions to calculate the results of
1384 a exponential, logarithmic and powerlaw fits analytically.
1385
1386 - general: Updated some macros with comments:
1387 + macros/optim/optimdisp.C
1388 + macros/optim/optimenergy.C
1389 + macros/optim/optimwobble.C:
1390
1391 - general: MTFillMatrix (the class to fill one or two MHMatrix from
1392 files) now allows adding a pre-cut like in the optimization. E.g. this
1393 is useful to perform g/h-separation cuts before training the random
1394 forest.
1395
1396 - general: Between the rund 53300 and 68754 the pixels 553-558 were not
1397 correctly assigned in the raw data assignement table. A fix to correct
1398 the assignment tabel have been implemented.
1399
1400 - general: MAstroCatalog now allows rotating of the sky-grid and stars
1401 by 90, 180 and 270 deg.
1402
1403 - general: the macro plotdb.C now allows to highlight sequences belonging
1404 to a datset. For more details see the descritions in the macro.
1405
1406 - StatusDisplay: Fixed the algorithm to calculate the size ratio
1407 of the display, it gave wrong results espacially for big sizes.
1408 Now the embedded canvas should always have a ratio width/height=3/2.
1409 The "Size" options have been updated with values fitting the 3/2
1410 size ratio.
1411
1412 - RanForest:
1413 + Updated the random forest classes to support also the
1414 regression method implemented by Thomas H.
1415 + added new tutorial macro how to train the random forest
1416 for energy estimation (macros/optim/rfenergyest.C)
1417 + new classes to train the random forest (still in development)
1418 mjtrain/MJTrainEnergy, mjtrain/MJTrainDisp, mjtrain/MJTrainSeparation
1419 + new tutorial macros for random forest training in macros/train
1420 trainenergy.C, traindisp.C, trainseparation.C
1421
1422 - mars: now allows to setup a cut in the resource file mars.rc to choose
1423 the events to be displayed, eg:
1424 Cut.Condition: {0} && {1}
1425 Cut.0: MHillas.fSize>100
1426 Cut.1: MHillas.fSize<900
1427
1428 - merpp: Made aware of the new .rep format 200510250. This includes
1429 interpretation of the Receiver Board Temperatures (MCameraRecTemp),
1430 the discriminator thresholds (MCameraTD) and the disciminator
1431 delays (MCameraTD). All of them come with the CC report and are therefor
1432 written to the CC tree.
1433
1434 - callisto: fixed a bug in the calculation of the arrival times in
1435 the Digital Filter. They were all shifted by the same amount
1436 fHiGainFirst. This caused an offset in the order of the position of
1437 the left border of the extraction window in the times calculated
1438 from high-gain and from low-gain. The bug effected only the absolute
1439 arrival times. The bug was there since 30.1.2005.
1440
1441 - callisto: Changed the ExtractionWindow for the pulse position check
1442 such that the camera inhomogeneity becomes as less as possible and
1443 comparable to the pulso position check switched off. More details
1444 on the study will be given at our result web-page.
1445
1446 - ganymed: ganymed.rc, ganymed_onoff.rc:
1447 changed to new cuts trained with 1ES1218 and Crab-data
1448 for maximum sigma*log10(excess)
1449
1450 - ganymed: In addition to the Hadronness calculator (CalcHadronness)
1451 a new option was implemented to estimate Disp (CalcDisp)
1452
1453 - ganymed: Implemented two new options which allow
1454 to overwrite the default path to search for the sequence files
1455 --ins=/magic/sequences
1456 and where to search for the image data
1457 --ind=/magic/data/star
1458
1459 - ganymed: MSrcPosCorrect now allows overwriting of the misfocussing
1460 dx/dy from the resource file by
1461 MSrcPosCorrect.Dx
1462 MSrcPosCorrect.Dy
1463
1464 - ganymed: fixed reading the source catalog. Only as many chars
1465 as the requested source name had were compared (If a source
1466 "1ES1218" and "1ES1218+304" were in the catalog and "1ES1218+304"
1467 were requested it could happen that the coordinates of
1468 "1ES1218" were read) The source coordinates are now printed
1469 in addition to its name to the logging output.
1470
1471 - ganymed: changed the background fit in the case of a ThetaSq function
1472 from a polynomial to a exponential, this should give a big improvement
1473 for on-only analysis'
1474
1475 - ganymed/sponde: Calculation of the error of single size-/energy-
1476 bins now uses Li/Ma (5) instead of LiMa (17)
1477
1478 - sponde: Added a plot E^2*dN/dE
1479
1480 - sponde: The energy estimator plot should now show values like
1481 they are commonly used.
1482
1483 - sponde: Now MMcSpectrumWeight also excepts formulas with two X
1484 (a powerlaw with cutoff didn't work before)
1485
1486
1487
1488 *** Version 0.9.4.2 (2005/10/01)
1489
1490 - general: added new tutorial macro macros/tutorials/threshold.C:
1491 how to calculate the threshold
1492
1493 - general: added a new game. Start it from the interpreter with
1494 MagicJam j; (other games are: MineSweeper, MagicSnake, MagicDomino
1495 and MagicReversi)
1496
1497 - general: neighbor pixels in MGeoms are now sorted clockwise
1498
1499 - merpp: made aware of new format 20050829-0
1500
1501 - callisto: New scale factors from muon analysis, stored in new
1502 resource file resources/calibration.rc
1503
1504 - callisto: MBadPixelsCalc now raises an error instead of simply stopping
1505 the eventloop if something went wrong. This is necessary for the
1506 automatic processing
1507
1508 - callisto: Implemented a new treatment for the time information
1509 developed by S.Ruegamer, this should give much better response than
1510 the old very primitive algorithm. This is especially important
1511 for bad pixels due to bright stars as Ceta-Tauri (btw: the old
1512 treatment was buggy! As neighbor pixels to interpolate the
1513 arrival times always the pixels 0 to 5 were taken)
1514
1515 - callisto: In addition to the new treatment of arrival times the
1516 decision of the treatment whether a pixel contains shower
1517 information or not is used to improve the signal interpolation
1518 further. Previously interpolated pixels showed a non-zero signal
1519 do the peak searching signal extractors. Having a signal pixel
1520 beside raised the signal above the cleaning level. Thus the
1521 pixel survived cleaning to often but with a too low mean signal.
1522 By replacing empty pixels with a gaus (mean and rms from the
1523 corresponding Area entries in MPedPhotCam) this effect can
1524 be supressed.
1525
1526 - callisto: The status "unmapped" (for pixel which cannot be interpolated)
1527 got lost when the events were stored by the calibration... fixed.
1528 (This was no problem for normal image cleaning because the pixel
1529 content was artificially set to 0 not surviving standard cleaning
1530 algorithm)
1531
1532 - callisto: Fixed a bug which caused the random and peak-search pedestal
1533 extracted with an extractor to be exchanged for the first (roughly)
1534 500 events (*Extractor and *ExtractorRndm).
1535 (They were simply exchanged in callisto.cc) This bug might have been
1536 introduced in Mars 0.9.4 when the order of calculation of the two
1537 types of pedestal in callisto got exchanged. The bug only effects
1538 the first seconds of data of each sequence.
1539
1540 - star: Taking the arrival time of Muons into account the calculation
1541 of the parameters could be made independant of the noise
1542 (pedestal rms). The dependance was due to the bias of the peak search
1543 extractor. Now only a ZA dependamcy is left which is not yet fully
1544 understood.
1545
1546 - ganymed: The sequences were still not sorted correctly in any case,
1547 because they were sorted by the full qualified path name. Now they
1548 are sorted by their sequence number.
1549
1550 - ganymed: new values for the spark-event-cut
1551
1552 - sponde: required missing MEnergyEst from ganymed.root... fixed.
1553
1554
1555
1556 *** Version 0.9.4.1 (2005/08/18)
1557
1558 - callisto: fixed some problems with the calibration in case of
1559 inteleaved events. Therefor the final and some intermediate
1560 fits are skipped which would take place on partly filled #
1561 histograms and gave wrong results or failed completely.
1562
1563 - callisto: If the intermediate finalization of the histograms
1564 calculating the mean charge of the calibration signal fails
1565 it is counted now and printed in PostProcess of MCalibCalcFromPast.
1566
1567 - ganymed: Fixed some bugs which caused problems in On-only mode.
1568 Still the false source plot doesn't give reasonable results.
1569
1570
1571
1572 *** Version 0.9.4 (2005/08/05)
1573
1574 - general: Fixed the ZA binning. It did not correctly fit the
1575 MC binning
1576
1577 - general: Added a class to correct for the missfocussing in
1578 April (MSrcPosCorrect)
1579
1580 - general: Random Forest energy estimator should now work properly
1581
1582 - general: MHCamera now displays the profiles in deg instead of mm
1583
1584 - general: MH::SetPalette offers a lot of new palettes
1585
1586 - general: MHillas - the case of CorrXY==0 is now handled properly
1587
1588 - general: implemented the possibility to change the line and
1589 marker style of a sky-grid drawn by MAstroCatalog
1590
1591 - general: Runs in sequences and datasets are now automatically
1592 ordered (it is assumed that the order of their filenames correctly
1593 represents the order of observations) to ensure correct reading
1594 of the subsystem data
1595
1596 - general: Runs cannot be added to a sequence twice anymore. Also
1597 Sequences cannot be added twice anymore to a dataset.
1598
1599 - general: fixed a bug in MAstro::Deg2Hms reported by Abelardo.
1600 It gave wrong results by 1./2pi
1601
1602 - showplot: got a new option to start a root interpreter, too
1603
1604 - mars: now displays a rough estimate of Disp and the third moment
1605
1606 - mars: now displays the event time MTime if available
1607
1608 - mars: show muon parameters graphically
1609
1610 - mars: now the file to open can be given as commandline
1611 argument
1612
1613 - merpp: Added support for new arehucas version >= 200507190
1614 implementing values for three temperature sensors in the
1615 counting house (MCameraAUX) and the name of the HV settings file
1616 (MCameraHV).
1617
1618 - merrp: Also fixed some problems with wrong versions numbers stated
1619 by arehucas and implemented some fixed for old versions (<200407070)
1620
1621 - callisto: MCalibrationHiLoCam can now be printed from its context
1622 menu, eg in the TBrowser
1623
1624 - callisto: fixed logain offset (fgOffsetLoGain) from 1.7 to
1625 - 1.39 (MExtractTimeAndChargeSpline)
1626 - 1.40 (MExtractTimeAndChargeDigitalFilter)
1627 This is important mainly for timing studies.
1628
1629 - callisto: Changed limits in MHCalibrationChargeCalc from
1630 - -100.125 to -98 (fgChargeHiGainFirst)
1631 - 1899.875 to 1902. (fgChargeHiGainLast)
1632 - -100.25 to -99 (fgChargeLoGainFirst)
1633 - 899.75 to 901. (fgChargeLoGainLast)
1634 Introduced new limits:
1635 - fgNumLoGainBlackoutLimit: 0.05
1636 - fgLoGainBlackoutLimit: 3.5
1637 - fgLoGainPickupLimit: 3.5
1638
1639 - callisto: The handling of automatic weights for the digital filter
1640 has been improved. There are now new calibration weights special
1641 for Monte Carlo calibrations.
1642
1643 - callisto: Updated Muon scale with latest results (1% difference
1644 for most data, 5% for Mar/Apr'05)
1645
1646 - callisto: use a new criterium to exclude bad pixels: If the high-gain
1647 was saturated and the blackout-events in the low-gain exceed the
1648 fNumLoGainBlackoutLimit, the pixel is declared unsuitable.
1649 This excludes those pixels which have a saturating high-gain
1650 channel, but the low-gain switch does not switch often enough
1651 to make the distribution reliable.
1652
1653 - callisto: fix a bug counting the number of saturated events. Up to now,
1654 the number of saturated slices was counted (which is one for a not too
1655 high number), but for some (pathological) pixels, many more slices
1656 saturated and produced wrong limits.
1657
1658 - callisto: New options in in callisto.rc for MCalibrationRelTimeCalc:
1659 + MCalibrationRelTimeCam.CheckFitResults: Yes
1660 + MCalibrationRelTimeCam.CheckDeviatingBehavior: Yes
1661 + MCalibrationRelTimeCam.CheckHistOverflow: Yes
1662 + MCalibrationRelTimeCam.CheckOscillations: Yes
1663
1664 - callisto: introduce max. number of events for intercalibration,
1665 the rest gets skipped. Default: 4096
1666 The calibration causes too many un-reliable pixels if more
1667 than about 5000 events are treated (@500 Hz) because of the
1668 mode hopping of the VCSels. However, in the past, some
1669 calibration runs have been taken (erroneously) with more
1670 than 5000 events, especially the intensity scans where
1671 a good precision is needed.
1672
1673 - callisto: Set UseExtractorRes to kTRUE, will raise the number of
1674 photo-electrons for the spline extractor by 1-2% (correctly).
1675
1676 - callisto: The intercalibration is now done using a full f-factor
1677 method instead of a simple update. This makes things slower but
1678 more reliable in terms of gain-fluctuations and sudden VCSEL gain
1679 changes.
1680
1681 - callisto: MPedestalY3 now uses the same extraction range as the data
1682 as calculated by MPedestalY2
1683
1684 - callisto: A check of the fraction of allowed unsuitable (10%) and
1685 unreliable (30%) pixels has been addded when the conversion is
1686 calculated from interleaved events
1687
1688 - star: fixed a bug which caused MEffectiveOnTime containers not to
1689 be written. In the worst case they were skipped almost all, in the
1690 best case they were all ok. It depends on how often the new value
1691 was assigned just with an event which was skipped later by another
1692 task
1693
1694 - star: new histograms MHPointing and MHRate
1695
1696 - star: New tab (Currents) displaying the time evolution of the mean
1697 DC currents
1698
1699 - star: New tab (MeanRms) displaying the time volution of the mean
1700 Pedestal Rms
1701
1702 - star: Output now contains MReportStarguider
1703
1704 - star: Improved muon analysis. Due to the absense of a constant
1705 for the gaus fit for arc width and the fact that the arcwidth
1706 plot was a histogram instead of a profile the resulting psf
1707 became pedestal rms dependant
1708
1709 - ganymed: added new plot (MHPhi) for wobble mode as described in
1710 http://www.astro.uni-wuerzburg.de/results/ringmethod/
1711
1712 - ganymed: corrects now (correctly?) for the misspointing in
1713 May/April 05
1714
1715 - ganymed: Two new default templates for ganymed.rc are avilable:
1716 ganymed_onoff.rc and ganymed_wobble.rc
1717
1718 - ganymed: The first version of MFMagicCuts has been released
1719
1720 - ganymed: the Conc1 plot was incorrectly scaled in MHVsSize
1721
1722 - ganymed, sponde: There are two new options to determin the number
1723 of bins for the signal region (NumBinsSignal) and the number of
1724 total bins (NumBinsTotal) in the MHThetaSq histogram
1725
1726 - ganymed: optimized palettes for MHDisp
1727
1728 - ganymed: Fixed an important bug when using ThetaSq as fit function:
1729 The result for the sigma of the gauss(sqrt(x)) fit was a factor
1730 sqrt(2) to large
1731
1732 - ganymed: The false source plot (MHDisp) is now based on Disp
1733 and a background model determined in the first loop is
1734 subtracted
1735
1736 - ganymed: MFMagicCuts are now available in the cvs. The correct
1737 solution for the disp ambiguity problem is now calculated using
1738 the third moment. The third moment cut therefor is skipped.
1739
1740 - ganymed: Output now contains "Disp [MParameterD]" which sign is
1741 already determined by the third moment along the major axis and
1742 so its actual sign is aligned along the major axis of the shower.
1743
1744 - ganymed: If starguider data is available it is taken into account
1745 when calculating the source position. This is especially important
1746 for wobble data at high zenith angles and culmination data.
1747
1748 - ganymed: If available the starguider data is taken into account as
1749 good as it is possible without a starguider calibration. To switch
1750 it off add
1751 MPointingDevCalc.MaxAbsDev: -1
1752 to your ganymed.rc
1753
1754 - sponde: the zenith angle distribution is now weighted instead of
1755 choosen by default. This gurantees higher statistics in the highest
1756 and lowest energy bins. To switch this behaviour off use...
1757
1758 - sponde: now automatically displays the energy threshold
1759
1760
1761
1762 *** Version 0.9.3 (2005/06/03)
1763
1764 - general: MMcEvt now derived from MMcEvtBasic which should
1765 have no influence on compatibility with older camera files
1766
1767 - general: Implemented a new option to MReadReports which allows
1768 to force reading of the first event of some trees (eg. Drive-tree)
1769 before any other tree.
1770
1771 - general: Made a fix to MPointingPosCalc which assumes that the
1772 run-type is real-data if Process is called before ReInit, such
1773 that also the very first Drive-events in a run are treated
1774 correctly.
1775
1776 - shoplot now displays the filename in the title bar of the window
1777
1778 - merpp: new options: --auto-time-start --auto-time-stop which
1779 allow to cut updating with slow-control at the start- or
1780 (previousle --auto-time only allowed: and) stop-time of
1781 the run stored in the runheader.
1782
1783 - callisto: changed default of fgFallTimeHiGain in
1784 MExtractTimeAndChargeSpline from 1.5 to 0.5. 0.5 was
1785 already set as default in callisto_Dec04Jan05.rc
1786
1787 - callisto: the digital filter (MExtractTimeAndChargeDigitalFilter)
1788 now changes the filename for new weights automatically for
1789 cosmics, MC and for different calibration colors.
1790
1791 - callisto: a problem with the order of some code cause the
1792 name of the weights file in MPedestalY2 to be ignored.
1793 Wrongly the calibration_UV weights were used instead
1794 of the cosmics weights set in callisto.rc.
1795
1796 - callisto: should allow ct1 pulser data when the color is
1797 explicitly set also for pretty new runs
1798
1799 - callisto: a new option (MCalibrateData.ScaleFactor) allows
1800 to introduce an additional scale factor (should be around 1)
1801 to adapt for slight deviations in different extractors from
1802 the MC calibration. For MC calibrations the scale factor
1803 is fixed to 1
1804
1805 - callisto: MFCosmics should handle very high signals a bit
1806 more accurate now
1807
1808 - callisto: when calculating the mean pedestal rms for different
1809 pixel sizes or sectors also kUnsuitableEvt is now taken into
1810 account - not only kUnsuitableRun
1811
1812 - callisto: '-raw' option is now the default
1813
1814 - callisto: A dead pixel check has been implemented in MJPedestalC2.
1815 This has the advantage that mean values in the calibration (eg
1816 arrival times) are calculated more accuratly.
1817
1818 - callisto: In the resource file callisto_Dec04Jan05.rc
1819 MJPedestalY2.ExtractWinRight has been reduced from 4.0 to 2.0
1820
1821 - callisto: new Hi-/Lo-Gain intercalibration constants
1822 hilocalib_sp1.root and hilocalib_sp1_mc.root
1823
1824 - callisto: changed default for MJPedestalY2.MaxEvents
1825 from 2000 to 5000 like in callisto_Dec04Jan05.txt
1826
1827 - callisto: in MCalibrationChargeCalc the limit fgPheErrLowerLimit
1828 has changed from 9.0 to 6.0. This is necessary to exclude two very
1829 ringing pixels in September which - when kept - destroy the image
1830 cleaning around them (Markus G.)
1831
1832 - callisto: (!) The Muon analysis of all data taken so far has
1833 suggested that different extractors give slightly different
1834 absolute results after calibration, due to there different
1835 handling of the calibration- and cosmics pulse shape. Although
1836 the over all calibration seems to be a bit to pesimistic (or
1837 the MC seems to be a little bit - 3-5% - too much attenuated).
1838 There for correction factors have been introduced which correct
1839 the calibration constants by
1840 0.956937799 for Digital Filter (callisto.rc)
1841 and
1842 0.904159132 for Spline (callisto_Dec04Jan05.rc)
1843 calibration. The main advantage is, that both data types can
1844 be easily analysed together and compared to the same MC sample.
1845 The factors are choosen such, that the reference is now a
1846 Monte Carlo sample calibrated with Digital Filter (callisto.rc)
1847
1848 - star: fixed a bug which caused the first bin of the histograms
1849 vs time to disapear in PostProcess. This gave wrong results
1850 on the screen. The output and all following programs not
1851 directly accessing the histograms haven't been affected
1852
1853 - star, ganymed: Made sure that always the first Drive-tree event
1854 is read and Processed before the first data event was read.
1855
1856 - ganymed: implemented the possibility to replace the standard
1857 false source plot with a different one. For example: If
1858 you want to use a Disp based FS plot use the resource:
1859 NameHistFS: MHDisp
1860 For details about the requirements of these plots look
1861 at the corresponding classes
1862
1863 - MJOptimize: For On/Off and Wobble optimization MJOptimize
1864 has been replaced by MJOptimizeCuts. To use MHThetaSq instead
1865 of MHAlpha call MJOptimizeCuts("MHThetaSq"). Make sure in this
1866 case MAlphaFitter is setup correctly. For On-Only optimization
1867 MJOptimize has been Replaced by MJOptimizeCuts, too. Call
1868 RunOn() instead of Run(). For energy estimation MJOptimize
1869 has been replaced by MJOptimizeEnergy
1870
1871 - sponde: The input MC spectrum can now be weighted to fake a
1872 different spectrum. This is done via MMcSpectrumWeight. For
1873 more details see the class description and sponde.rc
1874
1875 - sponde: The paremeter comparsion plots are not scaled by
1876 their entries anymore. Instead the MC plot is scaled by using
1877 the result spectrum of the analysis. If the input MC spectrum
1878 and the result spectrum has different slopes the absolut
1879 normalization is normally wrong.
1880
1881
1882
1883 *** Version 0.9.2 (2005/05/20)
1884
1885 - general: Changed the default paths for calibrated data and image
1886 files. (The implemented access to these files doesn't yet exist)
1887
1888 - general: support for MRunIter has been removed from the job classes
1889 (use the setter functions of MSeqeunce instead)
1890
1891 - general: ProcessFile has been renamed to Process in all job classes,
1892 because ProcessFile is missleading
1893
1894 - general: The storage of the palette in MHCamera is now possible
1895
1896 - general: new bits describing unsuitable and unreliable pixels have
1897 been introduced in MBadPixelsPix: kPreviouslyExcluded,
1898 kDeadPedestalRms, kFluctuatingArrivalTimes
1899
1900 - general: fixed reading of CC-REPORTS (weather data) for Arehucas file
1901 versions newer than V200404070
1902
1903 - general: support for cc file versions newer than V200504130. Added
1904 support for active loads (MCameraActiveLoad) and central pixel
1905 (MCameraCentralPixel)
1906
1907 - general: added new histograms for image parameters versus size
1908 (MHVsSize)
1909
1910 - general: The eventloop now automatically calls PrintStatistics
1911
1912 - Status Display: Improved support for printing:
1913 + A default can now be set in .rootrc (for more details see
1914 MStatusDisplay::PrintPS)
1915 + A print dialog is opened so that printer and command line
1916 can be canged
1917
1918 - showlog: improved such that it handles different verbosity levels
1919 more accurate now. This mean you can suppress output when
1920 using showlog.
1921
1922 - showplot: improved
1923 + The new graphics formats have been implemented
1924 (pdf, svg, png, jpg and xpm)
1925 + Implemented an interface for printing. Because you can change
1926 the printing command from the command line you can use all
1927 the nice postscript tool. To print a booklet for example call:
1928 showplot -b --print --print-cmd="cat %f" filename.root | lpr
1929 showplot -b --print --print-cmd="psbook %f | psnup -2 | lpr" filename.root
1930 showplot -b --null --print --print-cmd="psbook %f" filename.root > book.ps
1931
1932 - callisto: fixed a bug in the recognition of the calibration bit
1933 pattern. Concerns only intensity calibration. (The strength of the
1934 intensity has been updated in some cases)
1935
1936 - callisto: add a filter against PIN Diode events when running over
1937 calibration runs since some of the recent calibration runs have
1938 been taken with Pin Diode.
1939
1940 - callisto: added support for the runs 39942, 39944, 44834, 39941,
1941 39943, 44833 in the calibration (MCalibColorSet)
1942
1943 - callisto: MJCalibration.MHCalibrationChargeCam.ProbLimit has
1944 been set to 1e-18 in callisto_Dec04_Jan05.rc
1945
1946 - callisto: in callisto_Dec04Jan05.rc: set value for
1947 MJPedestalY2.MaxEvents from 2000 to 5000 to get better
1948 statistics for the calculation of the mean pulse time
1949 of the cosmisc
1950
1951 - callisto: the charge limit in the calibration has been raised
1952 from 2.5 to 4.5
1953
1954 - callisto: new setup read from callisto.rc
1955 + MCalibCalcFromPast.fNumEventsDump
1956 + MHCalibrationChargeCam.NumHiGainSaturationLimit
1957 + MHCalibrationChargeCam.NumLoGainSaturationLimit
1958
1959 - callisto: MExtractTimeAndChargeSpline extractor:
1960 + The integration ranges were shifted by 0.2 FADC slices to the right.
1961 + unreliable handling of floating point values caused different
1962 results on different platform or with different compiler options:
1963 The new algorithm is numerically exact and more accurate because
1964 it doesn't calculate the integration position by multiple times
1965 adding the step-size (which results in numerical uncertanties
1966 exspecially if multiplied with large numbers)
1967 + A lot of fixes have been introduced which effects integrating the
1968 spline at the edges of the valid range. In this case any memory
1969 was randomly accessed. This behaviour can be tested replacing
1970 all MArrayF by TArrayF which perform a range check (but of course
1971 they are a lot slower)
1972 ! No result obtained with the Spline before can be trusted! Due to
1973 random memory access it might by completely random!
1974
1975 - callisto: set new defaults in MExtractTimeAndChargeDigitalFilter:
1976 + extraction range in the high gain to 4.
1977 + weights file to cosmics_weights46.dat
1978
1979 - callisto:
1980 + introduce the check for fluctuating arrival times.
1981 + set charge limit to from 2.5 to 4.5
1982 + introduce asymmetric exclusion due to "deviating number of phes":
1983 Default: -9.0 +4.5
1984 + make deviating number of phes unsuitable (see David's findings).
1985
1986 - callisto: fixed the display of unsuitable pixels. The old change
1987 to a real profile in MHCamera broke it.
1988
1989 - callisto: The cosmics filter is used in MJCalibration now
1990 independant of the pulser color (formaly it was used only for
1991 CT1-pulser data). The threshold of number of max empty pixels
1992 has been raised from 2% to 5% in MJCalibration. The maximum
1993 fraction of rejected event is 50% otherwise the calibration has
1994 failed. The filter now ignores unsuitable pixels.
1995 Setup the filter from callisto.rc using "ContCosmics"
1996 (see MFCosmics::ReadEnv)
1997
1998 - callisto: changed default for fgOffsetFromLogain back
1999 from -2.8 to -1.8 in digital filter.
2000
2001 - callisto: for the common extractors
2002 + MExtractFixedWindow
2003 * MExtractTimeAndChargeSlidingWindow
2004 * MExtractTimeAndChargeSpline
2005 * MExtractTimeAndChargeDigitalFilter
2006 the hi- and lo-gain reolution is stored in fResolutionPerPheHiGain
2007 and fResolutionPerPheLoGain
2008
2009 - callisto: Updated the hi-/lo-gain intercalibration constants
2010 hilocalib_sp1.root, hilocalib_df46_mc.root, hilocalib_df4.root,
2011 hilocalib_df6.root
2012
2013 - callisto: The default lo-gain extraction window for the
2014 MExtractTimeAndChargeSlidingWindow extractor has been increased
2015 from 6 to 8 to take the stretch of the pusle into account
2016
2017 - callisto (!!!): fixed an important bug in the setting of the
2018 incoming pedestal pointer to the signal extractor extracting
2019 pedestals. This bug caused the pedestals not to be subtracted
2020 correctly in the calibration afterwards. The effect was about 10%
2021 too high conversion factors for the digital filter and the spline
2022 and more than 40% for the sliding window.
2023 The bug existed since end of February! (Markus G.)
2024
2025 - star: added muon support to star. A new tab "MHMuonPar" is
2026 displayed. The lower right plot is an estimate of the point spread
2027 function. A reference value is displayed. To get the real PSF
2028 you must compare with MC. The setup for the muon analysis
2029 is done in star.rc. More informations can be found in
2030 MHSingleMuon and MHCalibParCalc
2031
2032 - star: The weather data is now displayed in star
2033
2034 - star: MEventRateCalc handles the calculation of the event rate more
2035 accurate now in case of the start of a new run inside a sequence
2036
2037 - ganymed: a bug in MSrcPosCalc has been fixed (The changes were taken
2038 from a bugfix of Wolfgang to Loc0LocToCam; Wolfgang: the results are
2039 changed only minimally
2040
2041 - ganymed: (MJCut and MJOptimize) now displayes the number of
2042 excess events versus size. The energy estimation is done in
2043 MJSpectrum (sponde)
2044
2045 - ganymed: got support for using other variables than Alpha, eg. Theta.
2046 Therefor you need a class deriving from MHAlpha which supports
2047 this variable (one is already existing: MHTheta, which is now the
2048 default in ganymed). It is setup through ganymed.rc
2049
2050 - added a full featured spectrum program (sponde) which reads
2051 ganymed output and monte carlos and compiles a spectrum
2052
2053
2054
2055 *** Version 0.9.1 (2005/04/14)
2056
2057 - Fix bug on the arrival time reconstruction when using Digital
2058 Filter (in some marginal cases (10%) times were reconstructed shifted
2059 by 0.2 slices)
2060
2061 - all executables now return 2 where in previous versions -1 has
2062 been returned (gave problems with shell-scripts)
2063
2064 - the Hi-/Lo-Gain intercalibration for monte carlo files is now
2065 also done with a intercalibration input file
2066
2067 - a bug in the time fine adjustment of the digital filter has been fixed
2068
2069 - a lot of small fixes to calling TPad::Divide with a margin==0
2070
2071 - MStatusDisplay now shows the memory usage
2072
2073 - added a memory leak statistic after the eventloop
2074
2075 - MHadronness replaced by MParameterD
2076
2077 - MEnergyEst replaced by MParameterD
2078
2079 - wobble mode can now be switched on from the data-set
2080
2081 - switched on bad pixel detection for a pedestal level
2082 which is more than 5 times the variance
2083
2084 - Fixed default paths to be correct for the new data center
2085
2086 - Fixed handling of drive data. The pointing position in now
2087 copied to MPointingPos inside star for real and MC events
2088
2089 - made sure, that the sequences in a dataset are sorted by
2090 their number to ensure the correct synchronization
2091
2092 - added all resource files necessary to handle spline extraction
2093 of signal for the late 2004 and the early 2005 data
2094
2095 - update the reference lines for the december data
2096
2097 - changed default for fgHiGainFirst from 2 to 0 in spline extractor
2098 This is important for the Dec. and Jan. data where the calibration
2099 pulse position changes much.
2100
2101 - changed default for fgOffsetFromLogain from -1.8 to -2.8 in digital
2102 filter. This corrects only an defective extraction of the MC at
2103 low-gain signals lower than 90 phes.
2104
2105 - fixed some slowdown in calibrating data with interleaved events from
2106 Jan and Dec. As a workaround made the pretty palette the default.
2107 The inverse Deep Blue Sea has a bug which slows down long calibration
2108 runs a lot.
2109
2110 - implemented new values from new starguider report as defined
2111 in TDAS00-07 V7.1 (eg SkyBrighness)
2112
2113 - Fixed the formerly wrong unit of azimuth and zenith angle deviation
2114 in starguider report (If you merpp the same reports with this version
2115 you'll get the correct units (arcmin) but a different result
2116 than with old versions (wrong units))
2117
2118 - Now the status display can also write PNG, JPEG and XPM (other file
2119 formats are still unsupported by root)
2120
2121 - added a lot of scripts and macros in directory datacenter used
2122 for automatic processing
2123
2124
2125
2126 *** Version 0.9 (2005/03/23)
2127
2128 - Calibration is now done autmatically into photo-electrons like
2129 decided by the Collaboration Board
2130
2131 - Reference lines in the display can be read from resource file
2132
2133 - Interlaced calibration events can be handled by callisto
2134
2135 - Hi-Gain vs. Lo-Gain calibration constants can be calculated
2136 and applied in callisto.
2137
2138 - class MJCalibTest can be called by callisto
2139
2140 - callisto can now run with three data types: rawdata, rootdata, MC
2141
2142 - added two classes mreport/MReportStarguider.cc and
2143 mreport/MReportStarguider.h for implementing starguider-data
2144
2145 - the output of merpp-update now contains starguider information:
2146 MReportStarguider and MTimeStarguider
2147
2148 - Fixed bug in MHHadronness.cc which made that the displayed Q-factor
2149 values were lower than they should. This was more visible for high
2150 energy (Size) events.
2151
2152 - Made MExtractTimeAndChargeDigitalFilter the default for callisto
2153
2154 - added a new loop to callisto to support the correct extraction of
2155 the pedestal and pedestal rms through the signal extractor
2156
2157 - added class to perform fourier tranformation of a hexagonal structure
2158 (MHexagonalFT)
2159
2160 - added class to perform fourier tranformation of a hexagonal structure
2161 in a tasklist (MHexagonalFTCalc) example: hft.C
2162
2163 - added class to enhance the MCerPhotEvt from the Magic camera geometry
2164 MGeomCamMagic to a enhanced geometry MGeomCamMagicXT having only
2165 small pixels, example: extendcam.C
2166
2167 - added possibility to write data to memory (TTree) using MWriteRootFile
2168
2169 - added possibility to read a TTree stored only in memory by MReadTree
2170
2171 - new classes to deal with the interleaved calibration events:
2172 MTriggerPattern, MTriggerPatternDecode and MFTriggerPattern
2173
2174 - implemented filters to callisto to skip calibration events
2175
2176 - changed callisto to calculate three kinds of pedestals and pedestal rms:
2177 + fundamental pedestal (MPedPhotFundamental): extracted directly from
2178 the slices by statistics
2179 + pedestal from extractor (MPedPhotFromExtractor): extracted with the
2180 signal extractor without randomization
2181 + random pedestal from extractor (MPedPhotFromExtractorRndm): extracted
2182 with the signal extractor with randomization (extraction window is
2183 randomly fixed)
2184 The three kind of pedestal is not yet implemented (for speed reasons) as
2185 long as nobody really needs it:
2186 + pedestal from extractor with randomizatiuon (MPedPhotFromExtractorRndm):
2187 extracted with the signal extractor with randomization
2188
2189 - callisto now finds the pulse position in the data automatically
2190
2191 - implemented data reduction in calibrated data by reducing the precision
2192 of the stored floating point values (pedestal, rms and signal) to
2193 roughly 0.5%
2194
2195 - fixed showplot to make file format conversion (eg. converting a
2196 status display stored in a root file into a postscript file) in
2197 batch mode possible:
2198 showplot -b --save-as-ps[=outfile.ps] infile.root
2199
2200 - Allow class names as part of filter rules, eg
2201 (MFSupercuts) && (MHillas.fSize>100)
2202
2203 - fixed a lot of stuff to allow all programs to process MonteCarlo
2204 camera files.
2205
2206 - enhanced possibility to debug reading of resource file
2207
2208 - MDataChain should handle priorities of operator more
2209 accurate now
2210
2211 - completely revised the container in which the signal is stored
2212 MCerPhotEvt/Pix, MArrivalTime --> MSignalCam/Pix
2213 * the new implementation is faster and
2214 * needs less storage space
2215
2216 - FIRST version which can process Monte Carlos through the
2217 whole chain of programs (callisto, star, etc)
2218
2219 - implemented new image parameters for the border length of
2220 the shower image (MNewImagePar2)
2221
2222 - implemented wobble-mode in ganymed
2223
2224 - new class (MJOptimize) taking care of all optimization processes
2225
2226
2227
2228 *** Version 0.8.6 (2004/10/05)
2229
2230 - New combined signal and time extractor
2231 MExtractTimeAndChargeDigitalFilter
2232
2233 - The Report for the trigger section in the CC run summary has been
2234 updated, and now the IPRs (Individual Pixel Rates) are available.
2235
2236 - new macros for database interaction: filldotrun.C, filldotrbk.C
2237
2238 - added new program which can convert colored output which was redirected
2239 into a file back into colored text (for example to display it with
2240 more): showlog
2241
2242 - added new program to display an MStatusArray of plots (stored with
2243 MStatusDisplay) from a file: showplot
2244
2245 - Added support for Sequences (MSequence). Sequences are blocks of run
2246 files containing the same calibration and belonging to the same
2247 source
2248
2249 - Added a new task (MTaskEnv) which can be used in setup files to switch
2250 between different tasks (for example to choose a signal extractor)
2251
2252 - Implemented automatic file splitting in MWriteRootFile
2253
2254 - After image cleaning an island index is assigned to all used pixels.
2255 The index corresponds to the order of the islands in size.
2256
2257 - added a cleaning which takes signal height _and_ arrival time into
2258 account: probability cleaning (for more details see MImgCleanStd)
2259
2260 - added a cleaning which takes takes the absolute number of photons
2261 times the area ratio as cleaning level
2262 (for more details see MImgCleanStd)
2263
2264 - Changed calculation of image parameters such, that it can be done
2265 for all used pixels or the pixels with a defined island index only
2266
2267 - implemented new image parameters displaying the number of islands,
2268 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
2269
2270 - event display in executable changed to support also calibrated files
2271 (done with MJCalibrateSignal)
2272
2273 - added program doing the calibration and the signal extraction
2274 and signal calibration: callisto Most part of the setup is done
2275 by a resource file: callisto.rc
2276
2277 - implemented support for pixels with negative IDs (Raw file format
2278 version 4)
2279
2280 - implemented an new option in merpp (--auto-time) to get the time
2281 range for cc and/or caco data from the run header of the raw data
2282
2283 - New star-program (star and MJStar). Taking calibrated data from
2284 callisto/MJCalibrateSignal as input. The setup is done through
2285 a resource file: star.rc
2286
2287 - Added possibility to setup the eventloop in the mars-executable
2288 Camera Display by a resource file: mars.rc
2289
2290 - The the mars-executable Camera Display can now also read
2291 calibrated data files written by callisto/MJCalibrateSignal
2292
2293 - Added a new class which can calculate the source position in
2294 the camera from a pointing model known to be correct and
2295 the pointing model used for observations (MSrcPosFromModel)
2296
2297 - added a new version of the class calculating the effective on-time
2298 MHEffectiveOnTime. It unifies the old classes MHEffOnTime,
2299 MHEffOnTimeTime, MHEffOnTimeTheta, MHTimeDiff, MHTimeDiffTime and
2300 MHTimeDiffTheta.
2301
2302 - added the possibility to count how often a signal is above (or
2303 below) a certain threshold in MHCamEvent and MHCamEventRot (this
2304 can replace MHTriggerLvl0)
2305
2306 - added ore convinient ways to set the axis-titles of your histograms
2307 in your macro to some MH-classes like: MH3, MHVsTime, MHSectorVsTime,
2308 MHPixVsTime, MHVsTime, MHCamEvent and MHCamEventRot
2309
2310
2311
2312 *** Version 0.8.5 (2004/08/06)
2313
2314 - new Signal Extractors: MExtractFixedWindowSpline
2315 and MExtractAmplitudeSpline
2316
2317 - implementes interleave in merpp to be able to merpp parts of a file
2318
2319 - implemented force-functionality to merpp
2320
2321 - star display to display star catalogs (MAstroCatalog)
2322
2323 - star display to 'mirror' stars to the camera (MAstroCamera)
2324
2325 - implemented a new cleaning option which allows cleaning scaled with
2326 the real ratio of the rms depending on the pixel size, not only the
2327 square root of the pixelsize (MImgCleanStd, MCameraData)
2328
2329 - removed obsolete MBlind* classes
2330
2331 - Signal extractor taking the AB flag into account implemented (this makes
2332 an odd number of slices for signal extraction possible
2333 (MExtractSignalABcorr)
2334
2335 - implemented a class extracting the pedestal from the raw-data (events)
2336 itself using empty lo-gain (MpedCalcFromLoGain)
2337
2338 - Added mean values to MPedPhotCam
2339
2340 - Added Makefile for Darwin (this OS is NOT officially supported!)
2341
2342
2343
2344 *** Version 0.8.4 (2004/04/19)
2345
2346 - new fast arrival time extractor using cubic splines:
2347 MExtractTimeFastSpline
2348
2349 - implementes multi-argument support in MDataChain
2350 ("pow(a, b)")
2351
2352 - implemented double reference support in MDataChain
2353 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
2354
2355 - added support in MF for expressiond like
2356 "MHillas.fWidth<2*<MHillas.fLength"
2357
2358 - MDataChain is now able to support variables like [0], [1], ...
2359 which can be used in fit functions as parameters. The interface
2360 is implemented through the new virtual function
2361 MParContainer::SetVariables
2362
2363 - added new class MArrivalTimeCam/MArrivalTimePix:
2364 Storage containers to hold the ArrivalTime of the camera/pixel
2365
2366 - added new classes for the calibration of relative arrival times:
2367 MCalibrationRelTimePix and MCalibrationRelTimeCam
2368
2369 - added new classes to extract the signal of the blind pixel and the
2370 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
2371
2372 - added new classes for the bad-pixels treatment (MBadPixels*)
2373 which are more powerfull than the old ones (MBlindPixel*)
2374 and will replace them.
2375
2376 - added filter against cosmics: MFCosmics
2377
2378 - added new class MArrivalTimeCalc2:
2379 Calculates the arrival time as the signal weighted mean of the time
2380 slices in the maximum window
2381
2382 - added a new macro call pointspreadfucntion.C that fits with a 2D
2383 gaussian the DC spot for an star. It gives you the RMS of
2384 the PSF and the center of the star, very useful for misspointing
2385 studies.
2386
2387 - added support for multi-telescope camera files. Added classes
2388 MStereoCalc and MStereoPar, classes to calculate and store shower
2389 parameters calculated from the data of two telescopes, for the MC
2390 studies regarding the MAGIC clone.
2391
2392 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
2393 MC data calibrated in photons instead of ADC counts.
2394
2395 - added three macros to show the calibration and analysis chain of
2396 MC data. The macro starmc.C does both calibration and analysis, producing
2397 an output containing Hillas parameters for each event. The macro
2398 mccalibrate.C does just the calibration and writes out a file containing
2399 pixel information in photons instead of FADC data. The macro starmc2.C
2400 reads in such a file and produces an output with Hillas parameters.
2401
2402 - added MPedPhotCalc to compute pedestals in units of photons, see
2403 macro pedphotcalc.C
2404
2405 - added all class to perform the calibration, see macro calibration.C
2406
2407 - added class MFFT to perform Fast Fourier Transforms
2408
2409 - added class MSimulatedAnnealing to perform simulated annealing
2410 minimizations
2411
2412 - added new macro bootcampstandardanalysis.C which holds the skeleton
2413 of the analysis chain discussed in the december bootcamp.
2414
2415 - added support for DAQ raw data file format V2
2416
2417 - implemented an arbitrary time stamp for the events from raw-data
2418 files with file version<3. It is calculated from the run number,
2419 the date of start and the FADC clock tick from the first module
2420
2421 - implemented the correct decoding of the event time-stamp
2422 coming from the DAQ for raw-data files with file-version>2
2423
2424 - added a new classes storing the pedestals in units of photons:
2425 MPedPhotPix, MPedPhotCam
2426
2427 - added support for DC current files from the camera control
2428
2429 - added support for start- and stop-time when merpping report files
2430
2431 - added MReportCC storing the weather data from the CC-REPORT
2432
2433 - added class to fill trainings and test matrices (MTFillMatrix)
2434
2435 - added a filter performing a software trigger (MFSoftwareTrigger)
2436
2437 - Added classes to perform parts of the standard analysis (Jobs):
2438 + MJPedestals
2439 + MJCalibration
2440 + MJExtractSignal
2441 Note: All of them are preliminary!
2442
2443 - Added Iterator to iterate over files giving only the run-number
2444
2445 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
2446 the evolution of a sector vs time
2447
2448
2449
2450 *** Version 0.8.3 (2003/12/05)
2451
2452 - adapted Random Forest classes to allow the use with MC
2453 multi-telescope files which can be produced with the coming
2454 camera version 0.7.
2455
2456 - added classes to read and interprete central control report files
2457 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
2458
2459 - enhanced merpp (the executable) to support .raw and .rep files.
2460
2461 - added classes for light calibration (MCalibration* and
2462 MHCalibration*) by Markus Gaug. Further work has to be and will
2463 be done soon.
2464
2465 - Added a preliminary 'synchronizer' (MReadReports) which will
2466 replace MReadMarsFile as soon as it is finished.
2467
2468 - Added a tutorial macro demonstrating how report files are merpped
2469 and how they can be read from the root file in the correct order
2470 of time (readrep.C)
2471
2472 - Added a generalized histogram (similar to MH3) called MVsTime
2473 which allows to plot variables (or rules - MDataChain - of
2474 variables) vs time. For an example have a look at tempvstime.C.
2475
2476 - Changed the name of the event trees:
2477 + Events --> Events
2478 + PedEvents --> Pedestals
2479 + CalEvents --> Calibration
2480
2481 - changed name of MTime in the event trees from MRawEvtTime to MTime
2482
2483 - added displaying the sector indices to the mars event display
2484
2485 - Magic Online Analysis (MOnA) implemented in a first version
2486 (see mona.cc, MOnlineDump and MOnlineDisplay)
2487
2488 - added classes to calculate event rate
2489 (preliminary: MEventRateCalc, MEventRate)
2490
2491 - added new executable 'readdaq' to read *.raw files from the DAQ directly
2492
2493 - added classes dealing with the telescope pointing position (MPointing*)
2494
2495 - implemented the 'final' Mars time stamp based on some experiences with
2496 the new 'Synchonizer'
2497
2498
2499
2500 *** Version 0.8.2 (2003/11/10)
2501
2502 - accelerated standard analysis by a factor of 6-8 ...
2503 + doing precalculations in MGeomCam for the pixel area ratio
2504 + creating a look up table for the single pixels in MCerPhotEvt
2505
2506 - added task to calculates weights in case you want to 'change'
2507 the energy spectrum of a monte carlo file
2508 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
2509
2510 - added a new executable star which implements the
2511 star.C macro as precompiled executable. Currently a flexible
2512 setup is not possible, but a 'input card' setup will follow.
2513
2514 - Starting to implement Multi-Telescope-Support based on the
2515 upcomming camera version 0.7. The base for a general support
2516 is implemented and the star-functionality is proven to work.
2517
2518 - Replaced Event-Display in and Camera-Display in the Mars GUI
2519 executable by a more convinient display base on MStatusDisplay.
2520
2521 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
2522
2523
2524
2525 *** Version 0.8.1 (2003/10/20)
2526
2527 - added signal subtraction for pure on data by means of fitting
2528 the background in the off region or by performing a combined
2529 signal/background fit. Provides necessary histograms for
2530 obtaining energy spectra and a light curve.
2531
2532 - added classes to perform and study the selection of the
2533 2nd Level Trigger on MC data (example in triglvl2.C macro)
2534
2535 - added pedestal calculation
2536
2537 - implemented "democratic cleaning" (tail cut value proportional
2538 to pixel area) according to Wolfgang's suggestion.
2539
2540 - added Sigmabar treatment (calculation and basic histogramming)
2541
2542 - added basic routines to apply padding
2543
2544 - added first implementation of MARS-based source visibility plotter
2545 (needs to be linked against slalib, preliminary version)
2546
2547 - enhanced functionality of data chains: random numbers, conversion
2548 functions and access to MHMatrix objects
2549
2550 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
2551 numbers under certain circumstances (runs with 0 events included)
2552
2553 - fixed a bug in the general filter MF (didn't work on some systems
2554 at all)
2555
2556 - fixed a bug in chaining files, which caused the analysis to crash or
2557 ignore files
2558
2559 - implemented more geometry classes describing the parameters used
2560 to simulate the PMT camera
2561
2562 - added new Monte Carlo classes containing the setup of the different
2563 programs in the MC chain.
2564
2565 - added a (preliminary) general task to evaluate chi-square of a given
2566 parameter in an eventloop.
2567
2568 - first implementation of a container describing the observatory
2569 location (Long, Lat, etc)
2570
2571 - added Random Forest - method for g/h-separation
2572
2573 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
2574 (this means, that it is compiling, but not yet fully tested)
2575
2576 - added a new status display which can show the present status
2577 of histograms while an eventloop is running (MStatusDisplay,
2578 an example can be found at status.C)
2579
2580 - reorganized directories:
2581 classes describing the image --> mimage
2582 classes containing Monte Carlo Histograms --> mhistmc
2583 classes for Random Forest method --> mranforest
2584
2585 - added (event-)weights to fill histograms
2586
2587 - colors in logging output to screen
2588
2589 - changes to the Image Parameter declaration:
2590 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
2591 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
2592 + MHillasExt now derives from MParContainer instead of MHillas
2593 --> Files written with the old definition are more or less unreadable
2594
2595 - reading of reflector files
2596
2597 - display data from reflector files in the camera
2598
2599 - implemented currents (and display them in the camera)
2600
2601 - logarithmic scale in camera
2602
2603 - added class to iterate through directory contents (MDirIter)
2604
2605
2606
2607 *** Version 0.8 (2002/11/18)
2608
2609 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
2610
2611 - corrected 48(!) wrong entries in the Next Neighbor table of the
2612 Magic Camera (all in the inner part of the outer ring, mostly
2613 missing a single NN)
2614
2615 - Fixed a bug in the table describing the Next Neighbours of the
2616 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
2617 have any neighbour)
2618
2619 - changed trigrate.C: now it calculates the pure NSB triggers from
2620 a camera file (generated with no showers), so there is no need
2621 to introduce them by hand in the BgR array (for more details
2622 please ask Abelardo)
2623
2624 - added MHHadronness (and MHadronness) as a general facility to evaluate
2625 the quality of a gamma-hadron seperation method
2626
2627 - changed MWriteAsciiFile to accept rules (MDataChain)
2628
2629 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
2630 must be replaced by calles to MWriteAsciiFile::AddColumn and
2631 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
2632 changed.
2633
2634 - Implemented generalized event-matrices (one row per event)
2635 (MHMatrix)
2636
2637 - implemented the one dimensional composite probabilities
2638 (MHCompProb, MCompProbCalc, comprob.C)
2639
2640 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
2641 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
2642
2643 - Added a camera display displaying the pixel numbers to the
2644 event display gui.
2645
2646 - Added Monte Carlo Informations to event display gui
2647
2648 - Changed the camera display to display the pixel numbering
2649
2650 - Added three buttons to the camera display to change the palette
2651
2652 - Added the number of used and core pixels after image cleaning
2653 to MHillas
2654
2655 - Changed the algorithm used in MHillas according to TDAS 02-03
2656
2657 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
2658
2659 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
2660
2661 - Added fCosDeltaAlpha to MHillasSrc
2662
2663 - The numbers of photons used to calculate fConc and fConc1 in
2664 MHillasExt are now scaled with the pixel size, so that one get
2665 a four times smaller value for the bigger pixels in the outer ring.
2666
2667 - added new task to smooth the camera contents (MCameraSmooth)
2668
2669 - added possibility to use interpolated pixel values for blind pixels
2670 instead of removing it completely from the analysis
2671
2672 - Implemented the possibility to save the whole eventloop with
2673 its setup to a file. This information can be read and from
2674 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
2675 and MEvtLoop::MakeMacro. If you find something not working, please
2676 report - this stuff is still in a beta phase.
2677
2678 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
2679 file having crab starfield, but also for all following files - fixed
2680
2681 - MTaskList::PrintStatistics can now be instructud to print also the
2682 title, too: use PrintStatistics(0, kTRUE)
2683
2684 - Changed the image cleaning so that pixels with to many 'used'
2685 neighbors are left used (to get rid of 'holes' in events)
2686
2687 - Introduced more output to the camera displays
2688
2689 - Added an array of histograms (eg one hist per run), MHArray
2690
2691 - Added a _preliminary_ version of the reader for CT1 PreProc files
2692 (MCT1ReadPreProc)
2693
2694 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
2695 (thanks to Raquel)
2696
2697 - added the first energy estimator (MEnergyEstParam, estimate.C,
2698 estfit.C) using a parametrization
2699
2700 - Added some new Monte Carlo paremeter containers used to store
2701 setup information from the MC chain (MMcConfigRunHeader,
2702 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
2703
2704
2705
2706 *** Version 0.7 (2002/04/30)
2707
2708 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
2709 the pedestal mean value was saved incorrectly. For files from
2710 this versions we substract 0.5 from the pedestal mean.
2711 WARNING: This may effect your results, so don't wonder...
2712
2713 - First implementation of an algorithm using only triggered events
2714 for the collection area calculation
2715
2716 - Ascii Output can now also be used for parameter containers which
2717 doesn't overload MParCointainer::AsciiWrite
2718
2719 - The Ascii Output is now also capable of writing single data members
2720 of one container
2721
2722 - You are now able to change the order of the values written to the
2723 ascii file
2724
2725 - You can now specify a conversion factor for each data member written
2726 to an ascii file. This may be usefull to change the units of the
2727 data member (eg. degrees instead of millimeters in case of the
2728 hillas parameters)
2729
2730 - Replaced old MHillas by a new structure which allows you to extend
2731 the parameters stored in MHillas very easily:
2732 see MHillas and MHillasExt
2733
2734 - Added classes to handle source dependancy of image parameters:
2735 see MHillasSrc
2736
2737 - Added container (MBinning) to have a standard input for the binning
2738 in different histograms (eg. the Energy bins should be the same in
2739 all histograms)
2740
2741 - Changed Hillas histograms from mm to deg
2742
2743 - Added the flexible binning to the hillas histograms
2744
2745 - Added a filter for the alpha parameter (MFAlpha)
2746
2747 - It is now possible to write single data members of a class object to
2748 an output stream instead of the whole container only
2749
2750 - Added a generalized filter for a data member:
2751 MFDataMember filter("MHillas.fWidth", '<', 0.5);
2752
2753 - Added a generalized Filter parser for more difficult filter rules
2754 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
2755
2756 - Added new Monte Carlo histograms:
2757 MHMcEnergyImpact and MHMcEfficiency
2758
2759 - Added many new histograms needed for the flux calculation.
2760
2761 - Added a generalized histograms which can fill and show up to three
2762 data members in either a one-, two- or three-dimensional histogram, eg:
2763 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
2764
2765 - Added:
2766 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
2767 * calculation of <Theta> as a function of time (MHThetabarTime)
2768 they are needed in the flux calculation in
2769 order to select for a given bin in Theta (or time) the appropriate
2770 effective collection area, which is assumed to be given as a function
2771 of Theta and the true energy
2772
2773 - Added calculation of the migration matrix in the energy
2774 (MHMcEnergyMigration):
2775 the migration matrix describes the migration from the true (E_true)
2776 to the estimated energy (E_est); it is needed to determine the
2777 distribution of E_true from the measured distribution of E_est
2778 by unfolding
2779
2780 - changed the color palette in the camera display to DeapSea.
2781
2782
2783
2784 *** Version 0.6 (2002/01/15)
2785
2786 - Introduce the option of disable pixels (MBlindPixels and
2787 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
2788 able to deal with Star Field NSB.
2789
2790 - Fixed a bug in the pedestals substraction
2791
2792 - Introduced verbosity levels
2793
2794 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
2795
2796 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
2797 work correctly (thanks to Abelardo)
2798
2799 - Introduced correct treatment of the diffuse Night Sky Background
2800 and NSB (MMcPedestalNSB)
2801
2802 - Corrected treatment of the electronic noise (MMcPedestalCopy)
2803
2804 - Introduced MMcRunHeaders which contains monte carlo run informations
2805
2806 - Added a 'Print'-Task (MPrint) which calls the Print function
2807 of a parameter container for each event
2808
2809 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
2810
2811 - changes to be more efficient with root 3.02/06
2812
2813 - root 3.02/06 fixes:
2814 + the memory leak when reading MRawEvtData
2815 + loosing more time than necessary to update the progress bar
2816
2817 - MWriteAsciiFile is now capable of writing more than one container
2818 in a line. For example: To be able to write Monte Carlo and
2819 Hillas values (energy and alpha) in one line.
2820
2821
2822
2823 *** Version 0.5 (2001/11/06)
2824
2825 - Added new GUI functionality (Analysis)
2826
2827 - Added a camera display to be able to display events in the camera
2828 together with the calculated hillas ellipse
2829
2830 - Added a 'Clone'-Task (MClone) which can clone a parameter container
2831 object at any state of the analysis, so that the output are several
2832 states
2833
2834 - Fixed a bug in the collection area error calculation
2835 (Thanks to Ciro and Abelardo)
2836
2837 - Fixed a bug which causes merpp to crash in some environments
2838
2839 - Implemented auto enabling scheme for Branches to speed up reading
2840 a lot (see MReadTree and MTask)
2841
2842 - Fixed a bug in the Histogram classes which caused histograms to
2843 be written to a file by MWriteRootFile without request
2844
2845 - changed the object I/O from the old stylish root I/O to the new
2846 'auto evolution scheme' This was done only for classes which are not
2847 yet used in Monte Carlo files, so that these files are still readable.
2848
2849 - Added support for a progress bar in MEvtLoop and MReadTree
2850 (see the Analysis Window in Mars for an example)
2851
2852 - Fixed a bug in the package creation which disturbed the conversion
2853 between a mars version unpacked from a tar file and the repository.
2854
2855 - Changed the code to writer merpped (converted into root format)
2856 raw files, to get faster (around 10%)
2857
2858
2859
2860 *** Version 0.4 (2001/09/20)
2861
2862 - This release is made to compile on a root version >= 3.00
2863
2864 - Fixed a bug which causes MReadTree to read the first file only
2865
2866 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
2867
2868 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
2869
2870 - Added a task to write several container to a root file (MWriteRootFile)
2871
2872 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
2873
2874 - Added calculation of the collection area (MMcCollectionAreaCalc)
2875
2876 - fixed some bugs in the Hillas calculation
2877
2878 - added filters to be able to control the task execution dependent on
2879 a parameter (for example: the number of level 1 triggers in a MC-file)
2880
2881
2882
2883 *** Version 0.3 (2001/04/23)
2884
2885 - Many demo macros added
2886
2887 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
2888
2889 - Hillas Calculation added
2890
2891 - Standard image cleaning available
2892
2893 - MReadTree is now able to handle more than one file
2894 (Remark: of the same structure)
2895
2896 - Now we are able to display events in a first version of the
2897 Camera event display. To do this we must run the macro
2898 "macros/readCT1.C" to read data from CT1.
2899
2900
2901
2902 *** Version 0.2 (2001/01/24)
2903
2904 - First Implementation of a Gui to read the raw data. Start the
2905 gui with the command mars.
2906
2907
2908
2909 *** Version 0.1 (2000/12/20)
2910
2911 - First official release 0.1
2912
2913 - Changes:
2914
2915 + changed calling style of MRawPixelIterator from do...while to
2916 while-loop
Note: See TracBrowser for help on using the repository browser.