source: trunk/MagicSoft/Mars/NEWS@ 5308

Last change on this file since 5308 was 5187, checked in by tbretz, 20 years ago
:
File size: 24.7 KB
Line 
1 -*-*- END -*-*-
2 *** Version <cvs>
3
4
5
6 *** Version 0.8.6 (2004/10/05)
7
8 - New combined signal and time extractor
9 MExtractTimeAndChargeDigitalFilter
10
11 - The Report for the trigger section in the CC run summary has been
12 updated, and now the IPRs (Individual Pixel Rates) are available.
13
14 - new macros for database interaction: filldotrun.C, filldotrbk.C
15
16 - added new program which can convert colored output which was redirected
17 into a file back into colored text (for example to display it with
18 more): showlog
19
20 - added new program to display an MStatusArray of plots (stored with
21 MStatusDisplay) from a file: showplot
22
23 - Added support for Sequences (MSequence). Sequences are blocks of run
24 files containing the same calibration and belonging to the same
25 source
26
27 - Added a new task (MTaskEnv) which can be used in setup files to switch
28 between different tasks (for example to choose a signal extractor)
29
30 - Implemented automatic file splitting in MWriteRootFile
31
32 - After image cleaning an island index is assigned to all used pixels.
33 The index corresponds to the order of the islands in size.
34
35 - added a cleaning which takes signal height _and_ arrival time into
36 account: probability cleaning (for more details see MImgCleanStd)
37
38 - added a cleaning which takes takes the absolute number of photons
39 times the area ratio as cleaning level
40 (for more details see MImgCleanStd)
41
42 - Changed calculation of image parameters such, that it can be done
43 for all used pixels or the pixels with a defined island index only
44
45 - implemented new image parameters displaying the number of islands,
46 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
47
48 - event display in executable changed to support also calibrated files
49 (done with MJCalibrateSignal)
50
51 - added program doing the calibration and the signal extraction
52 and signal calibration: callisto Most part of the setup is done
53 by a resource file: callisto.rc
54
55 - implemented support for pixels with negative IDs (Raw file format
56 version 4)
57
58 - implemented an new option in merpp (--auto-time) to get the time
59 range for cc and/or caco data from the run header of the raw data
60
61 - New star-program (star and MJStar). Taking calibrated data from
62 callisto/MJCalibrateSignal as input. The setup is done through
63 a resource file: star.rc
64
65 - Added possibility to setup the eventloop in the mars-executable
66 Camera Display by a resource file: mars.rc
67
68 - The the mars-executable Camera Display can now also read
69 calibrated data files written by callisto/MJCalibrateSignal
70
71 - Added a new class which can calculate the source position in
72 the camera from a pointing model known to be correct and
73 the pointing model used for observations (MSrcPosFromModel)
74
75 - added a new version of the class calculating the effective on-time
76 MHEffectiveOnTime. It unifies the old classes MHEffOnTime,
77 MHEffOnTimeTime, MHEffOnTimeTheta, MHTimeDiff, MHTimeDiffTime and
78 MHTimeDiffTheta.
79
80 - added the possibility to count how often a signal is above (or
81 below) a certain threshold in MHCamEvent and MHCamEventRot (this
82 can replace MHTriggerLvl0)
83
84 - added ore convinient ways to set the axis-titles of your histograms
85 in your macro to some MH-classes like: MH3, MHVsTime, MHSectorVsTime,
86 MHPixVsTime, MHVsTime, MHCamEvent and MHCamEventRot
87
88
89
90 *** Version 0.8.5 (2004/08/06)
91
92 - new Signal Extractors: MExtractFixedWindowSpline
93 and MExtractAmplitudeSpline
94
95 - implementes interleave in merpp to be able to merpp parts of a file
96
97 - implemented force-functionality to merpp
98
99 - star display to display star catalogs (MAstroCatalog)
100
101 - star display to 'mirror' stars to the camera (MAstroCamera)
102
103 - implemented a new cleaning option which allows cleaning scaled with
104 the real ratio of the rms depending on the pixel size, not only the
105 square root of the pixelsize (MImgCleanStd, MCameraData)
106
107 - removed obsolete MBlind* classes
108
109 - Signal extractor taking the AB flag into account implemented (this makes
110 an odd number of slices for signal extraction possible
111 (MExtractSignalABcorr)
112
113 - implemented a class extracting the pedestal from the raw-data (events)
114 itself using empty lo-gain (MpedCalcFromLoGain)
115
116 - Added mean values to MPedPhotCam
117
118 - Added Makefile for Darwin (this OS is NOT officially supported!)
119
120
121
122 *** Version 0.8.4 (2004/04/19)
123
124 - new fast arrival time extractor using cubic splines:
125 MExtractTimeFastSpline
126
127 - implementes multi-argument support in MDataChain
128 ("pow(a, b)")
129
130 - implemented double reference support in MDataChain
131 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
132
133 - added support in MF for expressiond like
134 "MHillas.fWidth<2*<MHillas.fLength"
135
136 - MDataChain is now able to support variables like [0], [1], ...
137 which can be used in fit functions as parameters. The interface
138 is implemented through the new virtual function
139 MParContainer::SetVariables
140
141 - added new class MArrivalTimeCam/MArrivalTimePix:
142 Storage containers to hold the ArrivalTime of the camera/pixel
143
144 - added new classes for the calibration of relative arrival times:
145 MCalibrationRelTimePix and MCalibrationRelTimeCam
146
147 - added new classes to extract the signal of the blind pixel and the
148 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
149
150 - added new classes for the bad-pixels treatment (MBadPixels*)
151 which are more powerfull than the old ones (MBlindPixel*)
152 and will replace them.
153
154 - added filter against cosmics: MFCosmics
155
156 - added new class MArrivalTimeCalc2:
157 Calculates the arrival time as the signal weighted mean of the time
158 slices in the maximum window
159
160 - added a new macro call pointspreadfucntion.C that fits with a 2D
161 gaussian the DC spot for an star. It gives you the RMS of
162 the PSF and the center of the star, very useful for misspointing
163 studies.
164
165 - added support for multi-telescope camera files. Added classes
166 MStereoCalc and MStereoPar, classes to calculate and store shower
167 parameters calculated from the data of two telescopes, for the MC
168 studies regarding the MAGIC clone.
169
170 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
171 MC data calibrated in photons instead of ADC counts.
172
173 - added three macros to show the calibration and analysis chain of
174 MC data. The macro starmc.C does both calibration and analysis, producing
175 an output containing Hillas parameters for each event. The macro
176 mccalibrate.C does just the calibration and writes out a file containing
177 pixel information in photons instead of FADC data. The macro starmc2.C
178 reads in such a file and produces an output with Hillas parameters.
179
180 - added MPedPhotCalc to compute pedestals in units of photons, see
181 macro pedphotcalc.C
182
183 - added all class to perform the calibration, see macro calibration.C
184
185 - added class MFFT to perform Fast Fourier Transforms
186
187 - added class MSimulatedAnnealing to perform simulated annealing
188 minimizations
189
190 - added new macro bootcampstandardanalysis.C which holds the skeleton
191 of the analysis chain discussed in the december bootcamp.
192
193 - added support for DAQ raw data file format V2
194
195 - implemented an arbitrary time stamp for the events from raw-data
196 files with file version<3. It is calculated from the run number,
197 the date of start and the FADC clock tick from the first module
198
199 - implemented the correct decoding of the event time-stamp
200 coming from the DAQ for raw-data files with file-version>2
201
202 - added a new classes storing the pedestals in units of photons:
203 MPedPhotPix, MPedPhotCam
204
205 - added support for DC current files from the camera control
206
207 - added support for start- and stop-time when merpping report files
208
209 - added MReportCC storing the weather data from the CC-REPORT
210
211 - added class to fill trainings and test matrices (MTFillMatrix)
212
213 - added a filter performing a software trigger (MFSoftwareTrigger)
214
215 - Added classes to perform parts of the standard analysis (Jobs):
216 + MJPedestals
217 + MJCalibration
218 + MJExtractSignal
219 Note: All of them are preliminary!
220
221 - Added Iterator to iterate over files giving only the run-number
222
223 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
224 the evolution of a sector vs time
225
226
227
228 *** Version 0.8.3 (2003/12/05)
229
230 - adapted Random Forest classes to allow the use with MC
231 multi-telescope files which can be produced with the coming
232 camera version 0.7.
233
234 - added classes to read and interprete central control report files
235 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
236
237 - enhanced merpp (the executable) to support .raw and .rep files.
238
239 - added classes for light calibration (MCalibration* and
240 MHCalibration*) by Markus Gaug. Further work has to be and will
241 be done soon.
242
243 - Added a preliminary 'synchronizer' (MReadReports) which will
244 replace MReadMarsFile as soon as it is finished.
245
246 - Added a tutorial macro demonstrating how report files are merpped
247 and how they can be read from the root file in the correct order
248 of time (readrep.C)
249
250 - Added a generalized histogram (similar to MH3) called MVsTime
251 which allows to plot variables (or rules - MDataChain - of
252 variables) vs time. For an example have a look at tempvstime.C.
253
254 - Changed the name of the event trees:
255 + Events --> Events
256 + PedEvents --> Pedestals
257 + CalEvents --> Calibration
258
259 - changed name of MTime in the event trees from MRawEvtTime to MTime
260
261 - added displaying the sector indices to the mars event display
262
263 - Magic Online Analysis (MOnA) implemented in a first version
264 (see mona.cc, MOnlineDump and MOnlineDisplay)
265
266 - added classes to calculate event rate
267 (preliminary: MEventRateCalc, MEventRate)
268
269 - added new executable 'readdaq' to read *.raw files from the DAQ directly
270
271 - added classes dealing with the telescope pointing position (MPointing*)
272
273 - implemented the 'final' Mars time stamp based on some experiences with
274 the new 'Synchonizer'
275
276
277
278 *** Version 0.8.2 (2003/11/10)
279
280 - accelerated standard analysis by a factor of 6-8 ...
281 + doing precalculations in MGeomCam for the pixel area ratio
282 + creating a look up table for the single pixels in MCerPhotEvt
283
284 - added task to calculates weights in case you want to 'change'
285 the energy spectrum of a monte carlo file
286 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
287
288 - added a new executable star which implements the
289 star.C macro as precompiled executable. Currently a flexible
290 setup is not possible, but a 'input card' setup will follow.
291
292 - Starting to implement Multi-Telescope-Support based on the
293 upcomming camera version 0.7. The base for a general support
294 is implemented and the star-functionality is proven to work.
295
296 - Replaced Event-Display in and Camera-Display in the Mars GUI
297 executable by a more convinient display base on MStatusDisplay.
298
299 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
300
301
302
303 *** Version 0.8.1 (2003/10/20)
304
305 - added signal subtraction for pure on data by means of fitting
306 the background in the off region or by performing a combined
307 signal/background fit. Provides necessary histograms for
308 obtaining energy spectra and a light curve.
309
310 - added classes to perform and study the selection of the
311 2nd Level Trigger on MC data (example in triglvl2.C macro)
312
313 - added pedestal calculation
314
315 - implemented "democratic cleaning" (tail cut value proportional
316 to pixel area) according to Wolfgang's suggestion.
317
318 - added Sigmabar treatment (calculation and basic histogramming)
319
320 - added basic routines to apply padding
321
322 - added first implementation of MARS-based source visibility plotter
323 (needs to be linked against slalib, preliminary version)
324
325 - enhanced functionality of data chains: random numbers, conversion
326 functions and access to MHMatrix objects
327
328 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
329 numbers under certain circumstances (runs with 0 events included)
330
331 - fixed a bug in the general filter MF (didn't work on some systems
332 at all)
333
334 - fixed a bug in chaining files, which caused the analysis to crash or
335 ignore files
336
337 - implemented more geometry classes describing the parameters used
338 to simulate the PMT camera
339
340 - added new Monte Carlo classes containing the setup of the different
341 programs in the MC chain.
342
343 - added a (preliminary) general task to evaluate chi-square of a given
344 parameter in an eventloop.
345
346 - first implementation of a container describing the observatory
347 location (Long, Lat, etc)
348
349 - added Random Forest - method for g/h-separation
350
351 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
352 (this means, that it is compiling, but not yet fully tested)
353
354 - added a new status display which can show the present status
355 of histograms while an eventloop is running (MStatusDisplay,
356 an example can be found at status.C)
357
358 - reorganized directories:
359 classes describing the image --> mimage
360 classes containing Monte Carlo Histograms --> mhistmc
361 classes for Random Forest method --> mranforest
362
363 - added (event-)weights to fill histograms
364
365 - colors in logging output to screen
366
367 - changes to the Image Parameter declaration:
368 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
369 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
370 + MHillasExt now derives from MParContainer instead of MHillas
371 --> Files written with the old definition are more or less unreadable
372
373 - reading of reflector files
374
375 - display data from reflector files in the camera
376
377 - implemented currents (and display them in the camera)
378
379 - logarithmic scale in camera
380
381 - added class to iterate through directory contents (MDirIter)
382
383
384
385 *** Version 0.8 (2002/11/18)
386
387 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
388
389 - corrected 48(!) wrong entries in the Next Neighbor table of the
390 Magic Camera (all in the inner part of the outer ring, mostly
391 missing a single NN)
392
393 - Fixed a bug in the table describing the Next Neighbours of the
394 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
395 have any neighbour)
396
397 - changed trigrate.C: now it calculates the pure NSB triggers from
398 a camera file (generated with no showers), so there is no need
399 to introduce them by hand in the BgR array (for more details
400 please ask Abelardo)
401
402 - added MHHadronness (and MHadronness) as a general facility to evaluate
403 the quality of a gamma-hadron seperation method
404
405 - changed MWriteAsciiFile to accept rules (MDataChain)
406
407 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
408 must be replaced by calles to MWriteAsciiFile::AddColumn and
409 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
410 changed.
411
412 - Implemented generalized event-matrices (one row per event)
413 (MHMatrix)
414
415 - implemented the one dimensional composite probabilities
416 (MHCompProb, MCompProbCalc, comprob.C)
417
418 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
419 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
420
421 - Added a camera display displaying the pixel numbers to the
422 event display gui.
423
424 - Added Monte Carlo Informations to event display gui
425
426 - Changed the camera display to display the pixel numbering
427
428 - Added three buttons to the camera display to change the palette
429
430 - Added the number of used and core pixels after image cleaning
431 to MHillas
432
433 - Changed the algorithm used in MHillas according to TDAS 02-03
434
435 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
436
437 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
438
439 - Added fCosDeltaAlpha to MHillasSrc
440
441 - The numbers of photons used to calculate fConc and fConc1 in
442 MHillasExt are now scaled with the pixel size, so that one get
443 a four times smaller value for the bigger pixels in the outer ring.
444
445 - added new task to smooth the camera contents (MCameraSmooth)
446
447 - added possibility to use interpolated pixel values for blind pixels
448 instead of removing it completely from the analysis
449
450 - Implemented the possibility to save the whole eventloop with
451 its setup to a file. This information can be read and from
452 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
453 and MEvtLoop::MakeMacro. If you find something not working, please
454 report - this stuff is still in a beta phase.
455
456 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
457 file having crab starfield, but also for all following files - fixed
458
459 - MTaskList::PrintStatistics can now be instructud to print also the
460 title, too: use PrintStatistics(0, kTRUE)
461
462 - Changed the image cleaning so that pixels with to many 'used'
463 neighbors are left used (to get rid of 'holes' in events)
464
465 - Introduced more output to the camera displays
466
467 - Added an array of histograms (eg one hist per run), MHArray
468
469 - Added a _preliminary_ version of the reader for CT1 PreProc files
470 (MCT1ReadPreProc)
471
472 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
473 (thanks to Raquel)
474
475 - added the first energy estimator (MEnergyEstParam, estimate.C,
476 estfit.C) using a parametrization
477
478 - Added some new Monte Carlo paremeter containers used to store
479 setup information from the MC chain (MMcConfigRunHeader,
480 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
481
482
483
484 *** Version 0.7 (2002/04/30)
485
486 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
487 the pedestal mean value was saved incorrectly. For files from
488 this versions we substract 0.5 from the pedestal mean.
489 WARNING: This may effect your results, so don't wonder...
490
491 - First implementation of an algorithm using only triggered events
492 for the collection area calculation
493
494 - Ascii Output can now also be used for parameter containers which
495 doesn't overload MParCointainer::AsciiWrite
496
497 - The Ascii Output is now also capable of writing single data members
498 of one container
499
500 - You are now able to change the order of the values written to the
501 ascii file
502
503 - You can now specify a conversion factor for each data member written
504 to an ascii file. This may be usefull to change the units of the
505 data member (eg. degrees instead of millimeters in case of the
506 hillas parameters)
507
508 - Replaced old MHillas by a new structure which allows you to extend
509 the parameters stored in MHillas very easily:
510 see MHillas and MHillasExt
511
512 - Added classes to handle source dependancy of image parameters:
513 see MHillasSrc
514
515 - Added container (MBinning) to have a standard input for the binning
516 in different histograms (eg. the Energy bins should be the same in
517 all histograms)
518
519 - Changed Hillas histograms from mm to deg
520
521 - Added the flexible binning to the hillas histograms
522
523 - Added a filter for the alpha parameter (MFAlpha)
524
525 - It is now possible to write single data members of a class object to
526 an output stream instead of the whole container only
527
528 - Added a generalized filter for a data member:
529 MFDataMember filter("MHillas.fWidth", '<', 0.5);
530
531 - Added a generalized Filter parser for more difficult filter rules
532 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
533
534 - Added new Monte Carlo histograms:
535 MHMcEnergyImpact and MHMcEfficiency
536
537 - Added many new histograms needed for the flux calculation.
538
539 - Added a generalized histograms which can fill and show up to three
540 data members in either a one-, two- or three-dimensional histogram, eg:
541 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
542
543 - Added:
544 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
545 * calculation of <Theta> as a function of time (MHThetabarTime)
546 they are needed in the flux calculation in
547 order to select for a given bin in Theta (or time) the appropriate
548 effective collection area, which is assumed to be given as a function
549 of Theta and the true energy
550
551 - Added calculation of the migration matrix in the energy
552 (MHMcEnergyMigration):
553 the migration matrix describes the migration from the true (E_true)
554 to the estimated energy (E_est); it is needed to determine the
555 distribution of E_true from the measured distribution of E_est
556 by unfolding
557
558 - changed the color palette in the camera display to DeapSea.
559
560
561
562 *** Version 0.6 (2002/01/15)
563
564 - Introduce the option of disable pixels (MBlindPixels and
565 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
566 able to deal with Star Field NSB.
567
568 - Fixed a bug in the pedestals substraction
569
570 - Introduced verbosity levels
571
572 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
573
574 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
575 work correctly (thanks to Abelardo)
576
577 - Introduced correct treatment of the diffuse Night Sky Background
578 and NSB (MMcPedestalNSB)
579
580 - Corrected treatment of the electronic noise (MMcPedestalCopy)
581
582 - Introduced MMcRunHeaders which contains monte carlo run informations
583
584 - Added a 'Print'-Task (MPrint) which calls the Print function
585 of a parameter container for each event
586
587 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
588
589 - changes to be more efficient with root 3.02/06
590
591 - root 3.02/06 fixes:
592 + the memory leak when reading MRawEvtData
593 + loosing more time than necessary to update the progress bar
594
595 - MWriteAsciiFile is now capable of writing more than one container
596 in a line. For example: To be able to write Monte Carlo and
597 Hillas values (energy and alpha) in one line.
598
599
600
601 *** Version 0.5 (2001/11/06)
602
603 - Added new GUI functionality (Analysis)
604
605 - Added a camera display to be able to display events in the camera
606 together with the calculated hillas ellipse
607
608 - Added a 'Clone'-Task (MClone) which can clone a parameter container
609 object at any state of the analysis, so that the output are several
610 states
611
612 - Fixed a bug in the collection area error calculation
613 (Thanks to Ciro and Abelardo)
614
615 - Fixed a bug which causes merpp to crash in some environments
616
617 - Implemented auto enabling scheme for Branches to speed up reading
618 a lot (see MReadTree and MTask)
619
620 - Fixed a bug in the Histogram classes which caused histograms to
621 be written to a file by MWriteRootFile without request
622
623 - changed the object I/O from the old stylish root I/O to the new
624 'auto evolution scheme' This was done only for classes which are not
625 yet used in Monte Carlo files, so that these files are still readable.
626
627 - Added support for a progress bar in MEvtLoop and MReadTree
628 (see the Analysis Window in Mars for an example)
629
630 - Fixed a bug in the package creation which disturbed the conversion
631 between a mars version unpacked from a tar file and the repository.
632
633 - Changed the code to writer merpped (converted into root format)
634 raw files, to get faster (around 10%)
635
636
637
638 *** Version 0.4 (2001/09/20)
639
640 - This release is made to compile on a root version >= 3.00
641
642 - Fixed a bug which causes MReadTree to read the first file only
643
644 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
645
646 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
647
648 - Added a task to write several container to a root file (MWriteRootFile)
649
650 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
651
652 - Added calculation of the collection area (MMcCollectionAreaCalc)
653
654 - fixed some bugs in the Hillas calculation
655
656 - added filters to be able to control the task execution dependent on
657 a parameter (for example: the number of level 1 triggers in a MC-file)
658
659
660
661 *** Version 0.3 (2001/04/23)
662
663 - Many demo macros added
664
665 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
666
667 - Hillas Calculation added
668
669 - Standard image cleaning available
670
671 - MReadTree is now able to handle more than one file
672 (Remark: of the same structure)
673
674 - Now we are able to display events in a first version of the
675 Camera event display. To do this we must run the macro
676 "macros/readCT1.C" to read data from CT1.
677
678
679
680 *** Version 0.2 (2001/01/24)
681
682 - First Implementation of a Gui to read the raw data. Start the
683 gui with the command mars.
684
685
686
687 *** Version 0.1 (2000/12/20)
688
689 - First official release 0.1
690
691 - Changes:
692
693 + changed calling style of MRawPixelIterator from do...while to
694 while-loop
695
Note: See TracBrowser for help on using the repository browser.