source: trunk/MagicSoft/Mars/NEWS@ 4826

Last change on this file since 4826 was 4826, checked in by tbretz, 20 years ago
*** empty log message ***
File size: 23.7 KB
Line 
1 -*-*- END -*-*-
2 *** Version <cvs>
3
4 - new macros for database interaction: filldotrun.C, filldotrbk.C
5
6 - added new program which can convert colored output which was redirected
7 into a file back into colored text (for example to display it with
8 more): showlog
9
10 - added new program to display an MStatusArray of plots (stored with
11 MStatusDisplay) from a file: showplot
12
13 - Added support for Sequences (MSequence). Sequences are blocks of run
14 files containing the same calibration and belonging to the same
15 source
16
17 - Added a new task (MTaskEnv) which can be used in setup files to switch
18 between different tasks (for example to choose a signal extractor)
19
20 - Implemented automatic file splitting in MWriteRootFile
21
22 - After image cleaning an island index is assigned to all used pixels.
23 The index corresponds to the order of the islands in size.
24
25 - Changed calculation of image parameters such, that it can be done
26 for all used pixels or the pixels with a defined island index only
27
28 - implemented new image parameters displaying the number of islands,
29 saturated hi-gain and lo-gain pixels (MImagePar, MHImagePar)
30
31 - event display in executable changed to support also calibrated files
32 (done with MJCalibrateSignal)
33
34 - added a cleaning which takes signal height _and_ arrival time into
35 account: probability cleaning (for more details see MImgCleanStd)
36
37 - added program doing the calibration and the signal extraction
38 and signal calibration: callisto Most part of the setup is done
39 by a resource file: callisto.rc
40
41 - implemented support for pixels with negative IDs (Raw file format
42 version 4)
43
44 - implemented an new option in merpp (--auto-time) to get the time
45 range for cc and/or caco data from the run header of the raw data
46
47 - New star-program (star and MJStar). Taking calibrated data from
48 callisto/MJCalibrateSignal as input. The setup is done through
49 a resource file: star.rc
50
51 - Added possibility to setup the eventloop in the mars-executable
52 Camera Display by a resource file: mars.rc
53
54 - The the mars-executable Camera Display can now also read
55 calibrated data files written by callisto/MJCalibrateSignal
56
57 - Added a new class which can calculate the source position in
58 the camera from a pointing model known to be correct and
59 the pointing model used for observations (MSrcPosFromModel)
60
61
62
63 *** Version 0.8.5 (2004/08/06)
64
65 - new Signal Extractors: MExtractFixedWindowSpline
66 and MExtractAmplitudeSpline
67
68 - implementes interleave in merpp to be able to merpp parts of a file
69
70 - implemented force-functionality to merpp
71
72 - star display to display star catalogs (MAstroCatalog)
73
74 - star display to 'mirror' stars to the camera (MAstroCamera)
75
76 - implemented a new cleaning option which allows cleaning scaled with
77 the real ratio of the rms depending on the pixel size, not only the
78 square root of the pixelsize (MImgCleanStd, MCameraData)
79
80 - removed obsolete MBlind* classes
81
82 - Signal extractor taking the AB flag into account implemented (this makes
83 an odd number of slices for signal extraction possible
84 (MExtractSignalABcorr)
85
86 - implemented a class extracting the pedestal from the raw-data (events)
87 itself using empty lo-gain (MpedCalcFromLoGain)
88
89 - Added mean values to MPedPhotCam
90
91 - Added Makefile for Darwin (this OS is NOT officially supported!)
92
93
94
95 *** Version 0.8.4 (2004/04/19)
96
97 - new fast arrival time extractor using cubic splines:
98 MExtractTimeFastSpline
99
100 - implementes multi-argument support in MDataChain
101 ("pow(a, b)")
102
103 - implemented double reference support in MDataChain
104 ("MCameraLV.fPowerSupplyA.fVoltagePos5V")
105
106 - added support in MF for expressiond like
107 "MHillas.fWidth<2*<MHillas.fLength"
108
109 - MDataChain is now able to support variables like [0], [1], ...
110 which can be used in fit functions as parameters. The interface
111 is implemented through the new virtual function
112 MParContainer::SetVariables
113
114 - added new class MArrivalTimeCam/MArrivalTimePix:
115 Storage containers to hold the ArrivalTime of the camera/pixel
116
117 - added new classes for the calibration of relative arrival times:
118 MCalibrationRelTimePix and MCalibrationRelTimeCam
119
120 - added new classes to extract the signal of the blind pixel and the
121 PIN Diode separately: MExtractBlindPixel and MExtractPINDiode
122
123 - added new classes for the bad-pixels treatment (MBadPixels*)
124 which are more powerfull than the old ones (MBlindPixel*)
125 and will replace them.
126
127 - added filter against cosmics: MFCosmics
128
129 - added new class MArrivalTimeCalc2:
130 Calculates the arrival time as the signal weighted mean of the time
131 slices in the maximum window
132
133 - added a new macro call pointspreadfucntion.C that fits with a 2D
134 gaussian the DC spot for an star. It gives you the RMS of
135 the PSF and the center of the star, very useful for misspointing
136 studies.
137
138 - added support for multi-telescope camera files. Added classes
139 MStereoCalc and MStereoPar, classes to calculate and store shower
140 parameters calculated from the data of two telescopes, for the MC
141 studies regarding the MAGIC clone.
142
143 - added MMcCalibrationCalc, MMcCalibrationUpdate, classes to obtain
144 MC data calibrated in photons instead of ADC counts.
145
146 - added three macros to show the calibration and analysis chain of
147 MC data. The macro starmc.C does both calibration and analysis, producing
148 an output containing Hillas parameters for each event. The macro
149 mccalibrate.C does just the calibration and writes out a file containing
150 pixel information in photons instead of FADC data. The macro starmc2.C
151 reads in such a file and produces an output with Hillas parameters.
152
153 - added MPedPhotCalc to compute pedestals in units of photons, see
154 macro pedphotcalc.C
155
156 - added all class to perform the calibration, see macro calibration.C
157
158 - added class MFFT to perform Fast Fourier Transforms
159
160 - added class MSimulatedAnnealing to perform simulated annealing
161 minimizations
162
163 - added new macro bootcampstandardanalysis.C which holds the skeleton
164 of the analysis chain discussed in the december bootcamp.
165
166 - added support for DAQ raw data file format V2
167
168 - implemented an arbitrary time stamp for the events from raw-data
169 files with file version<3. It is calculated from the run number,
170 the date of start and the FADC clock tick from the first module
171
172 - implemented the correct decoding of the event time-stamp
173 coming from the DAQ for raw-data files with file-version>2
174
175 - added a new classes storing the pedestals in units of photons:
176 MPedPhotPix, MPedPhotCam
177
178 - added support for DC current files from the camera control
179
180 - added support for start- and stop-time when merpping report files
181
182 - added MReportCC storing the weather data from the CC-REPORT
183
184 - added class to fill trainings and test matrices (MTFillMatrix)
185
186 - added a filter performing a software trigger (MFSoftwareTrigger)
187
188 - Added classes to perform parts of the standard analysis (Jobs):
189 + MJPedestals
190 + MJCalibration
191 + MJExtractSignal
192 Note: All of them are preliminary!
193
194 - Added Iterator to iterate over files giving only the run-number
195
196 - Added class (MHSectorVsTime) and example (sectorvstime.C) to plot
197 the evolution of a sector vs time
198
199
200
201 *** Version 0.8.3 (2003/12/05)
202
203 - adapted Random Forest classes to allow the use with MC
204 multi-telescope files which can be produced with the coming
205 camera version 0.7.
206
207 - added classes to read and interprete central control report files
208 (Directory: mreport, Base-Class: MReport, Reader: MReportFileRead, ...)
209
210 - enhanced merpp (the executable) to support .raw and .rep files.
211
212 - added classes for light calibration (MCalibration* and
213 MHCalibration*) by Markus Gaug. Further work has to be and will
214 be done soon.
215
216 - Added a preliminary 'synchronizer' (MReadReports) which will
217 replace MReadMarsFile as soon as it is finished.
218
219 - Added a tutorial macro demonstrating how report files are merpped
220 and how they can be read from the root file in the correct order
221 of time (readrep.C)
222
223 - Added a generalized histogram (similar to MH3) called MVsTime
224 which allows to plot variables (or rules - MDataChain - of
225 variables) vs time. For an example have a look at tempvstime.C.
226
227 - Changed the name of the event trees:
228 + Events --> Events
229 + PedEvents --> Pedestals
230 + CalEvents --> Calibration
231
232 - changed name of MTime in the event trees from MRawEvtTime to MTime
233
234 - added displaying the sector indices to the mars event display
235
236 - Magic Online Analysis (MOnA) implemented in a first version
237 (see mona.cc, MOnlineDump and MOnlineDisplay)
238
239 - added classes to calculate event rate
240 (preliminary: MEventRateCalc, MEventRate)
241
242 - added new executable 'readdaq' to read *.raw files from the DAQ directly
243
244 - added classes dealing with the telescope pointing position (MPointing*)
245
246 - implemented the 'final' Mars time stamp based on some experiences with
247 the new 'Synchonizer'
248
249
250
251 *** Version 0.8.2 (2003/11/10)
252
253 - accelerated standard analysis by a factor of 6-8 ...
254 + doing precalculations in MGeomCam for the pixel area ratio
255 + creating a look up table for the single pixels in MCerPhotEvt
256
257 - added task to calculates weights in case you want to 'change'
258 the energy spectrum of a monte carlo file
259 (MMcWeightEnergySpecCalc - Great work from Marcos Lopez Moya)
260
261 - added a new executable star which implements the
262 star.C macro as precompiled executable. Currently a flexible
263 setup is not possible, but a 'input card' setup will follow.
264
265 - Starting to implement Multi-Telescope-Support based on the
266 upcomming camera version 0.7. The base for a general support
267 is implemented and the star-functionality is proven to work.
268
269 - Replaced Event-Display in and Camera-Display in the Mars GUI
270 executable by a more convinient display base on MStatusDisplay.
271
272 - fixed the algorithm for the blind pixel treatment (MBlindPixelCalc)
273
274
275
276 *** Version 0.8.1 (2003/10/20)
277
278 - added signal subtraction for pure on data by means of fitting
279 the background in the off region or by performing a combined
280 signal/background fit. Provides necessary histograms for
281 obtaining energy spectra and a light curve.
282
283 - added classes to perform and study the selection of the
284 2nd Level Trigger on MC data (example in triglvl2.C macro)
285
286 - added pedestal calculation
287
288 - implemented "democratic cleaning" (tail cut value proportional
289 to pixel area) according to Wolfgang's suggestion.
290
291 - added Sigmabar treatment (calculation and basic histogramming)
292
293 - added basic routines to apply padding
294
295 - added first implementation of MARS-based source visibility plotter
296 (needs to be linked against slalib, preliminary version)
297
298 - enhanced functionality of data chains: random numbers, conversion
299 functions and access to MHMatrix objects
300
301 - fixed some bugs in the CT1 Preproc file reader, which gave wrong
302 numbers under certain circumstances (runs with 0 events included)
303
304 - fixed a bug in the general filter MF (didn't work on some systems
305 at all)
306
307 - fixed a bug in chaining files, which caused the analysis to crash or
308 ignore files
309
310 - implemented more geometry classes describing the parameters used
311 to simulate the PMT camera
312
313 - added new Monte Carlo classes containing the setup of the different
314 programs in the MC chain.
315
316 - added a (preliminary) general task to evaluate chi-square of a given
317 parameter in an eventloop.
318
319 - first implementation of a container describing the observatory
320 location (Long, Lat, etc)
321
322 - added Random Forest - method for g/h-separation
323
324 - made compatible with the latest PRO version of root (3.04/02 and 3.05/07)
325 (this means, that it is compiling, but not yet fully tested)
326
327 - added a new status display which can show the present status
328 of histograms while an eventloop is running (MStatusDisplay,
329 an example can be found at status.C)
330
331 - reorganized directories:
332 classes describing the image --> mimage
333 classes containing Monte Carlo Histograms --> mhistmc
334 classes for Random Forest method --> mranforest
335
336 - added (event-)weights to fill histograms
337
338 - colors in logging output to screen
339
340 - changes to the Image Parameter declaration:
341 + moved fConc, fConc1 from MHillasSrc to MNewImagePar
342 + moved fNumUsedPix, fNumCorePix from MHillas to MNewImagePar
343 + MHillasExt now derives from MParContainer instead of MHillas
344 --> Files written with the old definition are more or less unreadable
345
346 - reading of reflector files
347
348 - display data from reflector files in the camera
349
350 - implemented currents (and display them in the camera)
351
352 - logarithmic scale in camera
353
354 - added class to iterate through directory contents (MDirIter)
355
356
357
358 *** Version 0.8 (2002/11/18)
359
360 - added all subdirectories as Include-Paths for ACLIC (s. rootlogon.C)
361
362 - corrected 48(!) wrong entries in the Next Neighbor table of the
363 Magic Camera (all in the inner part of the outer ring, mostly
364 missing a single NN)
365
366 - Fixed a bug in the table describing the Next Neighbours of the
367 CT1 camera (a pixel 127 doesn't exist and the pixel 126 didn't
368 have any neighbour)
369
370 - changed trigrate.C: now it calculates the pure NSB triggers from
371 a camera file (generated with no showers), so there is no need
372 to introduce them by hand in the BgR array (for more details
373 please ask Abelardo)
374
375 - added MHHadronness (and MHadronness) as a general facility to evaluate
376 the quality of a gamma-hadron seperation method
377
378 - changed MWriteAsciiFile to accept rules (MDataChain)
379
380 - Calls to MWriteAsciiFile::AddContainer and MWriteAsciiFile::AddRule
381 must be replaced by calles to MWriteAsciiFile::AddColumn and
382 MWriteAsciiFile::AddColumns. Be carefull, the arguments have slightly
383 changed.
384
385 - Implemented generalized event-matrices (one row per event)
386 (MHMatrix)
387
388 - implemented the one dimensional composite probabilities
389 (MHCompProb, MCompProbCalc, comprob.C)
390
391 - implemented the Multidimensional Distances (Next Neighbours, Kernel)
392 (MMultiDimDistCalc, multidimdist.C, multidimdist2.C, MHMatrix)
393
394 - Added a camera display displaying the pixel numbers to the
395 event display gui.
396
397 - Added Monte Carlo Informations to event display gui
398
399 - Changed the camera display to display the pixel numbering
400
401 - Added three buttons to the camera display to change the palette
402
403 - Added the number of used and core pixels after image cleaning
404 to MHillas
405
406 - Changed the algorithm used in MHillas according to TDAS 02-03
407
408 - Changed the Alpha range according to TDAS 02-03 to [-90°,90°]
409
410 - Changed the algorithm used in MHillasSrc according to TDAS 02-03
411
412 - Added fCosDeltaAlpha to MHillasSrc
413
414 - The numbers of photons used to calculate fConc and fConc1 in
415 MHillasExt are now scaled with the pixel size, so that one get
416 a four times smaller value for the bigger pixels in the outer ring.
417
418 - added new task to smooth the camera contents (MCameraSmooth)
419
420 - added possibility to use interpolated pixel values for blind pixels
421 instead of removing it completely from the analysis
422
423 - Implemented the possibility to save the whole eventloop with
424 its setup to a file. This information can be read and from
425 it you can (re)create a Macro. See MEvtLoop::Read, MEvtLoop::Write
426 and MEvtLoop::MakeMacro. If you find something not working, please
427 report - this stuff is still in a beta phase.
428
429 - MBlindPixelCalc set all Ceta-Tauri pixels to unused not only for the
430 file having crab starfield, but also for all following files - fixed
431
432 - MTaskList::PrintStatistics can now be instructud to print also the
433 title, too: use PrintStatistics(0, kTRUE)
434
435 - Changed the image cleaning so that pixels with to many 'used'
436 neighbors are left used (to get rid of 'holes' in events)
437
438 - Introduced more output to the camera displays
439
440 - Added an array of histograms (eg one hist per run), MHArray
441
442 - Added a _preliminary_ version of the reader for CT1 PreProc files
443 (MCT1ReadPreProc)
444
445 - Fixed the error calculation of MHMCollectionArea and MHMcIntRate
446 (thanks to Raquel)
447
448 - added the first energy estimator (MEnergyEstParam, estimate.C,
449 estfit.C) using a parametrization
450
451 - Added some new Monte Carlo paremeter containers used to store
452 setup information from the MC chain (MMcConfigRunHeader,
453 MMcCorsikaRunHeader, MGeomPMT, MGeomMirror)
454
455
456
457 *** Version 0.7 (2002/04/30)
458
459 - added a bugfix to MCerPhotCalc. In older camera versions (<=40)
460 the pedestal mean value was saved incorrectly. For files from
461 this versions we substract 0.5 from the pedestal mean.
462 WARNING: This may effect your results, so don't wonder...
463
464 - First implementation of an algorithm using only triggered events
465 for the collection area calculation
466
467 - Ascii Output can now also be used for parameter containers which
468 doesn't overload MParCointainer::AsciiWrite
469
470 - The Ascii Output is now also capable of writing single data members
471 of one container
472
473 - You are now able to change the order of the values written to the
474 ascii file
475
476 - You can now specify a conversion factor for each data member written
477 to an ascii file. This may be usefull to change the units of the
478 data member (eg. degrees instead of millimeters in case of the
479 hillas parameters)
480
481 - Replaced old MHillas by a new structure which allows you to extend
482 the parameters stored in MHillas very easily:
483 see MHillas and MHillasExt
484
485 - Added classes to handle source dependancy of image parameters:
486 see MHillasSrc
487
488 - Added container (MBinning) to have a standard input for the binning
489 in different histograms (eg. the Energy bins should be the same in
490 all histograms)
491
492 - Changed Hillas histograms from mm to deg
493
494 - Added the flexible binning to the hillas histograms
495
496 - Added a filter for the alpha parameter (MFAlpha)
497
498 - It is now possible to write single data members of a class object to
499 an output stream instead of the whole container only
500
501 - Added a generalized filter for a data member:
502 MFDataMember filter("MHillas.fWidth", '<', 0.5);
503
504 - Added a generalized Filter parser for more difficult filter rules
505 MF filter("MHillas.fWidth<0.5 && MHillas.fLength>0.5");
506
507 - Added new Monte Carlo histograms:
508 MHMcEnergyImpact and MHMcEfficiency
509
510 - Added many new histograms needed for the flux calculation.
511
512 - Added a generalized histograms which can fill and show up to three
513 data members in either a one-, two- or three-dimensional histogram, eg:
514 MH3 mh3("MHillas.fWidth", "MHillas.fLength");
515
516 - Added:
517 * calculation of <Theta> as a function of Theta (MHThetabarTheta)
518 * calculation of <Theta> as a function of time (MHThetabarTime)
519 they are needed in the flux calculation in
520 order to select for a given bin in Theta (or time) the appropriate
521 effective collection area, which is assumed to be given as a function
522 of Theta and the true energy
523
524 - Added calculation of the migration matrix in the energy
525 (MHMcEnergyMigration):
526 the migration matrix describes the migration from the true (E_true)
527 to the estimated energy (E_est); it is needed to determine the
528 distribution of E_true from the measured distribution of E_est
529 by unfolding
530
531 - changed the color palette in the camera display to DeapSea.
532
533
534
535 *** Version 0.6 (2002/01/15)
536
537 - Introduce the option of disable pixels (MBlindPixels and
538 MBlindPixelCalc) for the analysis (eg MHillasCalc) to be
539 able to deal with Star Field NSB.
540
541 - Fixed a bug in the pedestals substraction
542
543 - Introduced verbosity levels
544
545 - Introduced a task (MReadMarsFile) which reads the RunHeader tree, too.
546
547 - Fixed several bugs in MFTriggerLvl1 which caused to filter not to
548 work correctly (thanks to Abelardo)
549
550 - Introduced correct treatment of the diffuse Night Sky Background
551 and NSB (MMcPedestalNSB)
552
553 - Corrected treatment of the electronic noise (MMcPedestalCopy)
554
555 - Introduced MMcRunHeaders which contains monte carlo run informations
556
557 - Added a 'Print'-Task (MPrint) which calls the Print function
558 of a parameter container for each event
559
560 - Removed MHtml (was replaced by THtml of root 3.02) in dohtml.C
561
562 - changes to be more efficient with root 3.02/06
563
564 - root 3.02/06 fixes:
565 + the memory leak when reading MRawEvtData
566 + loosing more time than necessary to update the progress bar
567
568 - MWriteAsciiFile is now capable of writing more than one container
569 in a line. For example: To be able to write Monte Carlo and
570 Hillas values (energy and alpha) in one line.
571
572
573
574 *** Version 0.5 (2001/11/06)
575
576 - Added new GUI functionality (Analysis)
577
578 - Added a camera display to be able to display events in the camera
579 together with the calculated hillas ellipse
580
581 - Added a 'Clone'-Task (MClone) which can clone a parameter container
582 object at any state of the analysis, so that the output are several
583 states
584
585 - Fixed a bug in the collection area error calculation
586 (Thanks to Ciro and Abelardo)
587
588 - Fixed a bug which causes merpp to crash in some environments
589
590 - Implemented auto enabling scheme for Branches to speed up reading
591 a lot (see MReadTree and MTask)
592
593 - Fixed a bug in the Histogram classes which caused histograms to
594 be written to a file by MWriteRootFile without request
595
596 - changed the object I/O from the old stylish root I/O to the new
597 'auto evolution scheme' This was done only for classes which are not
598 yet used in Monte Carlo files, so that these files are still readable.
599
600 - Added support for a progress bar in MEvtLoop and MReadTree
601 (see the Analysis Window in Mars for an example)
602
603 - Fixed a bug in the package creation which disturbed the conversion
604 between a mars version unpacked from a tar file and the repository.
605
606 - Changed the code to writer merpped (converted into root format)
607 raw files, to get faster (around 10%)
608
609
610
611 *** Version 0.4 (2001/09/20)
612
613 - This release is made to compile on a root version >= 3.00
614
615 - Fixed a bug which causes MReadTree to read the first file only
616
617 - Added a task to compute the trigger rate (MMcTriggerRateCalc)
618
619 - Added a task to write a container to an Ascii file (MWriteAsciiFile)
620
621 - Added a task to write several container to a root file (MWriteRootFile)
622
623 - Added calculation of the Enegry Threshold (MMcThresholdCalc)
624
625 - Added calculation of the collection area (MMcCollectionAreaCalc)
626
627 - fixed some bugs in the Hillas calculation
628
629 - added filters to be able to control the task execution dependent on
630 a parameter (for example: the number of level 1 triggers in a MC-file)
631
632
633
634 *** Version 0.3 (2001/04/23)
635
636 - Many demo macros added
637
638 - MCT1ReadAscii is now able to handle more than one file (s. ::AddFile)
639
640 - Hillas Calculation added
641
642 - Standard image cleaning available
643
644 - MReadTree is now able to handle more than one file
645 (Remark: of the same structure)
646
647 - Now we are able to display events in a first version of the
648 Camera event display. To do this we must run the macro
649 "macros/readCT1.C" to read data from CT1.
650
651
652
653 *** Version 0.2 (2001/01/24)
654
655 - First Implementation of a Gui to read the raw data. Start the
656 gui with the command mars.
657
658
659
660 *** Version 0.1 (2000/12/20)
661
662 - First official release 0.1
663
664 - Changes:
665
666 + changed calling style of MRawPixelIterator from do...while to
667 while-loop
668
Note: See TracBrowser for help on using the repository browser.