Overview which processing / analysis outputs are available where and what are the differences.
Overview of Processings
| Analysis | Basis | Comment | Running at |
|---|---|---|---|
| quick look | run-wise | not reprocessed | La Palma |
| full | sequence-wise | reprocessed with new SW versions | ISDC |
Quick Look Analysis
In La Palma the QLA is running on daq and only the output of the qla processing is available on the machines there.
| Machine | Path | Comment |
|---|---|---|
| newdata | /data1/analysis | primary copy |
| newdaq | /loc_data/analysis_bu | backup |
| newdata | /newdaq/analysis_bu | backup |
| gate | /newdata/analysis | primary copy |
Remark: As all callisto files are in the meantime > 10 TB, no full copy of the QLA output is kept in La Palma. All callisto files can only be found at ISDC or Wue.
In La Palma, the software is located in /home/fact/SW.automatic.processing and the logfiles in /home/fact/logs.automatic.processing
| SW | Calibration / Cleaning / Cuts | Comment |
|---|---|---|
| Mars.von.Thomas.2012.06.19 Mars.CheObs.svn.2012.01.25 Mars.svn.2013.04.29 Mars.svn.2013.10.21 | old / old / old | running before 26.5.2014 |
| Mars.svn.2014.05.26 | new / old with adapted levels / old | running since 26.5.2014 |
Full Analysis
At ISDC the software is located in /home/projects/fact_opr and the logfiles in /home/projects/fact_opr/logs.automatic.processing
The analysis is running on isdc-in04 using sge on the cluster and the transfer is running on isdc-dl00.
| SW at ISDC | Comment | Output at ISDC | Output in WUE | DB |
|---|---|---|---|---|
| Mars.von.Thomas.2012.05.09 | first version | /gpfs0/scratch/fact/data.2012.05.09/ | - | |
| Mars.von.Thomas.2012.06.22 | analysis for gamma2012 | /gpfs0/scratch/fact/data.2012.06.22/ | - | |
| Mars.svn.2013.05.11 | improved calibration | /gpfs0/scratch/fact/data.2013.05.11/ | /fact/data/2013.05.11 /scratch/local/users/dorner/data.2013.05.11 (no callisto) | |
| Mars.svn.2014.05.26 | new (no) calibration new imgcl | /gpfs0/fact/processing/data.2014.05.26/ (deleted) | /fact/data/data.2014.05.26 /scratch/local/users/dorner/data.2014.05.26 (no callisto) | |
| Mars.svn.r18330 | few bugfixes new cuts | /gpfs0/fact/processing/data.r18330/ | /scratch/local/users/dorner/data.r18276 /fact/data/r18330 | |
| Mars.svn.r18753 | sw-trigger in callisto ganymed.C not as in svn as tests for new analysis ongoing | /gpfs0/fact/processing/data.r18753/ | not yet | factdata_cp20180814 |
| Mars.svn.r19161 | bugfix in star, fixed abberation updated disp coefficients | /gpfs0/fact/processing/data.r19161/ | not yet | factdata |
Some other in/output files:
| Files | Location at ISDC | Location in WUE |
|---|---|---|
| sequences | /gpfs0/fact/processing/sequences/ | /scratch/local/users/dorner/sequences/ |
| drs time calib | /gpfs0/fact/processing/drs_time_calib | /scratch/local/users/dorner/drs_time_calib |
| qla | /gpfs0/fact/processing/qla/ | /fact/data/qla /scratch/local/users/dorner/qla (no callisto) |
In Wuerzburg, a Mars version is located at /scratch/local/users/dorner/Mars.svn.2014.05.26_cp_extr
Content of Processing Directories
| Analysis Step | Subpath | Comment |
|---|---|---|
| calibration | callisto | output of callisto.C (ISDC) / callisto_data.C (LP) |
| image cleaning | star | output of star.C (ISDC) / star_file.C (LP) + subsystem information merged by merpp.C (ISDC) / merpp_file.C (LP) |
| background suppression | ganymed_run | output of ganymed.C (run runwise) |
