# # ChangeLog for trunk/DataCheck # # Generated by Trac 1.5.2 # 09/22/24 13:37:47 Thu, 05 Sep 2013 13:13:18 GMT Daniela Dorner [17077] * trunk/DataCheck/Sourcefile.sh (modified) added new function getdates to get the path for the wished nights ... Thu, 05 Sep 2013 13:09:56 GMT Daniela Dorner [17076] * trunk/DataCheck/Cron/crontab.fact-viewer (modified) added some crons to fill information and rearranged some times Mon, 02 Sep 2013 09:56:17 GMT Daniela Dorner [17062] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) made sure that for transfer reset only reset of RawFileRsyncedISDC is ... Mon, 12 Aug 2013 14:24:11 GMT Daniela Dorner [17003] * trunk/DataCheck/QuickLook/Step1.sh (modified) added directory for temporary rsync files Mon, 12 Aug 2013 14:22:56 GMT Daniela Dorner [17002] * trunk/DataCheck/Cron/crontab.fact01 (modified) added crons to get concam and magic allsky images Mon, 12 Aug 2013 14:20:38 GMT Daniela Dorner [17001] * trunk/DataCheck/Processing/FillAuxData.sh (modified) handle case that time cannot be retrieved from file via ftcopy Wed, 07 Aug 2013 00:09:35 GMT Daniela Dorner [16998] * trunk/DataCheck/Processing/FillAuxData.sh (modified) fixed bug in regular expression for source names Tue, 06 Aug 2013 23:11:14 GMT Daniela Dorner [16997] * trunk/DataCheck/Cron/crontab.coma (modified) adapted to run as operator on coma Wed, 31 Jul 2013 16:31:10 GMT Daniela Dorner [16992] * trunk/DataCheck/Transfer/BackupAuxToWue.sh (modified) * trunk/DataCheck/Transfer/BackupRawToWue.sh (modified) added rsync-temp-dir to avoid temporary files from the rsync on the ... Tue, 30 Jul 2013 12:48:04 GMT Daniela Dorner [16990] * trunk/DataCheck/Processing/RunCallisto.sh (modified) adapted paths for macro Tue, 30 Jul 2013 12:47:42 GMT Daniela Dorner [16989] * trunk/DataCheck/Processing/RunStar.sh (modified) adapted paths for macros and output path for star Tue, 30 Jul 2013 12:18:22 GMT Daniela Dorner [16988] * trunk/DataCheck/QuickLook/Step2b.sh (modified) completely rewritten to run only nightly ganymeds (summing more ... Tue, 30 Jul 2013 12:14:35 GMT Daniela Dorner [16987] * trunk/DataCheck/QuickLook/Step2a.sh (modified) choose dates depending on hour, treat case that rawfile not available ... Tue, 30 Jul 2013 11:42:42 GMT Daniela Dorner [16986] * trunk/DataCheck/Cron/crontab.fact-viewer (modified) added cron to fill output of QLA to DB Sat, 15 Jun 2013 03:45:14 GMT Daniela Dorner [16850] * trunk/DataCheck/Processing/FillAuxData.sh (modified) fixed bug in getting source name from drive file Wed, 05 Jun 2013 15:13:27 GMT mknoetig [16724] * trunk/DataCheck/Processing/FillAuxCurrents.sh (modified) edit FillAuxCurrents.sh to work with fCurrentsDiffToPrediction Tue, 04 Jun 2013 15:38:52 GMT Daniela Dorner [16690] * trunk/DataCheck/Processing/FillAuxCurrents.sh (modified) updated path for macro, implemented check whether calibrated- ... Mon, 03 Jun 2013 21:42:07 GMT Daniela Dorner [16679] * trunk/DataCheck/Transfer/BackupRawToWue.sh (modified) small fix in usage of lsof Mon, 03 Jun 2013 21:40:40 GMT Daniela Dorner [16678] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) reworked output, added summary Mon, 03 Jun 2013 21:38:39 GMT Daniela Dorner [16677] * trunk/DataCheck/QuickLook/Step2a.sh (modified) added loop over dates and usage of sge Mon, 03 Jun 2013 21:37:25 GMT Daniela Dorner [16676] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) added checking of command line options to allow for usage of sge Mon, 03 Jun 2013 21:36:24 GMT Daniela Dorner [16675] * trunk/DataCheck/Cron/crontab.fact-viewer (modified) removed time command Mon, 03 Jun 2013 21:34:34 GMT Daniela Dorner [16674] * trunk/DataCheck/Processing/FillNumEvts.sh (modified) use compiled version of macro Mon, 03 Jun 2013 21:28:51 GMT Daniela Dorner [16673] * trunk/DataCheck/Setup/setup.fact.isdc (modified) added setup for gla, adapted setup for jobmanager for new cluster Mon, 13 May 2013 15:00:23 GMT mknoetig [15604] * trunk/DataCheck/Processing/FillEffectiveOn.sh (modified) add fTriggerRateTimeOverx and TriggerRateRms to FillEffectiveOn.sh Mon, 13 May 2013 11:43:09 GMT mknoetig [15602] * trunk/DataCheck/Processing/FillEffectiveOn.sh (modified) add: fTriggerRateTimeOver125 to FillEffectiveOn.sh Mon, 13 May 2013 10:01:05 GMT Daniela Dorner [15601] * trunk/DataCheck/Processing/JobManager.sh (modified) added possibility to set queue differently for different scripts Mon, 13 May 2013 09:59:48 GMT Daniela Dorner [15600] * trunk/DataCheck/Sourcefile.sh (modified) updated debugging output and logging for case that job is already ... Mon, 13 May 2013 09:57:16 GMT Daniela Dorner [15599] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) check files only in detail when number of files does agree Mon, 13 May 2013 09:55:01 GMT Daniela Dorner [15598] * trunk/DataCheck/Processing/BuildSequences.sh (modified) updated path and name of macro Mon, 13 May 2013 09:52:01 GMT Daniela Dorner [15597] * trunk/DataCheck/Cron/crontab.fact-transfer (modified) moved control of number of instances from cron to script, added ... Mon, 13 May 2013 09:50:59 GMT Daniela Dorner [15596] * trunk/DataCheck/Transfer/BackupRawToWue.sh (modified) allow more than one instance of script and moved control of number of ... Mon, 13 May 2013 09:47:58 GMT Daniela Dorner [15595] * trunk/DataCheck/Transfer/ZipRawData.sh (modified) changed order of dates for processing to make sure that older data ... Mon, 13 May 2013 09:47:07 GMT Daniela Dorner [15594] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) changed limit to 5 MB/s during night Mon, 13 May 2013 09:46:37 GMT Daniela Dorner [15593] * trunk/DataCheck/Processing/CheckRawData.sh (modified) added creating of row in table RatesFileAvailISDCStatus Mon, 13 May 2013 09:45:49 GMT Daniela Dorner [15592] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added limit for disk usage on daq (transfer is stopped when limit is ... Mon, 13 May 2013 09:43:34 GMT Daniela Dorner [15591] * trunk/DataCheck/QuickLook/Step1.sh (modified) moved diskusage check to function and implemented it also in loop Wed, 08 May 2013 17:46:13 GMT Daniela Dorner [15562] * trunk/DataCheck/Setup/setup.fact.wue (modified) updated setup (as far as possible) to new machines in Wue Wed, 08 May 2013 17:45:36 GMT Daniela Dorner [15561] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added info Wed, 08 May 2013 17:45:11 GMT Daniela Dorner [15560] * trunk/DataCheck/Cron/crontab.coma (modified) * trunk/DataCheck/Cron/crontab.fact-transfer (modified) * trunk/DataCheck/Cron/crontab.fact2 (modified) added/updated cron for backup of QLA Wed, 08 May 2013 17:16:17 GMT Daniela Dorner [15559] * trunk/DataCheck/Transfer/BackupQLA.sh (added) added (script to backup results of QLA) Wed, 08 May 2013 17:14:35 GMT Daniela Dorner [15558] * trunk/DataCheck/QuickLook/Step1.sh (modified) bugfix in disk-usage-check Tue, 07 May 2013 22:34:18 GMT Daniela Dorner [15526] * trunk/DataCheck/Cron/crontab.root (added) cron to be used as root user on daq and newdaq Tue, 07 May 2013 22:32:45 GMT Daniela Dorner [15525] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added variable to steer zip-limitation on the fly Tue, 07 May 2013 22:32:11 GMT Daniela Dorner [15524] * trunk/DataCheck/Cron/crontab.fact01 (modified) changed path for gtc-skycam Tue, 07 May 2013 22:31:26 GMT Daniela Dorner [15523] * trunk/DataCheck/Cron/crontab.fact2 (modified) removed ionice for Step1 as it anyhow does not help for newdaq Tue, 07 May 2013 22:28:47 GMT Daniela Dorner [15522] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) move to svn mars version Tue, 07 May 2013 22:28:05 GMT Daniela Dorner [15521] * trunk/DataCheck/QuickLook/Step2a.sh (modified) removed logging to console to avoid emails from cron Tue, 07 May 2013 22:27:38 GMT Daniela Dorner [15520] * trunk/DataCheck/QuickLook/Step1.sh (modified) removed logging to console to avoid emails from cron Tue, 07 May 2013 22:26:37 GMT Daniela Dorner [15519] * trunk/DataCheck/DataCheck/PlotRatescans.sh (modified) move to svn mars version Tue, 07 May 2013 22:24:30 GMT Daniela Dorner [15518] * trunk/DataCheck/QuickLook/Step3.sh (modified) removed logging to console to avoid emails from cron Tue, 07 May 2013 22:22:58 GMT Daniela Dorner [15517] * trunk/DataCheck/Transfer/ZipRawData.sh (modified) added pv to control rate of zipping, limited pigz to 2 processes Tue, 07 May 2013 22:22:05 GMT Daniela Dorner [15516] * trunk/DataCheck/Processing/FillNumEvts.sh (modified) write output of macro to logfile and catch return value, move to svn ... Thu, 25 Apr 2013 12:20:40 GMT Daniela Dorner [15438] * trunk/DataCheck/QuickLook/Step3.sh (modified) re-added LD_LIBARY_PATH as else showplot was not running Thu, 25 Apr 2013 12:12:54 GMT Daniela Dorner [15435] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) * trunk/DataCheck/Transfer/RsyncRawLP.sh (modified) fixed bug which was caused by the introduction of the variable ... Thu, 25 Apr 2013 12:09:43 GMT Daniela Dorner [15434] * trunk/DataCheck/Cron/crontab.fact2 (modified) added commandline option for Step3.sh Mon, 22 Apr 2013 10:39:52 GMT Daniela Dorner [15409] * trunk/DataCheck/Cron/crontab.fact2 (modified) added cron to backup results of QLA to newdaq Mon, 22 Apr 2013 10:39:02 GMT Daniela Dorner [15408] * trunk/DataCheck/Cron/crontab.fact-transfer (modified) added cron to make a copy of QLA results Sun, 21 Apr 2013 01:27:31 GMT Daniela Dorner [15406] * trunk/DataCheck/Cron/crontab.fact2 (modified) added Step2a.sh Step3.sh and FillNumEvts.sh and optimized times for ... Sun, 21 Apr 2013 00:56:58 GMT Daniela Dorner [15402] * trunk/DataCheck/QuickLook/Step3.sh (modified) avoid that non-existent data is processed Sun, 21 Apr 2013 00:51:13 GMT Daniela Dorner [15401] * trunk/DataCheck/QuickLook/Step3.sh (modified) implemented plots for last week and run only for last night during ... Sun, 21 Apr 2013 00:50:22 GMT Daniela Dorner [15400] * trunk/DataCheck/QuickLook/Step2a.sh (modified) implemented sourcekey to get ra and dec for ganymed.C Sun, 21 Apr 2013 00:47:25 GMT Daniela Dorner [15399] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) implemented usage of new version of ganymed.C Sun, 21 Apr 2013 00:45:29 GMT Daniela Dorner [15398] * trunk/DataCheck/Processing/FillAuxData.sh (modified) adapted such that it treats only the current night during night, but ... Sun, 21 Apr 2013 00:44:31 GMT Daniela Dorner [15397] * trunk/DataCheck/Cron/crontab.fact1 (modified) adapted times for the transfer and insert scripts to speed up the QLA Sat, 20 Apr 2013 19:58:39 GMT Daniela Dorner [15393] * trunk/DataCheck/Processing/FillNumEvts.sh (modified) removed source key Sat, 20 Apr 2013 19:58:02 GMT Daniela Dorner [15392] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) fixed path to rawdata Sat, 20 Apr 2013 18:33:36 GMT Daniela Dorner [15391] * trunk/DataCheck/Processing/FillNumEvts.sh (added) added (script to fill results to DB with numevts.C) Sat, 20 Apr 2013 18:32:07 GMT Daniela Dorner [15390] * trunk/DataCheck/QuickLook/Step3.sh (modified) rewritten completely, adapted to new concept and structure Sat, 20 Apr 2013 18:31:03 GMT Daniela Dorner [15389] * trunk/DataCheck/QuickLook/RunCallisto.sh (modified) removed sourcekey Sat, 20 Apr 2013 18:30:04 GMT Daniela Dorner [15388] * trunk/DataCheck/QuickLook/Step1.sh (modified) removed sourcekey and other small improvements Sat, 20 Apr 2013 18:28:51 GMT Daniela Dorner [15387] * trunk/DataCheck/QuickLook/ReDoStar.sh (modified) removed sourcekey Sat, 20 Apr 2013 18:28:25 GMT Daniela Dorner [15386] * trunk/DataCheck/QuickLook/RunStar.sh (modified) removed sourcekey Sat, 20 Apr 2013 18:25:39 GMT Daniela Dorner [15385] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added new variables for the lightcurve processing Fri, 19 Apr 2013 20:39:26 GMT Daniela Dorner [15384] * trunk/DataCheck/Processing/CheckRatesFileAvail.sh (added) added (script to check if file FTM_CONTROL_TRIGGER_RATES is available ... Fri, 19 Apr 2013 19:52:39 GMT Daniela Dorner [15383] * trunk/DataCheck/QuickLook/Step2a.sh (modified) keep only run-wise processing, better naming of datasets and ganymed ... Fri, 19 Apr 2013 19:52:05 GMT Daniela Dorner [15382] * trunk/DataCheck/QuickLook/Step2b.sh (modified) keep only run-wise processing, better naming of datasets and ganymed ... Fri, 19 Apr 2013 19:50:40 GMT Daniela Dorner [15381] * trunk/DataCheck/QuickLook/Step1.sh (modified) added limitation for number of callisto jobs, added check on number ... Fri, 19 Apr 2013 19:45:47 GMT Daniela Dorner [15380] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added variables to steer transfer on La Palma (Step1.sh) Sat, 13 Apr 2013 23:29:52 GMT Daniela Dorner [15331] * trunk/DataCheck/Processing/FillEffectiveOn.sh (modified) prepared script to run in cron Sat, 13 Apr 2013 23:28:56 GMT Daniela Dorner [15330] * trunk/DataCheck/Processing/FillAuxThresholds.sh (modified) adapted name of logfile Sat, 13 Apr 2013 23:28:28 GMT Daniela Dorner [15329] * trunk/DataCheck/Processing/FillRatescans.sh (modified) adapted name of logfile Sat, 13 Apr 2013 23:26:27 GMT Daniela Dorner [15328] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) changed interval for crashed jobs to 5 hours Sat, 13 Apr 2013 23:25:06 GMT Daniela Dorner [15327] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) added RatesFileAvailISDC and sort direction Sat, 13 Apr 2013 23:23:43 GMT Daniela Dorner [15326] * trunk/DataCheck/Cron/crontab.fact-viewer (modified) added FillEffectiveOn.sh Sat, 13 Apr 2013 16:13:58 GMT Daniela Dorner [15323] * trunk/DataCheck/Cron/crontab.fact01 (modified) added cron for InfoForMWL.sh Sat, 13 Apr 2013 16:13:11 GMT Daniela Dorner [15322] * trunk/DataCheck/DataCheck/InfoForMWL.sh (modified) fixed bug and improved logging Sat, 13 Apr 2013 16:12:26 GMT Daniela Dorner [15321] * trunk/DataCheck/Setup/setup.fact.lp.gate (modified) added sqlrc Sat, 13 Apr 2013 15:41:58 GMT Daniela Dorner [15320] * trunk/DataCheck/DataCheck/InfoForMWL.sh (added) added (script to write files David needs for his MWL webpages) Fri, 12 Apr 2013 18:57:58 GMT Daniela Dorner [15319] * trunk/DataCheck/DataCheck/PlotRatescans.sh (added) added (script to create rate scan plots) Fri, 12 Apr 2013 18:57:32 GMT Daniela Dorner [15318] * trunk/DataCheck/DataCheck/SchedulingPlots.sh (added) added (script to create scheduling plots on gate Fri, 12 Apr 2013 18:56:45 GMT Daniela Dorner [15317] * trunk/DataCheck/DataCheck (added) added directory for data checking scripts Fri, 12 Apr 2013 12:05:12 GMT Daniela Dorner [15310] * trunk/DataCheck/QuickLook/Step2a.sh (modified) * trunk/DataCheck/QuickLook/Step2b.sh (modified) adapted names of scripts for automatic analysis Fri, 12 Apr 2013 12:03:22 GMT Daniela Dorner [15309] * trunk/DataCheck/Cron/crontab.fact2 (modified) adapted paths for automatic analysis scripts Fri, 12 Apr 2013 10:33:12 GMT Daniela Dorner [15308] * trunk/DataCheck/QuickLook/Step3.sh (added) added (script to run third step of the quick look analysis: light curve) Fri, 12 Apr 2013 10:32:48 GMT Daniela Dorner [15307] * trunk/DataCheck/QuickLook/Step2b.sh (added) added (script to run second step of the quick look analysis: building ... Fri, 12 Apr 2013 10:32:30 GMT Daniela Dorner [15306] * trunk/DataCheck/QuickLook/Step2a.sh (added) added (script to run second step of the quick look analysis: building ... Fri, 12 Apr 2013 10:31:10 GMT Daniela Dorner [15305] * trunk/DataCheck/QuickLook/Step1.sh (added) added (script to run first step of the quick look analysis: building ... Fri, 12 Apr 2013 10:29:36 GMT Daniela Dorner [15304] * trunk/DataCheck/QuickLook/RunGanymed.sh (added) added (script to run ganymed for quick look analysis) Fri, 12 Apr 2013 10:29:13 GMT Daniela Dorner [15303] * trunk/DataCheck/QuickLook/ReDoStar.sh (added) added (script to redo star for quick look analysis)