# # ChangeLog for trunk/DataCheck # # Generated by Trac 1.5.2 # 09/22/24 09:37:23 Thu, 23 Mar 2017 13:51:13 GMT Daniela Dorner [18790] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added path for flare alert files Fri, 17 Mar 2017 22:15:26 GMT Daniela Dorner [18784] * trunk/DataCheck/Sourcefile.sh (modified) adapted to convention of current night used in Step1.sh Wed, 15 Mar 2017 22:41:43 GMT Daniela Dorner [18783] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added amon alerts (sending of alert, trigger criteria still to be ... Wed, 15 Mar 2017 22:32:26 GMT Daniela Dorner [18782] * trunk/DataCheck/Sourcefile.sh (modified) in case of mysql-warnings skript is also stopped now (after the last ... Tue, 14 Mar 2017 20:42:06 GMT Daniela Dorner [18779] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) updated notes Thu, 02 Mar 2017 02:37:07 GMT Daniela Dorner [18778] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) fixed typo Thu, 02 Mar 2017 02:18:34 GMT Daniela Dorner [18777] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) run FlareAlerts.sh only on daq Wed, 22 Feb 2017 09:45:34 GMT Daniela Dorner [18776] * trunk/DataCheck/Processing/FillAuxData.sh (modified) bugfix (if filename is empty, function would complain) Tue, 21 Feb 2017 21:21:56 GMT Daniela Dorner [18775] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) fixed bug and added check Tue, 21 Feb 2017 20:16:54 GMT Daniela Dorner [18774] * trunk/DataCheck/Sourcefile.sh (modified) repeat query in case of deadlock Mon, 20 Feb 2017 21:22:32 GMT Daniela Dorner [18773] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added decay to type 3, added logging, uncommented sending email Mon, 20 Feb 2017 21:20:43 GMT Daniela Dorner [18772] * trunk/DataCheck/Cron/crontab.fact2 (modified) * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) added running FlareAlerts.sh Mon, 20 Feb 2017 13:58:55 GMT Daniela Dorner [18771] * trunk/DataCheck/Sourcefile.sh (modified) treat ratescan files specially in function check_file_avail Mon, 20 Feb 2017 13:58:17 GMT Daniela Dorner [18770] * trunk/DataCheck/Processing/FillAuxData.sh (modified) * trunk/DataCheck/QuickLook/Step1.sh (modified) implemented usage of new function check_file_avail Mon, 20 Feb 2017 13:32:28 GMT Daniela Dorner [18769] * trunk/DataCheck/QuickLook/RunCallisto.sh (modified) improved logging Mon, 20 Feb 2017 13:31:08 GMT Daniela Dorner [18768] * trunk/DataCheck/Processing/FillAuxLidar.sh (added) added (script to fill lidar data to DB) Mon, 20 Feb 2017 13:29:11 GMT Daniela Dorner [18767] * trunk/DataCheck/Sourcefile.sh (modified) added function to check file availability with proper severity in ... Mon, 20 Feb 2017 13:27:42 GMT Daniela Dorner [18766] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) bugfix in join for StarStatus; cleanup Mon, 20 Feb 2017 13:26:16 GMT Daniela Dorner [18765] * trunk/DataCheck/Processing/RunCallisto.sh (modified) * trunk/DataCheck/Processing/RunStar.sh (modified) addapted to new way of submitting jobs in JobManager Mon, 20 Feb 2017 13:25:04 GMT Daniela Dorner [18764] * trunk/DataCheck/Processing/JobManager.sh (modified) rewrote submitting part - now primaries are given in submit to avoid ... Sat, 18 Feb 2017 15:40:39 GMT Daniela Dorner [18763] * trunk/DataCheck/Sourcefile.sh (modified) handle empty $numchanged Sat, 18 Feb 2017 14:08:40 GMT Daniela Dorner [18762] * trunk/DataCheck/Sourcefile.sh (modified) catch mysql errors and print them to processlog Sat, 18 Feb 2017 13:51:00 GMT Daniela Dorner [18761] * trunk/DataCheck/Sourcefile.sh (modified) improved logging Sat, 18 Feb 2017 13:46:29 GMT Daniela Dorner [18760] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) * trunk/DataCheck/Sourcefile.sh (modified) optimized status/processing queries and settings Sat, 18 Feb 2017 13:44:48 GMT Daniela Dorner [18759] * trunk/DataCheck/Processing/BuildSequences.sh (modified) improved logging Sat, 11 Feb 2017 21:44:39 GMT Daniela Dorner [18757] * trunk/DataCheck/Processing/BuildSequences.sh (modified) added queries to update new columns in DB Sat, 11 Feb 2017 21:42:36 GMT Daniela Dorner [18756] * trunk/DataCheck/Processing/FillRates.sh (modified) improved logging Sat, 11 Feb 2017 21:41:11 GMT Daniela Dorner [18755] * trunk/DataCheck/Setup/setup.fact.isdc (modified) updated paths for new processing Sun, 05 Feb 2017 16:46:15 GMT Daniela Dorner [18754] * trunk/DataCheck/Processing/FillRates.sh (added) added (script to fill artificial trigger rates) Sat, 04 Feb 2017 20:36:24 GMT Daniela Dorner [18748] * trunk/DataCheck/Processing/FillAuxDust.sh (added) added (script to fill tng dust info to db) Sat, 04 Feb 2017 19:51:45 GMT Daniela Dorner [18747] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) removed debugging output Sat, 04 Feb 2017 16:41:48 GMT Daniela Dorner [18746] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) implemented speedup (rsync from/to ISDC took 1.5-2h each) Sat, 04 Feb 2017 16:28:19 GMT Daniela Dorner [18745] * trunk/DataCheck/Cron/crontab.fact-transfer (modified) updated cron for qla backup Sat, 04 Feb 2017 16:27:30 GMT Daniela Dorner [18744] * trunk/DataCheck/Transfer/BackupDatabase.sh (modified) fix in path Thu, 02 Feb 2017 03:30:07 GMT Daniela Dorner [18743] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug (for all source 3 sigma limit was used), some cleanup Thu, 02 Feb 2017 02:49:00 GMT Daniela Dorner [18742] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) implemented current triggers in the script Wed, 01 Feb 2017 14:36:48 GMT Daniela Dorner [18741] * trunk/DataCheck/QuickLook/FlareAlerts.sh (added) added (script to handle flare alerts) Wed, 25 Jan 2017 23:43:24 GMT Daniela Dorner [18739] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved logging Wed, 25 Jan 2017 23:42:22 GMT Daniela Dorner [18738] * trunk/DataCheck/Monitoring/InsertSchedule.sh (modified) improved logging Wed, 25 Jan 2017 23:40:10 GMT Daniela Dorner [18737] * trunk/DataCheck/Cron/crontab.fact2 (modified) updated crons for lid- and skycam to get image directly from php Sun, 08 Jan 2017 17:21:53 GMT Daniela Dorner [18723] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) files in the fails folder are considered now "fine" in the context of ... Sat, 07 Jan 2017 15:50:00 GMT Daniela Dorner [18721] * trunk/DataCheck/Processing/CheckRawData.sh (modified) fill information, which is available only at end of run, only when ... Thu, 05 Jan 2017 01:49:08 GMT Daniela Dorner [18710] * trunk/DataCheck/Setup/setup.fact.isdc (modified) new folder for sequences as quota for /scratch full Thu, 05 Jan 2017 00:56:47 GMT Daniela Dorner [18709] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) added backup of QLA to Wue Thu, 05 Jan 2017 00:44:59 GMT Daniela Dorner [18708] * trunk/DataCheck/Processing/CheckAuxFilesAvail.sh (modified) * trunk/DataCheck/Processing/CheckDriveFileAvail.sh (modified) * trunk/DataCheck/Processing/CheckRatesFileAvail.sh (modified) * trunk/DataCheck/Processing/CheckRawFilesAvail.sh (modified) * trunk/DataCheck/Processing/FillAuxCamHum.sh (modified) * trunk/DataCheck/Processing/FillAuxContTemp.sh (modified) * trunk/DataCheck/Processing/FillAuxCtrDev.sh (modified) * trunk/DataCheck/Processing/FillAuxCurrents.sh (modified) * trunk/DataCheck/Processing/FillAuxData.sh (modified) * trunk/DataCheck/Processing/FillAuxTemp.sh (modified) * trunk/DataCheck/Processing/FillAuxThresholds.sh (modified) * trunk/DataCheck/Processing/FillDrsTemp.sh (modified) * trunk/DataCheck/Processing/FillEffectiveOn.sh (modified) * trunk/DataCheck/Setup/setup.fact.isdc (modified) * trunk/DataCheck/Setup/setup.fact.lp.data (modified) avoid warnings for missing files for the first few days; fixed bug in ... Thu, 05 Jan 2017 00:31:54 GMT Daniela Dorner [18707] * trunk/DataCheck/Sourcefile.sh (modified) improved logging Wed, 04 Jan 2017 22:48:46 GMT Daniela Dorner [18706] * trunk/DataCheck/Cron/crontab.fact-transfer (modified) check for errors and warnings only once per day but for connection ... Wed, 04 Jan 2017 22:43:31 GMT Daniela Dorner [18705] * trunk/DataCheck/QuickLook/Step1.sh (modified) improved logging Wed, 04 Jan 2017 22:43:07 GMT Daniela Dorner [18704] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) bugfix (amount of spaces in format had changed) Wed, 04 Jan 2017 22:42:21 GMT Daniela Dorner [18703] * trunk/DataCheck/Cron/crontab.fact1 (modified) check for errors and warnings only once per day but for connection ... Wed, 04 Jan 2017 22:41:35 GMT Daniela Dorner [18702] * trunk/DataCheck/Monitoring/CheckLogs.sh (modified) check for errors and warnings only once per day but for connection ... Wed, 21 Dec 2016 12:37:49 GMT Daniela Dorner [18701] * trunk/DataCheck/DataCheck/InfoForMWL.sh (modified) * trunk/DataCheck/QuickLook/SendData.sh (modified) * trunk/DataCheck/QuickLook/SendData_Internal.sh (modified) * trunk/DataCheck/Sourcefile.sh (modified) * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified) fixed bug (variable pwfile occured twice -> renamed) Wed, 21 Dec 2016 12:36:32 GMT Daniela Dorner [18700] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved logging Tue, 20 Dec 2016 15:30:17 GMT Daniela Dorner [18699] * trunk/DataCheck/Processing/CheckRawFilesAvail.sh (modified) give warning only for last year (to avoid getting warnings for files ... Tue, 20 Dec 2016 15:25:21 GMT Daniela Dorner [18698] * trunk/DataCheck/Processing/FillAuxData.sh (modified) improved logging Mon, 19 Dec 2016 14:29:46 GMT Daniela Dorner [18697] * trunk/DataCheck/DataCheck/InfoForMWL.sh (modified) fixed typo in mysql query Sun, 18 Dec 2016 23:47:05 GMT Daniela Dorner [18696] * trunk/DataCheck/Processing/FillRatescans.sh (modified) optimized logging Sun, 18 Dec 2016 23:46:44 GMT Daniela Dorner [18695] * trunk/DataCheck/DataCheck/InfoForMWL.sh (modified) introduced usage of file for mysql pw to avoid warnings Sun, 18 Dec 2016 23:46:07 GMT Daniela Dorner [18694] * trunk/DataCheck/QuickLook/SendData.sh (modified) * trunk/DataCheck/QuickLook/SendData_Internal.sh (modified) * trunk/DataCheck/Setup/setup.fact.lp.data (modified) * trunk/DataCheck/Setup/setup.fact.lp.gate (modified) * trunk/DataCheck/Sourcefile.sh (modified) introduced usage of file for mysql pw to avoid warnings Sun, 18 Dec 2016 23:43:58 GMT Daniela Dorner [18693] * trunk/DataCheck/Monitoring/InsertSchedule.sh (modified) removed not needed output Sun, 18 Dec 2016 23:43:08 GMT Daniela Dorner [18692] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) changed from https to http as certificate caused problems after ... Sun, 18 Dec 2016 23:42:16 GMT Daniela Dorner [18691] * trunk/DataCheck/Monitoring/CheckNetworkStatus.sh (modified) adapted to account for additional eths Sun, 18 Dec 2016 23:41:29 GMT Daniela Dorner [18690] * trunk/DataCheck/Monitoring/CheckNTPDate.sh (modified) updated mysql access after system upgrade Sun, 18 Dec 2016 20:56:56 GMT Daniela Dorner [18687] * trunk/DataCheck/Processing/FillNumEvts.sh (modified) improved logging Sun, 18 Dec 2016 20:54:38 GMT Daniela Dorner [18686] * trunk/DataCheck/Transfer/BackupRawToWue.sh (modified) improved logging Sun, 18 Dec 2016 20:50:56 GMT Daniela Dorner [18685] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved logging Sun, 18 Dec 2016 20:49:49 GMT Daniela Dorner [18684] * trunk/DataCheck/QuickLook/Step2a.sh (modified) improved logging Sun, 18 Dec 2016 20:48:47 GMT Daniela Dorner [18683] * trunk/DataCheck/Setup/setup.fact.isdc (modified) updated paths for libraries and added MC paths Sun, 18 Dec 2016 18:38:15 GMT Daniela Dorner [18682] * trunk/DataCheck/Processing/FillAuxData.sh (modified) improved logging Wed, 02 Nov 2016 03:40:15 GMT Daniela Dorner [18672] * trunk/DataCheck/QuickLook/SendData.sh (added) * trunk/DataCheck/QuickLook/SendData_Internal.sh (added) added (scripts for the download websites) Wed, 02 Nov 2016 03:33:54 GMT Daniela Dorner [18671] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) changed back to not using the rsync server which was gone after the ... Wed, 02 Nov 2016 03:33:32 GMT Daniela Dorner [18670] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) changed back to not using the rsync server which was gone after the ... Wed, 02 Nov 2016 03:32:52 GMT Daniela Dorner [18669] * trunk/DataCheck/Transfer/BackupDatabase.sh (modified) fixed syntax of mysqldump for new mysqlversion Wed, 02 Nov 2016 03:32:09 GMT Daniela Dorner [18668] * trunk/DataCheck/Sourcefile.sh (modified) fixed small issue with certaindate Wed, 02 Nov 2016 03:31:38 GMT Daniela Dorner [18667] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) updated root version Wed, 02 Nov 2016 03:30:57 GMT Daniela Dorner [18666] * trunk/DataCheck/QuickLook/Step2a.sh (modified) improved logging Wed, 02 Nov 2016 03:30:30 GMT Daniela Dorner [18665] * trunk/DataCheck/QuickLook/Step1.sh (modified) changed back to not using the rsync server which was gone after the ... Wed, 02 Nov 2016 03:29:16 GMT Daniela Dorner [18664] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) improved logging Wed, 02 Nov 2016 03:28:48 GMT Daniela Dorner [18663] * trunk/DataCheck/Processing/FillMoonInfo.sh (modified) improved logging Wed, 02 Nov 2016 03:28:00 GMT Daniela Dorner [18662] * trunk/DataCheck/Processing/FillAuxData.sh (modified) improved logging Wed, 02 Nov 2016 03:27:27 GMT Daniela Dorner [18661] * trunk/DataCheck/Processing/CheckRawData.sh (modified) fixed issue with times stamps that occured since update of gate and ... Wed, 02 Nov 2016 03:26:33 GMT Daniela Dorner [18660] * trunk/DataCheck/DataCheck/SchedulingPlots.sh (modified) udated path to makeschedule Wed, 02 Nov 2016 03:25:08 GMT Daniela Dorner [18659] * trunk/DataCheck/Monitoring/InsertSchedule.sh (added) added (script to insert automatic schedule to db) Wed, 02 Nov 2016 03:24:27 GMT Daniela Dorner [18658] * trunk/DataCheck/Cron/crontab.fact01 (modified) added inserting automatic schedule Wed, 02 Nov 2016 03:23:55 GMT Daniela Dorner [18657] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) updated list of sources Sat, 10 Sep 2016 17:31:04 GMT Daniela Dorner [18582] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved output; fixed regular expression for finding rawfiles Sat, 10 Sep 2016 17:29:47 GMT Daniela Dorner [18581] * trunk/DataCheck/Cron/crontab.fact-viewer (modified) added crons for filling magic-lidar and tng-dust to db Fri, 22 Apr 2016 20:21:34 GMT Daniela Dorner [18474] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) improved logging Fri, 22 Apr 2016 20:21:03 GMT Daniela Dorner [18473] * trunk/DataCheck/DataCheck/SchedulingPlots.sh (modified) use version of makeschedule in operation-directory Fri, 22 Apr 2016 20:19:43 GMT Daniela Dorner [18472] * trunk/DataCheck/Processing/FillMoonInfo.sh (modified) implemented filling of fact period Fri, 22 Apr 2016 20:19:06 GMT Daniela Dorner [18471] * trunk/DataCheck/Processing/FillAuxData.sh (modified) fixed bug for very small TSTOPF Fri, 22 Apr 2016 20:18:14 GMT Daniela Dorner [18470] * trunk/DataCheck/Sourcefile.sh (modified) fixed but in getdates() Fri, 22 Apr 2016 20:17:33 GMT Daniela Dorner [18469] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) fixed bug for very small TSTOPF Sat, 13 Feb 2016 17:47:02 GMT Daniela Dorner [18435] * trunk/DataCheck/Transfer/BackupRawToWue.sh (modified) added output for case of certaindate Sat, 13 Feb 2016 17:46:02 GMT Daniela Dorner [18434] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved logging, additional check for DB (jobs that were reset while ... Sat, 13 Feb 2016 17:42:50 GMT Daniela Dorner [18433] * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified) implemented usage of certaindate Sat, 13 Feb 2016 17:41:36 GMT Daniela Dorner [18432] * trunk/DataCheck/Transfer/BackupAuxToWue.sh (modified) implemented usage of variable certaindate Wed, 27 Jan 2016 21:50:21 GMT Daniela Dorner [18422] * trunk/DataCheck/Sourcefile.sh (modified) added option to function getdate to get the next up to 9 nights Wed, 27 Jan 2016 21:49:21 GMT Daniela Dorner [18421] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) added option to run script for more than one night and run it per ... Tue, 26 Jan 2016 23:55:14 GMT Daniela Dorner [18420] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (added) added (script to check swift schedule for observations of our sources)