# # ChangeLog for trunk/DataCheck # # Generated by Trac 1.5.2 # 11/11/24 13:05:46 Fri, 29 Jun 2018 10:06:29 GMT Daniela Dorner [19036] * trunk/DataCheck/Tools/get_data.sh (modified) some cleanup and comments added Fri, 29 Jun 2018 09:46:29 GMT Daniela Dorner [19035] * trunk/DataCheck/Tools/get_data.sh (modified) added zd and th for min-binned queries to internal file, allow ... Thu, 28 Jun 2018 14:49:59 GMT Daniela Dorner [19033] * trunk/DataCheck/Tools/get_data.sh (modified) added tutorial, added comments, restructured query functions, added ... Thu, 28 Jun 2018 12:05:39 GMT Daniela Dorner [19032] * trunk/DataCheck/Tools/get_data.sh (modified) added readme Wed, 27 Jun 2018 02:20:49 GMT Daniela Dorner [19031] * trunk/DataCheck/Tools/get_data.sh (modified) fixed bug Tue, 26 Jun 2018 23:42:38 GMT Daniela Dorner [19030] * trunk/DataCheck/Tools/get_data.sh (modified) added host Tue, 26 Jun 2018 22:50:49 GMT Daniela Dorner [19029] * trunk/DataCheck/Tools/get_data.sh (modified) some cleanup Tue, 26 Jun 2018 22:34:00 GMT Daniela Dorner [19028] * trunk/DataCheck/Tools/get_data.sh (modified) updated data check, fixed order by, fixed bug, added more comments ... Wed, 13 Jun 2018 01:56:37 GMT Daniela Dorner [19019] * trunk/DataCheck/Tools/fill_r750.sh (modified) added and updated reference values and formula for corrected R750 Fri, 09 Feb 2018 23:04:39 GMT Daniela Dorner [18945] * trunk/DataCheck/Processing/FillAuxCam.sh (modified) moved filling of camera temperature to this script Fri, 09 Feb 2018 23:03:23 GMT Daniela Dorner [18944] * trunk/DataCheck/Processing/FillAuxMagic.sh (modified) added new values Fri, 09 Feb 2018 12:48:39 GMT Daniela Dorner [18941] * trunk/DataCheck/Processing/FillAuxCam.sh (moved) renamed script to better suit planned upd Fri, 09 Feb 2018 12:47:32 GMT Daniela Dorner [18940] * trunk/DataCheck/Processing/FillAuxMagic.sh (moved) renamed script to better suit planned upd Sun, 28 Jan 2018 20:12:20 GMT Daniela Dorner [18939] * trunk/DataCheck/Tools/fill_r750.sh (modified) updated correction formula and reference values for periods Fri, 26 Jan 2018 23:19:00 GMT Daniela Dorner [18938] * trunk/DataCheck/Setup/setup.fact.isdc (modified) * trunk/DataCheck/Setup/setup.fact.wue (modified) added encryption for mysql Mon, 22 Jan 2018 23:21:30 GMT Daniela Dorner [18937] * trunk/DataCheck/Tools/fill_r750.sh (added) added (script to fill corrected R750 and references) Sat, 02 Dec 2017 21:11:10 GMT Daniela Dorner [18935] * trunk/DataCheck/Processing/FillRates.sh (modified) added more values for artificial trigger rate Thu, 14 Sep 2017 22:22:39 GMT Daniela Dorner [18906] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed two bugs, added filling of informaion in DB Fri, 04 Aug 2017 13:40:42 GMT Daniela Dorner [18895] * trunk/DataCheck/Tools (added) * trunk/DataCheck/Tools/get_data.sh (added) * trunk/DataCheck/Tools/prepare_db.sh (added) added (tools to get data/fluxes from DB) Sun, 21 May 2017 09:42:02 GMT Daniela Dorner [18875] * trunk/DataCheck/Transfer/RsyncAuxToISDC.sh (modified) adapted to use newdata instead of data for transfer Sun, 21 May 2017 09:41:23 GMT Daniela Dorner [18874] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) added additional check for QLA results Sun, 21 May 2017 09:40:55 GMT Daniela Dorner [18873] * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified) fixed small bug in logging Sun, 21 May 2017 09:34:57 GMT Daniela Dorner [18872] * trunk/DataCheck/Transfer/ZipRawData.sh (modified) implemented option to use /data1 instead of /scratch Sun, 21 May 2017 09:33:52 GMT Daniela Dorner [18871] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) adapted to use proper rsync-temp-dir for each transfer Sun, 21 May 2017 09:32:54 GMT Daniela Dorner [18870] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) adapted settings to run QLA and transfer on newdata Sun, 21 May 2017 09:32:05 GMT Daniela Dorner [18869] * trunk/DataCheck/QuickLook/Step1.sh (modified) fixed bug and implemented option to use /data1 instead of /scratch Sun, 14 May 2017 22:38:52 GMT Daniela Dorner [18867] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) adapted logging to usage of newdata Sun, 14 May 2017 22:31:12 GMT Daniela Dorner [18866] * trunk/DataCheck/DataCheck/PlotRatescans.sh (modified) adapted path to run on newdata Sun, 14 May 2017 20:08:31 GMT Daniela Dorner [18864] * trunk/DataCheck/Monitoring/FillVisibilities.sh (added) * trunk/DataCheck/Monitoring/ToOVisibility.sh (added) added (tools to fill satellite visibilities for our sources to the ... Sun, 14 May 2017 20:05:33 GMT Daniela Dorner [18863] * trunk/DataCheck/Transfer/CleanupNewdata.sh (added) added (script to clean up newdata) Sun, 14 May 2017 20:04:52 GMT Daniela Dorner [18862] * trunk/DataCheck/Cron/crontab.fact1 (modified) * trunk/DataCheck/Cron/crontab.fact2 (modified) moved jobs from daq and data to newdata Sun, 14 May 2017 20:04:17 GMT Daniela Dorner [18861] * trunk/DataCheck/Cron/crontab.newdata (added) added (crontab file for jobs on newdata) Sun, 14 May 2017 20:03:07 GMT Daniela Dorner [18860] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) updated settings to run QLA on newdata Sun, 14 May 2017 20:02:33 GMT Daniela Dorner [18859] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug Sun, 14 May 2017 20:02:14 GMT Daniela Dorner [18858] * trunk/DataCheck/DataCheck/PlotQuality.sh (modified) updated to run on newdata Sun, 14 May 2017 20:01:41 GMT Daniela Dorner [18857] * trunk/DataCheck/Monitoring/CheckDU.sh (modified) added newdata, improved handling of limits Sun, 14 May 2017 20:01:03 GMT Daniela Dorner [18856] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) updated for newdata as download machine in LP Sun, 14 May 2017 20:00:03 GMT Daniela Dorner [18855] * trunk/DataCheck/QuickLook/Step1.sh (modified) updated to run on newdata Sun, 14 May 2017 19:59:09 GMT Daniela Dorner [18854] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) updated to run on newdata and create a second copy Sun, 14 May 2017 19:58:29 GMT Daniela Dorner [18853] * trunk/DataCheck/Transfer/ZipRawData.sh (modified) updated to run on newdata and create a second copy Sun, 14 May 2017 19:57:08 GMT Daniela Dorner [18852] * trunk/DataCheck/Transfer/RsyncAuxToISDC.sh (modified) * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified) updated to use newdata instead of data for transferring data Sun, 14 May 2017 01:29:35 GMT Daniela Dorner [18851] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) adapted as discussed in telcon (implemented warning if files in ... Sat, 08 Apr 2017 02:17:03 GMT Daniela Dorner [18807] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved logging Sat, 08 Apr 2017 02:16:32 GMT Daniela Dorner [18806] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) improve logging (log of numevts.C was overwriting log of ganymed.C) Sun, 02 Apr 2017 06:04:46 GMT Daniela Dorner [18799] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug in xml-filename; only create xml file when alert is new Mon, 27 Mar 2017 00:09:27 GMT Daniela Dorner [18794] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug in binning for queries Sat, 25 Mar 2017 16:21:36 GMT Daniela Dorner [18793] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed logging Sat, 25 Mar 2017 06:21:01 GMT Daniela Dorner [18792] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added average fluxes, added nightly binning for amon Fri, 24 Mar 2017 00:46:36 GMT Daniela Dorner [18791] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added check for path Thu, 23 Mar 2017 13:51:13 GMT Daniela Dorner [18790] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added path for flare alert files Fri, 17 Mar 2017 22:15:26 GMT Daniela Dorner [18784] * trunk/DataCheck/Sourcefile.sh (modified) adapted to convention of current night used in Step1.sh Wed, 15 Mar 2017 22:41:43 GMT Daniela Dorner [18783] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added amon alerts (sending of alert, trigger criteria still to be ... Wed, 15 Mar 2017 22:32:26 GMT Daniela Dorner [18782] * trunk/DataCheck/Sourcefile.sh (modified) in case of mysql-warnings skript is also stopped now (after the last ... Tue, 14 Mar 2017 20:42:06 GMT Daniela Dorner [18779] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) updated notes Thu, 02 Mar 2017 02:37:07 GMT Daniela Dorner [18778] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) fixed typo Thu, 02 Mar 2017 02:18:34 GMT Daniela Dorner [18777] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) run FlareAlerts.sh only on daq Wed, 22 Feb 2017 09:45:34 GMT Daniela Dorner [18776] * trunk/DataCheck/Processing/FillAuxData.sh (modified) bugfix (if filename is empty, function would complain) Tue, 21 Feb 2017 21:21:56 GMT Daniela Dorner [18775] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) fixed bug and added check Tue, 21 Feb 2017 20:16:54 GMT Daniela Dorner [18774] * trunk/DataCheck/Sourcefile.sh (modified) repeat query in case of deadlock Mon, 20 Feb 2017 21:22:32 GMT Daniela Dorner [18773] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added decay to type 3, added logging, uncommented sending email Mon, 20 Feb 2017 21:20:43 GMT Daniela Dorner [18772] * trunk/DataCheck/Cron/crontab.fact2 (modified) * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) added running FlareAlerts.sh Mon, 20 Feb 2017 13:58:55 GMT Daniela Dorner [18771] * trunk/DataCheck/Sourcefile.sh (modified) treat ratescan files specially in function check_file_avail Mon, 20 Feb 2017 13:58:17 GMT Daniela Dorner [18770] * trunk/DataCheck/Processing/FillAuxData.sh (modified) * trunk/DataCheck/QuickLook/Step1.sh (modified) implemented usage of new function check_file_avail Mon, 20 Feb 2017 13:32:28 GMT Daniela Dorner [18769] * trunk/DataCheck/QuickLook/RunCallisto.sh (modified) improved logging Mon, 20 Feb 2017 13:31:08 GMT Daniela Dorner [18768] * trunk/DataCheck/Processing/FillAuxLidar.sh (added) added (script to fill lidar data to DB) Mon, 20 Feb 2017 13:29:11 GMT Daniela Dorner [18767] * trunk/DataCheck/Sourcefile.sh (modified) added function to check file availability with proper severity in ... Mon, 20 Feb 2017 13:27:42 GMT Daniela Dorner [18766] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) bugfix in join for StarStatus; cleanup Mon, 20 Feb 2017 13:26:16 GMT Daniela Dorner [18765] * trunk/DataCheck/Processing/RunCallisto.sh (modified) * trunk/DataCheck/Processing/RunStar.sh (modified) addapted to new way of submitting jobs in JobManager Mon, 20 Feb 2017 13:25:04 GMT Daniela Dorner [18764] * trunk/DataCheck/Processing/JobManager.sh (modified) rewrote submitting part - now primaries are given in submit to avoid ... Sat, 18 Feb 2017 15:40:39 GMT Daniela Dorner [18763] * trunk/DataCheck/Sourcefile.sh (modified) handle empty $numchanged Sat, 18 Feb 2017 14:08:40 GMT Daniela Dorner [18762] * trunk/DataCheck/Sourcefile.sh (modified) catch mysql errors and print them to processlog Sat, 18 Feb 2017 13:51:00 GMT Daniela Dorner [18761] * trunk/DataCheck/Sourcefile.sh (modified) improved logging Sat, 18 Feb 2017 13:46:29 GMT Daniela Dorner [18760] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) * trunk/DataCheck/Sourcefile.sh (modified) optimized status/processing queries and settings Sat, 18 Feb 2017 13:44:48 GMT Daniela Dorner [18759] * trunk/DataCheck/Processing/BuildSequences.sh (modified) improved logging Sat, 11 Feb 2017 21:44:39 GMT Daniela Dorner [18757] * trunk/DataCheck/Processing/BuildSequences.sh (modified) added queries to update new columns in DB Sat, 11 Feb 2017 21:42:36 GMT Daniela Dorner [18756] * trunk/DataCheck/Processing/FillRates.sh (modified) improved logging Sat, 11 Feb 2017 21:41:11 GMT Daniela Dorner [18755] * trunk/DataCheck/Setup/setup.fact.isdc (modified) updated paths for new processing Sun, 05 Feb 2017 16:46:15 GMT Daniela Dorner [18754] * trunk/DataCheck/Processing/FillRates.sh (added) added (script to fill artificial trigger rates) Sat, 04 Feb 2017 20:36:24 GMT Daniela Dorner [18748] * trunk/DataCheck/Processing/FillAuxDust.sh (added) added (script to fill tng dust info to db) Sat, 04 Feb 2017 19:51:45 GMT Daniela Dorner [18747] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) removed debugging output Sat, 04 Feb 2017 16:41:48 GMT Daniela Dorner [18746] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) implemented speedup (rsync from/to ISDC took 1.5-2h each) Sat, 04 Feb 2017 16:28:19 GMT Daniela Dorner [18745] * trunk/DataCheck/Cron/crontab.fact-transfer (modified) updated cron for qla backup Sat, 04 Feb 2017 16:27:30 GMT Daniela Dorner [18744] * trunk/DataCheck/Transfer/BackupDatabase.sh (modified) fix in path Thu, 02 Feb 2017 03:30:07 GMT Daniela Dorner [18743] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug (for all source 3 sigma limit was used), some cleanup Thu, 02 Feb 2017 02:49:00 GMT Daniela Dorner [18742] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) implemented current triggers in the script Wed, 01 Feb 2017 14:36:48 GMT Daniela Dorner [18741] * trunk/DataCheck/QuickLook/FlareAlerts.sh (added) added (script to handle flare alerts) Wed, 25 Jan 2017 23:43:24 GMT Daniela Dorner [18739] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved logging Wed, 25 Jan 2017 23:42:22 GMT Daniela Dorner [18738] * trunk/DataCheck/Monitoring/InsertSchedule.sh (modified) improved logging Wed, 25 Jan 2017 23:40:10 GMT Daniela Dorner [18737] * trunk/DataCheck/Cron/crontab.fact2 (modified) updated crons for lid- and skycam to get image directly from php Sun, 08 Jan 2017 17:21:53 GMT Daniela Dorner [18723] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) files in the fails folder are considered now "fine" in the context of ... Sat, 07 Jan 2017 15:50:00 GMT Daniela Dorner [18721] * trunk/DataCheck/Processing/CheckRawData.sh (modified) fill information, which is available only at end of run, only when ... Thu, 05 Jan 2017 01:49:08 GMT Daniela Dorner [18710] * trunk/DataCheck/Setup/setup.fact.isdc (modified) new folder for sequences as quota for /scratch full Thu, 05 Jan 2017 00:56:47 GMT Daniela Dorner [18709] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) added backup of QLA to Wue Thu, 05 Jan 2017 00:44:59 GMT Daniela Dorner [18708] * trunk/DataCheck/Processing/CheckAuxFilesAvail.sh (modified) * trunk/DataCheck/Processing/CheckDriveFileAvail.sh (modified) * trunk/DataCheck/Processing/CheckRatesFileAvail.sh (modified) * trunk/DataCheck/Processing/CheckRawFilesAvail.sh (modified) * trunk/DataCheck/Processing/FillAuxCamHum.sh (modified) * trunk/DataCheck/Processing/FillAuxContTemp.sh (modified) * trunk/DataCheck/Processing/FillAuxCtrDev.sh (modified) * trunk/DataCheck/Processing/FillAuxCurrents.sh (modified) * trunk/DataCheck/Processing/FillAuxData.sh (modified) * trunk/DataCheck/Processing/FillAuxTemp.sh (modified) * trunk/DataCheck/Processing/FillAuxThresholds.sh (modified) * trunk/DataCheck/Processing/FillDrsTemp.sh (modified) * trunk/DataCheck/Processing/FillEffectiveOn.sh (modified) * trunk/DataCheck/Setup/setup.fact.isdc (modified) * trunk/DataCheck/Setup/setup.fact.lp.data (modified) avoid warnings for missing files for the first few days; fixed bug in ... Thu, 05 Jan 2017 00:31:54 GMT Daniela Dorner [18707] * trunk/DataCheck/Sourcefile.sh (modified) improved logging Wed, 04 Jan 2017 22:48:46 GMT Daniela Dorner [18706] * trunk/DataCheck/Cron/crontab.fact-transfer (modified) check for errors and warnings only once per day but for connection ... Wed, 04 Jan 2017 22:43:31 GMT Daniela Dorner [18705] * trunk/DataCheck/QuickLook/Step1.sh (modified) improved logging Wed, 04 Jan 2017 22:43:07 GMT Daniela Dorner [18704] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) bugfix (amount of spaces in format had changed) Wed, 04 Jan 2017 22:42:21 GMT Daniela Dorner [18703] * trunk/DataCheck/Cron/crontab.fact1 (modified) check for errors and warnings only once per day but for connection ... Wed, 04 Jan 2017 22:41:35 GMT Daniela Dorner [18702] * trunk/DataCheck/Monitoring/CheckLogs.sh (modified) check for errors and warnings only once per day but for connection ...