# # ChangeLog for trunk/DataCheck # # Generated by Trac 1.5.2 # 11/22/24 08:19:46 Fri, 11 Jan 2019 23:38:53 GMT Daniela Dorner [19425] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) print schedule to cron email if a source is found, add only to ... Tue, 08 Jan 2019 14:28:21 GMT Daniela Dorner [19424] * trunk/DataCheck/Tools/fill_r750.sh (modified) added comments and functionality to fill only corrected R750 and not ... Mon, 07 Jan 2019 21:40:32 GMT Daniela Dorner [19422] * trunk/DataCheck/Tools/fill_r750.sh (modified) added values for new period, bugfix for period 71 Thu, 15 Nov 2018 13:26:53 GMT Daniela Dorner [19401] * trunk/DataCheck/Monitoring/InsertSchedule.sh (modified) fixed FACT++ path Thu, 15 Nov 2018 13:25:14 GMT Daniela Dorner [19400] * trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified) changed from lynx to links to deal with non-valid certificates Thu, 15 Nov 2018 13:24:06 GMT Daniela Dorner [19399] * trunk/DataCheck/Processing/CalcSource.sh (modified) * trunk/DataCheck/Processing/FillEvents.sh (modified) improved logging, added ignore-option for filling events Tue, 11 Sep 2018 14:15:39 GMT Daniela Dorner [19228] * trunk/DataCheck/Tools/fill_r750.sh (modified) added reference values for last periods Mon, 03 Sep 2018 20:18:23 GMT Daniela Dorner [19209] * trunk/DataCheck/Sourcefile.sh (modified) fixed bug in setstatus, changed order of processing Fri, 31 Aug 2018 16:31:22 GMT Daniela Dorner [19202] * trunk/DataCheck/Processing/CheckRawData.sh (modified) added filling of FileID Fri, 31 Aug 2018 16:24:07 GMT Daniela Dorner [19201] * trunk/DataCheck/Processing/FillAuxContTemp.sh (modified) * trunk/DataCheck/Processing/FillAuxCtrDev.sh (modified) * trunk/DataCheck/Processing/FillAuxCurrents.sh (modified) * trunk/DataCheck/Processing/FillAuxDust.sh (modified) * trunk/DataCheck/Processing/FillAuxLidar.sh (modified) * trunk/DataCheck/Processing/FillAuxMagic.sh (modified) * trunk/DataCheck/Processing/FillAuxThresholds.sh (modified) * trunk/DataCheck/Processing/FillDrsTemp.sh (modified) * trunk/DataCheck/Processing/FillEffectiveOn.sh (modified) usage of check_file_avail function Fri, 31 Aug 2018 16:17:49 GMT Daniela Dorner [19200] * trunk/DataCheck/Setup/setup.fact.isdc (modified) datapath for new processing, simplified mysqlsetup, new sw-versions Fri, 31 Aug 2018 16:16:55 GMT Daniela Dorner [19199] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) added setup for StarEventsFilled and CalcSource Fri, 31 Aug 2018 16:16:24 GMT Daniela Dorner [19198] * trunk/DataCheck/Sourcefile.sh (modified) fixed bug in joins, simplified mysql-setup Fri, 31 Aug 2018 16:13:24 GMT Daniela Dorner [19197] * trunk/DataCheck/Processing/CalcSource.sh (added) added (script to calculate source position for star events in DB) Fri, 31 Aug 2018 16:12:34 GMT Daniela Dorner [19196] * trunk/DataCheck/Processing/FillEvents.sh (added) added (script to fill star events to DB) Fri, 31 Aug 2018 16:11:57 GMT Daniela Dorner [19195] * trunk/DataCheck/Tools/Step2a-short.sh (added) fast version of Step2a Tue, 14 Aug 2018 10:33:28 GMT Daniela Dorner [19161] * trunk/DataCheck/Cron/crontab.fact-viewer (modified) updated times, added FillRates.sh Thu, 19 Jul 2018 17:45:51 GMT Daniela Dorner [19066] * trunk/DataCheck/Tools/get_data.sh (modified) updated policy, headers and email-adresses Tue, 17 Jul 2018 23:23:20 GMT Daniela Dorner [19059] * trunk/DataCheck/Tools/get_data.sh (modified) fixed small bug, updated header Tue, 17 Jul 2018 23:02:10 GMT Daniela Dorner [19057] * trunk/DataCheck/Tools/get_data.sh (modified) fixed some small bugs, added information to header Fri, 29 Jun 2018 18:13:37 GMT Daniela Dorner [19044] * trunk/DataCheck/Tools/get_data.sh (modified) added sending email Fri, 29 Jun 2018 17:33:52 GMT Daniela Dorner [19043] * trunk/DataCheck/Tools/get_data.sh (modified) added data usage policy Fri, 29 Jun 2018 17:11:56 GMT Daniela Dorner [19042] * trunk/DataCheck/Tools/get_data.sh (modified) added all options needed for download.php Fri, 29 Jun 2018 11:16:23 GMT Daniela Dorner [19040] * trunk/DataCheck/Tools/check_torque_warning.sh (added) * trunk/DataCheck/Tools/check_torque_warning2.sh (added) scripts to check for drive problem Fri, 29 Jun 2018 10:56:03 GMT Daniela Dorner [19039] * trunk/DataCheck/Tools/get_data.sh (modified) updated notes Fri, 29 Jun 2018 10:54:09 GMT Daniela Dorner [19038] * trunk/DataCheck/Tools/get_data.sh (modified) made datacheck switchable and allow for own custom-made datacheck Fri, 29 Jun 2018 10:31:52 GMT Daniela Dorner [19037] * trunk/DataCheck/Tools/get_data.sh (modified) added R750 and CUfactor to internal output Fri, 29 Jun 2018 10:06:29 GMT Daniela Dorner [19036] * trunk/DataCheck/Tools/get_data.sh (modified) some cleanup and comments added Fri, 29 Jun 2018 09:46:29 GMT Daniela Dorner [19035] * trunk/DataCheck/Tools/get_data.sh (modified) added zd and th for min-binned queries to internal file, allow ... Thu, 28 Jun 2018 14:49:59 GMT Daniela Dorner [19033] * trunk/DataCheck/Tools/get_data.sh (modified) added tutorial, added comments, restructured query functions, added ... Thu, 28 Jun 2018 12:05:39 GMT Daniela Dorner [19032] * trunk/DataCheck/Tools/get_data.sh (modified) added readme Wed, 27 Jun 2018 02:20:49 GMT Daniela Dorner [19031] * trunk/DataCheck/Tools/get_data.sh (modified) fixed bug Tue, 26 Jun 2018 23:42:38 GMT Daniela Dorner [19030] * trunk/DataCheck/Tools/get_data.sh (modified) added host Tue, 26 Jun 2018 22:50:49 GMT Daniela Dorner [19029] * trunk/DataCheck/Tools/get_data.sh (modified) some cleanup Tue, 26 Jun 2018 22:34:00 GMT Daniela Dorner [19028] * trunk/DataCheck/Tools/get_data.sh (modified) updated data check, fixed order by, fixed bug, added more comments ... Wed, 13 Jun 2018 01:56:37 GMT Daniela Dorner [19019] * trunk/DataCheck/Tools/fill_r750.sh (modified) added and updated reference values and formula for corrected R750 Fri, 09 Feb 2018 23:04:39 GMT Daniela Dorner [18945] * trunk/DataCheck/Processing/FillAuxCam.sh (modified) moved filling of camera temperature to this script Fri, 09 Feb 2018 23:03:23 GMT Daniela Dorner [18944] * trunk/DataCheck/Processing/FillAuxMagic.sh (modified) added new values Fri, 09 Feb 2018 12:48:39 GMT Daniela Dorner [18941] * trunk/DataCheck/Processing/FillAuxCam.sh (moved) renamed script to better suit planned upd Fri, 09 Feb 2018 12:47:32 GMT Daniela Dorner [18940] * trunk/DataCheck/Processing/FillAuxMagic.sh (moved) renamed script to better suit planned upd Sun, 28 Jan 2018 20:12:20 GMT Daniela Dorner [18939] * trunk/DataCheck/Tools/fill_r750.sh (modified) updated correction formula and reference values for periods Fri, 26 Jan 2018 23:19:00 GMT Daniela Dorner [18938] * trunk/DataCheck/Setup/setup.fact.isdc (modified) * trunk/DataCheck/Setup/setup.fact.wue (modified) added encryption for mysql Mon, 22 Jan 2018 23:21:30 GMT Daniela Dorner [18937] * trunk/DataCheck/Tools/fill_r750.sh (added) added (script to fill corrected R750 and references) Sat, 02 Dec 2017 21:11:10 GMT Daniela Dorner [18935] * trunk/DataCheck/Processing/FillRates.sh (modified) added more values for artificial trigger rate Thu, 14 Sep 2017 22:22:39 GMT Daniela Dorner [18906] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed two bugs, added filling of informaion in DB Fri, 04 Aug 2017 13:40:42 GMT Daniela Dorner [18895] * trunk/DataCheck/Tools (added) * trunk/DataCheck/Tools/get_data.sh (added) * trunk/DataCheck/Tools/prepare_db.sh (added) added (tools to get data/fluxes from DB) Sun, 21 May 2017 09:42:02 GMT Daniela Dorner [18875] * trunk/DataCheck/Transfer/RsyncAuxToISDC.sh (modified) adapted to use newdata instead of data for transfer Sun, 21 May 2017 09:41:23 GMT Daniela Dorner [18874] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) added additional check for QLA results Sun, 21 May 2017 09:40:55 GMT Daniela Dorner [18873] * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified) fixed small bug in logging Sun, 21 May 2017 09:34:57 GMT Daniela Dorner [18872] * trunk/DataCheck/Transfer/ZipRawData.sh (modified) implemented option to use /data1 instead of /scratch Sun, 21 May 2017 09:33:52 GMT Daniela Dorner [18871] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) adapted to use proper rsync-temp-dir for each transfer Sun, 21 May 2017 09:32:54 GMT Daniela Dorner [18870] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) adapted settings to run QLA and transfer on newdata Sun, 21 May 2017 09:32:05 GMT Daniela Dorner [18869] * trunk/DataCheck/QuickLook/Step1.sh (modified) fixed bug and implemented option to use /data1 instead of /scratch Sun, 14 May 2017 22:38:52 GMT Daniela Dorner [18867] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) adapted logging to usage of newdata Sun, 14 May 2017 22:31:12 GMT Daniela Dorner [18866] * trunk/DataCheck/DataCheck/PlotRatescans.sh (modified) adapted path to run on newdata Sun, 14 May 2017 20:08:31 GMT Daniela Dorner [18864] * trunk/DataCheck/Monitoring/FillVisibilities.sh (added) * trunk/DataCheck/Monitoring/ToOVisibility.sh (added) added (tools to fill satellite visibilities for our sources to the ... Sun, 14 May 2017 20:05:33 GMT Daniela Dorner [18863] * trunk/DataCheck/Transfer/CleanupNewdata.sh (added) added (script to clean up newdata) Sun, 14 May 2017 20:04:52 GMT Daniela Dorner [18862] * trunk/DataCheck/Cron/crontab.fact1 (modified) * trunk/DataCheck/Cron/crontab.fact2 (modified) moved jobs from daq and data to newdata Sun, 14 May 2017 20:04:17 GMT Daniela Dorner [18861] * trunk/DataCheck/Cron/crontab.newdata (added) added (crontab file for jobs on newdata) Sun, 14 May 2017 20:03:07 GMT Daniela Dorner [18860] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) updated settings to run QLA on newdata Sun, 14 May 2017 20:02:33 GMT Daniela Dorner [18859] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug Sun, 14 May 2017 20:02:14 GMT Daniela Dorner [18858] * trunk/DataCheck/DataCheck/PlotQuality.sh (modified) updated to run on newdata Sun, 14 May 2017 20:01:41 GMT Daniela Dorner [18857] * trunk/DataCheck/Monitoring/CheckDU.sh (modified) added newdata, improved handling of limits Sun, 14 May 2017 20:01:03 GMT Daniela Dorner [18856] * trunk/DataCheck/Transfer/BackupQLA.sh (modified) updated for newdata as download machine in LP Sun, 14 May 2017 20:00:03 GMT Daniela Dorner [18855] * trunk/DataCheck/QuickLook/Step1.sh (modified) updated to run on newdata Sun, 14 May 2017 19:59:09 GMT Daniela Dorner [18854] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) updated to run on newdata and create a second copy Sun, 14 May 2017 19:58:29 GMT Daniela Dorner [18853] * trunk/DataCheck/Transfer/ZipRawData.sh (modified) updated to run on newdata and create a second copy Sun, 14 May 2017 19:57:08 GMT Daniela Dorner [18852] * trunk/DataCheck/Transfer/RsyncAuxToISDC.sh (modified) * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified) updated to use newdata instead of data for transferring data Sun, 14 May 2017 01:29:35 GMT Daniela Dorner [18851] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) adapted as discussed in telcon (implemented warning if files in ... Sat, 08 Apr 2017 02:17:03 GMT Daniela Dorner [18807] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) improved logging Sat, 08 Apr 2017 02:16:32 GMT Daniela Dorner [18806] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) improve logging (log of numevts.C was overwriting log of ganymed.C) Sun, 02 Apr 2017 06:04:46 GMT Daniela Dorner [18799] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug in xml-filename; only create xml file when alert is new Mon, 27 Mar 2017 00:09:27 GMT Daniela Dorner [18794] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed bug in binning for queries Sat, 25 Mar 2017 16:21:36 GMT Daniela Dorner [18793] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) fixed logging Sat, 25 Mar 2017 06:21:01 GMT Daniela Dorner [18792] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added average fluxes, added nightly binning for amon Fri, 24 Mar 2017 00:46:36 GMT Daniela Dorner [18791] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added check for path Thu, 23 Mar 2017 13:51:13 GMT Daniela Dorner [18790] * trunk/DataCheck/Setup/setup.fact.lp.data (modified) added path for flare alert files Fri, 17 Mar 2017 22:15:26 GMT Daniela Dorner [18784] * trunk/DataCheck/Sourcefile.sh (modified) adapted to convention of current night used in Step1.sh Wed, 15 Mar 2017 22:41:43 GMT Daniela Dorner [18783] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added amon alerts (sending of alert, trigger criteria still to be ... Wed, 15 Mar 2017 22:32:26 GMT Daniela Dorner [18782] * trunk/DataCheck/Sourcefile.sh (modified) in case of mysql-warnings skript is also stopped now (after the last ... Tue, 14 Mar 2017 20:42:06 GMT Daniela Dorner [18779] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) updated notes Thu, 02 Mar 2017 02:37:07 GMT Daniela Dorner [18778] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) fixed typo Thu, 02 Mar 2017 02:18:34 GMT Daniela Dorner [18777] * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) run FlareAlerts.sh only on daq Wed, 22 Feb 2017 09:45:34 GMT Daniela Dorner [18776] * trunk/DataCheck/Processing/FillAuxData.sh (modified) bugfix (if filename is empty, function would complain) Tue, 21 Feb 2017 21:21:56 GMT Daniela Dorner [18775] * trunk/DataCheck/Transfer/CheckTransfer.sh (modified) fixed bug and added check Tue, 21 Feb 2017 20:16:54 GMT Daniela Dorner [18774] * trunk/DataCheck/Sourcefile.sh (modified) repeat query in case of deadlock Mon, 20 Feb 2017 21:22:32 GMT Daniela Dorner [18773] * trunk/DataCheck/QuickLook/FlareAlerts.sh (modified) added decay to type 3, added logging, uncommented sending email Mon, 20 Feb 2017 21:20:43 GMT Daniela Dorner [18772] * trunk/DataCheck/Cron/crontab.fact2 (modified) * trunk/DataCheck/QuickLook/RunGanymed.sh (modified) added running FlareAlerts.sh Mon, 20 Feb 2017 13:58:55 GMT Daniela Dorner [18771] * trunk/DataCheck/Sourcefile.sh (modified) treat ratescan files specially in function check_file_avail Mon, 20 Feb 2017 13:58:17 GMT Daniela Dorner [18770] * trunk/DataCheck/Processing/FillAuxData.sh (modified) * trunk/DataCheck/QuickLook/Step1.sh (modified) implemented usage of new function check_file_avail Mon, 20 Feb 2017 13:32:28 GMT Daniela Dorner [18769] * trunk/DataCheck/QuickLook/RunCallisto.sh (modified) improved logging Mon, 20 Feb 2017 13:31:08 GMT Daniela Dorner [18768] * trunk/DataCheck/Processing/FillAuxLidar.sh (added) added (script to fill lidar data to DB) Mon, 20 Feb 2017 13:29:11 GMT Daniela Dorner [18767] * trunk/DataCheck/Sourcefile.sh (modified) added function to check file availability with proper severity in ... Mon, 20 Feb 2017 13:27:42 GMT Daniela Dorner [18766] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) bugfix in join for StarStatus; cleanup Mon, 20 Feb 2017 13:26:16 GMT Daniela Dorner [18765] * trunk/DataCheck/Processing/RunCallisto.sh (modified) * trunk/DataCheck/Processing/RunStar.sh (modified) addapted to new way of submitting jobs in JobManager Mon, 20 Feb 2017 13:25:04 GMT Daniela Dorner [18764] * trunk/DataCheck/Processing/JobManager.sh (modified) rewrote submitting part - now primaries are given in submit to avoid ... Sat, 18 Feb 2017 15:40:39 GMT Daniela Dorner [18763] * trunk/DataCheck/Sourcefile.sh (modified) handle empty $numchanged Sat, 18 Feb 2017 14:08:40 GMT Daniela Dorner [18762] * trunk/DataCheck/Sourcefile.sh (modified) catch mysql errors and print them to processlog Sat, 18 Feb 2017 13:51:00 GMT Daniela Dorner [18761] * trunk/DataCheck/Sourcefile.sh (modified) improved logging Sat, 18 Feb 2017 13:46:29 GMT Daniela Dorner [18760] * trunk/DataCheck/Setup/steps_fact_isdc.rc (modified) * trunk/DataCheck/Sourcefile.sh (modified) optimized status/processing queries and settings