#
# ChangeLog for trunk/DataCheck
#
# Generated by Trac 1.5.2
# 09/22/24 10:19:16

Sun, 21 May 2017 09:40:55 GMT Daniela Dorner [18873]
	* trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified)

	fixed small bug in logging


Sun, 21 May 2017 09:34:57 GMT Daniela Dorner [18872]
	* trunk/DataCheck/Transfer/ZipRawData.sh (modified)

	implemented option to use /data1 instead of /scratch


Sun, 21 May 2017 09:33:52 GMT Daniela Dorner [18871]
	* trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified)

	adapted to use proper rsync-temp-dir for each transfer


Sun, 21 May 2017 09:32:54 GMT Daniela Dorner [18870]
	* trunk/DataCheck/Setup/setup.fact.lp.data (modified)

	adapted settings to run QLA and transfer on newdata


Sun, 21 May 2017 09:32:05 GMT Daniela Dorner [18869]
	* trunk/DataCheck/QuickLook/Step1.sh (modified)

	fixed bug and implemented option to use /data1 instead of /scratch


Sun, 14 May 2017 22:38:52 GMT Daniela Dorner [18867]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	adapted logging to usage of newdata


Sun, 14 May 2017 22:31:12 GMT Daniela Dorner [18866]
	* trunk/DataCheck/DataCheck/PlotRatescans.sh (modified)

	adapted path to run on newdata


Sun, 14 May 2017 20:08:31 GMT Daniela Dorner [18864]
	* trunk/DataCheck/Monitoring/FillVisibilities.sh (added)
	* trunk/DataCheck/Monitoring/ToOVisibility.sh (added)

	added (tools to fill satellite visibilities for our sources to the ...


Sun, 14 May 2017 20:05:33 GMT Daniela Dorner [18863]
	* trunk/DataCheck/Transfer/CleanupNewdata.sh (added)

	added (script to clean up newdata)


Sun, 14 May 2017 20:04:52 GMT Daniela Dorner [18862]
	* trunk/DataCheck/Cron/crontab.fact1 (modified)
	* trunk/DataCheck/Cron/crontab.fact2 (modified)

	moved jobs from daq and data to newdata


Sun, 14 May 2017 20:04:17 GMT Daniela Dorner [18861]
	* trunk/DataCheck/Cron/crontab.newdata (added)

	added (crontab file for jobs on newdata)


Sun, 14 May 2017 20:03:07 GMT Daniela Dorner [18860]
	* trunk/DataCheck/Setup/setup.fact.lp.data (modified)

	updated settings to run QLA on newdata


Sun, 14 May 2017 20:02:33 GMT Daniela Dorner [18859]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	fixed bug


Sun, 14 May 2017 20:02:14 GMT Daniela Dorner [18858]
	* trunk/DataCheck/DataCheck/PlotQuality.sh (modified)

	updated to run on newdata


Sun, 14 May 2017 20:01:41 GMT Daniela Dorner [18857]
	* trunk/DataCheck/Monitoring/CheckDU.sh (modified)

	added newdata, improved handling of limits


Sun, 14 May 2017 20:01:03 GMT Daniela Dorner [18856]
	* trunk/DataCheck/Transfer/BackupQLA.sh (modified)

	updated for newdata as download machine in LP


Sun, 14 May 2017 20:00:03 GMT Daniela Dorner [18855]
	* trunk/DataCheck/QuickLook/Step1.sh (modified)

	updated to run on newdata


Sun, 14 May 2017 19:59:09 GMT Daniela Dorner [18854]
	* trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified)

	updated to run on newdata and create a second copy


Sun, 14 May 2017 19:58:29 GMT Daniela Dorner [18853]
	* trunk/DataCheck/Transfer/ZipRawData.sh (modified)

	updated to run on newdata and create a second copy


Sun, 14 May 2017 19:57:08 GMT Daniela Dorner [18852]
	* trunk/DataCheck/Transfer/RsyncAuxToISDC.sh (modified)
	* trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified)

	updated to use newdata instead of data for transferring data


Sun, 14 May 2017 01:29:35 GMT Daniela Dorner [18851]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	adapted as discussed in telcon (implemented warning if files in ...


Sat, 08 Apr 2017 02:17:03 GMT Daniela Dorner [18807]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	improved logging


Sat, 08 Apr 2017 02:16:32 GMT Daniela Dorner [18806]
	* trunk/DataCheck/QuickLook/RunGanymed.sh (modified)

	improve logging (log of numevts.C was overwriting log of ganymed.C)


Sun, 02 Apr 2017 06:04:46 GMT Daniela Dorner [18799]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	fixed bug in xml-filename; only create xml file when alert is new


Mon, 27 Mar 2017 00:09:27 GMT Daniela Dorner [18794]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	fixed bug in binning for queries


Sat, 25 Mar 2017 16:21:36 GMT Daniela Dorner [18793]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	fixed logging


Sat, 25 Mar 2017 06:21:01 GMT Daniela Dorner [18792]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	added average fluxes, added nightly binning for amon


Fri, 24 Mar 2017 00:46:36 GMT Daniela Dorner [18791]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	added check for path


Thu, 23 Mar 2017 13:51:13 GMT Daniela Dorner [18790]
	* trunk/DataCheck/Setup/setup.fact.lp.data (modified)

	added path for flare alert files


Fri, 17 Mar 2017 22:15:26 GMT Daniela Dorner [18784]
	* trunk/DataCheck/Sourcefile.sh (modified)

	adapted to convention of current night used in Step1.sh


Wed, 15 Mar 2017 22:41:43 GMT Daniela Dorner [18783]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	added amon alerts (sending of alert, trigger criteria still to be ...


Wed, 15 Mar 2017 22:32:26 GMT Daniela Dorner [18782]
	* trunk/DataCheck/Sourcefile.sh (modified)

	in case of mysql-warnings skript is also stopped now (after the last ...


Tue, 14 Mar 2017 20:42:06 GMT Daniela Dorner [18779]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	updated notes


Thu, 02 Mar 2017 02:37:07 GMT Daniela Dorner [18778]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	fixed typo


Thu, 02 Mar 2017 02:18:34 GMT Daniela Dorner [18777]
	* trunk/DataCheck/QuickLook/RunGanymed.sh (modified)

	run FlareAlerts.sh only on daq


Wed, 22 Feb 2017 09:45:34 GMT Daniela Dorner [18776]
	* trunk/DataCheck/Processing/FillAuxData.sh (modified)

	bugfix (if filename is empty, function would complain)


Tue, 21 Feb 2017 21:21:56 GMT Daniela Dorner [18775]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	fixed bug and added check


Tue, 21 Feb 2017 20:16:54 GMT Daniela Dorner [18774]
	* trunk/DataCheck/Sourcefile.sh (modified)

	repeat query in case of deadlock


Mon, 20 Feb 2017 21:22:32 GMT Daniela Dorner [18773]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	added decay to type 3, added logging, uncommented sending email


Mon, 20 Feb 2017 21:20:43 GMT Daniela Dorner [18772]
	* trunk/DataCheck/Cron/crontab.fact2 (modified)
	* trunk/DataCheck/QuickLook/RunGanymed.sh (modified)

	added running FlareAlerts.sh


Mon, 20 Feb 2017 13:58:55 GMT Daniela Dorner [18771]
	* trunk/DataCheck/Sourcefile.sh (modified)

	treat ratescan files specially in function check_file_avail


Mon, 20 Feb 2017 13:58:17 GMT Daniela Dorner [18770]
	* trunk/DataCheck/Processing/FillAuxData.sh (modified)
	* trunk/DataCheck/QuickLook/Step1.sh (modified)

	implemented usage of new function check_file_avail


Mon, 20 Feb 2017 13:32:28 GMT Daniela Dorner [18769]
	* trunk/DataCheck/QuickLook/RunCallisto.sh (modified)

	improved logging


Mon, 20 Feb 2017 13:31:08 GMT Daniela Dorner [18768]
	* trunk/DataCheck/Processing/FillAuxLidar.sh (added)

	added (script to fill lidar data to DB)


Mon, 20 Feb 2017 13:29:11 GMT Daniela Dorner [18767]
	* trunk/DataCheck/Sourcefile.sh (modified)

	added function to check file availability with proper severity in ...


Mon, 20 Feb 2017 13:27:42 GMT Daniela Dorner [18766]
	* trunk/DataCheck/Setup/steps_fact_isdc.rc (modified)

	bugfix in join for StarStatus; cleanup


Mon, 20 Feb 2017 13:26:16 GMT Daniela Dorner [18765]
	* trunk/DataCheck/Processing/RunCallisto.sh (modified)
	* trunk/DataCheck/Processing/RunStar.sh (modified)

	addapted to new way of submitting jobs in JobManager


Mon, 20 Feb 2017 13:25:04 GMT Daniela Dorner [18764]
	* trunk/DataCheck/Processing/JobManager.sh (modified)

	rewrote submitting part - now primaries are given in submit to avoid ...


Sat, 18 Feb 2017 15:40:39 GMT Daniela Dorner [18763]
	* trunk/DataCheck/Sourcefile.sh (modified)

	handle empty $numchanged


Sat, 18 Feb 2017 14:08:40 GMT Daniela Dorner [18762]
	* trunk/DataCheck/Sourcefile.sh (modified)

	catch mysql errors and print them to processlog


Sat, 18 Feb 2017 13:51:00 GMT Daniela Dorner [18761]
	* trunk/DataCheck/Sourcefile.sh (modified)

	improved logging


Sat, 18 Feb 2017 13:46:29 GMT Daniela Dorner [18760]
	* trunk/DataCheck/Setup/steps_fact_isdc.rc (modified)
	* trunk/DataCheck/Sourcefile.sh (modified)

	optimized status/processing queries and settings


Sat, 18 Feb 2017 13:44:48 GMT Daniela Dorner [18759]
	* trunk/DataCheck/Processing/BuildSequences.sh (modified)

	improved logging


Sat, 11 Feb 2017 21:44:39 GMT Daniela Dorner [18757]
	* trunk/DataCheck/Processing/BuildSequences.sh (modified)

	added queries to update new columns in DB


Sat, 11 Feb 2017 21:42:36 GMT Daniela Dorner [18756]
	* trunk/DataCheck/Processing/FillRates.sh (modified)

	improved logging


Sat, 11 Feb 2017 21:41:11 GMT Daniela Dorner [18755]
	* trunk/DataCheck/Setup/setup.fact.isdc (modified)

	updated paths for new processing


Sun, 05 Feb 2017 16:46:15 GMT Daniela Dorner [18754]
	* trunk/DataCheck/Processing/FillRates.sh (added)

	added (script to fill artificial trigger rates)


Sat, 04 Feb 2017 20:36:24 GMT Daniela Dorner [18748]
	* trunk/DataCheck/Processing/FillAuxDust.sh (added)

	added (script to fill tng dust info to db)


Sat, 04 Feb 2017 19:51:45 GMT Daniela Dorner [18747]
	* trunk/DataCheck/Transfer/BackupQLA.sh (modified)

	removed debugging output


Sat, 04 Feb 2017 16:41:48 GMT Daniela Dorner [18746]
	* trunk/DataCheck/Transfer/BackupQLA.sh (modified)

	implemented speedup (rsync from/to ISDC took 1.5-2h each)


Sat, 04 Feb 2017 16:28:19 GMT Daniela Dorner [18745]
	* trunk/DataCheck/Cron/crontab.fact-transfer (modified)

	updated cron for qla backup


Sat, 04 Feb 2017 16:27:30 GMT Daniela Dorner [18744]
	* trunk/DataCheck/Transfer/BackupDatabase.sh (modified)

	fix in path


Thu, 02 Feb 2017 03:30:07 GMT Daniela Dorner [18743]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	fixed bug (for all source 3 sigma limit was used), some cleanup


Thu, 02 Feb 2017 02:49:00 GMT Daniela Dorner [18742]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (modified)

	implemented current triggers in the script


Wed, 01 Feb 2017 14:36:48 GMT Daniela Dorner [18741]
	* trunk/DataCheck/QuickLook/FlareAlerts.sh (added)

	added (script to handle flare alerts)


Wed, 25 Jan 2017 23:43:24 GMT Daniela Dorner [18739]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	improved logging


Wed, 25 Jan 2017 23:42:22 GMT Daniela Dorner [18738]
	* trunk/DataCheck/Monitoring/InsertSchedule.sh (modified)

	improved logging


Wed, 25 Jan 2017 23:40:10 GMT Daniela Dorner [18737]
	* trunk/DataCheck/Cron/crontab.fact2 (modified)

	updated crons for lid- and skycam to get image directly from php


Sun, 08 Jan 2017 17:21:53 GMT Daniela Dorner [18723]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	files in the fails folder are considered now "fine" in the context of ...


Sat, 07 Jan 2017 15:50:00 GMT Daniela Dorner [18721]
	* trunk/DataCheck/Processing/CheckRawData.sh (modified)

	fill information, which is available only at end of run, only when ...


Thu, 05 Jan 2017 01:49:08 GMT Daniela Dorner [18710]
	* trunk/DataCheck/Setup/setup.fact.isdc (modified)

	new folder for sequences as quota for /scratch full


Thu, 05 Jan 2017 00:56:47 GMT Daniela Dorner [18709]
	* trunk/DataCheck/Transfer/BackupQLA.sh (modified)

	added backup of QLA to Wue


Thu, 05 Jan 2017 00:44:59 GMT Daniela Dorner [18708]
	* trunk/DataCheck/Processing/CheckAuxFilesAvail.sh (modified)
	* trunk/DataCheck/Processing/CheckDriveFileAvail.sh (modified)
	* trunk/DataCheck/Processing/CheckRatesFileAvail.sh (modified)
	* trunk/DataCheck/Processing/CheckRawFilesAvail.sh (modified)
	* trunk/DataCheck/Processing/FillAuxCamHum.sh (modified)
	* trunk/DataCheck/Processing/FillAuxContTemp.sh (modified)
	* trunk/DataCheck/Processing/FillAuxCtrDev.sh (modified)
	* trunk/DataCheck/Processing/FillAuxCurrents.sh (modified)
	* trunk/DataCheck/Processing/FillAuxData.sh (modified)
	* trunk/DataCheck/Processing/FillAuxTemp.sh (modified)
	* trunk/DataCheck/Processing/FillAuxThresholds.sh (modified)
	* trunk/DataCheck/Processing/FillDrsTemp.sh (modified)
	* trunk/DataCheck/Processing/FillEffectiveOn.sh (modified)
	* trunk/DataCheck/Setup/setup.fact.isdc (modified)
	* trunk/DataCheck/Setup/setup.fact.lp.data (modified)

	avoid warnings for missing files for the first few days; fixed bug in ...


Thu, 05 Jan 2017 00:31:54 GMT Daniela Dorner [18707]
	* trunk/DataCheck/Sourcefile.sh (modified)

	improved logging


Wed, 04 Jan 2017 22:48:46 GMT Daniela Dorner [18706]
	* trunk/DataCheck/Cron/crontab.fact-transfer (modified)

	check for errors and warnings only once per day but for connection ...


Wed, 04 Jan 2017 22:43:31 GMT Daniela Dorner [18705]
	* trunk/DataCheck/QuickLook/Step1.sh (modified)

	improved logging


Wed, 04 Jan 2017 22:43:07 GMT Daniela Dorner [18704]
	* trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified)

	bugfix (amount of spaces in format had changed)


Wed, 04 Jan 2017 22:42:21 GMT Daniela Dorner [18703]
	* trunk/DataCheck/Cron/crontab.fact1 (modified)

	check for errors and warnings only once per day but for connection ...


Wed, 04 Jan 2017 22:41:35 GMT Daniela Dorner [18702]
	* trunk/DataCheck/Monitoring/CheckLogs.sh (modified)

	check for errors and warnings only once per day but for connection ...


Wed, 21 Dec 2016 12:37:49 GMT Daniela Dorner [18701]
	* trunk/DataCheck/DataCheck/InfoForMWL.sh (modified)
	* trunk/DataCheck/QuickLook/SendData.sh (modified)
	* trunk/DataCheck/QuickLook/SendData_Internal.sh (modified)
	* trunk/DataCheck/Sourcefile.sh (modified)
	* trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified)

	fixed bug (variable pwfile occured twice -> renamed)


Wed, 21 Dec 2016 12:36:32 GMT Daniela Dorner [18700]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	improved logging


Tue, 20 Dec 2016 15:30:17 GMT Daniela Dorner [18699]
	* trunk/DataCheck/Processing/CheckRawFilesAvail.sh (modified)

	give warning only for last year (to avoid getting warnings for files ...


Tue, 20 Dec 2016 15:25:21 GMT Daniela Dorner [18698]
	* trunk/DataCheck/Processing/FillAuxData.sh (modified)

	improved logging


Mon, 19 Dec 2016 14:29:46 GMT Daniela Dorner [18697]
	* trunk/DataCheck/DataCheck/InfoForMWL.sh (modified)

	fixed typo in mysql query


Sun, 18 Dec 2016 23:47:05 GMT Daniela Dorner [18696]
	* trunk/DataCheck/Processing/FillRatescans.sh (modified)

	optimized logging


Sun, 18 Dec 2016 23:46:44 GMT Daniela Dorner [18695]
	* trunk/DataCheck/DataCheck/InfoForMWL.sh (modified)

	introduced usage of file for mysql pw to avoid warnings


Sun, 18 Dec 2016 23:46:07 GMT Daniela Dorner [18694]
	* trunk/DataCheck/QuickLook/SendData.sh (modified)
	* trunk/DataCheck/QuickLook/SendData_Internal.sh (modified)
	* trunk/DataCheck/Setup/setup.fact.lp.data (modified)
	* trunk/DataCheck/Setup/setup.fact.lp.gate (modified)
	* trunk/DataCheck/Sourcefile.sh (modified)

	introduced usage of file for mysql pw to avoid warnings


Sun, 18 Dec 2016 23:43:58 GMT Daniela Dorner [18693]
	* trunk/DataCheck/Monitoring/InsertSchedule.sh (modified)

	removed not needed output


Sun, 18 Dec 2016 23:43:08 GMT Daniela Dorner [18692]
	* trunk/DataCheck/Monitoring/CheckSwiftSchedule.sh (modified)

	changed from https to http as certificate caused problems after ...


Sun, 18 Dec 2016 23:42:16 GMT Daniela Dorner [18691]
	* trunk/DataCheck/Monitoring/CheckNetworkStatus.sh (modified)

	adapted to account for additional eths


Sun, 18 Dec 2016 23:41:29 GMT Daniela Dorner [18690]
	* trunk/DataCheck/Monitoring/CheckNTPDate.sh (modified)

	updated mysql access after system upgrade


Sun, 18 Dec 2016 20:56:56 GMT Daniela Dorner [18687]
	* trunk/DataCheck/Processing/FillNumEvts.sh (modified)

	improved logging


Sun, 18 Dec 2016 20:54:38 GMT Daniela Dorner [18686]
	* trunk/DataCheck/Transfer/BackupRawToWue.sh (modified)

	improved logging


Sun, 18 Dec 2016 20:50:56 GMT Daniela Dorner [18685]
	* trunk/DataCheck/Transfer/CheckTransfer.sh (modified)

	improved logging


Sun, 18 Dec 2016 20:49:49 GMT Daniela Dorner [18684]
	* trunk/DataCheck/QuickLook/Step2a.sh (modified)

	improved logging


Sun, 18 Dec 2016 20:48:47 GMT Daniela Dorner [18683]
	* trunk/DataCheck/Setup/setup.fact.isdc (modified)

	updated paths for libraries and added MC paths


Sun, 18 Dec 2016 18:38:15 GMT Daniela Dorner [18682]
	* trunk/DataCheck/Processing/FillAuxData.sh (modified)

	improved logging


Wed, 02 Nov 2016 03:40:15 GMT Daniela Dorner [18672]
	* trunk/DataCheck/QuickLook/SendData.sh (added)
	* trunk/DataCheck/QuickLook/SendData_Internal.sh (added)

	added (scripts for the download websites)


Wed, 02 Nov 2016 03:33:54 GMT Daniela Dorner [18671]
	* trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified)

	changed back to not using the rsync server which was gone after the ...


Wed, 02 Nov 2016 03:33:32 GMT Daniela Dorner [18670]
	* trunk/DataCheck/Transfer/BackupQLA.sh (modified)

	changed back to not using the rsync server which was gone after the ...