# # ChangeLog for trunk/DataCheck # # Generated by Trac 1.5.2 # 11/11/24 16:46:43 Fri, 09 Mar 2012 22:58:38 GMT Daniela Dorner [13056] * trunk/DataCheck/Cron/crontab.fact-transfer (modified) * trunk/DataCheck/Cron/crontab.fact01 (modified) * trunk/DataCheck/Cron/crontab.fact02 (modified) * trunk/DataCheck/Cron/crontab.fact04 (modified) * trunk/DataCheck/Cron/crontab.fact1 (modified) * trunk/DataCheck/Cron/crontab.fact2 (modified) adapted paths in crontab files Fri, 09 Mar 2012 22:27:53 GMT Daniela Dorner [13055] * trunk/DataCheck/Processing/CheckAuxFilesAvail.sh (modified) * trunk/DataCheck/Processing/CheckRawData.sh (modified) * trunk/DataCheck/Processing/CheckRawFilesAvail.sh (modified) * trunk/DataCheck/Processing/FillAuxData.sh (modified) * trunk/DataCheck/Setup/setup.lp.fact (modified) * trunk/DataCheck/Transfer/BackupRawToWue.sh (modified) * trunk/DataCheck/Transfer/RsyncAuxLP.sh (modified) * trunk/DataCheck/Transfer/RsyncRawLP.sh (modified) * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (modified) * trunk/DataCheck/Transfer/ZipRawData.sh (modified) adapted scripts to changes in directory structure Fri, 09 Mar 2012 22:18:35 GMT Daniela Dorner [13054] * trunk/DataCheck/Transfer/BackupAuxToWue.sh (modified) * trunk/DataCheck/Transfer/BackupRawToWue.sh (modified) reworked version of scripts doing backup to Wuerzburg Fri, 09 Mar 2012 22:15:38 GMT Daniela Dorner [13053] * trunk/DataCheck/Transfer/RsyncAuxToISDC.sh (added) * trunk/DataCheck/Transfer/RsyncRawToISDC.sh (added) added (scripts for transfer from LP to ISDC) Fri, 09 Mar 2012 22:13:25 GMT Daniela Dorner [13052] * trunk/DataCheck/Setup/setup.lp.fact (added) added (setup file for processing in La Palma) Fri, 09 Mar 2012 22:12:43 GMT Daniela Dorner [13051] * trunk/DataCheck/Setup/setup.isdc.fact (added) * trunk/DataCheck/Setup/steps_fact_isdc.rc (added) added (setup files for processing at ISDC) Fri, 09 Mar 2012 22:11:44 GMT Daniela Dorner [13050] * trunk/DataCheck/Processing/JobManager.sh (added) added (jobmanager to run callisto and star on a computing cluster Fri, 09 Mar 2012 22:09:54 GMT Daniela Dorner [13049] * trunk/DataCheck/Processing/RunCallisto.sh (added) * trunk/DataCheck/Processing/RunStar.sh (added) added (scripts for callisto and star) Fri, 09 Mar 2012 22:08:27 GMT Daniela Dorner [13048] * trunk/DataCheck/Processing/CheckAuxFilesAvail.sh (added) * trunk/DataCheck/Processing/CheckRawFilesAvail.sh (added) added (scripts to check availability of files) Fri, 09 Mar 2012 22:04:53 GMT Daniela Dorner [13047] * trunk/DataCheck/Transfer/RsyncDBToWue.sh (moved) moved db backup script to transfer directory Fri, 09 Mar 2012 22:03:57 GMT Daniela Dorner [13046] * trunk/DataCheck/Transfer/BackupAuxToWue.sh (moved) * trunk/DataCheck/Transfer/BackupRawToWue.sh (moved) moved rsync scripts to transfer directory Fri, 09 Mar 2012 22:01:08 GMT Daniela Dorner [13045] * trunk/DataCheck/Transfer/RsyncAuxLP.sh (moved) * trunk/DataCheck/Transfer/RsyncRawLP.sh (moved) moved La Palma rsync scripts to transfer directory Fri, 09 Mar 2012 21:28:22 GMT Daniela Dorner [13044] * trunk/DataCheck/Setup (added) added (directory for setup files) Fri, 09 Mar 2012 21:27:01 GMT Daniela Dorner [13043] * trunk/DataCheck/Monitoring/CheckDU.sh (moved) * trunk/DataCheck/Monitoring/CheckNTPDate.sh (moved) * trunk/DataCheck/Monitoring/CheckNetworkStatus.sh (moved) moved check scripts to monitoring directory Fri, 09 Mar 2012 21:23:58 GMT Daniela Dorner [13042] * trunk/DataCheck/CheckRawData.sh (deleted) moved to processing directory Fri, 09 Mar 2012 21:23:26 GMT Daniela Dorner [13041] * trunk/DataCheck/FillAuxData.sh (deleted) moved to processing directory Fri, 09 Mar 2012 21:19:11 GMT Daniela Dorner [13040] * trunk/DataCheck/Processing/FillAuxData.sh (copied) moved FillAuxData.sh to processing directory Fri, 09 Mar 2012 21:18:29 GMT Daniela Dorner [13039] * trunk/DataCheck/Processing/CheckRawData.sh (copied) added queries to fill status tables Fri, 09 Mar 2012 21:12:09 GMT Daniela Dorner [13038] * trunk/DataCheck/Transfer/ZipRawData.sh (moved) moved zipscript to transfer directory Fri, 09 Mar 2012 21:11:09 GMT Daniela Dorner [13037] * trunk/DataCheck/Monitoring (added) added (directory for monitoring scripts) Fri, 09 Mar 2012 21:08:33 GMT Daniela Dorner [13036] * trunk/DataCheck/Sourcefile.sh (modified) * trunk/DataCheck/crontab.coma (deleted) * trunk/DataCheck/crontab.fact-transfer (deleted) * trunk/DataCheck/crontab.fact01 (deleted) * trunk/DataCheck/crontab.fact02 (deleted) * trunk/DataCheck/crontab.fact04 (deleted) * trunk/DataCheck/crontab.fact1 (deleted) * trunk/DataCheck/crontab.fact2 (deleted) moved crontab files to cron directory Fri, 09 Mar 2012 21:07:19 GMT Daniela Dorner [13035] * trunk/DataCheck/Cron/crontab.coma (copied) * trunk/DataCheck/Cron/crontab.fact-transfer (copied) * trunk/DataCheck/Cron/crontab.fact01 (copied) * trunk/DataCheck/Cron/crontab.fact02 (copied) * trunk/DataCheck/Cron/crontab.fact04 (copied) * trunk/DataCheck/Cron/crontab.fact1 (copied) * trunk/DataCheck/Cron/crontab.fact2 (copied) moved crontab files to cron directory Fri, 09 Mar 2012 21:02:56 GMT Daniela Dorner [13034] * trunk/DataCheck/Processing (added) added (directory for processing scripts) Fri, 09 Mar 2012 20:53:36 GMT Daniela Dorner [13033] * trunk/DataCheck/Cron (added) added (directory for crontab files) Fri, 09 Mar 2012 20:50:22 GMT Daniela Dorner [13032] * trunk/DataCheck/Transfer (added) added (directory for transfer scripts) Thu, 01 Mar 2012 22:39:00 GMT Daniela Dorner [12988] * trunk/DataCheck/CheckRawData.sh (modified) fixed typo in mysql query Thu, 01 Mar 2012 15:02:57 GMT Daniela Dorner [12985] * trunk/DataCheck/CheckRawData.sh (modified) removed check for pw-file, adapted check for modification time, added ... Thu, 01 Mar 2012 15:01:43 GMT Daniela Dorner [12984] * trunk/DataCheck/FillAuxData.sh (modified) removed check for pw-file Thu, 01 Mar 2012 11:41:21 GMT Daniela Dorner [12980] * trunk/DataCheck/CheckRawData.sh (modified) * trunk/DataCheck/FillAuxData.sh (modified) * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) * trunk/DataCheck/ZipRawData.sh (modified) unified method to get dates to be processed Thu, 01 Mar 2012 11:32:40 GMT Daniela Dorner [12979] * trunk/DataCheck/FillAuxData.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) small changes in logging Thu, 01 Mar 2012 11:27:46 GMT Daniela Dorner [12978] * trunk/DataCheck/CheckAuxData.sh (deleted) not needed as job is done by FillAuxData.sh Wed, 29 Feb 2012 13:16:26 GMT Daniela Dorner [12972] * trunk/DataCheck/CheckRawData.sh (modified) introduced usage of global logfile and function sendquery Wed, 29 Feb 2012 13:15:36 GMT Daniela Dorner [12971] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) introduced usage of global logfile Wed, 29 Feb 2012 12:39:37 GMT Daniela Dorner [12970] * trunk/DataCheck/ZipRawData.sh (modified) introduced usage of global logfile Wed, 29 Feb 2012 12:30:32 GMT Daniela Dorner [12969] * trunk/DataCheck/FillAuxData.sh (modified) introduced logfile to get trace of fitsfile errors Wed, 29 Feb 2012 11:08:30 GMT Daniela Dorner [12968] * trunk/DataCheck/crontab.fact-transfer (modified) changed MAILTO Thu, 23 Feb 2012 16:55:37 GMT Daniela Dorner [12936] * trunk/DataCheck/Sourcefile.sh (modified) bugfix for ftcopy in cron; adapted paths Thu, 23 Feb 2012 16:54:46 GMT Daniela Dorner [12935] * trunk/DataCheck/FillAuxData.sh (modified) implemented function for getting statistics; usage of sendquery Thu, 23 Feb 2012 16:53:22 GMT Daniela Dorner [12934] * trunk/DataCheck/crontab.fact01 (modified) * trunk/DataCheck/crontab.fact02 (modified) * trunk/DataCheck/crontab.fact04 (modified) * trunk/DataCheck/crontab.fact1 (modified) * trunk/DataCheck/crontab.fact2 (modified) adapted path, changed mailto Thu, 23 Feb 2012 16:49:03 GMT Daniela Dorner [12933] * trunk/DataCheck/CheckRawData.sh (modified) added new variables and further checks Thu, 23 Feb 2012 16:42:14 GMT Daniela Dorner [12932] * trunk/DataCheck/CheckDU.sh (modified) changed limits Thu, 09 Feb 2012 13:37:44 GMT Daniela Dorner [12882] * trunk/DataCheck/crontab.fact1 (modified) adapted times for some scripts Wed, 08 Feb 2012 20:44:49 GMT Daniela Dorner [12876] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) changed time range for bwlimit Wed, 08 Feb 2012 13:12:49 GMT lyard [12873] * trunk/DataCheck/Archive/README (modified) improved readme Wed, 08 Feb 2012 12:33:48 GMT lyard [12871] * trunk/DataCheck/Archive/ENDfixer.cpp (added) * trunk/DataCheck/Archive/MjDtoISO.cpp (added) * trunk/DataCheck/Archive/README (added) * trunk/DataCheck/Archive/RowChecker.cpp (added) * trunk/DataCheck/Archive/associateRunsAndCalibs.sh (added) * trunk/DataCheck/Archive/auxIngest.sh (modified) * trunk/DataCheck/Archive/checkForHeaderUpdatesAux.sh (added) * trunk/DataCheck/Archive/checkForHeaderUpdatesRaw.sh (added) * trunk/DataCheck/Archive/checkRawFileIntegrityAndContent.sh (added) * trunk/DataCheck/Archive/correctFileName.cpp (added) * trunk/DataCheck/Archive/fitsCompare.cpp (added) * trunk/DataCheck/Archive/fixRawKeyWords.sh (modified) * trunk/DataCheck/Archive/rawIngest.sh (modified) * trunk/DataCheck/Archive/repairRawFile.sh (modified) added more scripts Tue, 31 Jan 2012 11:27:05 GMT Daniela Dorner [12798] * trunk/DataCheck/Sourcefile.sh (added) added (file with common definitions etc for FillAuxData.sh and ... Mon, 30 Jan 2012 19:57:07 GMT Daniela Dorner [12789] * trunk/DataCheck/FillAuxData.sh (modified) included further checks and fill more information; common logfile Mon, 30 Jan 2012 19:56:29 GMT Daniela Dorner [12788] * trunk/DataCheck/CheckRawData.sh (modified) included further checks and fill more information; common logfile; ... Tue, 24 Jan 2012 15:42:25 GMT Daniela Dorner [12762] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) adapted rsync options for running ftchecksum on data, but still commented Tue, 24 Jan 2012 15:39:34 GMT Daniela Dorner [12761] * trunk/DataCheck/CheckRawData.sh (modified) path to FACT++ as variable Tue, 24 Jan 2012 15:04:43 GMT Daniela Dorner [12760] * trunk/DataCheck/ZipRawData.sh (modified) implemented ftchecksum but left commented; implemented variable for ... Tue, 17 Jan 2012 11:45:35 GMT lyard [12750] * trunk/DataCheck/Archive (added) * trunk/DataCheck/Archive/ENDfixer (added) * trunk/DataCheck/Archive/ENDfixer.cxx (added) * trunk/DataCheck/Archive/RowChecker (added) * trunk/DataCheck/Archive/RowChecker.cxx (added) * trunk/DataCheck/Archive/auxIngest.sh (added) * trunk/DataCheck/Archive/correctFileName (added) * trunk/DataCheck/Archive/correctFileName.cxx (added) * trunk/DataCheck/Archive/fixAuxKeyWords.sh (added) * trunk/DataCheck/Archive/fixRawKeyWords.sh (added) * trunk/DataCheck/Archive/ingest.sh (added) * trunk/DataCheck/Archive/rawIngest.sh (added) * trunk/DataCheck/Archive/repairAuxFile.sh (added) * trunk/DataCheck/Archive/repairRawFile.sh (added) * trunk/DataCheck/Archive/testNaming.sh (added) added ingest stuff Mon, 16 Jan 2012 13:17:10 GMT Daniela Dorner [12746] * trunk/DataCheck/crontab.fact-transfer (moved) changed name as transfer has been moved to different machine Mon, 16 Jan 2012 13:13:53 GMT Daniela Dorner [12745] * trunk/DataCheck/BackupAuxToWue.sh (modified) * trunk/DataCheck/BackupRawToWue.sh (modified) removed -p from rsync options; adapted home path Mon, 16 Jan 2012 13:11:51 GMT Daniela Dorner [12744] * trunk/DataCheck/crontab.fact-viewer (modified) removed -p from rsync options; adapted home path Mon, 16 Jan 2012 12:26:12 GMT Daniela Dorner [12743] * trunk/DataCheck/crontab.coma (modified) included changes of Watz Sat, 03 Dec 2011 00:15:53 GMT Daniela Dorner [12693] * trunk/DataCheck/crontab.fact1 (modified) added auxiliary fill script Sat, 03 Dec 2011 00:14:59 GMT Daniela Dorner [12692] * trunk/DataCheck/CheckRawData.sh (modified) continue instead of exit in case of unknown runtype Sat, 03 Dec 2011 00:12:44 GMT Daniela Dorner [12691] * trunk/DataCheck/FillAuxData.sh (modified) added filling of information into db Fri, 02 Dec 2011 12:27:11 GMT Daniela Dorner [12684] * trunk/DataCheck/FillAuxData.sh (modified) added more values Thu, 01 Dec 2011 17:39:04 GMT Daniela Dorner [12679] * trunk/DataCheck/FillAuxData.sh (modified) added getting mjd and information from some slow control files Thu, 01 Dec 2011 16:07:27 GMT Daniela Dorner [12676] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) small fix to create new directories Tue, 29 Nov 2011 00:19:49 GMT Daniela Dorner [12664] * trunk/DataCheck/crontab.fact01 (modified) * trunk/DataCheck/crontab.fact02 (modified) * trunk/DataCheck/crontab.fact04 (modified) * trunk/DataCheck/crontab.fact1 (modified) * trunk/DataCheck/crontab.fact2 (modified) updated MAILTO to shift@fact-project.org Mon, 28 Nov 2011 06:49:22 GMT Daniela Dorner [12662] * trunk/DataCheck/FillAuxData.sh (added) added (started writing a script to read data from slow control files) Mon, 28 Nov 2011 03:52:32 GMT Daniela Dorner [12661] * trunk/DataCheck/crontab.coma (added) added (crontab for coma) Mon, 28 Nov 2011 03:21:49 GMT Daniela Dorner [12660] * trunk/DataCheck/CheckAuxData.sh (modified) added notes Mon, 28 Nov 2011 03:20:38 GMT Daniela Dorner [12659] * trunk/DataCheck/CheckRawData.sh (modified) bugfix for update Fri, 25 Nov 2011 06:09:50 GMT Daniela Dorner [12645] * trunk/DataCheck/CheckRawData.sh (modified) changed option for automatic running Fri, 25 Nov 2011 06:07:06 GMT Daniela Dorner [12644] * trunk/DataCheck/CheckRawData.sh (modified) added roitm; added new option Fri, 25 Nov 2011 06:04:15 GMT Daniela Dorner [12643] * trunk/DataCheck/crontab.fact1 (modified) added CheckRawData.sh Fri, 25 Nov 2011 06:03:29 GMT Daniela Dorner [12642] * trunk/DataCheck/CheckDU.sh (modified) during day check for 500 GB, during night during 200 GB Thu, 24 Nov 2011 08:39:46 GMT Daniela Dorner [12633] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) added check if /daq is mounted Thu, 24 Nov 2011 08:38:47 GMT Daniela Dorner [12632] * trunk/DataCheck/CheckRawData.sh (modified) added new values, rearranged checks Thu, 24 Nov 2011 08:38:08 GMT Daniela Dorner [12631] * trunk/DataCheck/CheckDU.sh (modified) added output of df -h Wed, 23 Nov 2011 05:42:34 GMT Daniela Dorner [12623] * trunk/DataCheck/CheckRawData.sh (modified) added new version of start and stop time Wed, 23 Nov 2011 05:41:16 GMT Daniela Dorner [12622] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) added logging Wed, 23 Nov 2011 05:40:28 GMT Daniela Dorner [12621] * trunk/DataCheck/ZipRawData.sh (modified) added some logging Tue, 22 Nov 2011 06:18:09 GMT Daniela Dorner [12609] * trunk/DataCheck/CheckRawData.sh (modified) added new information and checks Mon, 21 Nov 2011 06:58:02 GMT Daniela Dorner [12584] * trunk/DataCheck/CheckAuxData.sh (added) added (script to check aux data files and fill information into database) Mon, 21 Nov 2011 06:57:28 GMT Daniela Dorner [12583] * trunk/DataCheck/CheckRawData.sh (added) added (script to check raw data files and fill information into database) Mon, 21 Nov 2011 06:56:22 GMT Daniela Dorner [12582] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) * trunk/DataCheck/ZipRawData.sh (modified) changed to take into account the current and the 3 previous nights Sun, 20 Nov 2011 07:14:05 GMT Daniela Dorner [12577] * trunk/DataCheck/crontab.fact1 (modified) adapted times of crons Sun, 20 Nov 2011 07:13:35 GMT Daniela Dorner [12576] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) changed to new structure (nfs mount of disk); bugfix Sun, 20 Nov 2011 07:11:38 GMT Daniela Dorner [12575] * trunk/DataCheck/ZipRawData.sh (modified) included algorithm to make sure that only finished files are zipped Sun, 20 Nov 2011 00:11:07 GMT Daniela Dorner [12572] * trunk/DataCheck/crontab.fact01 (modified) fixed typo Sat, 19 Nov 2011 06:06:18 GMT Daniela Dorner [12569] * trunk/DataCheck/crontab.fact1 (modified) changed time for zip cron Sat, 19 Nov 2011 06:05:13 GMT Daniela Dorner [12568] * trunk/DataCheck/crontab.fact01 (modified) added cron to copy db backup Sat, 19 Nov 2011 06:02:41 GMT Daniela Dorner [12567] * trunk/DataCheck/RsyncDBToWue.sh (added) added (script to backup LP DB in Wue) Sat, 19 Nov 2011 04:56:56 GMT Daniela Dorner [12566] * trunk/DataCheck/crontab.fact01 (modified) * trunk/DataCheck/crontab.fact02 (modified) * trunk/DataCheck/crontab.fact04 (modified) * trunk/DataCheck/crontab.fact1 (modified) * trunk/DataCheck/crontab.fact2 (modified) changed MAILTO Sat, 19 Nov 2011 04:56:04 GMT Daniela Dorner [12565] * trunk/DataCheck/BackupAuxToWue.sh (modified) * trunk/DataCheck/BackupRawToWue.sh (modified) minor changes Sat, 19 Nov 2011 04:55:10 GMT Daniela Dorner [12564] * trunk/DataCheck/crontab.fact-viewer (added) added (crontab file for fact_opr on fact-viewer) Sat, 19 Nov 2011 03:49:13 GMT Daniela Dorner [12563] * trunk/DataCheck/BackupRawToWue.sh (added) added (script to rsync raw data to Wuerzburg for backup) Sat, 19 Nov 2011 03:48:41 GMT Daniela Dorner [12562] * trunk/DataCheck/BackupAuxToWue.sh (added) added (script to rsync auxiliary data to Wuerzburg for backup) Sat, 19 Nov 2011 03:45:56 GMT Daniela Dorner [12561] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) * trunk/DataCheck/crontab.fact1 (modified) minor changes Sat, 19 Nov 2011 02:27:07 GMT Daniela Dorner [12560] * trunk/DataCheck/crontab.fact1 (modified) * trunk/DataCheck/crontab.fact2 (modified) adapted times for rsync and diskcheck scripts Sat, 19 Nov 2011 02:25:36 GMT Daniela Dorner [12559] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) implemented bwlimit between 18h and 8h Sat, 19 Nov 2011 02:24:00 GMT Daniela Dorner [12558] * trunk/DataCheck/CheckDU.sh (modified) changed limit to 200 GB Fri, 18 Nov 2011 20:36:54 GMT Daniela Dorner [12557] * trunk/DataCheck/RsyncAux.sh (modified) * trunk/DataCheck/RsyncRaw.sh (modified) changed such that only last night is rsynced Fri, 18 Nov 2011 04:27:53 GMT Daniela Dorner [12554] * trunk/DataCheck/CheckDU.sh (modified) bufix Fri, 18 Nov 2011 02:18:25 GMT Daniela Dorner [12553] * trunk/DataCheck/crontab.fact1 (modified) * trunk/DataCheck/crontab.fact2 (modified) adapted times for disk usage check