Solar cron jobs - switchover to RAL commanding 2011

Back to Jobs

Solar cron jobs - switchover to RAL commanding 2011

As part of the process of switching CDS commanding from GSFC to RAL the crontab system needed updating. Previously, all CDS Fits files were made at GSFC (by fitsgen on the cdso7 machine) and then rsynced to solar@RAL:/cdsfits/arch32.

To reflect the change in direction required of some jobs, the original cron job was renamed as "gsfc.command.crontab". This was then copied as "ral.command.crontab" and edited (see both files using the links below).

Since RAL took over commanding the crontab file "ral.command.crontab" has been used.

These "directional" changes involved rsycing CDS Fits files - which are now created at RAL (by fitsgen on newsolar) back to cdso7@GSFC. Other rsync jobs have been reversed to flow from RAL to GSFC, (for example; update_cds_lrg_data and the update_cds_eofcs_db_* jobs).

However, it's important to point out that not all cron jobs are to be reversed (for example; the solarsoft updates).

Up until now, 2 cron jobs ran on cdso7. One of these was "update_soho_private_data" and remains unaffected.

Changes to cron jobs

The other job (2 actually) rsynced the new CDS Fits files from cdso7 where they were made (by fitsgen) to solar@RAL. The crontab file on cdso7 included the following lines;

# Update solar with new cdsfits images
00 03 * * * /home/master/cron/update_cdsfits_arch31
30 03 * * * /home/master/cron/update_cdsfits_arch32
The first script is;
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
#! /bin/bash
find /cdsfits/arch31/ -type f -name "*.fits" -mtime -5 > /home/master/cron/include-new-fits
FTS_RSYNC="rsync -avz --force --delete -e ssh"
INCLUDE_NEW=" --include-from=/home/master/cron/include-new-fits"
#CDS="master@cdso7.nascom.nasa.gov"
SOLAR="master@solar"
# rsync the EIT archive
$FTS_RSYNC $INCLUDE_NEW /cdsfits/arch31/ $SOLAR:/cdsfits/arch31
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
and the second one (arch_32) is the same, except replace 31 with 32. So, 2 things;
  1. comment out those jobs from the cdso7 crontab file
  2. copy those cron jobs to solar, and edit them accordingly
  3. Done on 18-Jul-2011
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
#! /bin/bash
find /cdsfits/arch31/ -type f -name "*.fits" -mtime -5 > /home/master/rsync/include-new-fits
FTS_RSYNC="rsync -avz --force --delete -e ssh"
INCLUDE_NEW=" --include-from=/home/master/rsync/include-new-fits"
CDS="master@cdso7.nascom.nasa.gov"
#SOLAR="master@solar"
# rsync the EIT archive
$FTS_RSYNC $INCLUDE_NEW /cdsfits/arch31/ $CDS:/cdsfits/arch31
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done on 18-Jul-2011. Everything appears to be running successfully!!


Back to Jobs

This page is maintained by J. Rainnie