CDS Atlas

This is a description of the procedure to create the CDS Atlas data and webpages.

Fixing up the year and month droplist menus on the Atlas front page. Added on Weds 23-Feb-2011

You know, these ones;


Go to "master@solar:/usr/.../atlas/atlas.shtml" and make sure;
  1. The current year is in the big list; like
    // fill array newCat();
    OO("January ","../cds_images/atlas_201101.html");
    OO("February ","../cds_images/atlas_201102.html");
    etc, and so forth.

  2. Edit the "function relate(formName,elementNum,j) {" function. Make sure in the loop the line;
    j=j+(2011-year)
    is modified to the current year (in this case 2011, it was 2008).

  1. The cron job "head_cat-and-mk_atlas.cron" runs on Solar

    2. 20 8 * * * /home/master/cron/head_cat-and-mk_atlas.cron

    This script is;
    #!/usr/bin/csh
    #
    # batch job to process headcat and once completed to continue processing mk_atlas.
    #
    # Jeff Payne V1.0 11 Jan 2000
    # Modified by A Matheson & J Rainnie 9/8/2007. Moved to Solar and updated.
    #
    /home/master/cron/head_cat_cron
    #
    /home/master/cron/mk_atlas_cron_all

    So this job calls 2 scripts - and are detailed below.

  2. head_cat_cron

    3. This job serves to update the FITS Header catalogue (headcat) for this year and last year. The actual source is here and a summary is shown below.

    #!/usr/bin/csh
    source ~/.cshrc
    cidl<<done
    add_path,'/home/master/atlas/IDL_prog'
    .r use_eof_cat
    .r use_eof_data
    .r write_gif
    set_plot,'X'
    window,0,xs=600,ys=650
    ;
    ; update this and the previous year's catalogue
    ;
    get_utc,utc
    thisyear = fix(strmid(anytim2cal(utc,form=11),0,4))
    mk_head_cat,update=2,/all,year=(thisyear-1)
    mk_head_cat,update=2,/all,year=thisyear
    ;
    done
    echo "end of script"

    This script


    hc_update and newfits file

    The procedure mk_head_cat is called with the keyword "update" (and is by default "update = 2"). This value specifies the number of previous days the update should cover, where "update = 2" means update for any files created/modified in the last 2 days.

  3. mk_atlas_cron_all

    4. The actual source is here.
    This script performs a variety of jobs, including creating the jpeg images for each FITS file and updating the corresponding monthly webpages (eg; /archive/private/data/cds/html/atlas_200708.html).

  4. Full Sun Mosaics

    5. Selecting a date (eg: 19-Dec-2005) using the drop-list and clicking "Go" will load the webpage ../cds_images/fsun_mosaics/s34062.jpg. These images are located here: /archive/private/data/cds/html/fsun_mosaics and are named according to study number (eg: s34062.jpg).

    These files are created by the IDL routine /home/master/site/create_mosaic.pro (this directory also includes multi_create_mosaic.pro). This routine requires a study number; eg:

    OK, this is a MANUAL job. It is NOT called by the Atlas job. Here's what to do;


  5. Synoptic Maps

    6. The procedure mk_syn_atlas is called as part of the Atlas job.

    Selecting a year (eg: 2008) using the drop-list and clicking "Go" will load the webpage ../cds_images/synoptic/2008/. The 2008 (and other) sub-directories are located here: /archive/private/data/cds/atlas/synoptic/.

    This webpage lists the contents of those directories. It contains files of the form svn_yyyymmdd.jpg These are produced by the (IDL) procedure mk_syn_atlas after calling show_synoptic which actually stitches the appropriate FITS files together.

    The latter procedure looks for the relevant FITS files in

    /sohos1/eofcs/lrg_data/summary/    (environment variable is CDS_SUMMARY_DATA)
    of the form
    scds_*_me_yyyymmdd_*.fts
    There should be between 5 and 8 FITS files for a given day - these will be stitched together.

    These FITS files are rsynced from GSFC, by the cron job $HOME/rsync/update_cds_lrg_summ.


Notes

Manually seeding 2008 headcat

It appears that the creation of the 2008 headcat didn't happen automatically. Here's what I did to generate it.

First of all, make sure the routine /cs/idl/cds_util/misc/headcat.pro has the new year in its CASE statement!

This also applies to the routine /cs/idl/cds_util/misc/mk_head_cat.


Manually running mk_atlas

It appears that invoking CIDL from a cron job will not set up the display properly...hence the Atlas jpegs will not be plotted and saved. This may be run manually by starting CIDL and;

use_eof_cat
use_eof_data
add_path,'/home/master/atlas/IDL_prog'
  1. Previous newfits file
    pathName = '/usr/local/html_docs/software/cron_jobs/newfits_dir'
    fileName = concat_dir( pathName , 'newfits_yyymmdd_hhmmss')
  2. Current newfits file
    fileName = concat_dir( 'CDS_HEAD_CAT' , 'newfits')
f = rd_ascii(fileName)
mk_atlas , f , /ALL

newfits

A file consisting of the full filenames of newly acquired FITS files is updated in /cs/lrg_data/headcat/newfits. This file is produced by the IDL procedure /home/master/atlas/IDL_prog/hc_update.pro which searches the FITS data directories and creates a list of files that have arrived (rsync'ed from GSFC) in the specified time interval (by default update=2 days). Here is an example from 29-Aug-2007.
This is a listing of the newfits files.

ral_file_loc

The save file /cs/lrg_data/headcat/ral_file_loc which is a string array of all the CDS FITS filenames; 
    IDL> help,concat_dir('$CDS_HEAD_CAT','ral_file_loc')
        STRING    = '/cs/lrg_data/headcat/ral_file_loc'
    IDL>restore,concat_dir('$CDS_HEAD_CAT','ral_file_loc')
    IDL>help,rfl
    RFL             STRING    = Array[353075]
    IDL> help,rfl[10000]
        STRING    = '/cdsfits/arch19/s10868r135.fits.Z'
    IDL> help,rfl[100000]
        STRING    = '/cdsfits/arch29/s25444r63.fits.Z '


Jeff Payne's how_to_manualy_rerun_atlas.txt instructions

Jeff left some instructions (mostly obsolete now) in ~/atlas/how_to_manualy_rerun_atlas.txt

This page is maintained by J. Rainnie. Last modified on 24-Dec-2008.