DATA PROCESSING CHECK LIST AND EXAMPLES

Starting up :

Connect to w1d5pl, and in each window you will type

tcsh

source .planet  (it will set up all variables for DoPhot and WISIS)

You are going to flat field the images, run the DoPhot pipeline,

and the WISIS pipeline (ChC version of pySIS for mountain top operation).

FLAT FIELDING

Compute median bias and median normalized dome flat:
$SCRIPT_CODE/csh_prep_lists
check that you only have 50 biases and 50 dome flats in I
csh_bias_flat biasmay15 flatmay15
cd $BIASFLAT
rm Domeflatmay15V.fits (if no V flat has been taken)
ds9 biasmay15.fits Domeflatmay15If.fits
 

Start reduction loops in three different windows  :
csh_loop_flatfield biasmay15 Domeflatmay15  (flat fielding)

   It will copy the flatfielded image in $IN_IMAGE (for DoPhot processing)

     and in $PI_IMAGE (for WISIS processing).
csh_loop_cross     (DoPhot processing)
AcqLoop               (WISIS processing)

New target:
save OGLE web page as ews.html
ccsh_wcs ZOB06215I001.fits
puts WCS keywords, so that OGLE position gives the target
saves astrometric image as ZOB06215I001w.fits to ImagesAstrom

DoPhot pipeline (QUYLLURWASI): useful commands:
ccsh_fwhm to find best seeing image
cd $ARCHIVE
emacs archZOB06207.dat to put its name in arch file
ccsh_template ZOB06207I011
ccsh_cross ZOB06207I011
ccsh_arch ZOB06207I 11 11 C
cd $IN_IMAGE
ds9 ZOB06207I011.fits
Identify the lens on the reference image
ccsh_searchXY ZOB06207I 268 232 2 or
$EXEARCH/searchXY -5 ZOB06207I 268 232 2 0 gives the lens DoPhot number
(NumStar)
$EXEARCH/ListArch ZOB06207I -F look for best reference stars and bad images
ccsh_writepl ZOB06207I to update the binary archive
ccsh_refs ZOB06207I to look for ref stars (old)
ccsh_anarch ZOB06207I to analyse the binary archive
ccsh_plotref ZOB06207I or
$EXEARCH/plotref -5 ZOB06207I tt -k -m 3872 to plot results
SyncArchives to send binary archives to chianti

to remove a bad image from an archive:
ccsh_undo ZOB06181I037 ; ccsh_setbad ZOB06181I037
ccsh_arch ZOB06181I 1 76 C to recreate the archive

WISIS pipeline (pySIS on the rocks):
directory structure:
/home/guest/PIPELINE/PIPE_WISIS/
sub-directory Parameters:
AcqParam.conf configuration parameters

Z_ISISdefault.config
Z_ISISphot.config
Z_pySIS.config

For each event, we have sub-directory WISIS:
ZOB06207I/Wisis  (containing all intermediate files for the processing)
ZOB06207I/Archive  (containing the result file, the ZOB06207I.pysis, and the locks)
ZOB06207I/Images  (all the images before processing)

All scripts are in sub-directory bin:
AcqLoop
AcqUtil.py
process
update

AcqLoop
mktree ZOB06207I to create sub-directories for a new event
stop to stop it
process ZOB06207I (mandatory for new events)
update ZOB06207I
Call sm and type pp ZOB06207I to see the light curve, or pz ZOB06207I
to only see the last two nights

If an event light curve does not show recent measurements, check two things:
- lock file:
ls WISIS/ZOB*/Archive/Acq.lock
delete them to restart the reduction of images in wait status
- nan measurements in Archive/ZOB06234I.pysis
mv ZOB06234I064.fits ZOB06234I064.bad
update ZOB06234I

in AcqParam.conf, put RSYNC_ARCH to N if chianti unreachable