Pipeline Demo 3/22/02

• OPUS v3.2
• Runs processes on SunOS & Linux
• Pipeline runs on shapley (SunOS), oort, cecilia, sage, tsingtao (Linux)
• Currently runs through Level C photometry step
• Takes about 10 minutes to run the pipeline on the 64 images using 8 processors (4 Linux computers) to do the photometry and shapley for the rest of the processes

Input Files to the Pipeline

• 4 row x 4 column AOR (1/2 step visits)
  - 16 pointings x 4 bands = 64 calibrated images plus ancillary data
• Calibrated Images
  - From Matt Ashby's IRAC Science Data Simulator (includes instrument effects) whose input truth image was created by Remy using 2MASS PSC & MSX bkg
• Ancillary Data
  - pmask (bad pixel), dmask (quality), crmask (cosmic rays), lmask (latent image), fluxerr & ghost images created for each calibrated image. As realistic as possible using instrumental effects and guesses for SSC fits header keywords.

Processes in the GLIMPSE1 Pipeline

GF (gfLevA) = Get Files - Level A file recognition

RN (rnLevA) = Rename files and stage for photometry

CK (ckLevA) = Perform Level A automated frame checks

• Do statistics on calibrated image - write info to header
  - min, max, count # bad pixels, # poor quality pixels (e.g. saturation, banding), # cosmic ray and latent image pixels using mask files
  - STATSCHK keyword set to OK or PROBLEM
• Compare GLIMPSE AOR with AOR-related information in the calibrated image header
  - AORCHK keyword set to OK or PROBLEM
• Verify SSC Processing Steps Done
  - STEPSCHK keyword set to OK or PROBLEM
• LVATROUB keyword set to YES if either STATSCHK, AORCHK or STEPSCHK is set to PROBLEM.
• levaflux.fits file created (header updated, image unchanged)

FL (flLevB) = Perform Level B processing (zody calc, generate GLIMPSE masks)

• Calculate zodiacal light intensity given the channel, position and time and write to FITS header
• Assemble a GLIMPSE quality mask from SSC masks and GLIMPSE processing masks
• GLIMPSE Mask image file created for removing all bad pixels (dead, saturated, cosmic rays) from calibrated image
• levbflux.fits created (header updated, image unchanged)
  levbqual.fits created (contains all bad & poor quality pixel info)
  levbmask.fits created (sets bad pixels to be masked to 1e36)

ZS (zsLevC) = Perform Level C mask application & zody subtraction

• Subtract zodi intensity from calibrated image
• Subtract GLIMPSE mask image from calibrated image
• levcflux.fits file created (header updated, image changed)

PH (phLevC) = Perform Level C photometry

• Run DAOPHOT on levcflux.fits calibrated image
• resid.fits, cat, wcs, log files created

Examples of OPUS Process Manager (PMG) & Observation Manager (OMG)

Near-term tasks

• Optimize compiler options, compile with lf95 instead of g77 on Linux
• Error trapping
• Interaction with database
• Add bandmerging and mosaicing