{"id":4962,"date":"2016-05-09T12:29:34","date_gmt":"2016-05-09T22:29:34","guid":{"rendered":"http:\/\/www.eaobservatory.org\/jcmt\/?page_id=4962"},"modified":"2020-11-24T12:12:47","modified_gmt":"2020-11-24T22:12:47","slug":"heterodyne-dr-tutorial-1","status":"publish","type":"page","link":"https:\/\/www.eaobservatory.org\/jcmt\/science\/reductionanalysis-tutorials\/heterodyne-dr-tutorial-1\/","title":{"rendered":"Heterodyne Instrument Data Reduction Tutorial 1"},"content":{"rendered":"

Note:<\/strong> This tutorial assumes that the computer to be used already has a functioning installation of a recent version of the Starlink<\/em> software suite (the latest release is available for download here<\/a>).<\/em><\/p>\n

Basic Pipeline Reduction<\/h2>\n

This tutorial demonstrates how to run a standard, basic reduction of a heterodyne observation using the ORAC-DR<\/em> pipeline software and provides an introduction to basic Gaia<\/em> use.<\/p>\n

The ORAC-DR pipeline is a generic automated data reduction pipeline that can process your raw JCMT data and return advanced data products: baselined single observation cubes, mosaicked and co-added cubes, moments map and clump catalogues. Before you begin we recommend reading Chapter 5<\/a> of the The Heterodyne Data Reduction Cookbook<\/a> which discusses the ACSIS Pipeline<\/a>.<\/p>\n

    \n
  1. Obtain a copy of the file JCMT_HETERODYNE_tutorial_2016.tar.gz<\/em><\/a> containing the raw data. Copy this file to a suitable directory to work in (~\/data<\/em> is used in the following example):\n

    cp JCMT_HETERODYNE_tutorial_2016.tar.gz ~\/data<\/code><\/p>\n<\/li>\n

  2. Switch to the data directory and open the tarball:\n

    tar xvzf JCMT_HETERODYNE_tutorial_2016.tar.gz<\/code><\/p>\n

    This directory should now contain a number of .sdf<\/em> files corresponding to different heterodyne observing modes which are to be reduced by different recipes:<\/p>\n\n\n\n\n\n\n\n\n\n\n
    Observation (UT Date + Scan Number)<\/strong><\/td>\nSource Observed<\/strong><\/td>\nSpectral Line<\/strong><\/td>\nMode<\/strong><\/td>\nType of Data<\/strong><\/td>\n<\/tr>\n
    20110103 Scan 25<\/td>\nL1551-IRS5<\/a><\/td>\nC18<\/sup>O(3-2)<\/td>\nStare<\/td>\nNarrow Line<\/td>\n<\/tr>\n
    20160317 Scan 17<\/td>\nCRL 618<\/a><\/td>\nCO(3-2)<\/td>\nStare<\/td>\nBroad Line<\/td>\n<\/tr>\n
    20110926 Scan 29<\/td>\nCRL 2688<\/a><\/td>\nCO(3-2)<\/td>\nStare (wide band mode)<\/td>\nGradient<\/td>\n<\/tr>\n
    20160316 Scan 39<\/td>\nMars<\/td>\nCO(3-2)<\/td>\nStare<\/td>\nContinuum<\/td>\n<\/tr>\n
    20111025 Scan 7<\/td>\nG34.3+0.2<\/a><\/td>\nCH3<\/sub>OH(7-6)<\/td>\nStare<\/td>\nLine forest<\/td>\n<\/tr>\n
    20070705 Scan 34<\/td>\nG34.3+0.2<\/a><\/td>\nCO(3-2)<\/td>\nHARP-5 Jiggle map<\/td>\nGradient<\/td>\n<\/tr>\n
    20070705 Scans 38+39<\/td>\nG34.3+0.2<\/a><\/td>\nCO(3-2)<\/td>\nRaster map (basket-weave)<\/td>\nGradient<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/li>\n
  3. before proceeding further you will need to ensure the starlink software is loaded in your terminal, and you have loaded the analysis tools package; Kappa.Firstly, in case there is uncertainty as to which shell is currently in use, type the following to find out the answer:\n

    echo \"$SHELL\"<\/code><\/p>\n

    If using the Bash or zsh shells, type:<\/p>\n

    export STARLINK_DIR=\/star<\/code><\/p>\n

    Or, if using the TC-shell or C-shell, instead type:<\/ul>\n<\/li>\n<\/ul>\n

    setenv STARLINK_DIR \/star<\/code><\/p>\n

    Then in any of the above shells, type:<\/p>\n

    source $STARLINK_DIR\/etc\/profile<\/code><\/p>\n

    And then launch Kappa by typing:<\/p>\n

    kappa<\/code><\/p>\n

    If you encouter issues, please ensure you have installed Starlink correctly<\/a>. You can also consult the\u00a0Starlink support mailing list<\/a> for questions\/concerns (or email\u00a0 helpdesk@eaobservatory.org<\/a>).<\/p>\n<\/li>\n

  4. It is possible to inspect a raw data file with Gaia<\/em>:\n

    gaia a20110103_00025_01_0001.sdf<\/code><\/p>\n

  5. Before reducing your data it is possible to look at the metadata using fitslist<\/a> and ndftrace<\/a> (for more information about the metadata click here)<\/a>:\n

    fitslist a20110103_00025_01_0001.sdf<\/code><\/p>\n

    and:<\/p>\n

    ndftrace a20110103_00025_01_0001.sdf<\/code><\/p>\n<\/li>\n

  6. It is possible to check the System Temperature (Tsys) and Receiver Temperature (Trx) by doing an hdstrace on your data:\n

    hdstrace a20110103_00025_01_0001.MORE.ACSIS.TSYS<\/code><\/p>\n

    and:<\/p>\n

    hdstrace a20110103_00025_01_0001.MORE.ACSIS.TRX
    \n<\/code><\/li>\n

  7. Set up ORAC-DR<\/em> for ACSIS<\/em> data processing, and specify that the reduced files will be written to the current working directory:\n

    oracdr_acsis<\/code><\/p>\n

    By default, ORAC-DR<\/em> will issue a warning that the default input data directory does not exist. It is therefore necessary to manually set the ORAC_DATA_IN<\/em> environment variable.<\/p>\n

    If in the Bash or zsh shells, type:<\/p>\n

    export ORAC_DATA_IN=.<\/code><\/p>\n

    Or, if in the TC-shell or C-shell, type:<\/p>\n

    setenv ORAC_DATA_IN .<\/code><\/p>\n<\/li>\n

  8. Next, create a file mylist<\/em> with the absolute file path to the raw data. This can be done via:\n

    ls \/absolute\/file\/path\/file-of-interest.sdf > mylist<\/code><\/p>\n

    Initially it is recommended to only reduce a single file at a time (typically one source\/frequency set-up)<\/p>\n<\/li>\n

  9. It should now be possible to run ORAC-DR<\/em> by typing the following:\n

    oracdr -files mylist
    \n<\/code><\/p>\n

    ORAC-DR<\/em> will use the default recipe<\/a> specified in the header (REDUCE_SCIENCE<\/em>) to reduce the data. This should launch a separate windows showing the progress of the data reduction. It will also indicate any problems encountered, and report as files are created and\/or deleted. The -nodisplay<\/em> option is not necessary. Although often informative, displaying the outputs from the reduction process while running it may slow down its execution.<\/p>\n

    Once the reduction process has completed, press the Exit ORAC-DR<\/em> button to close the window. A number of files should have been produced as a result of the reduction process, including various logs, NDF and PNG preview image files. REDUCE_SCIENCE<\/em> uses REDUCE_STANDARD<\/em> for standard calibration sources and REDUCE_SCIENCE_GRADIENT<\/em> for maps. Note that REDUCE_STANDARD<\/em> does not produce group files. Alternatively (for to see progress in the terminal, and a log saved to the directory you are working in) try:<\/p>\n

    oracdr -files mylist -nodisplay -log sf<\/code><\/p>\n

    A list of the output files produced and their descriptions can be found here:<\/p>\n<\/li>\n

  10. It is possible to examine the reduced group dataset in Gaia<\/em>. This can be done by typing:\n

    gaia a20110103_00025_01_reduced001.sdf &<\/code><\/p>\n

    or<\/p>\n

    gaia ga20110103_25_1_reduced001.sdf &<\/code><\/p>\n

    This should launch a main Gaia<\/em> window with the reduced image in it. It is possible to zoom in and out of the image using the two Z<\/em> buttons. Click on a pixel to view the spectrum at this position. It is then possible to click on the Send: replace<\/em> button to view the spectrum in SPLAT<\/em>.<\/p>\n

  11. Estimation of the rms of a spectrum can be done in SPLAT using the \u03a3 button (“Get statistics on region of spectrum”), by “adding” new background regions and calculating the statistics. Alternatively you can simply run the kappa stats command on the error component of the data:\n

    stats file.sdf comp=error
    \n<\/code><\/li>\n<\/ol>\n

    \n

    Other JCMT data reduction\/analysis tutorials are available here.<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

    Note: This tutorial assumes that the computer to be used already has a functioning installation of a recent version of the Starlink software suite (the latest release is available for download here). Basic Pipeline Reduction This tutorial demonstrates how to run a standard, basic reduction of a heterodyne observation using\u2026 Continue reading<\/a><\/p>\n","protected":false},"author":41,"featured_media":0,"parent":4510,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4962"}],"collection":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/users\/41"}],"replies":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/comments?post=4962"}],"version-history":[{"count":69,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4962\/revisions"}],"predecessor-version":[{"id":11530,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4962\/revisions\/11530"}],"up":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4510"}],"wp:attachment":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/media?parent=4962"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}