{"id":4648,"date":"2016-04-29T17:39:33","date_gmt":"2016-04-30T03:39:33","guid":{"rendered":"http:\/\/www.eaobservatory.org\/jcmt\/?page_id=4648"},"modified":"2020-11-23T17:27:56","modified_gmt":"2020-11-24T03:27:56","slug":"scuba-2-dr-tutorial-1","status":"publish","type":"page","link":"https:\/\/www.eaobservatory.org\/jcmt\/science\/reductionanalysis-tutorials\/scuba-2-dr-tutorial-1\/","title":{"rendered":"SCUBA-2 Data Reduction – Tutorial 1"},"content":{"rendered":"

Note:<\/strong> This tutorial assumes that the computer to be used already has a functioning installation of the latest version of the Starlink<\/em> software suite (the latest release is available for download here<\/a>).<\/em><\/p>\n

You must initialise the Starlink software following the instructions on the release page in the same terminal you are going to run this tutorial in.<\/p>\n

Basic Pipeline Reduction<\/h2>\n

This tutorial demonstrates how to run a standard, basic reduction of a SCUBA-2<\/em> dataset using the ORAC-DR<\/em> pipeline software using different data reduction recipes and provides an introduction to basic Gaia use.<\/p>\n

    \n
  1. Obtain a copy of the file JCMT_SCUBA-2_tutorial1_2016.tar.gz<\/em><\/a> containing the raw data from here<\/a> (file size: ~650 MB). This file contains SCUBA-2<\/em> 850-micron band observational data for G34.3+0.2<\/a>.\n

    Copy this file to a suitable directory to work in (e.g. your local home directory, ~\/<\/em> , in the following example):<\/p>\n

    cp JCMT_SCUBA-2_tutorial1_2016.tar.gz ~\/<\/code><\/p>\n<\/li>\n

  2. Switch to the working directory, open the tarball and change to the newly-created directory containing the raw data:\n

    cd ~\/
    \ntar xvzf JCMT_SCUBA-2_tutorial1_2016.tar.gz
    \ncd tutorial\/raw\/<\/code><\/p>\n

    This directory should contain a number of .sdf<\/em> files and a README <\/em>document. This can be checked by listing the contents of the directory by typing<\/p>\n

    ls<\/code><\/p>\n<\/li>\n

  3. Create an index file (called mylist<\/em>) listing all of the input files, with explicit pathnames, and move it to the reduced directory, and switch to that as the current working directory (ORAC-DR<\/em> will be run from there later on):\n

    ls -d -1 $PWD\/*.sdf > mylist
    \nmv mylist ..\/reduced\/
    \ncd ..\/reduced\/<\/code><\/li>\n

  4. Set up ORAC-DR<\/em> for SCUBA-2<\/em> 850-micron data processing, and specify that the reduced files will be written to the current working directory:\n

    oracdr_scuba2_850 -cwd<\/code><\/p>\n

    The -cwd<\/em> option specifies that the current working directory should be used. Depending on your environment variable settings, it may not be needed.<\/p>\n

    By default, ORAC-DR<\/em> will issue a warning that the default input data directory does not exist. It is therefore necessary to manually set the ORAC_DATA_IN<\/em> environment variable. In case there is uncertainty as to which shell is currently in use, type the following to find out the answer:<\/p>\n

    echo \"$SHELL\"<\/code><\/p>\n

    If in the Bash or zsh<\/strong> shell, type:<\/p>\n

    export ORAC_DATA_IN=~\/tutorial\/raw\/<\/code><\/p>\n

    Or<\/strong><\/span>, if in the TC-shell or C-shell<\/strong>, type:<\/p>\n

    setenv ORAC_DATA_IN ~\/tutorial\/raw\/<\/code><\/p>\n<\/li>\n

  5. It should now be possible to run ORAC-DR<\/em> by typing the following:\n

    oracdr -loop file -files mylist<\/code><\/p>\n

    This should launch a separate window showing the progress of the data reduction. It will also indicate any problems encountered, and report as files are created and\/or deleted.<\/p>\n

  6. It is also possible to examine the reduced group dataset in Gaia<\/em>. This can be done by typing:\n

    gaia gs20120501_68_850_reduced.sdf &<\/code><\/p>\n

    This should launch a main Gaia<\/em> window with the reduced image in it. To get a better sense of the more extended structure in the source, use the View<\/em> drop-down menu, select Cut Levels<\/em> and use the Auto Set<\/em> option of 98%<\/em>. It is also trivial to zoom in and out of the image using the two Z<\/em> buttons.<\/p>\n

  7. As well as examining the reduced image data in Gaia<\/em>, it is also possible to view other components of the NDF<\/em> file. For example, the dataset also includes maps of the weights used at each position, the exposure times, and so on. In order to view these, the general strategy is to locate the supplementary Gaia window with the title Select NDF<\/em> in container file, then select the desired table entry, and finally select one of the buttons near the bottom of that window. For example, to view the variance map of the science data, click on the top row of the table (number 1) to choose the science dataset, and then press the Variance<\/em> button to see the science data variance map in the main Gaia<\/em> window. Similarly, to view the exposure time map for the field, select the third row of the table (number 3 \/ EXP_TIME<\/em>) and click on the data<\/em> button. It should be noted that the levels of each of these maps can be very different, so it may be necessary to modify the cut levels again, as in step 6.\n
  8. Each SCUBA-2<\/em> science observation specifies a default data reduction recipe in the header information. This is originally set by selecting a recipe option in the Observing Tool<\/em> during MSB preparation. To view the default recipe for a given dataset, switch to the raw data directory:\n

    cd ..\/raw\/<\/code><\/p>\n

     <\/p>\n

    If you set up the KAPPA package by typing
    \n
    \nkappa
    \n<\/code>
    \nAnd seeing in your terminal
    \n
    \nKAPPA commands are now available -- (Version 2.6-4)<\/code><\/p>\n

    Type kaphelp for help on KAPPA commands.
    \nType ‘showme sun95’ to browse the hypertext documentation.<\/p>\n

    See the ‘Release Notes’ section of SUN\/95 for details of the
    \nchanges made for this release.<\/p>\n

    You can use either of the following commands to examine the relevant part of the FITS header component of the data:<\/li>\n

  9. fitsval s8a20120501_00068_0001.sdf RECIPE<\/code>\n

    or<\/p>\n

    fitslist s8a20120501_00068_0001.sdf | grep RECIPE<\/code><\/p>\n

    The default recipe for the example dataset is REDUCE_SCAN<\/em>.<\/p>\n<\/li>\n

  10. It is also possible to re-run the pipeline reduction process using a different recipe from the default specified in the FITS header by simply appending the name of the recipe to the command line instruction. To try this, switch to the reduced data directory and try re-running the pipeline reduction with a different recipe:\n

    cd ..\/reduced\/
    \noracdr -loop file -files mylist REDUCE_SCAN_EXTENDED_SOURCES<\/code><\/p>\n

    Note that when this is run, ORAC-DR<\/em> will issue a warning about the suitability of the specified recipe for the DAISY<\/em> mode data used in this tutorial. This demonstrates that care should be taken when manually specifying recipes.<\/p>\n

    To regenerate the original default reduction, just re-run ORAC-DR<\/em> with the default recipe as before:<\/p>\n

    oracdr -loop file -files mylist<\/code><\/p>\n<\/li>\n<\/ol>\n

    \n

    Other JCMT data reduction\/analysis tutorials are available here.<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

    Note: This tutorial assumes that the computer to be used already has a functioning installation of the latest version of the Starlink software suite (the latest release is available for download here). You must initialise the Starlink software following the instructions on the release page in the same terminal you\u2026 Continue reading<\/a><\/p>\n","protected":false},"author":41,"featured_media":0,"parent":4510,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4648"}],"collection":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/users\/41"}],"replies":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/comments?post=4648"}],"version-history":[{"count":97,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4648\/revisions"}],"predecessor-version":[{"id":11485,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4648\/revisions\/11485"}],"up":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/4510"}],"wp:attachment":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/media?parent=4648"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}