{"id":2897,"date":"2015-05-12T13:40:32","date_gmt":"2015-05-12T23:40:32","guid":{"rendered":"http:\/\/www.eaobservatory.org\/jcmt\/?page_id=2897"},"modified":"2016-10-25T16:36:37","modified_gmt":"2016-10-26T02:36:37","slug":"data-quality","status":"publish","type":"page","link":"https:\/\/www.eaobservatory.org\/jcmt\/instrumentation\/continuum\/scuba-2\/data-reduction\/data-quality\/","title":{"rendered":"SCUBA-2 Data Quality"},"content":{"rendered":"<p style=\"text-align: justify\">The following is a discussion of the factors that can attribute to variations between <a href=\"http:\/\/www.eaobservatory.org\/jcmt\/instrumentation\/continuum\/scuba-2\/data-reduction\/reducing-scuba2-data\/#Estimating_the_noise\" target=\"_blank\">obtained rms values<\/a> and predicted SCUBA-2 rms estimates:<\/p>\n<p style=\"text-align: justify\"><div id=\"toc_container\" class=\"no_bullets\"><p class=\"toc_title\">Contents<\/p><ul class=\"toc_list\"><ul><li><a href=\"#Air_Mass_and_ITC_formula_used\"><span class=\"toc_number toc_depth_2\">0.1<\/span> Air Mass and ITC formula used<\/a><\/li><li><a href=\"#Cropping\"><span class=\"toc_number toc_depth_2\">0.2<\/span> Cropping<\/a><\/li><li><a href=\"#Tau_estimates\"><span class=\"toc_number toc_depth_2\">0.3<\/span> Tau estimates<\/a><\/li><li><a href=\"#Elevation_issues\"><span class=\"toc_number toc_depth_2\">0.4<\/span> Elevation issues<\/a><\/li><li><a href=\"#NEPs\"><span class=\"toc_number toc_depth_2\">0.5<\/span> NEPs<\/a><\/li><li><a href=\"#Temperature_Spikes\"><span class=\"toc_number toc_depth_2\">0.6<\/span> Temperature Spikes<\/a><\/li><li><a href=\"#Reduction_method\"><span class=\"toc_number toc_depth_2\">0.7<\/span> Reduction method<\/a><\/li><\/ul><\/li><li><a href=\"#Diagnostic_Tools\"><span class=\"toc_number toc_depth_1\">1<\/span> Diagnostic Tools<\/a><ul><li><a href=\"#Quality_statistics_from_the_mapmaker\"><span class=\"toc_number toc_depth_2\">1.1<\/span> Quality statistics from the mapmaker<\/a><\/li><li><a href=\"#Telescope_status\"><span class=\"toc_number toc_depth_2\">1.2<\/span> Telescope status<\/a><\/li><li><a href=\"#Config_file\"><span class=\"toc_number toc_depth_2\">1.3<\/span> Config file<\/a><\/li><li><a href=\"#Checking_array_noise\"><span class=\"toc_number toc_depth_2\">1.4<\/span> Checking array noise<\/a><\/li><\/ul><\/li><\/ul><\/div>\n\n<h3 style=\"text-align: justify\"><span id=\"Air_Mass_and_ITC_formula_used\">Air Mass and ITC formula used<\/span><\/h3>\n<p style=\"text-align: justify\">When we estimate the time required to spend on source we try to take into account the air mass at which the object is likely to be observed. Ideally you would always like to observe a source at zenith and at a night high elevation. The ITC&#8217;s equation as reported on the <a href=\"http:\/\/www.eaobservatory.org\/jcmt\/instrumentation\/continuum\/scuba-2\/time-and-sensitivity\/\">Calculating Integration Times<\/a> page calculates an expected air mass which is slightly higher than that obtained by an object transiting at a given declination. This is also the case for the <a href=\"http:\/\/www.eaobservatory.org\/jcmt\/instrumentation\/continuum\/scuba-2\/itc\/\">ITC Gui<\/a>.<\/p>\n<p style=\"text-align: justify\">In the case of SCUBA-2 the estimation of an air-mass is further complicated because we avoid taking data with SCUBA-2 above an elevation of 70-75 degrees. This issue affects sources that have a Declination between +5 and +35 degrees. At these elevations the air mass is predicted (form the ITC formula) to be 1.15 or less, but this is clearly not the case.<\/p>\n<div id=\"attachment_2898\" style=\"width: 310px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Average_airmass_analysis.png\"><img aria-describedby=\"caption-attachment-2898\" loading=\"lazy\" class=\"wp-image-2898 size-medium\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Average_airmass_analysis-300x300.png\" alt=\"Average_airmass_analysis\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Average_airmass_analysis-300x300.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Average_airmass_analysis-150x150.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Average_airmass_analysis.png 787w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-2898\" class=\"wp-caption-text\">Figure displaying average air mass from a year&#8217;s worth of observations. We see that the air mass typically used in ITC estimations can underestimate the true air mass by up to 15%.<\/p><\/div>\n<p>It is possible to determine the air mass at the start and end of an observation using:<\/p>\n<pre>&gt;&gt; fitsval file.sdf AMSTART\r\n&gt;&gt; fitsval file.sdf AMEND \r\n<\/pre>\n<p>To see a record of the air mass throughout the observation it is possible to use the <a href=\"http:\/\/www.starlink.ac.uk\/docs\/sc21.htx\/sc21ch9.html#x10-1120003\">jcmtstate2cat<\/a> command as outlined below.<\/p>\n<h3><span id=\"Cropping\">Cropping<\/span><\/h3>\n<p style=\"text-align: justify\">If you are comparing the rms obtained via the use of a tool such as <a href=\"http:\/\/www.eaobservatory.org\/jcmt\/instrumentation\/continuum\/scuba-2\/data-reduction\/reducing-scuba2-data\/#Estimating_the_noise\">PICARD&#8217;s SCUBA2_MAPSTATS<\/a> then it may be important to consider the region used for estimating the noise in the map. In the following Daisy example we see that the region of highest exposure does not match perfectly with the centre of the map (the position the map is cropped for the noise estimation). This is particularly evident in the following image of a calibrator observation (these are short observations), and will emphasize any oddities such as the non-uniform distribution of bolometers that should get smoothed out over a longer integration.<\/p>\n<div id=\"attachment_2901\" style=\"width: 310px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreRMS.png\"><img aria-describedby=\"caption-attachment-2901\" loading=\"lazy\" class=\"wp-image-2901 size-medium\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreRMS-300x298.png\" alt=\"DaisyCentreRMS\" width=\"300\" height=\"298\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreRMS-300x298.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreRMS-150x150.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreRMS-151x150.png 151w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreRMS.png 916w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-2901\" class=\"wp-caption-text\">rms from a Daisy observation (central 3&#8242;)<\/p><\/div>\n<div id=\"attachment_2900\" style=\"width: 310px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreExp.png\"><img aria-describedby=\"caption-attachment-2900\" loading=\"lazy\" class=\"wp-image-2900 size-medium\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreExp-300x300.png\" alt=\"DaisyCentreExp\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreExp-300x300.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreExp-150x150.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreExp-149x150.png 149w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/DaisyCentreExp.png 869w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-2900\" class=\"wp-caption-text\">Exposure time from the same Daisy observation. Clearly see is that the map does not sit entirely in the centre of the cropped region.<\/p><\/div>\n<h3><span id=\"Tau_estimates\">Tau estimates<\/span><\/h3>\n<p style=\"text-align: justify\">During JCMT observing the Water Vapor Monitor (WVM) inside the JCMT receiver cabin monitors the <a href=\"http:\/\/www.eaobservatory.org\/jcmt\/observing\/weather-bands\/\">sky opacity<\/a> for the same patch of sky that is observed. These measurements are key in helping to remove the atmospheric sky background from SCUBA-2 observations. For the most part the WVM is extremely reliable (see the plots below). We get a feeling for it&#8217;s reliability from comparison with the CSO&#8217;s WVM. The latter, however, stares at a fixed point in the atmosphere and does not have the time resolution of the WVM installed at the JCMT.<a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tau_20131221.png\"><img loading=\"lazy\" class=\" size-medium wp-image-2913 aligncenter\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tau_20131221-300x211.png\" alt=\"tau_20131221\" width=\"300\" height=\"211\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tau_20131221-300x211.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tau_20131221-214x150.png 214w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tau_20131221-150x105.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tau_20131221.png 854w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>Unfortunately sometimes the JCMT&#8217;s WVM has issues and produces noisy spikes. When these occur (as shown below) it is necessary to base any SCUBA-2 extinction model from the CSO WVM. In the plot below the JCMT&#8217;s WVM is show in red, CSO in green and a fit to the CSO data is shown in blue. CSO WVM fits are produced for every night we observe with SCUBA-2 but generated fits are only used for a night when either the WVM was unavailable i.e. for maintenance or unusable due to noise spikes (such as the example below).<a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/WVM-CSO_overlay.png\"><img loading=\"lazy\" class=\" size-medium wp-image-2912 aligncenter\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/WVM-CSO_overlay-300x180.png\" alt=\"WVM-CSO_overlay\" width=\"300\" height=\"180\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/WVM-CSO_overlay-300x180.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/WVM-CSO_overlay-250x150.png 250w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/WVM-CSO_overlay-150x90.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/WVM-CSO_overlay.png 1000w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a>The map making software used to reduce data has access to dates when the WVM was having issues\/offline. In these cases it uses the nightly CSO fits. To specifically control which model is used during reduction it is possible to use the ext.tausrc config parameter. The default value for ext.tausrc = auto. Allowed values are &#8220;auto&#8221;, &#8220;wvmraw&#8221;, &#8220;csotau&#8221; and &#8220;filtertau&#8221;.<\/p>\n<h3><span id=\"Elevation_issues\">Elevation issues<\/span><\/h3>\n<p style=\"text-align: justify\">As is outlined in a sub section of the <a href=\"http:\/\/www.eaobservatory.org\/jcmt\/instrumentation\/continuum\/scuba-2\/observing-modes\/\">observing modes<\/a> web page an elevation constraint 70 degrees is applied to observations. At high elevations the telescope struggles to make the tight turns at high speed required by the observing patterns. If you observation happened to be observed at a high elevation-close to this limit then it is possible that your exposure time and also noise coverage may be affected. This affect is clearly seen in the data if the usually circular pattern appears to be elongated. This problem appears confined to data taken in 2011 (when the exact observing mode method was being investigated).<\/p>\n<div id=\"attachment_2907\" style=\"width: 235px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Highelevation.png\"><img aria-describedby=\"caption-attachment-2907\" loading=\"lazy\" class=\"wp-image-2907 size-medium\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Highelevation-225x300.png\" alt=\"Highelevation\" width=\"225\" height=\"300\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Highelevation-225x300.png 225w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Highelevation-113x150.png 113w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/Highelevation.png 417w\" sizes=\"(max-width: 225px) 100vw, 225px\" \/><\/a><p id=\"caption-attachment-2907\" class=\"wp-caption-text\">The exposure time map of a closed dome test observation taken at high elevation. This is an extreme example of an elevation issue.<\/p><\/div>\n<h3><span id=\"NEPs\">NEPs<\/span><\/h3>\n<p style=\"text-align: justify\">NEPs help serve as a measure of the arrays&#8217; performance over the course of a night. The NEPs for each night we have SCUBA-2 data are plotted on the project page in the OMP. They are measured approximately every 30 seconds and plotted per sub-array. The image below shows a good night: the NEPs vary a bit throughout the night (which is natural), but do so in a way that is mostly smooth (except for the s8c array for observation 18) with almost no jumps in performance between observations.<\/p>\n<div id=\"attachment_2905\" style=\"width: 310px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_good.png\"><img aria-describedby=\"caption-attachment-2905\" loading=\"lazy\" class=\"wp-image-2905 size-medium\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_good-300x240.png\" alt=\"NEPs_example_good\" width=\"300\" height=\"240\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_good-300x240.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_good-188x150.png 188w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_good-150x120.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_good.png 1000w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-2905\" class=\"wp-caption-text\">An example of a night where the NEP&#8217;s were well behaved.<\/p><\/div>\n<p style=\"text-align: justify\">The next image shows a worse night. Here the NEPs are jumping around quite a bit more, looking more like a swarm of points than a smooth-varying curve over time. There are some strange spikes on the scale of a few minutes in the last few observations (observation 63 and 68) as well.<\/p>\n<div id=\"attachment_2904\" style=\"width: 310px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_bad.png\"><img aria-describedby=\"caption-attachment-2904\" loading=\"lazy\" class=\"wp-image-2904 size-medium\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_bad-300x240.png\" alt=\"NEPs_example_bad\" width=\"300\" height=\"240\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_bad-300x240.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_bad-188x150.png 188w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_bad-150x120.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/NEPs_example_bad.png 1000w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-2904\" class=\"wp-caption-text\">An example of a night where the NEPs were not good<\/p><\/div>\n<p style=\"text-align: justify\">Offline these variations can be investigated using ORAC-DR command: ASSESS_DATA_NOISE. Tweaks to the configuration file can eliminate or down weight noisy bolometers\/sub-arrays with a trade off in noise.<\/p>\n<h3><span id=\"Temperature_Spikes\">Temperature Spikes<\/span><\/h3>\n<p style=\"text-align: justify\">In very rare cases unexpected events occur at the JCMT which can feed into the noise component of an observation and it is good to be aware of these. Back in April 2012 we noticed some issues that were related to events where the FPU temperature increases and then exponentially returns to its steady state again. The origin of these particular temperature spikes was a caused by slip in the telescope elevation drive. Please note that temperature events form elevation slips were eliminated on 20120417.<\/p>\n<div id=\"attachment_2909\" style=\"width: 310px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tempspike_1.png\"><img aria-describedby=\"caption-attachment-2909\" loading=\"lazy\" class=\"wp-image-2909 size-medium\" src=\"http:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tempspike_1-300x275.png\" alt=\"tempspike_1\" width=\"300\" height=\"275\" srcset=\"https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tempspike_1-300x275.png 300w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tempspike_1-164x150.png 164w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tempspike_1-150x138.png 150w, https:\/\/www.eaobservatory.org\/jcmt\/wp-content\/uploads\/sites\/2\/2015\/05\/tempspike_1.png 435w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-2909\" class=\"wp-caption-text\">Focal Plane Unit temperatures (SC2_FPUTEMP) as measured at 450 and 850 microns. Normally constant we see a temperature excursion of over 0.5 mK.<\/p><\/div>\n<h3><span id=\"Reduction_method\">Reduction method<\/span><\/h3>\n<p style=\"text-align: justify\">When running the SCUBA-2 reduction software you can provide a number of different reduction recipes to use. Differences in rms based on the particular reduction methd (summit pipeline, vs off the shelf recipe, vs a bespoke reduction) can account for anywhere up to 10% or higher in some cases. This may be due to filters used, error estimates to remove small scale variations from the common mode, number of iterations etc. You may even find that a &#8216;good&#8217; reduction in terms of visual appearance\/science quality\/lack of artifacts, might have a higher rms if more data is thrown away.<\/p>\n<h2><span id=\"Diagnostic_Tools\">Diagnostic Tools<\/span><\/h2>\n<p>If you are worried about the quality of your data it is advisable to use some of the tools outlined below:<\/p>\n<h3><span id=\"Quality_statistics_from_the_mapmaker\">Quality statistics from the mapmaker<\/span><\/h3>\n<p>A first check might be to see how many samples made it into the final map. This can be done by inspecting the quality statistics displayed on the screen at the end of the final iteration, as shown:<\/p>\n<pre>smf_iteratemap: Iteration 7 \/ 40 ---------------\r\nsmf_iteratemap: Calculate time-stream model components\r\nsmf_iteratemap: Rebin residual to estimate MAP\r\nsmf_iteratemap: Calculate ast\r\n--- Quality flagging statistics --------------------------------------------\r\n BADDA:   11322624 (37.56%),        1923 bolos  ,change          0 (+0.00%)\r\nBADBOL:   11652352 (38.65%),        1979 bolos  ,change          0 (+0.00%)\r\n SPIKE:         30 ( 0.00%),                    ,change          0 (+0.00%)\r\nDCJUMP:      13558 ( 0.04%),                    ,change          0 (+0.00%)\r\n  STAT:     368640 ( 1.22%),          72 tslices,change          0 (+0.00%)\r\n   COM:     295618 ( 0.98%),                    ,change          0 (+0.00%)\r\n NOISE:     111872 ( 0.37%),          19 bolos  ,change          0 (+0.00%)\r\nTotal samples available for map:   18178445, 60.30% of max (3087.37 bolos)\r\n     Change from last report:          0, +0.00% of previous\r\nsmf_iteratemap: *** CHISQUARED = 0.973485660180563\r\nsmf_iteratemap: *** change: -4.25552926119899e-07\r\nsmf_iteratemap: *** NORMALIZED MAP CHANGE: 0.0323018 (mean) 0.0519139 (max)\r\nsmf_iteratemap: ****** Completed in 7 iterations\r\nsmf_iteratemap: ****** Solution CONVERGED\r\n<\/pre>\n<p>For more information regarding the map maker and for diagnostic tools for advanced users please see the <a href=\"http:\/\/www.starlink.ac.uk\/docs\/sc21.htx\/sc21.html\">SCUBA-2 data reduction book<\/a>.<\/p>\n<h3><span id=\"Telescope_status\">Telescope status<\/span><\/h3>\n<p>To check the status of an observation in detail can be done by running the command:<a href=\"http:\/\/www.starlink.ac.uk\/docs\/sc21.htx\/sc21ch9.html#x10-1120003\" target=\"_blank\"> jcmtstate2cat<\/a> on the raw data:<\/p>\n<pre>&gt;&gt; jcmtstate2cat \/directory\/raw\/data\/files.sdf &gt; state.tst\r\n&gt;&gt; topcat -f tst state.tst\r\n<\/pre>\n<p>and plotting one parameter against another i.e.<\/p>\n<ul>\n<li>RA vs Dec\n<ul>\n<li>to look at mapping pattern on source<\/li>\n<\/ul>\n<\/li>\n<li>Az vs El\n<ul>\n<li>to look at mapping pattern on sky<\/li>\n<\/ul>\n<\/li>\n<li>Id vs WVMTAU\n<ul>\n<li>to look for WVM problems<\/li>\n<\/ul>\n<\/li>\n<li>Id vs SC2_FPUTEMP\n<ul>\n<li>to look at focal plane temperature<\/li>\n<\/ul>\n<\/li>\n<li>Id vs TCS_AIRMASS\n<ul>\n<li>to look at the change in air mass during an observation<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3><span id=\"Config_file\">Config file<\/span><\/h3>\n<p style=\"text-align: justify\">To display the name and value of one or all configuration parameters either from a configuration file or from the history of an NDF file use the KAPPA command configecho. See here for more information on <a href=\"http:\/\/www.starlink.ac.uk\/docs\/sc21.htx\/sc21ch8.html#x9-1080009\">map provenance &amp; configuration parameters<\/a>.<\/p>\n<p style=\"text-align: justify\">The first example below will return the value of numiter from the map 850map.sdf. The second example will display the values of all the parameters in 850map.sdf and will prefix them with a &#8216;+&#8217; if they differ from the the values given in dimmconfig.lis.<\/p>\n<pre>&gt;&gt; configecho name=numiter config=! ndf=file.sdf\r\n&gt;&gt; configecho name=! config=^dimmconfig.lis ndf=file.sdf\r\n<\/pre>\n<p>If you wish to compare differences between maps (i.e. maps with large differences in rms&#8217;s) you can simply use the configmeld command:<\/p>\n<pre>&gt;&gt; configmeld file1.sdf files2.sdf\r\n&gt;&gt; configmeld file1.sdf ^dimmconfig2.lis\r\n<\/pre>\n<p style=\"text-align: justify\">Sometimes it is useful to write out each iteration of the map maker to see how the map maker progresses during a reduction. For more information on writing out models and intermediate maps click <a href=\"http:\/\/www.starlink.ac.uk\/docs\/sc21.htx\/sc21ch9.html#x10-1170008\">here<\/a>.<\/p>\n<h3 style=\"text-align: justify\"><span id=\"Checking_array_noise\">Checking array noise<\/span><\/h3>\n<p style=\"text-align: justify\">To check how the noise changes on an array over an observation it is possible to use the ORAC-DR command: ASSESS_DATA_NOISE. As an example the following asses the noise on the 450um data for observation 68 taken on the 20130329.<\/p>\n<pre>&gt;&gt; oracdr_scuba2_450 -cwd  20130329\r\n&gt;&gt; oracdr -log sf -recpars params.ini -loop flag -list 68 ASSESS_DATA_NOISE\r\n<\/pre>\n<p>with params.ini containing:<\/p>\n<pre>[ASSESS_DATA_NOISE]\r\nNOISE_CALC = each\r\nNOISE_CFG = dimmconfig.lis\r\n<\/pre>\n<p>Where NOISE_CFG is the config file used on the data, NOISE_CALC = each, will calculate the noise on each science observation. The outputs from the above are:<\/p>\n<pre>&gt;&gt; log.scinoise450\r\n&gt;&gt; log.bolonoise\r\n&gt;&gt; log.nep\r\n<\/pre>\n<p>which can be viewed using TOPCAT.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The following is a discussion of the factors that can attribute to variations between obtained rms values and predicted SCUBA-2 rms estimates: Air Mass and ITC formula used When we estimate the time required to spend on source we try to take into account the air mass at which the\u2026 <a class=\"continue-reading-link\" href=\"https:\/\/www.eaobservatory.org\/jcmt\/instrumentation\/continuum\/scuba-2\/data-reduction\/data-quality\/\">Continue reading<\/a><\/p>\n","protected":false},"author":5,"featured_media":0,"parent":184,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/2897"}],"collection":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/comments?post=2897"}],"version-history":[{"count":11,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/2897\/revisions"}],"predecessor-version":[{"id":2918,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/2897\/revisions\/2918"}],"up":[{"embeddable":true,"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/pages\/184"}],"wp:attachment":[{"href":"https:\/\/www.eaobservatory.org\/jcmt\/wp-json\/wp\/v2\/media?parent=2897"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}