Guide to the NA Imaging Template: Difference between revisions

From CASA Guides
Jump to navigationJump to search
Ekeller (talk | contribs)
No edit summary
 
(83 intermediate revisions by 6 users not shown)
Line 1: Line 1:
{{checked_6.6.1}}
== About this Guide ==
== About this Guide ==


This guide provides an outline of the Imaging Script followed by the North America ALMA Science Center (NAASC) in producing manually imaged Quality Assurance 2 (QA2) products of interferometric data. This is intended to be used as a template to produce basic continuum and line images. Some sections of this template are only appropriate for certain datasets. Therefore, not all sections of code in this guide may need to be run in order to reach a final product.  
This guide describes the template scripts used to manually image data for quality assurance by the North America ALMA Science Center (NAASC). This script is designed to guide the user through the decisions needed when imaging ALMA data. It should not be applied blindly; some editing of the scripts will be required in almost all cases. Not all sections of the template are relevant for all data sets. It can be adapted for use with partial pipeline processing of images. For example, you could do continuum subtraction in the pipeline, but use the scripts here as a template for manual imaging.  See the [[ALMA_Imaging_Pipeline_Reprocessing | ALMA Imaging Pipeline Reprocessing]] guide for information on pipeline processed images.


The [[ALMA_Imaging_Pipeline_Reprocessing | ALMA Imaging Pipeline Reprocessing]] guide should be used to create pipeline images of delivered data.
A current version of the script can be found on [https://github.com/CasaGuides/ALMAImagingScript github].
All example images were produced using ALMA Science Verification Data of TW Hya. More information along with the dataset can be obtained from the [https://casaguides.nrao.edu/index.php/TWHydraBand7 TW Hydra Band 7 Calibration and Imaging Guide].


== Prepare for Imaging ==
== Prepare for Imaging ==


Before you begin imaging, it is important to determine whether the data is manually or pipeline calibrated. The README file should state how the dataset was calibrated. If this is not the case, look in the script directory of the delivered data package. If you see a file named <ASDM UID>.ms.scriptForCalibration.py, the dataset was manually calibrated. If you see a filename PPR_<Member OUS UID>.xml, the dataset was pipeline calibrated.
Before you begin imaging, determine whether the dataset was manually or pipeline calibrated. The README file should state how the dataset was calibrated. If it does not, look in the script directory of the delivered data package. If you see a file named <ASDM UID>.ms.scriptForCalibration.py, the dataset was manually calibrated. If you see a filename PPR_*.xml, the dataset was pipeline calibrated.


It is recommended that you use the same version of CASA in which the original reduction was performed. Refer to the README file or CASA logs to see which version was used. [https://casa.nrao.edu/casa_obtaining.shtml Download CASA] and check for operating system requirements before proceeding.
Instructions on restoring the calibrated measurement set should be found in the README of your delivered dataset. For most cases, this can be done by running CASA in the script directory and executing scriptForPI.py in CASA:
 
Instructions on restoring the calibrated measurement set should be found in the README of your delivered dataset. For most cases, this can be done by executing scriptForPI.py in CASA in the script directory.


<source lang="python">
<source lang="python">
Line 20: Line 18:
</source>
</source>


== Attached Scripts ==
== Guide Contents ==
 
This guide has been split into 4 sections:
 
#'''[[Imaging_Prep | Prepare the data for Imaging]]''': This page creates the calibrated_final.ms that will be used for imaging. Commands can be found in scriptForImagingPrep_template.py available on [https://github.com/CasaGuides/ALMAImagingScript github].
#'''[[Image_Continuum | Image the Continuum]]''': This page creates a continuum measurement set (MS) named calibrated_final_cont.ms and continuum images using the MS created in [[Imaging_Prep | Prepare the data for imaging]] section. Commands can be found in scriptForImaging_template.py available on [https://github.com/CasaGuides/ALMAImagingScript github].
#'''[[Self-Calibration_Template | Self-Calibration]]''': This page provides a basic template for phase and amplitude self calibration of the continuum using the MS created in [[Image_Continuum | Image the Continuum]] section. Commands can be found in scriptForImaging_template.py available on [https://github.com/CasaGuides/ALMAImagingScript github].
#'''[[Image_Line | Spectral Line Imaging]]''': This page performs continuum subtraction and creates spectral line cubes using the MS created in [[Imaging_Prep | Prepare the data for imaging]] section. Commands can be found in scriptForImaging_template.py available on [https://github.com/CasaGuides/ALMAImagingScript github].


Two template scripts are attached to this guide. These contain commands with minimal directions and are intended to be used by those more familiar with imaging.  
The NA imaging workflow used with these scripts is shown below.


== Obtaining Analysis Utilities ==
[[Image:Imaging_WorkFlow.png|center|frame|1200px]]


Some optional steps in this guide use the [https://casaguides.nrao.edu/index.php?title=Analysis_Utilities Analysis Utilities] package. If you wish to use any of these tasks, follow the link above for download and installation instructions.
== Resources ==


== CASA Basics ==
=== ALMA QA2 ===
A description of how the script is used at the NAASC can be found in [http://adsabs.harvard.edu/abs/2016SPIE.9910E..0CK Kepley et al. Proceedings of the SPIE, 9910, 99100C ]. More information on the ALMA Quality Assurance procedure and standards can be found on the [https://almascience.org/processing/qa2-data-products ALMA Science Portal].


If you are new to interferometry or CASA, we recommend you follow the [https://casaguides.nrao.edu/index.php?title=ALMAguides “First Look” Imaging Tutorials]. In addition, many frequently asked questions can be found in the [https://help.almascience.org/index.php?/default/Knowledgebase/List ALMA Knowledgebase]. If you have additional questions after reviewing this guide, please contact the [https://help.almascience.org ALMA Helpdesk].
=== Example Data Set ===


== Guides for Using the North American ALMA Manual Imaging Template
All example images were produced using ALMA Science Verification Data of TW Hya. More information along with the dataset can be obtained from the [https://casaguides.nrao.edu/index.php/TWHydraBand7 TW Hydra Band 7 Calibration and Imaging Guide]. That guide is no longer being updated, however the same data set is also used for the First Look guides found on the homepage: [[ALMA Tutorials#Basic Imaging and Analysis]].


This guide has been split into 4 sections. The
=== CASA Version and Weights ===


#<font size = 3>'''[[Imaging_Prep | Prepare for Imaging]]'''</font size> This page creates the calibrated_final.ms that will be used in during imaging. Commands can be found in scriptForImagingPrep_template.py attached to this page.
If the data was calibrated prior to CASA 4.3, we recommend that you image the data in the same version of CASA that it was calibrated in because the weighting scheme for the data in CASA was in limbo. See  [https://casaguides.nrao.edu/index.php/DataWeightsAndCombination Data Weights and Combination] for more information. If the data was calibrated in CASA version 4.3 or later, imaging the data in a later version of CASA should work but we recommend using the same version of  Casa used for calibration when imaging since Casa is not guaranteed to be backwards compatible. The README or CASA log file will indicate which CASA version was used to calibrate the data. Different versions of CASA can be obtained from [https://casa.nrao.edu/casa_obtaining.shtml Download CASA]. Remember to check the operating system requirements before proceeding with the installation.  
#<font size = 3>'''[Image_Continuum | Image the Continuum]]'''</font size> This page creates a continuum measurement set (MS) and continuum images. The MS created in Imaging_Prep is needed for this guide. Commands can be found in scriptForImaging.py attached to this page.
#<font size = 3>'''[Self_Calibration | Self Calibration]]'''</font size> This page provides a basic template for phase and amplitude self calibration of the continuum. The MS created in Image_Continuum is needed for this guide. Commands can be found in scriptForImaging.py attached to this page.
#<font size = 3>'''[Image_Line | Spectral Line Imaging]]'''</font size> This page performs continuum subtraction and creates spectral line cubes. The MS created in Imaging_Prep is needed for this guide. Commands can be found in scriptForImaging.py attached to this page.


==How to Use A CASA Guide==
=== Attached Scripts ===


For tips on using CASA and ways CASA can be run, see [http://casaguides.nrao.edu/index.php?title=EVLA_Spectral_Line_Calibration_IRC%2B10216#How_to_Use_This_casaguide EVLA_Spectral_Line_Calibration_IRC+10216#How_to_Use_This_casaguide] page.
Two template scripts (scriptForImagingPrep_template.py and scriptForImaging_template.py) are available for this guide. These contain commands with minimal instructions and are intended to be used by those more familiar with imaging.
A current version of the scripts can be found on [https://github.com/CasaGuides/ALMAImagingScript github].


'''To learn how to extract executable Python scripts from the tutorial, see''' [http://casaguides.nrao.edu/index.php?title=Extracting_scripts_from_these_tutorials Extracting_scripts_from_these_tutorials].
=== Obtaining Analysis Utilities ===


Within the guides:
Some optional steps in this guide use the [https://casaguides.nrao.edu/index.php?title=Analysis_Utilities Analysis Utilities] package. If you wish to use any of these tasks, follow the link for download and installation instructions.
<source lang="python">
 
# In CASA
=== Background Knowledge ===
Regions of this color are CASA commands (or definitions) that need to be cut and
 
pasted in sequence. Wait until one command is finished before pasting another.  
This guide assumes that you are familiar with basic Python. If you need more information about python, see the official [https://docs.python.org/3/tutorial/index.html Python 3.13 tutorial]
Tabs matter in python, make sure that commands that span more than one line and
 
"for" loops keep their spacing. Sometimes (especially "for" loops) you may need to  
If you are new to interferometry or CASA, we recommend you follow the [[ALMA_Tutorials#Basic_Imaging_and_Analysis | “First Look” Imaging Tutorials]]. The [https://web.cvent.com/event/90ae72df-7675-41b5-b056-48af11e1aa7f/summary Synthesis Imaging Summer School Lectures] provide a wealth of information on interferometry.
explicitly hit enter twice to get the command going.
 
</source>
=== Getting Help ===
 
Many frequently asked questions can be found in the [https://help.almascience.org/kb ALMA Knowledgebase]. If you have additional questions after reviewing this guide, please contact the [https://help.almascience.org ALMA Helpdesk]. CASA specific feedback should be sent to casa-feedback@nrao.edu.


<pre style="background-color: #fffacd;">
== Version History ==
Information in this color shows excerpts from the CASA Logger output
</pre>


<pre style="background-color: #E0FFFF;">
The older CASA 6.1 versions of these guides are available at the following links:
This color shows you background information about the data or other types of reference material
#'''[[Imaging Prep CASA 6.5.4]]'''
</pre>
#'''[[Image Continuum CASA 6.5.4]]'''
#'''[[Self-Calibration Template CASA 6.5.4]]'''
#'''[[Image Line CASA 6.5.4]]'''

Latest revision as of 22:07, 30 April 2025

Most recently updated for CASA Version 6.6.1 using Python 3.8

About this Guide

This guide describes the template scripts used to manually image data for quality assurance by the North America ALMA Science Center (NAASC). This script is designed to guide the user through the decisions needed when imaging ALMA data. It should not be applied blindly; some editing of the scripts will be required in almost all cases. Not all sections of the template are relevant for all data sets. It can be adapted for use with partial pipeline processing of images. For example, you could do continuum subtraction in the pipeline, but use the scripts here as a template for manual imaging. See the ALMA Imaging Pipeline Reprocessing guide for information on pipeline processed images.

A current version of the script can be found on github.

Prepare for Imaging

Before you begin imaging, determine whether the dataset was manually or pipeline calibrated. The README file should state how the dataset was calibrated. If it does not, look in the script directory of the delivered data package. If you see a file named <ASDM UID>.ms.scriptForCalibration.py, the dataset was manually calibrated. If you see a filename PPR_*.xml, the dataset was pipeline calibrated.

Instructions on restoring the calibrated measurement set should be found in the README of your delivered dataset. For most cases, this can be done by running CASA in the script directory and executing scriptForPI.py in CASA:

# in CASA
execfile(scriptForPI.py)

Guide Contents

This guide has been split into 4 sections:

  1. Prepare the data for Imaging: This page creates the calibrated_final.ms that will be used for imaging. Commands can be found in scriptForImagingPrep_template.py available on github.
  2. Image the Continuum: This page creates a continuum measurement set (MS) named calibrated_final_cont.ms and continuum images using the MS created in Prepare the data for imaging section. Commands can be found in scriptForImaging_template.py available on github.
  3. Self-Calibration: This page provides a basic template for phase and amplitude self calibration of the continuum using the MS created in Image the Continuum section. Commands can be found in scriptForImaging_template.py available on github.
  4. Spectral Line Imaging: This page performs continuum subtraction and creates spectral line cubes using the MS created in Prepare the data for imaging section. Commands can be found in scriptForImaging_template.py available on github.

The NA imaging workflow used with these scripts is shown below.

Resources

ALMA QA2

A description of how the script is used at the NAASC can be found in Kepley et al. Proceedings of the SPIE, 9910, 99100C . More information on the ALMA Quality Assurance procedure and standards can be found on the ALMA Science Portal.

Example Data Set

All example images were produced using ALMA Science Verification Data of TW Hya. More information along with the dataset can be obtained from the TW Hydra Band 7 Calibration and Imaging Guide. That guide is no longer being updated, however the same data set is also used for the First Look guides found on the homepage: ALMA Tutorials#Basic Imaging and Analysis.

CASA Version and Weights

If the data was calibrated prior to CASA 4.3, we recommend that you image the data in the same version of CASA that it was calibrated in because the weighting scheme for the data in CASA was in limbo. See Data Weights and Combination for more information. If the data was calibrated in CASA version 4.3 or later, imaging the data in a later version of CASA should work but we recommend using the same version of Casa used for calibration when imaging since Casa is not guaranteed to be backwards compatible. The README or CASA log file will indicate which CASA version was used to calibrate the data. Different versions of CASA can be obtained from Download CASA. Remember to check the operating system requirements before proceeding with the installation.

Attached Scripts

Two template scripts (scriptForImagingPrep_template.py and scriptForImaging_template.py) are available for this guide. These contain commands with minimal instructions and are intended to be used by those more familiar with imaging. A current version of the scripts can be found on github.

Obtaining Analysis Utilities

Some optional steps in this guide use the Analysis Utilities package. If you wish to use any of these tasks, follow the link for download and installation instructions.

Background Knowledge

This guide assumes that you are familiar with basic Python. If you need more information about python, see the official Python 3.13 tutorial

If you are new to interferometry or CASA, we recommend you follow the “First Look” Imaging Tutorials. The Synthesis Imaging Summer School Lectures provide a wealth of information on interferometry.

Getting Help

Many frequently asked questions can be found in the ALMA Knowledgebase. If you have additional questions after reviewing this guide, please contact the ALMA Helpdesk. CASA specific feedback should be sent to casa-feedback@nrao.edu.

Version History

The older CASA 6.1 versions of these guides are available at the following links:

  1. Imaging Prep CASA 6.5.4
  2. Image Continuum CASA 6.5.4
  3. Self-Calibration Template CASA 6.5.4
  4. Image Line CASA 6.5.4