Data flagging with viewer

Overview

Your data will inevitably have some bad data. Perhaps a receiver on a given antenna is acting up, or perhaps the pointing on a given antenna is poor, and these problematic data will translate to (hopefully) obviously aberrant data in your measurement set. It's a good idea to inspect your data carefully before calibration and imaging, and CASA offers several tools to flag bad data interactively.

This tutorial illustrates how to use viewer to flag poor data. It will use the continuum dataset AU079 from the VLA archive; this dataset is also used in the Imaging Flanking Fields tutorial.

Loading the Measurement Set into Viewer

As described in the Imaging Flanking Fields tutorial, the data may be loaded into CASA using the importvla command. The following commands import the data into the measurement set au079.ms and send them to the viewer.

# from loaddata.py
from glob import glob

# Define the list of files for reading. Use glob to perform wildcard matching with VLA archive filenames.
fileList = glob('AU079_*.xp?')

importvla(archivefiles=fileList,vis='au079.ms')
viewer('au079.ms') # load the data into the viewer for editing

The viewer command can also be invoked without argument, in which case a file selector GUI will appear.

Setting Up for Antenna-based Flagging

The figure at right shows the default viewer display for a measurement set. The axes are (y) time and (x) baseline, or antenna pair, enumerated by the common antenna number of the pair. Flagged data are highlighted in pale blue. Another window, titled Data Display Options, will also appear, allowing you to alter the display and flagging options. Click to enlarge

The blue highlights can be initially distracting, and they can be optionally suppressed by altering the Flagging Options in the Data Display Options. The figure at right shows the options. Set Show Flagged Regions... to Masked to Background. This operation will effectively set the flagged regions to black. In anticipation of the antenna-based editing to come, it's also worth setting the antenna flag. Set Flag / Unflag Entire Antenna to Yes. Now, when multiple baselines are selected, all baselines to the common antenna will be flagged. Click to enlarge

There is a choice of data to display. Select the MS and Visibility Selection tab on the Data Display Options window; see the figure at right. The Visibility Component menu allows you to choose to display visibility data from the following list. Amplitude Phase Real (the real part of the visibilities) Imaginary (the imaginary part of the visibilities) Amp Diff (amplitudes after subtracting a local, rolling time-average) Amp RMS (based on a rolling time window) Phase Diff (phases after subtracting a local, rolling time-average) Phase RMS (based on a rolling time window) The rolling time windows needed to calculate the Diff and RMS options are tuned using the Moving Average Size slider. All of these options are useful to investigate aberrant data, but Amp Diff can be efficient to start with. Reasonable options are shown in the figure at right. Be sure to turn down the display maximum (Data Maximum under Basic Settings) to bring out the fainter variations. Click to enlarge

The result of these operations is illustrated in the figure at right. Data from the RR correlator are shown, but you can easily select the other correlators (RL, LR, LL) by using the blue, DVD-style control buttons below the main display. The RR data look overall pretty good. The brighter horizontal stripes mark calibrator observations; brighter sources show greater noise. Antenna 13 looks a little junky, however, especially between time marks 1000 and 2500. Click to enlarge

Antenna-Based Flagging

The following steps outline flagging with viewer.

• Zoom in on junky-looking data using the zoom tool .
• Use one of the drawing selectors to identify the bad data.
• Zoom out and repeat.
• Important: save your edits! Under Flagging Options, use the Save Edits button.

This section of the tutorial provides a more detailed walkthrough.

Time to zap those junky antenna 13 data. First, use the zoom tool , which by default is activated by the left mouse button, to click and drag a box around the region of interest. Left double-click within the box to zoom. The figure at right shows the zoom selector box and the resulting zoom. Click to enlarge

Now, use the drawing rectangle selector tool , which by default is activated by the right mouse button. Right-click and drag to draw a box around the data to be flagged. Since we're flagging all to a common antenna, it's better to make the box narrow in the baseline (x) direction to avoid accidentally flagging the neighboring antenna. Then, right double-click within the selector box to flag. The figure at right illustrates the data selection tool and the result of data flagging. Although only a subset of the Antenna 13 baselines were selected, all of the Antenna 13 baselines were flagged because of our choice of Flag / Unflag Entire Antenna in the Data Display Options - Flagging Options menu. Click to enlarge

Finishing up

To flag additional data, zoom out , select correlators as necessary, and repeat the steps outlined above.

It is absolutely vital to save your edits before leaving viewer. From the Data Display Options window, select Flagging Options and Save Edits (see figure at right). You are now ready for calibration and imaging!

Click to enlarge

--Jgallimo 19:14, 23 November 2009 (UTC)