Corrupting Observation simdata1: Difference between revisions
Line 34: | Line 34: | ||
<font color="red">Full corruption will make your data look worse than real ALMA data should look</font>. ALMA will use Water Vapor Radiometers (WVRs) to correct for the atmospheric phase delay in real time during the observation. Once the full hardware and software system is operational, the residual phase errors should be small (a few microns of equivalent PWV variation), roughly Gaussian, and independent on each antenna, so a more realistic portrayal of that may be to use <tt>sm.setgain</tt> with the real part of the gain equal to zero, or to use '''mode'''="individual" below. | <font color="red">Full corruption will make your data look worse than real ALMA data should look</font>. ALMA will use Water Vapor Radiometers (WVRs) to correct for the atmospheric phase delay in real time during the observation. Once the full hardware and software system is operational, the residual phase errors should be small (a few microns of equivalent PWV variation), roughly Gaussian, and independent on each antenna, so a more realistic portrayal of that may be to use <tt>sm.setgain</tt> with the real part of the gain equal to zero, or to use '''mode'''="individual" below. | ||
The full phase screen treatment is interesting to explore the full uncorrected corruption, to test other telescopes, and to test heuristics for WVR calculations. For more information, please see ALMA memos [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs587.html 587], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs582.html 582], | The full phase screen treatment is interesting to explore the full uncorrected corruption, to test other telescopes, and to test heuristics for WVR calculations. For more information, please see ALMA memos [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs587.html # 587], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs582.html 582], | ||
[http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs573.html 573], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs568.html 568], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs535.html 535], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs523.html 523], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs515.html 515], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs496.html 496], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs495.html 495], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs491.html 491], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs490.html 490], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs451.html 451], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs415.html 415], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs404.html 404], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs361.html 361], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs332.html 332], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs262.html 252], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs210.html 210], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs209.html 209], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs176.html 176] ... | [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs573.html 573], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs568.html 568], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs535.html 535], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs523.html 523], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs515.html 515], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs496.html 496], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs495.html 495], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs491.html 491], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs490.html 490], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs451.html 451], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs415.html 415], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs404.html 404], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs361.html 361], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs332.html 332], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs262.html 252], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs210.html 210], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs209.html 209], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs176.html 176] ... | ||
Revision as of 15:09, 17 December 2009
↵ Simulating Observations in CASA
The descriptions on this page are rather anemic at the moment, so please read this pdf explanation of how this is all done
Thermal noise
noise_thermal, t_sky, and tau0 allow you to add thermal noise from the atmosphere and from the ALMA receivers according to current ALMA specifications according to observing band. At time of writing, simdata knows the receiver temperature specifications for ALMA and EVLA, and a little about the altitude and pressure at the ALMa site.
For more flexibility and control, use the sm tool. run simdata without noise, and niter=0 to not produce a clean image. Optionally make a copy of the noise-free measurement set, and then do the following:
sm.openfromms("my.ms")
sm.setnoise( ... options ... )
sm.corrupt()
sm.done()
sm.setnoise takes as arguments the atmospheric and ground/ambient temperatures, antenna efficiencies, site characteristics, etc. There are three modes:
- simple: specify simplenoise="1Jy" to get random Gaussian noise with 1Jy RMS
- tsys-atm: use environment temperatures, antenna parameters, and the aatm library to create a model of the troposphere and add random noise of the appropriate magnitude to the visibilities
- tsys-manual: specify atmospheric brightness temperature and optical depth yourself (rather than let aatm calculate it for you) and apply noise of the corresponding magnitude.
- see the pdf mentioned above for the precise equations used
For any of the sm corruption methods, an actual calibration table can be written out, and plotted with plotcal to make sure you're introducing the magnitude and type of corruption that you desire.
Atmospheric Phase Noise
The troposphere is refractive, so introduces a phase delay, and is not uniform, so that phase delay differs between antennas. Excessive phase noise decorrelates the signal. In CASA, you can use sm.settrop to corrupt your measurement set with phase noise in two different ways:
Full corruption will make your data look worse than real ALMA data should look. ALMA will use Water Vapor Radiometers (WVRs) to correct for the atmospheric phase delay in real time during the observation. Once the full hardware and software system is operational, the residual phase errors should be small (a few microns of equivalent PWV variation), roughly Gaussian, and independent on each antenna, so a more realistic portrayal of that may be to use sm.setgain with the real part of the gain equal to zero, or to use mode="individual" below. The full phase screen treatment is interesting to explore the full uncorrected corruption, to test other telescopes, and to test heuristics for WVR calculations. For more information, please see ALMA memos [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs587.html # 587], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs582.html 582], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs573.html 573], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs568.html 568], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs535.html 535], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs523.html 523], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs515.html 515], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs496.html 496], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs495.html 495], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs491.html 491], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs490.html 490], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs451.html 451], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs415.html 415], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs404.html 404], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs361.html 361], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs332.html 332], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs262.html 252], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs210.html 210], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs209.html 209], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs176.html 176] ...
For more information about the atmosphere at Chanchatnor, see memos [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs542.html 542], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs529.html 529], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs521.html 521], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs517.html 517], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs512.html 512], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs500.html 500], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs497.html 497], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs459.html 459], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs384.html 384], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs365.html 365], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs363.html 363], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs345.html 345], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs334.html 334], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs238.html 238], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs237.html 237], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs187.html 187], [http:/http://www.alma.nrao.edu/memos/html-memos/abstracts/abs186.html 186] ...
- mode="individual": the delay varies with time according to fractional Brownian Motion (fBM), or generalized 1/f noise. This mathematical description is very good for many natural stochastic processes, and used very widely for e.g. CGI simulations of fractal landscapes, turbulent motions and structures in clouds and water, electronic gain drift, etc.
- mode="screen": a 2-dimensional phase screen is generated with the same fBM mathematical model, and blows across the array at the specified wind speed. This creates much more realistic correlations in time and space between antennas. In practice, what is created is a fluctuation of precipitable water vapor (PWV) screen, and then the aatm library and tropospheric model is used to calculate the corresponding phase delay as a function of frequency.
old method, unsupported, YMMV: Rob Reid wrote a python script to add phase noise,
noisify_alma.py. noisify_alma gets its parameters from the ALMA specifications where it can, and an approximate Komolgorov model of the atmosphere such that the phase difference
between two antennas increases with baseline length.
- note that noisify_alma.py also does thermal noise. don't add twice as much as you intended.
Gain
- sm.setgain
- mode="random" generates random Gaussian complex gains with the given real and imaginary RMS
- mode="fbm" generates a fractional Brownian Motion complex gain drift or time-dependent variation, independently for each antenna
Leakage a.k.a. Cross-polarization
- sm.setleakage
- random Gaussian (time-independent) complex cross-polarization leakage terms, with specified real and imaginary amplitudes, and an optional systematic offset from zero
- at time of writing, CASA only calculates cross-polarization in the linear approximation. Full treatment will be added in the future.