RAWACF to FITACF
SuperDARN data is distributed to the community in the rawacf
format. For most science applications you will want to process these files into the fitacf
format using the make_fit
routine.
Choosing a fitting algorithm
Several methods have been developed by the SuperDARN community to determine the physical properties of SuperDARN backscatter (power, velocity, spectral width, elevation, and their errors).
The fitting algorithms available for processing SuperDARN data are:
Name | Notes |
---|---|
fitacf3 |
Suitable for all scientific applications. Fitted data may appear 'noisy' for some radars due to operational problems (remove with fit_speck_removal ).Released: 2017 References: (1) FitACF 3.0 White Paper, (2) SuperDARN noise estimation |
fitacf2 |
Suitable for all scientific applications. Generally results in fewer fitted ACFs compared to fitacf3 . Released: 2006 Reference: Annales Geophysicae, 24, 115–128, 2006 |
lmfit2 |
Suitable for scientific applications of fit-level data. Levenburg-Marquardt fitting of SuperDARN auto-correlation functions (ACFs). ACF fitting is performed for all range gates. No elevation angles. Takes ~5-10 minutes to process 1 hour of data. Call using separate binary, make_lmfit2 Released: 2018 Reference: Radio Science, 53, 93-111, 2018 |
lmfit1 |
Suitable for scientific applications of fit-level data. A model complex ACF (single component, exponential decay) is fitted to the observed one using the Levenberg-Marquardt algorithm. No elevation angles. Released: c.a. 2012 Reference: Radio Science, 48, 274–282, 2013 |
fitex2 |
Intended for use with the tauscan multipulse sequence. Phase fitting performed with 120 phase variation models. Released: c.a. 2012 Reference: Radio Science, 48, 274–282, 2013 |
fitex1 |
Original fitex algorithm. Not thoroughly tested. No elevation angles. |
Warning
The lmfit2
algorithm must be called using the separate binary, make_lmfit2
.
Basic syntax
make_fit -fitacf3 [inputfile].rawacf > [outputfile].fitacf3
make_fit -fitacf2 [inputfile].rawacf > [outputfile].fitacf2
Use the -vb
flag to print some information in the terminal during the data processing.
Supplying TDIFF values
By default, RST reads TDIFF from each radar's hardware file.
To supply TDIFF values from a separate calibration file, use make_fit -tdiff_method [method]
. A sample calibration file is available in $RSTPATH/tables/superdarn/tdiff/tdiff.dat.tst
.
The user can also supply a fixed TDIFF value in microseconds using make_fit -tdiff [tdiff]
Type make_fit --help
in the command line for more information.
Old format files
The Data Analysis Working Group recommends converting old-format dat
files to rawacf
format before calling make_fit
. For example,
dattorawacf 2002020202f.dat > 2002020202f.rawacf
make_fit -fitacf2 2002020202f.rawacf > 2002020202f.fitacf2
It is also possible to process dat
files directly using make_fit -old
, which will produce an old-format fit
file as output. However, lossy compression associated with the old-format fit
files will lead to small differences in the fitted parameters compared to the recommended procedure shown above.
make_fit -old -fitacf2 [inputfile].dat [outputfile].fit
Convert multiple files
To perform the rawacf
to fitacf
conversion for all files in the current directory:
for file in *.rawacf
do
make_fit -fitacf3 -vb $file > "${file%.rawacf}.fitacf3"
done
You can then concatenate the 2-hour fitacf
files into a daily file, for example:
cat 20181001.*.lyr.fitacf3 > 20181001.lyr.fitacf3
Warning
When concatenating fitacf
files, it is important that the files are in chronological order. Usually the shell sorts the filenames in the correct order automatically, but if you do the listing with wildcards (e.g. system call from another program), you may need to do the sorting yourself.