I was wondering if anyone knows a good resource for documentation on what algorithms are used to process NEXRAD level 3 data. There is obviously the mapping of data to a standard polar grid, but it also appears that some smoothing and filtering is applied as well. I’m assuming all of the data is built from the ray messages like Level 2 data are, but I could be wrong about that too!
I have been unable to locate and documention that details these processes. Have searched through the RPG/RDA docs and ROC website without luck. But maybe I’m looking in the wrong place.
I reached out to @jmkurdzo (thank you!) and he supplied me with a doc. With NOAA ROCs blessing I’ll post if others might find this useful. BUT, I can’t find a way to attach a file here?
The files are the Algorithm Enunciation Language (AEL) documents from the ROC on the recombination (super-res to legacy res) algorithm and the dual-pol pre-processing algorithm. In ORPG land, these go by recomb and dpprep. The AEL documents use pseudo code to step through the entire process of the algorithm, including all of the filter settings and lengths. Our ROC contacts informed me that given recomb and dpprep are part of the public CODE repo (WSR-88D CODE), the AEL documents are public knowledge. I’m not entirely sure why they aren’t more public facing, but as far as I can tell, we’ve got clearance to post them here, so let’s be trend setters!
These documents are incredibly useful for determining exactly how Level-II data translate to Level-III products. We use them for algorithm development that is destined for the ORPG (specifically new classes for the HCA recently), as well as studies that compare Level-II and Level-III data or use Level-III algorithms like QPE.
@mgrover1 could you host the two pdf files on the website somewhere that we could link to here? It would be good to avoid a non-permanent, say, Dropbox link. The recomb is a little over 11 mb, the dpprep is tiny.
@mgrover1@jmkurdzo What if we add a page regarding data formats to the openradarscience.org site? We could host docs there permanently and also provide links to relevant sites.
Thanks for this additional information Jim. This information is essential for private industry developing alternative products to those served by NOAA as well (think industry specific) as there can be advantages and disadvantages to use of Level 2 or 3 products.
@kmuehlbauer I like the idea of a page with these docs. If possible, I’d just make sure to note versions of docs as things change and users can be aware of the date of validity or request posting of updated docs they can provide.
I think another example of this is format description of cfradial that @mgrover1 pointed towards in a previous thread (I am sensing I’m an instigator in these, haha).
@mgrover1 Yes, great idea! We could think about dedicating it’s own repo to format descriptions. This could then live under https://docs.openradarscience.org like the xradar package.