# RADOLAN-YW historical data format different from recent data format? **URL:** \ **Category:** Data\ **Created:** [July 19, 2024, 9:00am UTC](https://openradar.discourse.group/t/radolan-yw-historical-data-format-different-from-recent-data-format/489 "2024-07-19T09:00:05Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![GiantMGG](https://yyz2.discourse-cdn.com/free1/user_avatar/openradar.discourse.group/giantmgg/32/362_2.png) [@GiantMGG](https://openradar.discourse.group/u/GiantMGG)\ **Post date:** [July 19, 2024, 9:00am UTC](https://openradar.discourse.group/t/radolan-yw-historical-data-format-different-from-recent-data-format/489/1 "2024-07-19T09:00:06Z")
Hello, I just started to get into “nowcasting” and I am trying to do some machine learning stuff in this field. I am located in Germany and am using precipitation data from the DWD open data server. Also I am using python with the wradlib library. I want to use the RADOLAN-YW product but am struggling to find historical data and recent data in the same format. Right now I am using the historical data from [Index of /climate\_environment/CDC/grids\_germany/5\_minutes/radolan/reproc/2017\_002/ (dwd.de)](https://opendata.dwd.de/climate_environment/CDC/grids_germany/5_minutes/radolan/reproc/2017_002/) and the recent data from [Index of /weather/radar/radolan/yw/ (dwd.de)](https://opendata.dwd.de/weather/radar/radolan/yw/). The issue is that the historcial data is in the RADOLAN version 2.18.3 with a grid size of 1100km x 900km and the recent data in the version 2.29.1 with a grid size of 900km x 900km. Also the radar station radius is different with 150km (historical) to 128km (recent). But if I plot the data with the respective radolan\_grids from the wradlib library, the data circles from the historical data are smaller than the recent ones: ![dff23d9e-51df-4bf3-8fcc-3755c53b2f8f](https://global.discourse-cdn.com/free1/uploads/openradar/original/1X/fac0bab14b7a5e51a121c04490118afe013f1cd6.png) (Since I am a new user, I can only uplad one picture) Are there historical datasets with the RADOLAN version 2.29.1? Or ist there maybe something I am doing wrong? Best Max ---
**Author:** ![tschneider](https://avatars.discourse-cdn.com/v4/letter/t/9d8465/32.png) [@tschneider](https://openradar.discourse.group/u/tschneider)\ **Post date:** [July 24, 2024, 1:45pm UTC](https://openradar.discourse.group/t/radolan-yw-historical-data-format-different-from-recent-data-format/489/2 "2024-07-24T13:45:19Z")
Unfortunately i did not find both recent and historical datasets with the same format. The files from [Index of /climate\_environment/CDC/grids\_germany/5\_minutes/radolan/recent/ (dwd.de)](https://opendata.dwd.de/climate_environment/CDC/grids_germany/5_minutes/radolan/recent/) also seem to be 900 x 900 while the historical data are 1100 x 900. Historical data are reprocessed before publishing. I only found a document in German: [251\_pdf.pdf;jsessionid=A9C29FFDAE4B1F845DFEE05DB5857D3B.live21061 (dwd.de)](https://www.dwd.de/DE/leistungen/pbfb_verlag_berichte/pdf_einzelbaende/251_pdf.pdf;jsessionid=A9C29FFDAE4B1F845DFEE05DB5857D3B.live21061?__blob=publicationFile&v=2) The reprocessing is only done once per year for the year prior and not done continuously for recent data. ---
**Author:** ![tschneider](https://avatars.discourse-cdn.com/v4/letter/t/9d8465/32.png) [@tschneider](https://openradar.discourse.group/u/tschneider)\ **Post date:** [July 24, 2024, 2:00pm UTC](https://openradar.discourse.group/t/radolan-yw-historical-data-format-different-from-recent-data-format/489/3 "2024-07-24T14:00:13Z")
I still have 900x900 radolan bin files from /weather/radar/radolan/yw/ for a few days from August 2023 from an old project analysis. If you are interested, i can upload those and you can try to compare / overlay these datasets with the reprocessed historical data. However, there are the differences in both spatial/grid aspect as well as the reprocessing, so i am not sure if you will get a sufficiently good setup to do machine learning. ---
**Author:** ![GiantMGG](https://yyz2.discourse-cdn.com/free1/user_avatar/openradar.discourse.group/giantmgg/32/362_2.png) [@GiantMGG](https://openradar.discourse.group/u/GiantMGG)\ **Post date:** [July 28, 2024, 7:04pm UTC](https://openradar.discourse.group/t/radolan-yw-historical-data-format-different-from-recent-data-format/489/4 "2024-07-28T19:04:17Z")
Thanks for the information. Somehow its hard to keep track of the different pieces and versions of information available from the DWD 😃 I also contacted the DWD directly and got a reply which confirmed my observation, that the historical (reprocessed) data is different format and based on the “DX” product, with 128 km radius around the radar stations on a 1100 km x 900 km grid. The new processing pipeline has 150 km radius with a 900 km x 900 km radius. Maybe they can provid the raw data of the “new” measurements, so I possibly could create the precipitation grids myself. For now I will stick to the older format for training some initial models.