[End-to-End Test Code Sprint] BUFR to IODA converter for ADPUPA bufr dump

[PraveenKumar-NOAA]

Configuration

• Test Date is 2021080100
• BUFR Converter:
  • Convert time to dateTime (in units of seconds since 1970-01-01T00:00:00Z)
  • Add conversions of: latitude, longitude, stationIdentification, stationElevation, windEastward, windNorthward, airTemperature, dewPointTemperature, and pressure
• Convert BUFR to IODA format using Python API
• Create a JSON file for the converter
• Run and update run_bufr2ioda.py for the converter
• Run UFO HofX

Check List

Investigate diag output from UFO

• bufr2ioda_adpupa.json
• ADPUPA bufr version of Python API
• dateTime, receiptTime, launchTime
• driftTime, driftLatitude, driftLongitude
• ADPUPA HofX
• GSI HofX

The following ADPUPA BUFR subsets will be included into the converter:

| NC002001 | A63218 | MSG TYPE 002-001 RAWINSONDE - FIXED LAND |
| NC002002 | A63219 | MSG TYPE 002-002 RAWINSONDE - MOBIL LAND |
| NC002003 | A63220 | MSG TYPE 002-003 RAWINSONDE - SHIP |
| NC002004 | A63221 | MSG TYPE 002-004 DROPWINSONDE |
| NC002005 | A63222 | MSG TYPE 002-005 PIBAL |

[PraveenKumar-NOAA]

A first version of the API is finished using the original LAT/LON. The end-to-end tests were run and scatter plots were created for the following observations:

airTemperature:

windEastward:

windNorthward:

[PraveenKumar-NOAA]

JEDI h(x) vs obsValues plots created after fixing the dateTime variable issues:

airTemperature:

windEastward:

windNorthward:

[PraveenKumar-NOAA]

Comparison of the data files generated using the prepBUFR and BUFR Python API:

prepBUFR: Total Counts or locations - 270,600 (1353, 200)
BUFR: Total Counts or locations - 188,190 (738, 255)

Pressure Comparison:

prepBUFR
Location - 270600
Missing values - 190565
Total obs - (270600 - 190565) = 80,035

BUFR
Location - 188190
Missing values - 123236
Total obs - (188190 - 123236) = 64,954

[PraveenKumar-NOAA]

Wind Comparison:

prepBUFR
Location - 270600
Missing values - 228986
Total obs - (270600 - 228986) = 41,614

BUFR
Location - 188190
Missing values - 135259
Total obs - (188190 - 135259) = 52931

[PraveenKumar-NOAA]

windNorthward:

[PraveenKumar-NOAA]

Temperature Comparison:

prepBUFR
Location - 270600
Missing values - 255384
Total obs - (270600 - 255384) = 15,216

BUFR
Location - 188190
Missing values - 142596
Total obs - (188190 - 142596) = 45,594

[PraveenKumar-NOAA]

@emilyhcliu I created plots for the pressure, wind, and temperature observations using the ioda files generated using the adpupa prepbufr and bufr python api. Please look at these plots and let me know your comments/suggestions.

[PraveenKumar-NOAA]

Validation for the Python API converter: following plots were created using observation from the input BUFR DUMP and output IODA files:

BUFR/pressure:

IODA/pressure:

[PraveenKumar-NOAA]

BUFR/airTemperature:

IODA/airTemperature: