Update CAWDL for new website data availability; pause CASGEM module #105
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Related Issues
Closes #70
Addresses #98
Description
Extend
collect.dwr.cawdl
module for compatibility with data availability per the new data endpoints (CAWDL continuous data has migrated to https://wdlstorageaccount.blob.core.windows.net). Continuous data records encompass both surface and ground water records, so methods are refactored to be used for both data streams.Temporarily remove
collect.dwr.casgem
module - collect methods are obsolete due to changes in CASGEM website structure. This will be revived when public endpoints are available via CASGEM's website.Breaking Changes
Key changes in
collect.dwr.cawdl
:get_cawdl_site_detail_url
: helper function to produce URL for station detail page (interactive web page)get_cawdl_site_report_url
: helper function to produce URL for text site reportget_cawdl_continuous_data_url
: helper function to produce URL for timeseriesget_cawdl_dataset_overview
: access to summary datasets on CNRA open data portal related to CAWDL recordsget_cawdl_data
: continuous data records appear to be the mainget_cawdl_surface_water_data
withget_cawdl_continuous_data
and providedstart
andend
date filtersget_cawdl_surface_water_por
withget_cawdl_continuous_data
get_cawdl_surface_water_site_report
withget_cawdl_site_detail
andget_cawdl_continuous_data_site_report
Key changes in
collect.dwr.casgem
:casgem.casgem_scraper
tocasgem.casgem
casgem.get_casgem_data
to raiseNotImplementedError
Example Usage