SD_Toolbox

Checkout Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
* Unified ERA5 extraction methods, as they are basically the same.

* Extracted InputData and OutputData for better maintainability.

** Extended / improved InputData validation.

* Renamed output_messages for file naming consistency.

Related to Issue [SDTOOLBOX-24]

    • -355
    • +0
    /trunk/SDToolBox/extract_data_era5.py
    • -635
    • +0
    /trunk/SDToolBox/data_acquisition.py
    • -91
    • +49
    /trunk/tests/test_extract_data.py
    • -24
    • +317
    /trunk/SDToolBox/extract_data.py
    • -67
    • +0
    /trunk/tests/test_extract_data_era5.py
    • -0
    • +167
    /trunk/SDToolBox/input_data.py
    • -25
    • +22
    /trunk/SDToolBox/extract_data_EARTH.py
    • -0
    • +22
    /trunk/SDToolBox/output_messages.py
    • -23
    • +0
    /trunk/tests/test_main_acceptance.py
  1. … 5 more files in changeset.
Removed reference to previous defined class.

Related to Issue [SDTOOLBOX-23]

Removed unneeded files (sea level pressure EARTH and era5) because of refactoring

Related to Issue [SDTOOLBOX-23]

    • -112
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -201
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
Added missing extract_data_EARTH

Related to Issue [SDTOOLBOX-23]

    • -0
    • +237
    /trunk/SDToolBox/extract_data_EARTH.py
Added tests for EARTH and wind

Related to Issue [SDTOOLBOX-23]

    • -0
    • +37
    /trunk/tests/test_extract_wind.py
    • -0
    • +42
    /trunk/tests/test_extract_data_EARTH.py
Added simple resampling for the feature given either a xarray or an outputdata object. Added simple unit tests.

Related to Issue [SDTOOLBOX-27]

    • -0
    • +88
    /trunk/SDToolBox/data_processing.py
    • -0
    • +140
    /trunk/tests/test_data_processing.py
Added EC-EARTH sea level pressure extraction

Related to Issue [SDTOOLBOX-23]

    • -2
    • +20
    /trunk/SDToolBox/data_acquisition.py
Added extraction of ERA5 subset water levels

Related to Issue [SDTOOLBOX-18]

    • -3
    • +42
    /trunk/SDToolBox/extract_data_era5.py
    • -1
    • +1
    /trunk/tests/test_extract_data_era5.py
Fixed failing test by comparing sets and length of their lists.

Related to Issue [SDTOOLBOX-15]

Added Test day 1 documentation and data
  1. /trunk/doc/SDToolBox - Test Plan/study_case_NL
Fixed a small bug, now we return a list of unique variables. Extended tests.

Related to Issue [SDTOOLBOX-15]

Finished validation for the input, extended Input data structure and how to work with it for the extract_data_Era5, removed extract waves and its previous test as they have been deprecated in favor of extract_data_era5.py

Related to Issue [SDTOOLBOX-15]

    • -64
    • +37
    /trunk/SDToolBox/extract_data_era5.py
    • -7
    • +10
    /trunk/tests/test_extract_data_era5.py
    • -185
    • +0
    /trunk/tests/test_extract_waves.py
    • -220
    • +0
    /trunk/SDToolBox/extract_waves.py
Added wind extraction. Minor changes to test extract waves

Related to Issue [SDTOOLBOX-19]

Reworked on the input data class and its structure to have a more uniformed code.

Added tests for input data.

Related to Issue [SDTOOLBOX-15]

    • -230
    • +0
    /trunk/tests/test_data_acquisition.py
    • -0
    • +234
    /trunk/tests/test_input_data.py
    • -73
    • +38
    /trunk/SDToolBox/data_acquisition.py
Adapted code for correct extraction of data.

Changed parent private properties into internal so they are accessible from the inherited classes.

Related to Issue [SDTOOLBOX-24]

    • -15
    • +15
    /trunk/SDToolBox/extract_data.py
    • -72
    • +11
    /trunk/tests/test_extract_data_era5.py
    • -29
    • +45
    /trunk/SDToolBox/extract_data_era5.py
Created a unified era5 extraction method with matching tests and logic for waves, wind and slp.

Related to Issue [SDTOOLBOX-24]

    • -0
    • +68
    /trunk/tests/test_extract_data.py
    • -14
    • +16
    /trunk/tests/test_output_data.py
    • -0
    • +125
    /trunk/tests/test_extract_data_era5.py
    • -0
    • +332
    /trunk/SDToolBox/extract_data_era5.py
    • -0
    • +56
    /trunk/SDToolBox/extract_data.py
Corrected input data property, instead of a dictionary we expect a list of variable names.

Related to Issue [SDTOOLBOX-17]

Now we can generate the output as a temporary file, without having to give all the parameters.

Related to Issue [SDTOOLBOX-22]

    • -23
    • +42
    /trunk/SDToolBox/data_acquisition.py
Updated input data to require the variable dictionary.

Related to Issue [SDTOOLBOX-22]

    • -28
    • +79
    /trunk/tests/test_extract_waves.py
    • -14
    • +12
    /trunk/SDToolBox/extract_waves.py
Updated dummy wave file, now we do not create variables for those which are empty.

Related to Issue [SDTOOLBOX-22]

    • -8
    • +17
    /trunk/SDToolBox/data_acquisition.py
Fixed some tests

Related to Issue [SDTOOLBOX-20]

    • -42
    • +43
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
Generation of output works now given a netcdf file path, it also generates an xarray.

Extended functionality to directly call to generate output (does both netcdf and xarray).

Related to Issue [SDTOOLBOX-22]

    • -43
    • +52
    /trunk/tests/test_output_data.py
    • -33
    • +45
    /trunk/SDToolBox/data_acquisition.py
Corrected reference file, it was getting the wrong assumption.

Related to Issue [SDTOOLBOX-17]

Corrected extraction of time array.

Related to Issue [SDTOOLBOX-22]

Small refactoring towards creation of netcdf.

Related to Issue [SDTOOLBOX-22]

    • -8
    • +16
    /trunk/SDToolBox/data_acquisition.py
    • -12
    • +10
    /trunk/tests/test_output_data.py
Added sea level pressure with OutputData

Related to Issue [SDTOOLBOX-20]

    • -31
    • +131
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
    • -21
    • +73
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
Added logic to create a xarray from the netcdf, added logic to set dictionary values into the output netcdf.

Related to Issue [SDTOOLBOX-22]

    • -22
    • +46
    /trunk/SDToolBox/data_acquisition.py
Small code correction to dynamically search for a reference file.

Related to Issue [SDTOOLBOX-17]

Corrected code to generate a valid netcdf. Set error messages in outputmessages.py

Fixed tests.

Related to Issue [SDTOOLBOX-22]

    • -43
    • +65
    /trunk/SDToolBox/data_acquisition.py
    • -31
    • +54
    /trunk/tests/test_output_data.py
Readded extract waves and adapted system test.

Related to Issue [SDTOOLBOX-17]

    • -0
    • +211
    /trunk/SDToolBox/extract_waves.py