SD_Toolbox

Checkout Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
added aggregation methods for atmospheric data. work in progress

Related to Issue [SDTOOLBOX-32]

    • -9
    • +81
    /trunk/tests/test_data_processing.py
    • -8
    • +91
    /trunk/SDToolBox/data_processing.py
Added spatial resampling and a simple test for data processing.

Related to Issue [SDTOOLBOX-28]

    • -4
    • +23
    /trunk/SDToolBox/data_processing.py
    • -7
    • +25
    /trunk/tests/test_data_processing.py
Added logic and tests for the feature resampling in time.

Related to Issue [SDTOOLBOX-27]

    • -27
    • +39
    /trunk/SDToolBox/data_processing.py
    • -0
    • +56
    /trunk/tests/test_data_processing.py
Changed lat-lon dimensions for each variable, added input_scenarios as parameter.

Related to Issue [SDTOOLBOX-24]

Extended tests and input data definition.Improved extraction for consider gridded points.

Related to Issue [SDTOOLBOX-24]

    • -33
    • +25
    /trunk/tests/test_data_processing.py
Improved extraction for consider gridded points.

Related to Issue [SDTOOLBOX-24]

Added PCA calculation and derivates as static methods

Related to Issue [SDTOOLBOX-29]

Fixed review remarks

Related to Issue [SDTOOLBOX-29]

    • -18
    • +52
    /trunk/SDToolBox/data_processing.py
    • -18
    • +19
    /trunk/tests/test_data_processing.py
Compute gradients of sea level pressure and PCA component Analysis to be tested with more consistent values

Related to Issue [SDTOOLBOX-29]

    • -23
    • +22
    /trunk/SDToolBox/data_processing.py
Fixed remaining bugs / adjustments of the code.

Related to Issue [SDTOOLBOX-24]

Added max and mean resampling for xarray.

Related to Issue [SDTOOLBOX-27]

    • -16
    • +64
    /trunk/tests/test_data_processing.py
    • -4
    • +44
    /trunk/SDToolBox/data_processing.py
Changed a few metadata values.

Related to Issue [SDTOOLBOX-24]

Improved Extract data functionality, joined everything by using inheritance and abstract classes.

* Removed outdated files.

* Added EARTH logic to extract its values.

Related to Issue [SDTOOLBOX-24]

    • -71
    • +0
    /trunk/SDToolBox/extract_data_EARTH.py
    • -98
    • +169
    /trunk/SDToolBox/extract_data.py
    • -42
    • +0
    /trunk/tests/test_extract_data_EARTH.py
Refactoring for EARTH.

Related to Issue [SDTOOLBOX-24]

    • -168
    • +1
    /trunk/SDToolBox/extract_data_EARTH.py
    • -121
    • +182
    /trunk/SDToolBox/extract_data.py
Implemented Compute gradients of slp and PCA.

Work in progress. To be tested.

Related to Issue [SDTOOLBOX-29]

    • -0
    • +47
    /trunk/tests/test_data_processing.py
    • -3
    • +71
    /trunk/SDToolBox/data_processing.py
    • -2
    • +6
    /trunk/SDToolBox/extract_data_EARTH.py
* Further improvements by using abstract classes.

* Created a setter / getter in OutputData for variable_dict.

Related to Issue [SDTOOLBOX-24]

    • -111
    • +200
    /trunk/SDToolBox/extract_data.py
    • -1
    • +1
    /trunk/tests/test_extract_data_EARTH.py
* Unified ERA5 extraction methods, as they are basically the same.

* Extracted InputData and OutputData for better maintainability.

** Extended / improved InputData validation.

* Renamed output_messages for file naming consistency.

Related to Issue [SDTOOLBOX-24]

    • -355
    • +0
    /trunk/SDToolBox/extract_data_era5.py
    • -635
    • +0
    /trunk/SDToolBox/data_acquisition.py
    • -91
    • +49
    /trunk/tests/test_extract_data.py
    • -24
    • +317
    /trunk/SDToolBox/extract_data.py
    • -67
    • +0
    /trunk/tests/test_extract_data_era5.py
    • -0
    • +167
    /trunk/SDToolBox/input_data.py
    • -25
    • +22
    /trunk/SDToolBox/extract_data_EARTH.py
    • -0
    • +22
    /trunk/SDToolBox/output_messages.py
    • -23
    • +0
    /trunk/tests/test_main_acceptance.py
  1. … 5 more files in changeset.
Removed reference to previous defined class.

Related to Issue [SDTOOLBOX-23]

Removed unneeded files (sea level pressure EARTH and era5) because of refactoring

Related to Issue [SDTOOLBOX-23]

    • -112
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -201
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
Added missing extract_data_EARTH

Related to Issue [SDTOOLBOX-23]

    • -0
    • +237
    /trunk/SDToolBox/extract_data_EARTH.py
Added tests for EARTH and wind

Related to Issue [SDTOOLBOX-23]

    • -0
    • +37
    /trunk/tests/test_extract_wind.py
    • -0
    • +42
    /trunk/tests/test_extract_data_EARTH.py
Added simple resampling for the feature given either a xarray or an outputdata object. Added simple unit tests.

Related to Issue [SDTOOLBOX-27]

    • -0
    • +88
    /trunk/SDToolBox/data_processing.py
    • -0
    • +140
    /trunk/tests/test_data_processing.py
Added EC-EARTH sea level pressure extraction

Related to Issue [SDTOOLBOX-23]

    • -2
    • +20
    /trunk/SDToolBox/data_acquisition.py
Added extraction of ERA5 subset water levels

Related to Issue [SDTOOLBOX-18]

    • -3
    • +42
    /trunk/SDToolBox/extract_data_era5.py
    • -1
    • +1
    /trunk/tests/test_extract_data_era5.py
Fixed failing test by comparing sets and length of their lists.

Related to Issue [SDTOOLBOX-15]

Added Test day 1 documentation and data
  1. /trunk/doc/SDToolBox - Test Plan/study_case_NL
Fixed a small bug, now we return a list of unique variables. Extended tests.

Related to Issue [SDTOOLBOX-15]

Finished validation for the input, extended Input data structure and how to work with it for the extract_data_Era5, removed extract waves and its previous test as they have been deprecated in favor of extract_data_era5.py

Related to Issue [SDTOOLBOX-15]

    • -64
    • +37
    /trunk/SDToolBox/extract_data_era5.py
    • -7
    • +10
    /trunk/tests/test_extract_data_era5.py
    • -185
    • +0
    /trunk/tests/test_extract_waves.py
    • -220
    • +0
    /trunk/SDToolBox/extract_waves.py
Added wind extraction. Minor changes to test extract waves

Related to Issue [SDTOOLBOX-19]

Reworked on the input data class and its structure to have a more uniformed code.

Added tests for input data.

Related to Issue [SDTOOLBOX-15]

    • -230
    • +0
    /trunk/tests/test_data_acquisition.py
    • -0
    • +234
    /trunk/tests/test_input_data.py
    • -73
    • +38
    /trunk/SDToolBox/data_acquisition.py