SD_Toolbox

Checkout Tools

Line History

Line Count Graph
Line Count Graph

Stats

Commits this week: 0
Total Committers: 4
Last Commit: 21 Oct 20
Commits this week: 0
Total Lines of Code (LoC): 18,020
Net change in LoC this week: 0

Commit Activity

Commits By Day In Week
52 week commits volume
Commits By Day In Week
Commits by day
Commits By Day In Week
Commits by hour
Commits By Hour In Day
Commit calendar
 

Most active committers (90 days)

loading
loading

Subversion Details

6 properties
  • bugtraq:label = Jira Issue-ID
  • bugtraq:logregex = Issue \[([A-Za-z]+-\d+)\]
  • bugtraq:message = Related to Issue [%BUGID%]
  • bugtraq:number = false
  • bugtraq:url = https://issuetracker.deltares.nl/browse/%BUGID%
  • bugtraq:warnifnoissue = true
  • last updated a few seconds ago
All Commits Reviews
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Friday 18 Oct 2019
5:59 pm

tiotto

Implemented Compute gradients of slp and PCA.

Work in progress. To be tested.

Related to Issue [SDTOOLBOX-29]

Options
    • -0
    • +2
    /trunk/SDToolBox/output_messages.py
    • -0
    • +47
    /trunk/tests/test_data_processing.py
    • -3
    • +71
    /trunk/SDToolBox/data_processing.py
    • -2
    • +6
    /trunk/SDToolBox/extract_data_EARTH.py
4:23 pm

Carles Soriano Perez

* Further improvements by using abstract classes.

* Created a setter / getter in OutputData for variable_dict.

Related to Issue [SDTOOLBOX-24]

Options
    • -2
    • +2
    /trunk/tests/test_output_data.py
    • -111
    • +200
    /trunk/SDToolBox/extract_data.py
    • -1
    • +1
    /trunk/tests/test_extract_data_EARTH.py
    • -2
    • +26
    /trunk/SDToolBox/output_data.py
    • -0
    • +3
    /trunk/SDToolBox/input_data.py
    • -0
    • +1
    /trunk/SDToolBox/output_messages.py
    • -3
    • +13
    /trunk/tests/test_extract_data.py
2:33 pm

Carles Soriano Perez

* Unified ERA5 extraction methods, as they are basically the same.

* Extracted InputData and OutputData for better maintainability.

** Extended / improved InputData validation.

* Renamed output_messages for file naming consistency.

Related to Issue [SDTOOLBOX-24]

Options
    • -16
    • +0
    /trunk/tests/test_main_unit.py
    • -37
    • +0
    /trunk/tests/test_extract_wind.py
    • -2
    • +3
    /trunk/SDToolBox/main.py
    • -355
    • +0
    /trunk/SDToolBox/extract_data_era5.py
    • -635
    • +0
    /trunk/SDToolBox/data_acquisition.py
    • -91
    • +49
    /trunk/tests/test_extract_data.py
    • -31
    • +0
    /trunk/tests/test_extract_slp.py
    • -24
    • +317
    /trunk/SDToolBox/extract_data.py
    • -67
    • +0
    /trunk/tests/test_extract_data_era5.py
    • -4
    • +68
    /trunk/tests/test_input_data.py
    • -0
    • +167
    /trunk/SDToolBox/input_data.py
    • -25
    • +22
    /trunk/SDToolBox/extract_data_EARTH.py
    • -0
    • +22
    /trunk/SDToolBox/output_messages.py
    • -21
    • +0
    /trunk/SDToolBox/outputmessages.py
    • -23
    • +0
    /trunk/tests/test_main_acceptance.py
  16. … 5 more files in changeset.
8:50 am

Carles Soriano Perez

Removed reference to previous defined class.

Related to Issue [SDTOOLBOX-23]

Options
    • -4
    • +5
    /trunk/tests/test_extract_slp.py
Thursday 17 Oct 2019
4:05 pm

tiotto

Removed unneeded files (sea level pressure EARTH and era5) because of refactoring

Related to Issue [SDTOOLBOX-23]

Options
    • -112
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -201
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
4:01 pm

tiotto

Added missing extract_data_EARTH

Related to Issue [SDTOOLBOX-23]

Options
    • -0
    • +237
    /trunk/SDToolBox/extract_data_EARTH.py
3:59 pm

tiotto

Added tests for EARTH and wind

Related to Issue [SDTOOLBOX-23]

Options
    • -0
    • +37
    /trunk/tests/test_extract_wind.py
    • -0
    • +42
    /trunk/tests/test_extract_data_EARTH.py
3:55 pm

Carles Soriano Perez

Added simple resampling for the feature given either a xarray or an outputdata object. Added simple unit tests.

Related to Issue [SDTOOLBOX-27]

Options
    • -0
    • +88
    /trunk/SDToolBox/data_processing.py
    • -0
    • +140
    /trunk/tests/test_data_processing.py
    • -0
    • +2
    /trunk/SDToolBox/outputmessages.py
3:33 pm

tiotto

Added EC-EARTH sea level pressure extraction

Related to Issue [SDTOOLBOX-23]

Options
    • -0
    • +4
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -2
    • +20
    /trunk/SDToolBox/data_acquisition.py
    • -4
    • +2
    /trunk/SDToolBox/extract_data.py
3:32 pm

tiotto

Added extraction of ERA5 subset water levels

Related to Issue [SDTOOLBOX-18]

Options
    • -3
    • +42
    /trunk/SDToolBox/extract_data_era5.py
    • -1
    • +1
    /trunk/tests/test_extract_data_era5.py
1:26 pm

Carles Soriano Perez

Fixed failing test by comparing sets and length of their lists.

Related to Issue [SDTOOLBOX-15]

Options
    • -1
    • +2
    /trunk/tests/test_input_data.py
12:45 pm

alvareza

Added Test day 1 documentation and data
Options
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/Test day 1.docx
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_ERA5.p
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP85.p
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP45.p
  5. /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP85.nc
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_hist.p
  8. /trunk/doc/SDToolBox - Test Plan/study_case_NL
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/NorthSeaUseCase.pptx
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_hist.nc
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_ERA5.nc
  12. /trunk/doc/SDToolBox - Test Plan/study_case_NL/data
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP45.nc
    • too large
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/MSc_Thesis_CarlosRozas.pdf
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/~$NorthSeaUseCase.pptx
11:55 am

Carles Soriano Perez

Fixed a small bug, now we return a list of unique variables. Extended tests.

Related to Issue [SDTOOLBOX-15]

Options
    • -0
    • +84
    /trunk/tests/test_input_data.py
    • -1
    • +1
    /trunk/SDToolBox/data_acquisition.py
10:33 am

Carles Soriano Perez

Finished validation for the input, extended Input data structure and how to work with it for the extract_data_Era5, removed extract waves and its previous test as they have been deprecated in favor of extract_data_era5.py

Related to Issue [SDTOOLBOX-15]

Options
    • -64
    • +37
    /trunk/SDToolBox/extract_data_era5.py
    • -3
    • +3
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -6
    • +56
    /trunk/tests/test_extract_data.py
    • -3
    • +3
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
    • -7
    • +10
    /trunk/tests/test_extract_data_era5.py
    • -6
    • +4
    /trunk/SDToolBox/extract_data.py
    • -185
    • +0
    /trunk/tests/test_extract_waves.py
    • -1
    • +1
    /trunk/SDToolBox/outputmessages.py
    • -7
    • +11
    /trunk/tests/test_output_data.py
    • -1
    • +1
    /trunk/tests/test_extract_slp.py
    • -220
    • +0
    /trunk/SDToolBox/extract_waves.py
10:21 am

tiotto

Added wind extraction. Minor changes to test extract waves

Related to Issue [SDTOOLBOX-19]

Options
    • -1
    • +3
    /trunk/tests/test_extract_waves.py
    • -7
    • +2
    /trunk/SDToolBox/extract_data_era5.py
9:53 am

Carles Soriano Perez

Reworked on the input data class and its structure to have a more uniformed code.

Added tests for input data.

Related to Issue [SDTOOLBOX-15]

Options
    • -230
    • +0
    /trunk/tests/test_data_acquisition.py
    • -1
    • +3
    /trunk/SDToolBox/outputmessages.py
    • -0
    • +0
    /trunk/tests/test_data_acquisition_utils.py
    • -0
    • +234
    /trunk/tests/test_input_data.py
    • -73
    • +38
    /trunk/SDToolBox/data_acquisition.py
Wednesday 16 Oct 2019
6:00 pm

Carles Soriano Perez

Adapted code for correct extraction of data.

Changed parent private properties into internal so they are accessible from the inherited classes.

Related to Issue [SDTOOLBOX-24]

Options
    • -3
    • +2
    /trunk/tests/test_output_data.py
    • -15
    • +15
    /trunk/SDToolBox/extract_data.py
    • -72
    • +11
    /trunk/tests/test_extract_data_era5.py
    • -29
    • +45
    /trunk/SDToolBox/extract_data_era5.py
5:22 pm

tiotto

Created a unified era5 extraction method with matching tests and logic for waves, wind and slp.

Related to Issue [SDTOOLBOX-24]

Options
    • -0
    • +68
    /trunk/tests/test_extract_data.py
  2. /trunk/tests/test_data/Hs
    • -14
    • +16
    /trunk/tests/test_output_data.py
    • -0
    • +125
    /trunk/tests/test_extract_data_era5.py
    • -0
    • +332
    /trunk/SDToolBox/extract_data_era5.py
    • -9
    • +8
    /trunk/tests/test_extract_slp.py
    • -0
    • +56
    /trunk/SDToolBox/extract_data.py
3:50 pm

Carles Soriano Perez

Corrected input data property, instead of a dictionary we expect a list of variable names.

Related to Issue [SDTOOLBOX-17]

Options
    • -3
    • +3
    /trunk/SDToolBox/outputmessages.py
    • -16
    • +8
    /trunk/tests/test_output_data.py
    • -7
    • +20
    /trunk/SDToolBox/extract_waves.py
    • -13
    • +6
    /trunk/tests/test_extract_waves.py
    • -1
    • +1
    /trunk/SDToolBox/data_acquisition.py
3:28 pm

Carles Soriano Perez

Now we can generate the output as a temporary file, without having to give all the parameters.

Related to Issue [SDTOOLBOX-22]

Options
    • -1
    • +53
    /trunk/tests/test_output_data.py
    • -23
    • +42
    /trunk/SDToolBox/data_acquisition.py
    • -0
    • +3
    /trunk/SDToolBox/outputmessages.py
    • -12
    • +0
    /trunk/SDToolBox/extract_waves.py
2:26 pm

Carles Soriano Perez

Updated input data to require the variable dictionary.

Related to Issue [SDTOOLBOX-22]

Options
    • -4
    • +9
    /trunk/SDToolBox/outputmessages.py
    • -28
    • +79
    /trunk/tests/test_extract_waves.py
    • -2
    • +2
    /trunk/tests/test_extract_slp.py
    • -1
    • +9
    /trunk/tests/test_output_data.py
    • -14
    • +12
    /trunk/SDToolBox/extract_waves.py
    • -0
    • +1
    /trunk/SDToolBox/data_acquisition.py
1:51 pm

Carles Soriano Perez

Updated dummy wave file, now we do not create variables for those which are empty.

Related to Issue [SDTOOLBOX-22]

Options
    • -8
    • +17
    /trunk/SDToolBox/data_acquisition.py
    • binary
    /trunk/tests/test_data/system_tests_nc/dummy_wave_file.nc
    • -5
    • +5
    /trunk/tests/test_output_data.py
1:21 pm

tiotto

Fixed some tests

Related to Issue [SDTOOLBOX-20]

Options
    • -3
    • +3
    /trunk/tests/test_extract_slp.py
    • -42
    • +43
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -9
    • +9
    /trunk/tests/test_extract_waves.py
11:53 am

Carles Soriano Perez

Generation of output works now given a netcdf file path, it also generates an xarray.

Extended functionality to directly call to generate output (does both netcdf and xarray).

Related to Issue [SDTOOLBOX-22]

Options
    • -5
    • +4
    /trunk/tests/test_extract_waves.py
  2. /trunk/tests/test_data/system_tests_nc
    • -43
    • +52
    /trunk/tests/test_output_data.py
    • -33
    • +45
    /trunk/SDToolBox/data_acquisition.py
    • binary
    /trunk/tests/test_data/system_tests_nc/dummy_wave_file.nc
11:09 am

Carles Soriano Perez

Corrected reference file, it was getting the wrong assumption.

Related to Issue [SDTOOLBOX-17]

Options
    • -9
    • +10
    /trunk/SDToolBox/extract_waves.py
10:33 am

Carles Soriano Perez

Corrected extraction of time array.

Related to Issue [SDTOOLBOX-22]

Options
    • -1
    • +1
    /trunk/SDToolBox/extract_waves.py
    • -6
    • +9
    /trunk/SDToolBox/data_acquisition.py
9:46 am

Carles Soriano Perez

Small refactoring towards creation of netcdf.

Related to Issue [SDTOOLBOX-22]

Options
    • -8
    • +16
    /trunk/SDToolBox/data_acquisition.py
    • -1
    • +0
    /trunk/SDToolBox/extract_waves.py
    • -12
    • +10
    /trunk/tests/test_output_data.py
Tuesday 15 Oct 2019
4:57 pm

tiotto

Added sea level pressure with OutputData

Related to Issue [SDTOOLBOX-20]

Options
    • -4
    • +4
    /trunk/tests/test_extract_slp.py
    • -31
    • +131
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
    • -21
    • +73
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
4:55 pm

Carles Soriano Perez

Added logic to create a xarray from the netcdf, added logic to set dictionary values into the output netcdf.

Related to Issue [SDTOOLBOX-22]

Options
    • -3
    • +68
    /trunk/tests/test_output_data.py
    • -22
    • +46
    /trunk/SDToolBox/data_acquisition.py
4:04 pm

Carles Soriano Perez

Small code correction to dynamically search for a reference file.

Related to Issue [SDTOOLBOX-17]

Options
    • -3
    • +12
    /trunk/SDToolBox/extract_waves.py