SD_Toolbox

Checkout Tools

Line History

Line Count Graph
Line Count Graph

Stats

Commits this week: 0
Total Committers: 4
Last Commit: 21 Oct 20
Commits this week: 0
Total Lines of Code (LoC): 18,020
Net change in LoC this week: 0

Commit Activity

Commits By Day In Week
52 week commits volume
Commits By Day In Week
Commits by day
Commits By Day In Week
Commits by hour
Commits By Hour In Day
Commit calendar
 

Most active committers (90 days)

loading
loading

Subversion Details

6 properties
  • bugtraq:label = Jira Issue-ID
  • bugtraq:logregex = Issue \[([A-Za-z]+-\d+)\]
  • bugtraq:message = Related to Issue [%BUGID%]
  • bugtraq:number = false
  • bugtraq:url = https://issuetracker.deltares.nl/browse/%BUGID%
  • bugtraq:warnifnoissue = true
  • last updated a few seconds ago
All Commits Reviews
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Tuesday 22 Oct 2019
2:30 pm

Carles Soriano Perez

Improved extraction for consider gridded points.

Related to Issue [SDTOOLBOX-24]

Options
    • -3
    • +20
    /trunk/SDToolBox/extract_data.py
    • -1
    • +6
    /trunk/SDToolBox/input_data.py
    • -51
    • +74
    /trunk/SDToolBox/output_data.py
Monday 21 Oct 2019
5:12 pm

tiotto

Added PCA calculation and derivates as static methods

Related to Issue [SDTOOLBOX-29]

Options
    • -3
    • +5
    /trunk/SDToolBox/data_processing.py
4:43 pm

tiotto

Fixed review remarks

Related to Issue [SDTOOLBOX-29]

Options
    • -18
    • +52
    /trunk/SDToolBox/data_processing.py
    • -18
    • +19
    /trunk/tests/test_data_processing.py
4:00 pm

tiotto

Compute gradients of sea level pressure and PCA component Analysis to be tested with more consistent values

Related to Issue [SDTOOLBOX-29]

Options
    • -23
    • +22
    /trunk/SDToolBox/data_processing.py
10:17 am

Carles Soriano Perez

Fixed remaining bugs / adjustments of the code.

Related to Issue [SDTOOLBOX-24]

Options
    • -7
    • +8
    /trunk/SDToolBox/input_data.py
    • -0
    • +2
    /trunk/SDToolBox/output_messages.py
    • -7
    • +11
    /trunk/SDToolBox/output_data.py
    • -3
    • +16
    /trunk/SDToolBox/extract_data.py
Sunday 20 Oct 2019
8:52 pm

Carles Soriano Perez

Added max and mean resampling for xarray.

Related to Issue [SDTOOLBOX-27]

Options
    • -16
    • +64
    /trunk/tests/test_data_processing.py
    • -4
    • +44
    /trunk/SDToolBox/data_processing.py
Saturday 19 Oct 2019
5:04 pm

Carles Soriano Perez

Changed a few metadata values.

Related to Issue [SDTOOLBOX-24]

Options
    • -16
    • +17
    /trunk/SDToolBox/output_data.py
2:59 pm

Carles Soriano Perez

Improved Extract data functionality, joined everything by using inheritance and abstract classes.

* Removed outdated files.

* Added EARTH logic to extract its values.

Related to Issue [SDTOOLBOX-24]

Options
    • -0
    • +1
    /trunk/SDToolBox/output_messages.py
    • -71
    • +0
    /trunk/SDToolBox/extract_data_EARTH.py
    • -98
    • +169
    /trunk/SDToolBox/extract_data.py
    • -42
    • +0
    /trunk/tests/test_extract_data_EARTH.py
    • -3
    • +34
    /trunk/tests/test_extract_data.py
Friday 18 Oct 2019
6:04 pm

Carles Soriano Perez

Refactoring for EARTH.

Related to Issue [SDTOOLBOX-24]

Options
    • -168
    • +1
    /trunk/SDToolBox/extract_data_EARTH.py
    • -4
    • +1
    /trunk/SDToolBox/input_data.py
    • -121
    • +182
    /trunk/SDToolBox/extract_data.py
5:59 pm

tiotto

Implemented Compute gradients of slp and PCA.

Work in progress. To be tested.

Related to Issue [SDTOOLBOX-29]

Options
    • -0
    • +2
    /trunk/SDToolBox/output_messages.py
    • -0
    • +47
    /trunk/tests/test_data_processing.py
    • -3
    • +71
    /trunk/SDToolBox/data_processing.py
    • -2
    • +6
    /trunk/SDToolBox/extract_data_EARTH.py
4:23 pm

Carles Soriano Perez

* Further improvements by using abstract classes.

* Created a setter / getter in OutputData for variable_dict.

Related to Issue [SDTOOLBOX-24]

Options
    • -2
    • +2
    /trunk/tests/test_output_data.py
    • -111
    • +200
    /trunk/SDToolBox/extract_data.py
    • -1
    • +1
    /trunk/tests/test_extract_data_EARTH.py
    • -2
    • +26
    /trunk/SDToolBox/output_data.py
    • -0
    • +3
    /trunk/SDToolBox/input_data.py
    • -0
    • +1
    /trunk/SDToolBox/output_messages.py
    • -3
    • +13
    /trunk/tests/test_extract_data.py
2:33 pm

Carles Soriano Perez

* Unified ERA5 extraction methods, as they are basically the same.

* Extracted InputData and OutputData for better maintainability.

** Extended / improved InputData validation.

* Renamed output_messages for file naming consistency.

Related to Issue [SDTOOLBOX-24]

Options
    • -16
    • +0
    /trunk/tests/test_main_unit.py
    • -37
    • +0
    /trunk/tests/test_extract_wind.py
    • -2
    • +3
    /trunk/SDToolBox/main.py
    • -355
    • +0
    /trunk/SDToolBox/extract_data_era5.py
    • -635
    • +0
    /trunk/SDToolBox/data_acquisition.py
    • -91
    • +49
    /trunk/tests/test_extract_data.py
    • -31
    • +0
    /trunk/tests/test_extract_slp.py
    • -24
    • +317
    /trunk/SDToolBox/extract_data.py
    • -67
    • +0
    /trunk/tests/test_extract_data_era5.py
    • -4
    • +68
    /trunk/tests/test_input_data.py
    • -0
    • +167
    /trunk/SDToolBox/input_data.py
    • -25
    • +22
    /trunk/SDToolBox/extract_data_EARTH.py
    • -0
    • +22
    /trunk/SDToolBox/output_messages.py
    • -21
    • +0
    /trunk/SDToolBox/outputmessages.py
    • -23
    • +0
    /trunk/tests/test_main_acceptance.py
  16. … 5 more files in changeset.
8:50 am

Carles Soriano Perez

Removed reference to previous defined class.

Related to Issue [SDTOOLBOX-23]

Options
    • -4
    • +5
    /trunk/tests/test_extract_slp.py
Thursday 17 Oct 2019
4:05 pm

tiotto

Removed unneeded files (sea level pressure EARTH and era5) because of refactoring

Related to Issue [SDTOOLBOX-23]

Options
    • -112
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -201
    • +0
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
4:01 pm

tiotto

Added missing extract_data_EARTH

Related to Issue [SDTOOLBOX-23]

Options
    • -0
    • +237
    /trunk/SDToolBox/extract_data_EARTH.py
3:59 pm

tiotto

Added tests for EARTH and wind

Related to Issue [SDTOOLBOX-23]

Options
    • -0
    • +37
    /trunk/tests/test_extract_wind.py
    • -0
    • +42
    /trunk/tests/test_extract_data_EARTH.py
3:55 pm

Carles Soriano Perez

Added simple resampling for the feature given either a xarray or an outputdata object. Added simple unit tests.

Related to Issue [SDTOOLBOX-27]

Options
    • -0
    • +88
    /trunk/SDToolBox/data_processing.py
    • -0
    • +140
    /trunk/tests/test_data_processing.py
    • -0
    • +2
    /trunk/SDToolBox/outputmessages.py
3:33 pm

tiotto

Added EC-EARTH sea level pressure extraction

Related to Issue [SDTOOLBOX-23]

Options
    • -0
    • +4
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -2
    • +20
    /trunk/SDToolBox/data_acquisition.py
    • -4
    • +2
    /trunk/SDToolBox/extract_data.py
3:32 pm

tiotto

Added extraction of ERA5 subset water levels

Related to Issue [SDTOOLBOX-18]

Options
    • -3
    • +42
    /trunk/SDToolBox/extract_data_era5.py
    • -1
    • +1
    /trunk/tests/test_extract_data_era5.py
1:26 pm

Carles Soriano Perez

Fixed failing test by comparing sets and length of their lists.

Related to Issue [SDTOOLBOX-15]

Options
    • -1
    • +2
    /trunk/tests/test_input_data.py
12:45 pm

alvareza

Added Test day 1 documentation and data
Options
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/Test day 1.docx
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_ERA5.p
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP85.p
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP45.p
  5. /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP85.nc
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_hist.p
  8. /trunk/doc/SDToolBox - Test Plan/study_case_NL
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/NorthSeaUseCase.pptx
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_hist.nc
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_ERA5.nc
  12. /trunk/doc/SDToolBox - Test Plan/study_case_NL/data
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/data/NS_WAM_RCP45.nc
    • too large
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/MSc_Thesis_CarlosRozas.pdf
    • binary
    /trunk/doc/SDToolBox - Test Plan/study_case_NL/docs/~$NorthSeaUseCase.pptx
11:55 am

Carles Soriano Perez

Fixed a small bug, now we return a list of unique variables. Extended tests.

Related to Issue [SDTOOLBOX-15]

Options
    • -0
    • +84
    /trunk/tests/test_input_data.py
    • -1
    • +1
    /trunk/SDToolBox/data_acquisition.py
10:33 am

Carles Soriano Perez

Finished validation for the input, extended Input data structure and how to work with it for the extract_data_Era5, removed extract waves and its previous test as they have been deprecated in favor of extract_data_era5.py

Related to Issue [SDTOOLBOX-15]

Options
    • -64
    • +37
    /trunk/SDToolBox/extract_data_era5.py
    • -3
    • +3
    /trunk/SDToolBox/extract_sea_level_pressure_EARTH.py
    • -6
    • +56
    /trunk/tests/test_extract_data.py
    • -3
    • +3
    /trunk/SDToolBox/extract_sea_level_pressure_era5.py
    • -7
    • +10
    /trunk/tests/test_extract_data_era5.py
    • -6
    • +4
    /trunk/SDToolBox/extract_data.py
    • -185
    • +0
    /trunk/tests/test_extract_waves.py
    • -1
    • +1
    /trunk/SDToolBox/outputmessages.py
    • -7
    • +11
    /trunk/tests/test_output_data.py
    • -1
    • +1
    /trunk/tests/test_extract_slp.py
    • -220
    • +0
    /trunk/SDToolBox/extract_waves.py
10:21 am

tiotto

Added wind extraction. Minor changes to test extract waves

Related to Issue [SDTOOLBOX-19]

Options
    • -1
    • +3
    /trunk/tests/test_extract_waves.py
    • -7
    • +2
    /trunk/SDToolBox/extract_data_era5.py
9:53 am

Carles Soriano Perez

Reworked on the input data class and its structure to have a more uniformed code.

Added tests for input data.

Related to Issue [SDTOOLBOX-15]

Options
    • -230
    • +0
    /trunk/tests/test_data_acquisition.py
    • -1
    • +3
    /trunk/SDToolBox/outputmessages.py
    • -0
    • +0
    /trunk/tests/test_data_acquisition_utils.py
    • -0
    • +234
    /trunk/tests/test_input_data.py
    • -73
    • +38
    /trunk/SDToolBox/data_acquisition.py
Wednesday 16 Oct 2019
6:00 pm

Carles Soriano Perez

Adapted code for correct extraction of data.

Changed parent private properties into internal so they are accessible from the inherited classes.

Related to Issue [SDTOOLBOX-24]

Options
    • -3
    • +2
    /trunk/tests/test_output_data.py
    • -15
    • +15
    /trunk/SDToolBox/extract_data.py
    • -72
    • +11
    /trunk/tests/test_extract_data_era5.py
    • -29
    • +45
    /trunk/SDToolBox/extract_data_era5.py
5:22 pm

tiotto

Created a unified era5 extraction method with matching tests and logic for waves, wind and slp.

Related to Issue [SDTOOLBOX-24]

Options
    • -0
    • +68
    /trunk/tests/test_extract_data.py
  2. /trunk/tests/test_data/Hs
    • -14
    • +16
    /trunk/tests/test_output_data.py
    • -0
    • +125
    /trunk/tests/test_extract_data_era5.py
    • -0
    • +332
    /trunk/SDToolBox/extract_data_era5.py
    • -9
    • +8
    /trunk/tests/test_extract_slp.py
    • -0
    • +56
    /trunk/SDToolBox/extract_data.py
3:50 pm

Carles Soriano Perez

Corrected input data property, instead of a dictionary we expect a list of variable names.

Related to Issue [SDTOOLBOX-17]

Options
    • -3
    • +3
    /trunk/SDToolBox/outputmessages.py
    • -16
    • +8
    /trunk/tests/test_output_data.py
    • -7
    • +20
    /trunk/SDToolBox/extract_waves.py
    • -13
    • +6
    /trunk/tests/test_extract_waves.py
    • -1
    • +1
    /trunk/SDToolBox/data_acquisition.py
3:28 pm

Carles Soriano Perez

Now we can generate the output as a temporary file, without having to give all the parameters.

Related to Issue [SDTOOLBOX-22]

Options
    • -1
    • +53
    /trunk/tests/test_output_data.py
    • -23
    • +42
    /trunk/SDToolBox/data_acquisition.py
    • -0
    • +3
    /trunk/SDToolBox/outputmessages.py
    • -12
    • +0
    /trunk/SDToolBox/extract_waves.py
2:26 pm

Carles Soriano Perez

Updated input data to require the variable dictionary.

Related to Issue [SDTOOLBOX-22]

Options
    • -4
    • +9
    /trunk/SDToolBox/outputmessages.py
    • -28
    • +79
    /trunk/tests/test_extract_waves.py
    • -2
    • +2
    /trunk/tests/test_extract_slp.py
    • -1
    • +9
    /trunk/tests/test_output_data.py
    • -14
    • +12
    /trunk/SDToolBox/extract_waves.py
    • -0
    • +1
    /trunk/SDToolBox/data_acquisition.py