Index: doc/LaTeX/D-Soil Model - Test report/pictures/TestCoverageData.png =================================================================== diff -u -r994 -r1144 Binary files differ Index: doc/LaTeX/D-Soil Model - Test report/D-Soil Model - Test Report.tex =================================================================== diff -u -r1136 -r1144 --- doc/LaTeX/D-Soil Model - Test report/D-Soil Model - Test Report.tex (.../D-Soil Model - Test Report.tex) (revision 1136) +++ doc/LaTeX/D-Soil Model - Test report/D-Soil Model - Test Report.tex (.../D-Soil Model - Test Report.tex) (revision 1144) @@ -42,8 +42,7 @@ \includepdf[pages=1, offset=72 -70]{pictures/D-SoilModel-TestReport.pdf} % links-rechts past precies \cleardoublepage -\newcommand{\ProgramNamePlusSpace}{D-Soil~Model\xspace} -\newcommand{\ProgramName}{D-Soil~Model} +\newcommand{\ProgramName}{D-Soil~Model\xspace} \newcommand{\OK}{\LARGE \textcolor[rgb]{0.2,0.8,0.2}{\textbf{\smiley}} \normalsize} \newcommand{\OKbut}{\LARGE \textcolor[rgb]{1,0.68,0.36}{\textbf{\smiley}} \normalsize} \newcommand{\NotOK}{\LARGE \textcolor[rgb]{1,0,0}{\textbf{\frownie}} \normalsize} @@ -55,8 +54,7 @@ %%%%%%%%%%%%% UPDATED FOR EACH NEW RELEASE %%%%%%%%%%%%% %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% -\newcommand{\VersionNumberPlusSpace}{\VersionNumber\xspace} -\newcommand{\VersionNumber}{24.2.1} +\newcommand{\VersionNumber}{24.2.1\xspace} \newcommand{\VersionDSLCore}{24.1.1} \newcommand{\VersionDSLFormsGeo}{24.1.1} @@ -72,7 +70,7 @@ \newcommand{\VersionDotSpatial}{1.8.0.0} \newcommand{\DirectoyPDFTestDocument}{../../../test/DSoilModel-TestDocumenten} -\newcommand{\FileNamePDFTestDocument}{Testdocument_DSoilModel_17_2_1.pdf} +\newcommand{\FileNamePDFTestDocument}{Testdocument_DSoilModel_24_2_0.pdf} @@ -87,50 +85,54 @@ \client{RWS} +\contact{} \projectnumber{11210373-002} +\documentid{} \reference{-} \classification{-} \keywords{BOI, Stochastic subsoil schematization, soil profile, soil properties, macro stability, piping, flow slide} \references{Refer to \autoref{chp:References}.} -\summary{This document contains the test report for \ProgramNamePlusSpace \VersionNumber. All the unit tests performed for the validation of \ProgramNamePlusSpace pass and cover 69.6\% of the code, so more than the minimum required code coverage of 60\% for Delta Shell Light products. All the features of \ProgramNamePlusSpace were tested during the user interface testing (using test scripts) and work as expected. All the `must-have' and `non-functional' requirements are implemented and met. The functioning of \ProgramNamePlusSpace as described in the Functional Design is therefore ensured. +\summary{This document contains the test report for \ProgramName \VersionNumber. All the unit tests performed for the validation of \ProgramName pass and cover 67.3\% of the code, so more than the minimum required code coverage of 60\% for Delta Shell Light products. All the features of \ProgramName were tested during the user interface testing (using test scripts) and work as expected. All the `must-have' and `non-functional' requirements are implemented and met. The functioning of \ProgramName as described in the Functional Design is therefore ensured. \textbf{\footnotesize{Samenvatting}} \newline -Dit document bevat het test rapport voor \ProgramNamePlusSpace \VersionNumber. Alle uitgevoerde 'unit tests' voor de validatie van \ProgramNamePlusSpace slagen en dekken 69.6\% van de code, dus meer dan de minimaal vereiste code dekking van 60\% voor Delta Shell Light producten. Alle functionaliteit van \ProgramNamePlusSpace werd getest tijdens de 'user interface' testen (met behulp van testscripts) en werkt zoals verwacht. Alle `must-have' en `niet-functionele' requirements zijn geimplementeerd en voldoen. De werking van \ProgramName, zoals beschreven in het functioneel ontwerp, is daarom gewaarborgd.} +Dit document bevat het test rapport voor \ProgramName \VersionNumber. Alle uitgevoerde 'unit tests' voor de validatie van \ProgramName slagen en dekken 67.3\% van de code, dus meer dan de minimaal vereiste code dekking van 60\% voor Delta Shell Light producten. Alle functionaliteit van \ProgramName werd getest tijdens de 'user interface' testen (met behulp van testscripts) en werkt zoals verwacht. Alle `must-have' en `niet-functionele' requirements zijn geimplementeerd en voldoen. De werking van \ProgramName, zoals beschreven in het functioneel ontwerp, is daarom gewaarborgd.} +%\authori{dr. V. Trompille} +%\revieweri{dr.ir. J.G. van \newline Putten} +%\approvali{ir. J. Icke} +%\versioni{1.0} +%\datei{Aug. 2016} +% +%\authorii{dr. V. Trompille} +%\reviewerii{dr.ir. J.G. van \newline Putten} +%\approvalii{ir. J. Icke} +%\versionii{2.0} +%\dateii{Dec. 2016} +% +%\authoriii{dr. V. Trompille} +%\revieweriii{dr.ir. J.G. van \newline Putten} +%\approvaliii{ir. J. Icke} +%\versioniii{3.0} +%\dateiii{Jan. 2017} + \authori{dr. V. Trompille} \revieweri{dr.ir. J.G. van \newline Putten} \approvali{ir. J. Icke} -\versioni{1.0} -\datei{Aug. 2016} +\organisationi{Deltares} +\versioni{4.0} +\datei{Sept. 2017} \authorii{dr. V. Trompille} -\reviewerii{dr.ir. J.G. van \newline Putten} -\approvalii{ir. J. Icke} -\versionii{2.0} -\dateii{Dec. 2016} +\reviewerii{B.S.T.I.M. The} +\approvalii{drs. A. Baart} +\versionii{5.0} +\dateii{Nov. 2024} -\authoriii{dr. V. Trompille} -\revieweriii{dr.ir. J.G. van \newline Putten} -\approvaliii{ir. J. Icke} -\versioniii{3.0} -\dateiii{Jan. 2017} - -\authoriv{dr. V. Trompille} -\revieweriv{dr.ir. J.G. van \newline Putten} -\approvaliv{ir. J. Icke} -\versioniv{4.0} -\dateiv{Sept. 2017} - -\authoriv{dr. V. Trompille} -\revieweriv{B.S.T.I.M. The} -\approvaliv{drs. A. Baart} -\versioniv{5.0} -\dateiv{Nov. 2024} - \status{final} +\disclaimer{} \deltarestitle @@ -170,8 +172,9 @@ \section{Version} These are the changes in this version of the document compared to the previous version. +Only these changes are reviewed. -\subsection{Version 5.0} +\subsection{Version 4.0} The following sections have been updated: \begin{itemize} \item the number of unit/integration tests in \autoref{sec:2.1} @@ -182,23 +185,30 @@ \end{itemize} -Only these changes are reviewed. +\subsection{Version 5.0} +The following sections have been updated: +\begin{itemize} + \item the number of unit/integration tests in \autoref{sec:2.1} + \item the code coverage in \autoref{sec:CodeCoverage} + \item all the pictures of the code coverage in appendix \autoref{app:CodeCoverage} + \item the test document in appendix \autoref{app:TestDocument} +\end{itemize} \section{Requirements} \label{sec:1.3} \subsection{Non-functional requirements} -In \autoref{tab:NFREQs}, the non-functional requirements of \ProgramNamePlusSpace are enumerated. Note that only the requirements applicable to the testing of the program are listed. The full description of non-functional requirements of \ProgramNamePlusSpace can be found in the Functional Design of \ProgramNamePlusSpace \citep{DSoilModel_FunctionalDesign}. +In \autoref{tab:NFREQs}, the non-functional requirements of \ProgramName are enumerated. Note that only the requirements applicable to the testing of the program are listed. The full description of non-functional requirements of \ProgramName can be found in the Functional Design of \ProgramName \citep{DSoilModel_FunctionalDesign}. \begin{table}[H] -\caption{Non-functional requirements \ProgramNamePlusSpace applicable to testing} \label{tab:NFREQs} +\caption{Non-functional requirements \ProgramName applicable to testing} \label{tab:NFREQs} \begin{tabular}{|p{15mm}|p{\textwidth-15mm-24pt}|} \hline \rowcolor[gray]{.8}\textbf{Nr.} & \textbf{Description requirement} \\ \hline \textbf{NFR3} & Data definitions will follow existing and emerging standards such as IRIS as much as possible. (must have). \\ \hline -\textbf{NFR6} & Ringtoets and its computational core must perform sufficient error checks on the validity and completeness of data during import or input, as well as during a computation. Ringtoets needs to show warnings and error messages in an error message dialog, and also write them to a log file. The message text needs to be clear in what went wrong and where it went wrong (context). The message finally needs to supply suggestions for improvement wherever possible (read \ProgramNamePlusSpace for Ringtoets. ) \\ \hline +\textbf{NFR6} & Ringtoets and its computational core must perform sufficient error checks on the validity and completeness of data during import or input, as well as during a computation. Ringtoets needs to show warnings and error messages in an error message dialog, and also write them to a log file. The message text needs to be clear in what went wrong and where it went wrong (context). The message finally needs to supply suggestions for improvement wherever possible (read \ProgramName for Ringtoets. ) \\ \hline \textbf{NFR12} & The user-interface may not cause crashes during regular usage. \\ \hline @@ -233,10 +243,10 @@ \subsection{Functional requirements} -In \autoref{tab:REQs}, the functional requirements of \ProgramNamePlusSpace are ranked from must-have to won't-have. The full description of the requirements can be found in the Functional Design of \ProgramNamePlusSpace \citep{DSoilModel_FunctionalDesign}. +In \autoref{tab:REQs}, the functional requirements of \ProgramName are ranked from must-have to won't-have. The full description of the requirements can be found in the Functional Design of \ProgramName \citep{DSoilModel_FunctionalDesign}. \begin{longtable}{|p{20mm}|p{1.05\textwidth-40mm-36pt}|p{20mm}|} -\caption{Functional requirements of \ProgramNamePlusSpace} \label{tab:REQs} \\ \hline +\caption{Functional requirements of \ProgramName} \label{tab:REQs} \\ \hline \rowcolor[gray]{.8}\textbf{Nr.} & \textbf{Description requirement} & \textbf{MoSCoW} \\ \hline REQ 3.1 & Import data. & must-have \\ \hline REQ 3.3 & Select relevant SOS information for project & must-have \\ \hline @@ -302,7 +312,7 @@ \section{Libraries} -The complete list of libraries used for the release of \ProgramNamePlusSpace version \VersionNumberPlusSpace can be found in the document ``Protocol van Overdracht'', part of the documentation delivered with this release. +The complete list of libraries used for the release of \ProgramName version \VersionNumber can be found in the document ``Protocol van Overdracht'', part of the documentation delivered with this release. %\begin{itemize} %\item Delta Shell Light libraries: @@ -335,7 +345,7 @@ The tests on functional level are the integration tests. These types of tests combine multiple functions in the kernel to prove that high level functionality works. For this, a unit test is defined within the C\# solution for each method with high level functionality. -To obtain a single code coverage, it is convenient to combine unit and integration tests, 98 in total. For these tests, see the C\# solution or the build server. +To obtain a single code coverage, it is convenient to combine unit and integration tests. For these tests, see the C\# solution or the build server. These tests are considered to be ok when the unit tests pass and when the code coverage of those tests is more than 60\%, as prescribed in \cite{OverallTestPlanWTI} for Delta Shell Light products. @@ -354,9 +364,9 @@ CenterCrestLocationTest & 2 & 0 \\ DSoilModelDataSourceRedirestorTests & 19 & 0 \\ DSoilModelIOTest & 23 & 0 \\ -DSoilModelProjectTest & 48 & 0 \\ +DSoilModelProjectTest & 51 & 0 \\ DSoilModelTransformerTests & 7 & 0 \\ -SosSoilLayer1DTest & 6 & 0 \\ +SosSoilLayer1DTest & 7 & 0 \\ SosSoilProfilesImporterTests & 7 & 0 \\ \hline \multicolumn{3}{|p{120mm}|}{\textbf{\textit{Namespace: Deltares.DSoilModel.Forms.Tests}}} \\ \hline BoringControlTests & 3 & 0 \\ @@ -366,9 +376,9 @@ CptControlTests & 3 & 0 \\ CptLookup1DControlTests & 3 & 0 \\ CptLookup2DControlTests & 3 & 0 \\ -DSoilModelContextTest & 79 & 0 \\ +DSoilModelContextTest & 80 & 0 \\ DSoilModelGeometryEditorTests & 28 & 0 \\ -DSoilModelPluginTests & 15 & 0 \\ +DSoilModelPluginTests & 16 & 0 \\ DSoilModelSegmentGeometryEditorTests & 15 & 0 \\ FilmStripTest & 4 & 0 \\ PreconsolidationStressControlTests & 3 & 0 \\ @@ -378,11 +388,10 @@ SosSoilLayer1DControlTests & 4 & 0 \\ SosSoilProfile1DControlTest & 4 & 0 \\ SpecificMechanismPointLocationControlTests & 3 & 0 \\ \hline -\textbf{Total} & \textbf{297} & \textbf{0} \\ \hline +\textbf{Total} & \textbf{301} & \textbf{0} \\ \hline \end{tabular} \end{table} - \section{Code coverage of the unit/integration tests} \label{sec:CodeCoverage} To determine what proportion of the code is actually being tested by coded tests such as unit tests or integration tests, the code coverage feature of Visual Studio is used. The results of this tool are displayed on the Deltares build server called TeamCity (see appendix \autoref{app:CodeCoverage}). An overview is given in \autoref{tab:2-2} showing the percentage of the code that was tested for each class, method and statement for each of the different assemblies. @@ -393,19 +402,14 @@ \renewcommand{\arraystretch}{1.3} \begin{tabular}{|p{\textwidth-83mm-36pt}|p{23mm}|p{28mm}|p{32mm}|} \hline \rowcolor[gray]{.8} Namespace & \textbf{Class} & \textbf{Method} & \textbf{Statement} \\ \hline -Deltares.DSoilModel.Data \newline (see \autoref{fig:TestCoverageData}) & 100\% (11/11) & 87.4\% (132/151) & 87\% (924/1062) \\ \hline -Deltares.DSoilModel.Forms \newline (see \autoref{fig:TestCoverageForms}) & 84.4\% (27/32) & 53.5\% (300/561) & 65.9\% (3269/4964) \\ \hline -\textbf{Total} & \textbf{88.4\% (38/43)} & \textbf{60.7\% (432/712)} & \textbf{69.6\% (4198/6032)}\\ \hline +Deltares.DSoilModel.Data \newline (see \autoref{fig:TestCoverageData}) & 100\% (11/11) & 87.7\% (136/155) & 86.1\% (1647/1913) \\ \hline +Deltares.DSoilModel.Forms \newline (see \autoref{fig:TestCoverageForms}) & 83.9\% (26/31) & 56.9\% (316/555) & 61.9\% (4157/6714) \\ \hline +\textbf{Total} & \textbf{88.1\% (37/42)} & \textbf{63.7\% (452/710)} & \textbf{67.3\% (5804/8627)}\\ \hline \end{tabular} \end{table} +The code coverage of \ProgramName (\textbf{67.3\%}) is more than the minimum required code coverage of 60\% prescribed in \cite{OverallTestPlanWTI}. -The code coverage of \ProgramNamePlusSpace (\textbf{69.6\%}) is more than the minimum required code coverage of 60\% prescribed in \cite{OverallTestPlanWTI}. - - - - - %------------------------------------------------------------------------------ \chapter{System testing (Test Scripts)} \label{chapter3} @@ -415,7 +419,7 @@ \section{Testing of the 'must-have' functional requirements} -In \autoref{tab:OverviewTests}, the 'must-have' functional requirements of \ProgramNamePlusSpace are compared to the user-interface features that were tested. Refer to the Functional Design of \ProgramNamePlusSpace \citep{DSoilModel_FunctionalDesign} for a complete description of the requirements. +In \autoref{tab:OverviewTests}, the 'must-have' functional requirements of \ProgramName are compared to the user-interface features that were tested. Refer to the Functional Design of \ProgramName \citep{DSoilModel_FunctionalDesign} for a complete description of the requirements. The legend of \autoref{tab:OverviewTests} is: \\ @@ -728,7 +732,7 @@ \section{Testing of the non-functional requirements} -In \autoref{tab:OverviewTestsNF}, the Non-Functional Requirements of \ProgramNamePlusSpace are compared to the user-interface features that were tested. Refer to the Functional Design of \ProgramNamePlusSpace \citep{DSoilModel_FunctionalDesign} for a complete description of the requirements. +In \autoref{tab:OverviewTestsNF}, the Non-Functional Requirements of \ProgramName are compared to the user-interface features that were tested. Refer to the Functional Design of \ProgramName \citep{DSoilModel_FunctionalDesign} for a complete description of the requirements. \renewcommand{\arraystretch}{1.3} @@ -743,7 +747,7 @@ \textbf{NFR12} & No crashes during regular usage & Yes & Test-script nr. 47 of the Test Document (see appendix \autoref{app:TestDocument}) attests that no crash occured when performing all test-scripts listed in the Test Document (which represents about 8 hours working with \ProgramName), proving that this requirement is met. \\ \hline -\textbf{NFR15} & A documented test bench of unit tests and integration tests is required & Yes & Test coverage of \ProgramNamePlusSpace is 69.5\% (see \autoref{sec:CodeCoverage}). \\ \hline +\textbf{NFR15} & A documented test bench of unit tests and integration tests is required & Yes & Test coverage of \ProgramName is 69.5\% (see \autoref{sec:CodeCoverage}). \\ \hline %\textbf{R13} & Perform test according to engagement & Yes & A test plan explaining how the program should be tested is available \citep{DSoilModel_TestPlan} and this document (Test Report) shows that all the functionalities of the program are implemented and tested. \\ \hline @@ -882,7 +886,7 @@ \end{itemize} -The errors listed above are absolutely not blocking for the use of \ProgramNamePlusSpace within +The errors listed above are absolutely not blocking for the use of \ProgramName within WTI 2017. All those issues should be fixed in a future release of the program. @@ -893,17 +897,17 @@ \renewcommand{\arraystretch}{1.2} -All the unit and integration tests performed for the validation of \ProgramNamePlusSpace pass and cover 69.6\% of the code, so more than the minimum required code coverage of 60\% prescribed in \citep{OverallTestPlanWTI}. +All the unit and integration tests performed for the validation of \ProgramName pass and cover 67.3\% of the code, so more than the minimum required code coverage of 60\% prescribed in \citep{OverallTestPlanWTI}. A complete test of the User Interface has been performed by means of test scripts (see appendix \autoref{app:TestDocument}). Almost all of the test scripts pass; however, a few minor inconveniences were found and reported in the \textit{Known Issues} list. -However, the discrepancies listed above are not blocking for the use of \ProgramNamePlusSpace version \VersionNumberPlusSpace within WTI 2017, and will be reported in the list of \textit{Known Issues} delivered with the application. +However, the discrepancies listed above are not blocking for the use of \ProgramName version \VersionNumber within WTI 2017, and will be reported in the list of \textit{Known Issues} delivered with the application. -All the '\textit{must-have}' functional requirements and non-functional requirements listed in the Functional Design of \ProgramNamePlusSpace are implemented and met. Only three of the '\textit{should-have}' requirements are not completely implemented (REQ 3.4, REQ 8.8 and REQ 8.12). None of the '\textit{nice-to-have}' requirements have been implemented, but this may be done in future development of the application, if desired and prioritized accordingly by the Product Owners. +All the '\textit{must-have}' functional requirements and non-functional requirements listed in the Functional Design of \ProgramName are implemented and met. Only three of the '\textit{should-have}' requirements are not completely implemented (REQ 3.4, REQ 8.8 and REQ 8.12). None of the '\textit{nice-to-have}' requirements have been implemented, but this may be done in future development of the application, if desired and prioritized accordingly by the Product Owners. Regarding the non-functional requirements: only the non-functional requirements that can be captured by a test are reported here. The explanation about how the other non-functional requirements are met is given in the Functional Design. -To conclude, the correct functioning of the User Interface of \ProgramNamePlusSpace version \VersionNumberPlusSpace is ensured; the program can therefore be handed over to the client. +To conclude, the correct functioning of the User Interface of \ProgramName version \VersionNumber is ensured; the program can therefore be handed over to the client. @@ -918,11 +922,10 @@ \begin{appendices} -\chapter{Overview of the Code Coverage of \ProgramNamePlusSpace \VersionNumberPlusSpace on build server TeamCity} \label{app:CodeCoverage} +\chapter{Overview of the Code Coverage of \ProgramName \VersionNumber on build server TeamCity} \label{app:CodeCoverage} -An overview of the code coverage of \ProgramNamePlusSpace \VersionNumberPlusSpace is available on the build server TeamCity which displays the percentage of the code that was tested in method, class, and statement for each assembly. +An overview of the code coverage of \ProgramName \VersionNumber is available on the build server TeamCity which displays the percentage of the code that was tested in method, class, and statement for each assembly. - \begin{landscape} \begin{figure}[H] @@ -941,7 +944,6 @@ \begin{figure}[H] \centering - \includegraphics[width=210mm]{pictures/TestCoverageFormsAll.png} \includegraphics[width=210mm]{pictures/TestCoverageForms.png} \caption{Overview of the code coverage of Deltares.DSoilModel.Forms} \label{fig:TestCoverageForms} @@ -951,66 +953,65 @@ \end{landscape} -\chapter{Test Document \ProgramNamePlusSpace } \label{app:TestDocument} +\chapter{Test Document \ProgramName } \label{app:TestDocument} The test-scripts part of the Test Document hereafter have been performed using version \VersionNumber. %he test-scripts part of the Test Document hereafter have been first performed during the development of \ProgramName, using versions 16.1.3.618, 16.1.3.634 and 16.1.3.647 so versions prior to version \VersionNumber. Because the test document contains about 1200 questions, more than one day is needed to answer all the questions. By lack of time, only the failing tests were performed with version \VersionNumber. A risk exists therefore that a test-script passing with previous versions does not pass anymore with version \VersionNumber. However such a risk is very low because the program is developed in a continuous integration way, which means that an improvement in a feature leading to a failure of an other feature is immediately detected by the build server (via the unit tests) and therefore fixed by the developer. - -\includepdf[pages=1, offset=-20 -20, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=2, offset=20 -20, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=3, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=1, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=2, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=3, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=4, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=5, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=5, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=6, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=7, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=7, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=8, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=9, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=9, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=10, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=11, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=11, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=12, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=13, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=13, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=14, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=15, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=15, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=16, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=17, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=17, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=18, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=19, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=19, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=20, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=21, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=21, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=22, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=23, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=23, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=24, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=25, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=25, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=26, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=27, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=27, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=28, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=29, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=29, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=30, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=31, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=31, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=32, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=33, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=33, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=34, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=35, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=35, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=36, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=37, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=37, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=38, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=39, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=39, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=40, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=41, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=41, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=42, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=43, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=43, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=44, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=45, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=45, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=46, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=47, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=47, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=48, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=49, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=49, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=50, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=51, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=51, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=52, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} -\includepdf[pages=53, offset=-20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} +\includepdf[pages=53, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} \includepdf[pages=54, offset=20mm -20mm, angle=90]{\DirectoyPDFTestDocument/\FileNamePDFTestDocument} Index: doc/LaTeX/D-Soil Model - Test report/pictures/TestCoverageForms.png =================================================================== diff -u -r994 -r1144 Binary files differ Index: doc/LaTeX/D-Soil Model - Test report/pictures/TestCoverageAll.png =================================================================== diff -u -r994 -r1144 Binary files differ Index: doc/LaTeX/D-Soil Model - Test report/pictures/TestCoverageFormsAll.png =================================================================== diff -u -r874 -r1144 Binary files differ