Regression Test#23
Closed
ghost wants to merge 132 commits into
Closed
Conversation
…e generated locally for testing only
… requirement for running make install
…g the python interpreter
… the reg test commands
… listed python requirement to Python 3.0+
…ently of openfast
…icit input arguments and build fewer directory paths internally
Closed
Closed
Open
psakievich
pushed a commit
to psakievich/openfast
that referenced
this pull request
Aug 3, 2023
Add hub and nacelle ref orient
andrew-platt
pushed a commit
that referenced
this pull request
Mar 11, 2024
UA driver bug fix: sim mod 2
This pull request was closed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request adds a simple regression test borrowing heavily from @jrood-nrel's Nalu regression test and @gantech's fastCPPtests.
The test configuration is handled with CTest, so the test is only built if the appropriate CMake flag,
ENABLE_TESTS, isON.The regression test itself is driven by
reg_tests/executeRegressionTestCase.pywhich runs the OpenFAST test case and compares the binary output to the "gold standard" withreg_tests/pass_fail.py. The pass/fail criteria is a comparison of the variance of each channel in the binary output file with a predetermined tolerance. The tolerance is automatically picked by CMake based on machine and compiler type.The test data is included in a submodule called RegressionTestData which based on the CertTest directory in FAST v8. This repository has two subdirectories:
inputsandoutputs. The contents ofinputsare used in CTest configuration and the contents ofoutputsare the "gold standard" solutions. There is also a python scriptrunCertTestsLocally.pywhich executes all of the cases ininputsin a new directoryoutputs-local.To run the test from a fresh clone:
git clone https://github.com/rafaelmudafort/openfast.gitcd openfastgit checkout devgit submodule update --init --recursivemkdir buildcd buildccmake .. # or otherwise configure cmake flags-- hit c, then e
-- turn on the test boolean, configure the install prefix, etc
-- hit c, then e
-- again hit c, then e
-- hit g
makemake testImprovements to come: