ATE_FUN.2 Ordered functional testing
Objectives
The objective is for the developer to demonstrate that all security functions perform as specified. The developer is required to perform testing and to provide test documentation.
In this component, an additional objective is to ensure that testing is structured such as to avoid circular arguments about the correctness of the portions of the TSF being tested.
Application notes
Although the test procedures may state pre-requisite initial test conditions in terms of ordering of tests, they may not provide a rationale for the ordering. An analysis of test ordering is an important factor in determining the adequacy of testing, as there is a possibility of faults being concealed by the ordering of tests.
Dependencies:
No dependencies.
Developer action elements:
ATE_FUN.2.1D The developer shall test the TSF and document the results.
ATE_FUN.2.2D The developer shall provide test documentation.
Content and presentation of evidence elements:
ATE_FUN.2.1C The test documentation shall consist of test plans, test procedure descriptions, expected test results and actual test results.
ATE_FUN.2.2C The test plans shall identify the security functions to be tested and describe the goal of the tests to be performed.
ATE_FUN.2.3C The test procedure descriptions shall identify the tests to be performed and describe the scenarios for testing each security function. These scenarios shall include any ordering dependencies on the results of other tests.
ATE_FUN.2.4C The expected test results shall show the anticipated outputs from a successful execution of the tests.
ATE_FUN.2.5C The test results from the developer execution of the tests shall demonstrate that each tested security function behaved as specified.
ATE_FUN.2.6C The test documentation shall include an analysis of the test procedure ordering dependencies.
Evaluator action elements:
ATE_FUN.2.1E The evaluator shall confirm that the information provided meets all requirements for content and presentation of evidence.