From 0bb8620a670c16c03603fb7d82388d24a347626f Mon Sep 17 00:00:00 2001 From: Christian Thaeter Date: Sat, 18 Aug 2007 15:07:13 +0200 Subject: [PATCH 1/2] test renumbered --- tests/{15plugin.tests => 20plugin.tests} | 0 1 file changed, 0 insertions(+), 0 deletions(-) rename tests/{15plugin.tests => 20plugin.tests} (100%) diff --git a/tests/15plugin.tests b/tests/20plugin.tests similarity index 100% rename from tests/15plugin.tests rename to tests/20plugin.tests From 0ec7efb4512e05e7a590dadd89b59e1d60ff5277 Mon Sep 17 00:00:00 2001 From: Christian Thaeter Date: Sat, 18 Aug 2007 15:23:24 +0200 Subject: [PATCH 2/2] suggestion for test ordering, please refine if necessary --- wiki/index.html | 17 ++++++++++++++++- 1 file changed, 16 insertions(+), 1 deletion(-) diff --git a/wiki/index.html b/wiki/index.html index 6b16c2ab8..e77f90799 100755 --- a/wiki/index.html +++ b/wiki/index.html @@ -3494,7 +3494,7 @@ Portions written by Luke Blanshard are hereby released into the public domain. <!--}}}--> -
+
! The Test Script
 To drive the various tests, we use the script {{{tests/test.sh}}}. All tests are run under valgrind control if available unless {{{VALGRINDFLAGS=DISABLE}}} is defined. 
 * The SCons buildsystem will build and run the testcode when executing the target {{{scons tests}}}.
@@ -3529,6 +3529,21 @@ In a .tests file one has to define following:
 
 If no {{{out:}}} or {{{err:}}} is given, stdout and stderr are not considered as part of the test. If no {{{return:}}} is given, then 0 is expected.
 
+!! Numbering Tests
+It needs to be ensured that simpler tests come before more complex ones and that dependant tests come after their dependencies.
+
+Here is the order suggested:
+|00|The test system itself|
+|01..|Infrastructure, package consistency etc.|
+|10..|Basic support library functionality|
+|20..|Higher level support library services|
+|40..|Backend Unit tests|
+|50..|Proc Layer Unit tests|
+|60..|User interface Unit tests (Gui, Scripting)|
+|70..|Unit interaction tests (Backend, Proc, UI, ...)|
+|80..|Functionality tests on the complete program|
+|90..|Optional tests, example code etc.|
+