From: Richard Levitte <levitte@openssl.org>
Date: Thu, 1 Sep 2016 16:48:19 +0000 (+0200)
Subject: Document the enhanced tests specification
X-Git-Tag: OpenSSL_1_1_1-pre1~3601
X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=b3e718e286c7a51fb1defc4136695937f4f19d66;p=openssl

Document the enhanced tests specification

Reviewed-by: Emilia Käsper <emilia@openssl.org>
---

diff --git a/INSTALL b/INSTALL
index 132b2aa1fb..c63797af34 100644
--- a/INSTALL
+++ b/INSTALL
@@ -667,6 +667,9 @@
 
      Please send bug reports to <rt@openssl.org>.
 
+     For more details on how the make variables TESTS can be used,
+     see section TESTS in Detail below.
+
   4. If everything tests ok, install OpenSSL with
 
        $ make install                                   # Unix
@@ -879,6 +882,38 @@
                 automatically generated files; add new error codes or add new
                 (or change the visibility of) public API functions. (Unix only).
 
+ TESTS in Detail
+ ---------------
+
+ The make variable TESTS supports a versatile set of space separated tokens
+ with which you can specify a set of tests to be performed.  With a "current
+ set of tests" in mind, initially being empty, here are the possible tokens:
+
+ alltests       The current set of tests becomes the whole set of available
+                tests (as listed when you do 'make list-tests' or similar).
+ xxx            Adds the test 'xxx' to the current set of tests.
+ -xxx           Removes 'xxx' from the current set of tests.  If this is the
+                first token in the list, the current set of tests is first
+                assigned the whole set of available tests, effectively making
+                this token equivalent to TESTS="alltests -xxx"
+
+ Also, all tokens except for "alltests" may have wildcards, such as *.
+ (on Unix and Windows, BSD style wildcards are supported, while on VMS,
+ it's VMS style wildcards)
+
+ Example: All tests except for the fuzz tests:
+
+ $ make TESTS=-test_fuzz test
+
+ or (if you want to be explicit)
+
+ $ make TESTS='alltests -test_fuzz' test
+
+ Example: All tests that have a name starting with "test_ssl" but not those
+ starting with "test_ssl_":
+
+ $ make TESTS='test_ssl* -test_ssl_*' test
+
  Note on multi-threading
  -----------------------