tests/README
author Thomas Arendsen Hein <thomas@intevation.de>
Fri, 29 Jul 2005 06:43:21 +0100
changeset 793 445970ccf57a
parent 761 0fb498458905
parent 774 6592c4f5cd4f
child 799 583e290e4945
permissions -rw-r--r--
Merge with upstream
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
331
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
     1
A simple testing framework
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
     2
332
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
     3
To run the tests, do:
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
     4
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
     5
cd tests/
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
     6
./run-tests
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
     7
331
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
     8
This finds all scripts in the test directory named test-* and executes
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
     9
them. The scripts can be either shell scripts or Python. Each test is
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    10
run in a temporary directory that is removed when the test is complete.
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    11
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    12
A test-<x> succeeds if the script returns success and its output
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    13
matches test-<x>.out. If the new output doesn't match, it is stored in
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    14
test-<x>.err.
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    15
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    16
There are some tricky points here that you should be aware of when
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    17
writing tests:
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    18
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    19
- hg commit and hg up -m want user interaction
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    20
761
0fb498458905 Change all references to -t --text commit message to -m and --message.
Andrew Thompson <andrewkt@aktzero.com>
parents: 350
diff changeset
    21
  for commit use -m "text"
331
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    22
  for hg up -m, set HGMERGE to something noninteractive (like true or merge)
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    23
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    24
- changeset hashes will change based on user and date which make
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    25
  things like hg history output change
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    26
761
0fb498458905 Change all references to -t --text commit message to -m and --message.
Andrew Thompson <andrewkt@aktzero.com>
parents: 350
diff changeset
    27
  use commit -m "test" -u test -d "0 0"
331
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    28
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    29
- diff will show the current time
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    30
774
6592c4f5cd4f Change sed patterns in tests to strip dates after spaces or tabs
mpm@selenic.com
parents: 761
diff changeset
    31
  use hg diff | sed "s/\(\(---\|+++\) [^ \t]*\)[ \t].*/\1/" to strip
6592c4f5cd4f Change sed patterns in tests to strip dates after spaces or tabs
mpm@selenic.com
parents: 761
diff changeset
    32
  dates
331
55f63f3b6a54 Add a simple testing framework
mpm@selenic.com
parents:
diff changeset
    33
332
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
    34
- set -x and pipelines don't generate stable output
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
    35
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
    36
  turn off set -x or break pipelines into pieces
6c869059beb4 testing fixups
mpm@selenic.com
parents: 331
diff changeset
    37