alltests — test runner for competitive programming

Basic usage:

1. Prepare static tests as pairs of *.in and *.out files with the same base name.
2. Run alltests <cmd> to execute <cmd> with every *.in file as stdin and compare stdout with corresponding *.out file

Requirements:

• Other scripts from this repo must be in $PATH: nice_paste, runcpp, (optional, requires python3) floatdiff
• Unix commands: find, sed, time, rm

Examples (aplusb):

Run command python2 sum.py on the given set of tests (test/*.in) and compare outputs with corresponding files (test/*.out):

$ alltests python2 sum.py

Automatically find and use *.py or *.cpp file. Python files have precedence over C++. If several files of the same filetype are available random is choosen.

$ alltests

Abort on the first failed test:

$ alltests --cpp sum.cpp --abort-on-fail

Print only results of tests, no verbose stdout/correct answer:

$ alltests --cpp sum.cpp --short

Print help:

$ alltests --help

Examples (sort):

If you have several *.py files in the same directory:

$ alltests python sort.py

You can specify any command for testing:

$ alltests sort  # unix sort command