[Omake] Re: Tests

[David Kågedal]

Aleksey Nogin <nogin at metaprl.org> writes:

> On 14.06.2007 08:42, David Kågedal wrote:
>
>> OK, now there is some kind of test suite in the 0.9.8.4 branch.  To
>> run it, type "omake check".
>
> Cool, thanks!

I found a couple of problems in my test cases that I will fix shortly.

>> Please try it out and see if it actually works. Also look at my code
>> to see if I did something stupid.  And finally, please have a look at
>> all the test cases that are failing.
>
> I've updated the tests/OMakefile slightly, however there is still a
> fundamental problem with it - currently it assumes the success is
> signaled by the exit status. Instead, we need some framework for
> comparing the actual result with the expected ones. For example, in
> some of the tests that are currently considered "failing", OMake is
> _supposed_ to die (e.g. exn/Test1). In some, the point of the test is
> to see if the output is what we expect it to be (all the awk tests),
> in some - whether the right targets are created...

The awk tests could potentially handle that themselves by sending the
output to a file and checking the result in the test script.  But the
expected failures are harder to handle this way.

I'll think some more about it.

-- 
David Kågedal