Texttest is an application-independent open source tool for text-based functional testing. This means running a batch-mode binary in lots of different ways, and using the text output produced as a means of controlling the behaviour of that application.

TextTest can be downloaded from the SourceForge project page