Test Design Tools

Tools that help you decide what tests need to be executed or that generate test data.

Current Listings

 		     These folks help keep the site running-
Where the Geeks are Heroes -
The Aremac Project, by Jerry Weinberg
25% off for testingfaqs.org readers
Service-Oriented Virtualization Paper from iTKO - How to test w/Virtual Services instead of live apps
Could ISTQB testing certification work for you? - Discover 4 reasons 60,000+ testers have chosen ISTQB.
TechExcel DevSuite - Manage requirements, planning, issue tracking and testing.
(click here for details about advertising)

Tools Listed Elsewhere

 These tools fit better into a different category, but are worth mentioning here as well. Their main listing is in the other category.

DGL
Kind of Tool
Design tests from context-free grammars (freeware)
Organization
Peter Maurer
http://cs.ecs.baylor.edu/~maurer/
Software Description
"This report describes the data generation language "dgl." The language was originally designed to create general functional level tests for VLSI designs, but there is no inherent reason why this tool cannot be used for other purposes. In particular, there is no reason why this tool could not be used to generate tests for software systems as well as for other types of hardware. The tool is particularly adapted to situations requiring random selection and printing of data. The dgl language was designed to facilitate the construction of data generators that select items at random from a set of items described by a probabilistic context free grammar."
Platforms
UNIX

Entry updated July 10, 2003.
Return to Listings

Datatect
Kind of Tool
Test Data Generator
Organization
Banner Software Inc.
http://www.datatect.com/
Software Description
Test data generation program for generating realistic test data to ASCII flat files or directly to RDBMS including Oracle, Sybase, SQL Server, and Informix. Free demo available.
Platforms
Windows 95/NT

Return to Listings

T-VEC Test Generation System
Kind of Tool
Specification-based Test Vector Generator, Coverage Analysis and Test Driver Generation
Organization
T-VEC Technologies
http://www.t-vec.com/
Software Description
The toolset, called the T-VEC Factory, provides specification-based test vector generation, coverage analysis and test driver generation. The Factory tools are integrated in an environment to support the development and management of structured or object-oriented requirements specifications. This process supports both unit testing, integration and software system testing through hierarchical specifications. A Specification Compiler verifies the consistency of the specification and then transforms it into a form appropriate for test vector generation. The Test Vector Generator automatically generates tests by determining the input space boundaries for each requirement specification element, and then selects inputs along the boundaries; it uses the inputs to compute the expected output based on the specification. The Test Coverage Analyzer verifies that each requirement specification element has associated test vectors; if not, uncovered requirements are flagged. An execution/debug environment is included to aid in locating specification errors. The test execution can be fully automated from the specification-based tests. The environment supports generation and management of specification-to-implementation objects mappings that can be customized for any implementation language and test environment. The Test Driver Generator automatically creates test drives from the object mappings to support test execution and results analysis. The environment functionality is packaged in a visual environment that has a look and feel similar to the Microsoft WindowsNT Explorer and includes Visualization - a matrix representation of the test vectors and of artifact status.
Platforms
PC, WindowsNT

Return to Listings

DataFactory
Kind of Tool
Test Data Generator
Organization
Quest Software, Inc.
http://www.quest.com/datafactory/

Entry updated July 7, 2005.
Return to Listings

DARTT
Kind of Tool
Automated testing over subprogram parameter range
Organization
BSSE System and Software Enginering
http://www.bsse.biz/
Software Description
The DARTT tool (Dynamic Ada Random Test Tool) is a tool for verification of software and for quality analysis of the inspected code. It is currently available for Ada software but will also be provided for C software in future.

DARTT scans incrementally or randomly the full input range of subprogram parameters for exceptions or anomalies and generates test output. It evaluates the test results and provides textual or graphical reports.

DARTT sets up automatically the test environment for subprogram testing based on a subprogram's specification. As input it only needs a pattern of sources files which inlude the source code of the subprograms to be tested or which are referenced by the subprograms-under-test. Having received this information DARTT does everything what is needed to run the tests automatically and in background.

When DARTT is used as quality analysis tool it identifies unhandled exceptions or significant changes of output. Such changes help to determine test ranges for more detailed testing.

As test tool DARTT produces and documents the results over the full input parameter domain Such results may be subject of further manual or automatic analysis.

Platforms
PC, DOS / Windows 3.1x
Other platforms on request.

Return to Listings

TDGEN
Kind of Tool
Test Data Generation Tool
Organization
Software Research, Inc.
http://www.soft.com/TestWorks/
Software Description
TDGEN is a test data generator which works as a stand-alone product or as part of the fully integrated TestWorks/Advisor tool suite. TDGEN takes an existing test script and substitutes new random or sequential data values to create additional tests. With minimal work, TDGEN increases the size of a test suite to more fully exercise the application under test. TDGEN behaves as an intelligent macro processor. The user either creates new test data files or configures existing test scripts to substitute different data items for selected fields. With TDGEN, hundreds of additional tests can be created in a short amount of time.
Platforms
SPARC SunOS 4.1.3; SPARC Solaris 2.3, 2.4, 2.5, 2.5.1, 2.6; x86 Solaris 2.4, 2.5; RS-6000/AIX 3.2.5, 4.1.2, 4.2; HP-9000/7xx HP-UX 9.05, 10.10; HP-9000/8xx HP-UX 9.04, 10.01, 10.10; x86 SCO/ODT 2.0, 5.0(3.0); SGI Irix 5.3, 6.2; DEC-Alpha OSF1 3.2, 4.0; NCR 3000; SCO/UnixWare 2.1.1; DOS.

Entry updated October 23, 2003.
Return to Listings

Reactis Tester
Kind of Tool
Model-based automated testing
Organization
Reactive Systems, Inc.
http://www.reactive-systems.com/
Software Description
Reactis Tester generates test cases for implementations from models. These test cases may then be fed to the model and its implementation and the outputs compared to determine whether or not the code conforms to its model. A user may indicate how exhaustive the testing should be. The tool eliminates the need for producing test suites manually and reduces the time spent in testing by ensuring that unnecessary tests are avoided.
Platforms
Unix/Linux, Windows 95/98/NT

Entry added November 28, 2000.
Return to Listings

ALLPAIRS
Kind of Tool
Test Case Generation Tool (freeware)
Organization
Satisfice, Inc.
1198 South Fork Drive
Front Royal, Virginia 22630
USA
Phone: (540) 631-0600
Fax: (540) 631-9264
E-mail: james@satisfice.com
http://satisfice.com/
Software Description
Allpairs.pl is a Perl script that constructs a reasonably small set of test cases that include all pairings of each value of each of a set of parameters. Allpairs is a command-line executable based on a Perl script. Source is included. See the Test Methodology section of http://satisfice.com.
Platforms
Win98, Win2K, WinXP

Entry updated February 24, 2002.
Return to Listings

Multi
Kind of Tool
Generating test ideas from expressions with booleans and relational operators (freeware)
Organization
Testing Foundations
Phone: (217) 351-7228
E-mail: marick@testing.com
http://www.testing.com/
Software Description
A test idea is a brief statement of something that should be tested. For example, if you're testing a square root function, one idea for a test would be "test a number less than zero". The idea is to check if the code handles an error case.

Test ideas are gotten in a number of ways. This program helps derive test ideas from expressions that contain boolean operators and relational operators. The rationale behind the program is described in my "Testing for Programmers" course notes, beginning with the slide titled "A Program for Finding Faults in Boolean Expressions", currently slide 22.

Platforms
Java required

Entry updated February 24, 2002.
Return to Listings

SSW SQL Auditor
Kind of Tool
Database Tool
Organization
Superior Software for Windows Pty Ltd
http://www.ssw.com.au/
Software Description
Keep your SQL Server database free from design flaws with SSW SQL Auditor

Maintaining quality code across a large team is difficult. Even when standards are in place developers can make mistakes that will slip through QA. SSW SQL Auditor, built in VB .NET, allows a developer to set SQL Server design rules and then check the database for code or design elements that ignores those rules.

Platforms
Windows 98, ME, NT 4.0, 2000 or XP

Entry updated June 4, 2002.
Return to Listings

jenny
Kind of Tool
Cover all pairs of features, with restrictions (freeware)
Organization
Bob Jenkins
E-mail: bob_jenkins@burtleburtle.net
http://burtleburtle.net/bob/math/jenny.html
Software Description
Jenny generates testcases that cover all pairs (or triples) of features. For example, all feature pairs for 20 dimensions of 10 features each is covered by 210 testcases. You can specify restrictions (combinations of features not to cover), for example feature combinations that are supposed to raise errors. Similar to ALLPAIRS or AETG. Public Domain.
Platforms
Executable available for Windows. C code available for any platform that with a C compiler.

Entry updated July 7, 2003.
Return to Listings

TurboData

Kind of Tool
Test Data Generator and SQL Builder
Organization
Canam Software Labs, Inc.
http://www.turbodata.ca/
Software Description
TurboData is a test data generator. Simply read in the table and column information directly from your database, press 2 pushbuttons, and TurboData will load your database with valid test data, all the foreign keys will be correctly resolved!
Platforms
Runs on Windows 32. Targets databases: DB2, Jet (Microsoft Access), MS SQL Server, NonStop SQL, Oracle, Sybase

Entry updated October 3, 2002.
Return to Listings

Move for DB2

Kind of Tool
Relational extract tool for test data creation and management
Organization
Princeton Softech
http://princetonsoftech.com/
Software Description
Princeton Softech’s Move(TM) for DB2 extracts and moves complex relational data to and from any DB2 database with ease. You can create referentially intact subsets of data with 100% accuracy, no matter how many tables or relationships are involved. Move for DB2 maximizes your productivity by completely eliminating the need to write custom extract programs.
Platforms
OS/390, z/OS

Entry updated October 16, 2002.
Return to Listings

Move for Legacy

Kind of Tool
Extract tool for creation of test data from legacy data sources
Organization
Princeton Softech
http://princetonsoftech.com/
Software Description
Princeton Softech's Move(TM) for Legacy provides a federated data access capability so you can migrate related subsets of IMS, VSAM and DB2 data in order to thoroughly test your applications. You can identify “relationships” between IMS segments and DB2 tables, and use flexible selection criteria to precisely define the desired result. Move for Legacy eliminates the need to clone large IMS databases or write complicated data extract programs.
Platforms
os/390, z/OS

Entry updated October 16, 2002.
Return to Listings

Move for Servers

Kind of Tool
Relational data extract for test data creation and management
Organization
Princeton Softech
http://princetonsoftech.com/
Software Description
Princeton Softech's Move™ for Servers extracts and moves complex relational data to and from any database with ease. It creates referentially-intact subsets of data with 100% accuracy, no matter how many tables or relationships are involved. Move for Servers supports the major distributed databases, including Oracle, DB2/UDB, Sybase, SQL Server and Informix. It maximizes your productivity by completely eliminating the need to write custom extract programs.
Platforms
Windows, Unix

Entry updated October 16, 2002.
Return to Listings

Edit for Servers

Kind of Tool
Relational editor for test data creation and management
Organization
Princeton Softech
http://princetonsoftech.com/
Software Description
Princeton Softech's Edit™ for Servers allows you to browse and edit referentially-intact subsets of data, from multiple related tables, simultaneously on one screen. With Edit for Servers, you can dynamically "join" related tables and views, synchronously scroll the data, and browse or edit data from within in its relational context. Edit for Servers supports the major distributed databases, including Oracle, DB2/UDB, Sybase, SQL Server and Informix.
Platforms
Windows, Unix

Entry updated October 16, 2002.
Return to Listings

Orchid

Kind of Tool
test case design tool
Organization
stag software private limited
http://www.stagsoftware.com/
Software Description
Orchid is a test case design tool that helps you to design effective test cases that are adequate and yet minimal

Key Benefits

Features

Platforms
Linux and Windows

Entry updated February 21, 2003.
Return to Listings

AllPairs.java

Kind of Tool
All-pairs test case generator (freeware)
Organization
Cunningham & Cunningham, Inc.
E-mail: ward@c2.com
http://fit.c2.com/wiki.cgi?AllPairs
Software Description
AllPairs.java is a Java program that can design a set of tests using the all-pairs method, which reduces a potentially astronomical number of combinations of variables into a manageable set that still makes for an effective test suite in most situations.

Distributed under the GNU GPL.

Platforms
Platforms supported by Java

Entry updated July 25, 2003.
Return to Listings

Assertion Definition Language (ADL)

Kind of Tool
Automatic test generation tool (freeware)
Organization
The Open Group
Apex Plaza,
Forbury Road,
Reading,
Berkshire RG1 1AX,
UK
Phone: +44 (0)118 950 8311
Fax: +44 (0)118 950 0110
E-mail: adl_support@opengroup.org
http://adl.opengroup.org/
Software Description
Assertion Definition Language (ADL) is a high-level language that provides a formal grammar for the expression of programmatic assertions. It can be used to automatically generate tests based on API specifications and to produce natural language representations of these assertions for documentation. The language has C/C++, IDL and Java dialects each of which are designed to reflect the syntax of those languages to help developers to better describe native APIs.
Platforms
Platforms supported by Java. Supports C, C++, IDL and Java interfaces.

Entry updated July 25, 2003.
Return to Listings

tsl

Kind of Tool
Test specification language compiler (freeware)
Organization
Central Iowa Railroad
P.O.Box 868013
Plano, TX 75086-8013
Phone: +1.214.674.8152
Fax: +1.972.881.8331
E-mail: info@cirr.com
ftp://ftp.cirr.com/pub/cite
Software Description
Tsl is an implementation of an idea originally proposed by Ostrand and Balcer in CACM June '86 which has been enhanced to allow generation of test source instead of just a list of tests to be written. Tsl was written by Paco Romero and Peter Vogel.

Sources are under cite-4.4/src/tsl in the CITE 4.4 distribution (CONVEX Integrated Test Environment).

Platforms
HP-UX, SPP-UX, ConvexOS

Entry updated July 25, 2003.
Return to Listings

LOGAN Fault Tree Analysis
Kind of Tool
Fault & Event Tree Analysis Tool
Organization
Reliass
http://www.reliass.com/
Software Description
Features include:
Platforms
Windows

Entry updated April 17, 2003.
Return to Listings

LOGAN Monte Carlo Simulation
Kind of Tool
Availability Simulation Tool
Organization
Reliass
http://www.reliass.com/
Software Description
The LOGAN Monte Carlo Simulation package is designed to assess process availability. The system simulates both binary systems (working/not working) and systems capable of operating at various levels of production. The system has the following main features:
Platforms
Windows

Entry updated April 17, 2003.
Return to Listings

Raptor
Kind of Tool
Availability Simulation Tool
Organization
Reliass
http://www.reliass.com/
Software Description
Raptor software allows a reliability novice to quickly model a system. The graphical user interface and strong emphasis on human factors make Raptor the pre-eminent reliability analysis tool.

Using Raptor, you model your systems graphically by drawing reliability block diagrams (RBDs) and describing the way components fail and are repaired. By placing components within the workspace and connecting them with links and nodes, the series-parallel relationships of the components that make up a system can easily be described.

Platforms
Windows

Entry updated April 17, 2003.
Return to Listings

RAMP
Kind of Tool
Availability Simulation Tool
Organization
Reliass
http://www.reliass.com/
Software Description
RAMP is a powerful availability modelling package developed specifically for the analysis of process systems. RAMP models the effects of scheduled and unscheduled downtime on process throughput, establishing relationships between equipment reliability, configuration, maintenance strategy, spares and resources.
Platforms
Windows

Entry updated April 17, 2003.
Return to Listings

dadada
Kind of Tool
ASCII Test Data Generator (freeware)
Organization
Phuoc Can HUA
Carlton NSW 2218
Australia
E-mail: home@huaonline.com
http://www.huaonline.com/dadada
Software Description
dadada generates ASCII files for Data Driven Test. It allows user to separate the don't care data from the test data, so that he does not need to be distracted by the irrelevant data. Additionally, you can assign value with a meaningful name and make your data much more understandable.
Platforms
Windows (DOS)

Entry updated April 24, 2003.
Return to Listings

BenderRBT
Kind of Tool
Functional test case design
Organization
Bender RBT Inc.
http://benderrbt.com/
Software Description
BenderRBT assists project teams in analyzing and reviewing the application requirements to eliminate logical inconsistencies and errors. Using cause-effect graphing, an innovative approach which graphically displays relationships and constraints between application nodes (inputs and outputs), the project team can analyze every aspect of the requirements in BenderRBT. BenderRBT then evaluates the recorded information to identify precedence problems in relations, logical errors, missing functionality and improperly used aliases. BenderRBT provides detailed analysis information in a variety of easy-to-read formats. Business analysts and project stakeholders collaboratively can review the natural language test cases generated by BenderRBT, enabling them to identify and correct any requirement errors earlier in the development cycle.

Cause-Effect Graphing - A proven technique for effective requirements validation and test case design, cause-effect graphing is the process of transforming specifications into a graphic representation. This graphic representation depicts the functional relationships and conditions present in the requirements, illustrating how each input relates to every other input, as well as every output. Constraints and observability of nodes also are established during this process, allowing the project team to identify potential problem areas. In developing the cause-effect graph, the test team evaluates the requirements for completeness, consistency, sufficient level of detail and lack of ambiguity, often finding defects that otherwise would not be found until integration testing.

Through its Visio add-on, BenderRBT allows project teams to quickly create cause-effect graphs, complete with node relationships, constraints, and attributes. A BenderRBT Visio stencil is provided, containing all of the components required to produce cause-effect graphs. When a node is created, users are prompted to enter the required attributes, reducing the risk of incompletely defined nodes. Relationships, including exclusivity and masking, can be added simply by dragging and dropping relation components onto the Visio grid. When the cause-effect graph is completed, users can invoke BenderRBT to design test cases based on the requirements depicted in the graph.

Platforms
BenderRBT runs on Windows. It can create test cases for any application running on any platform written in any language.

Entry updated May 23, 2003.
Return to Listings

DTM Data Generator
Kind of Tool
test data enerator for database testing purposes
Organization
DTM soft
http://www.sqledit.com
Software Description
DTM Data Generator is a simple, powerful and fully customizable utility that generates data, tables, views, procedures, etc for database testing purposes: performance testing, QA testing, loading tests or usability testing.
Platforms
Windows 9x, 2000, XP, 2003, Vista

Entry updated December 4, 2006.
Return to Listings

LISA Business Process Validation
Kind of Tool
Provides a rich feature set for discovering, modeling and validating complex business workflows across multiple technologies.
Organization
iTKO, Inc.
http://www.itko.com/site/products/lisa/business_process.jsp
Software Description
For SOA, effectively managing quality within IT to support business processes requires deep collaboration between system architects, technical implementers and end business users. Working with your process tools, LISA Business Process Validation (LISA BPV) provides a rich feature set for discovering, modeling and validating complex business workflows across multiple technologies. LISA BPV maintains test awareness of the larger workflow, while providing visibility into every detailed behavior of the business process, uncovering the root causes of functional and performance issues before and after rollout of new functionality.
Platforms
Win XP/2000/Me/Vista, Mac OS X, Unix, Linux, Solaris

Entry updated December 11, 2007.
Return to Listings

Return to index