Frequently Asked Questions
What technology are you using for Test Automation?
We use our own test automation tool, Verifaya Studio. It is a 100% script-free tool, with the flexibility and power to perform sophisticated web and mobile testing. It includes a rich set of test generation, execution and reporting features, and supports all web technologies, .Net, Java, Adobe Air/Flex, web services, Android, and many more. You can download Verifaya Studio here.
What is your definition of a test case?
A test case is a test scenario that typically matches a user experience and contains multiple actions and validations. Obviously, the length and complexity of test cases varies greatly from company to company and from application to application. Our pricing for the automation of one test case above is based on our experience and correlates with the average length and complexity of test scenarios we see in most test suites. We will let you know if your test cases are significantly above or below average as this may change your final price. We can work with test case definitions in any format and level of detail. Example A | Example B.
How many test cases can I automate?
You can automate any number of test cases. Some of our customers have automated fewer than 10 test cases, others have automated thousands.
How many tests can I execute and how frequently?
After your test cases are automated, you can define different test suites – perhaps a regression suite with all your test cases, a smoke test suite with only a subset of your test cases for a specific module, or just one test case to check key functionality in your live application. So a test run can be any size you want – from one test case to many thousands. You can then execute your test suites on any frequency and schedule, or ad hoc, 24 hours a day, 365 days a year.
Which test execution environments are supported?
The complete list of test execution environments that are supported in our on-demand service can be found here.
Do I need to purchase test automations or executions in advance?
No. Verifaya is a pay-as-you-go service. You pay at the end of the month only for the test cases that have been automated or executed in that month.
Do I have to purchase test automation maintenance in advance?
No. Test automation maintenance is optional. If you chose not to have test automation maintenance as part of your plan and find that you need maintenance at some point, we can update your test automations at your request. Our rate for test automation maintenance is $30 per hour.
How does the pricing for test execution work?
The price above is for the execution of a test case one time in a single test environment. Generally, a test environment is the combination of specific versions of the operating system, browser, and any other relevant software in the execution environment. For example, if a test case is executed one time in one version of Chrome on a Windows PC, that’s one test execution. Executions of the same test case in other versions of Chrome or other browsers would be additional executions.
For example: a test run of 100 test cases executed in Chrome would be 100 test executions and will cost 100 times the price above. A test run of the same 100 test cases in one version each of Chrome, Firefox and IE on a Windows PC would be 300 test executions and will cost 300 times the price above.
Who is eligible for volume discounts?
The pricing above is typical for medium sized sets of test cases to be automated and executed. If your number of test cases to be automated is above 500, or if the number of test executions exceeds 20,000 per month, we can offer lower prices to reflect the efficiencies of that activity. Contact us for more details.
How does the free trial work?
In a free trial, we will automate a subset of your test cases and execute those for 2 weeks. This allows you to see that the test automations work in your environment, view the results of the tests, and generally get a feel for how the service works.
While we will do most of the work, there are a few things you will need to do: provide us with access to the application to be tested and provide us with a high level description or detailed definition of the scenarios you want tested. Getting access to your application might mean simply having us access your public web site. Alternatively, you might want to give us VPN access to a test system or a copy of your app to install in our lab.
Typically we can demonstrate the automated test cases a few days after receiving them from the customer.
Can I execute tests on my servers and in that case, do I need to pay for test execution?
At any time during or after your use of the Verifaya On-Demand Service, you can use Verifaya Studio to execute your automated test cases, on your premises, at no cost.
Can you perform other types of testing in addition to functional testing?
Yes. We provide a wide range of testing services to customers,including performance and load testing, localization testing, security testing, compliance testing, and usability testing. For information, see our testing services page.
If I decide to stop using the On-Demand service, who owns the automated tests?
You own the test automations we create as part of our service. At any time, you can get copies of all test automations and import them into your own installation of our Verifaya Studio tool where you can store, enhance, maintain, and execute the automations.