Frequently asked questions
Short answers to common Testmode questions: whether it fits your app, re-running, cost, Self-driving, parallel tests, passwords, report recipients, CI and AI agents, and the Free plan.
Straight answers to the questions people ask while they use Testmode. Each answer points to the page with the full detail.
Will Testmode work with my app?
Section titled “Will Testmode work with my app?”That depends on how your app is reached and how people sign in to it. What Testmode can and cannot test answers the common questions, from localhost and VPNs to one-time codes, CAPTCHA and payment forms.
More questions
Section titled “More questions”Do I need to write code or selectors?
Section titled “Do I need to write code or selectors?”No. Test cases are plain-English steps and an Expected Outcome. Testmode works out the browser actions from your words the first time a test runs, and replays them on later runs.
Why does my test behave the same on every run?
Section titled “Why does my test behave the same on every run?”Each step is turned into browser operations once, and those operations are saved and replayed. Testmode works a step out again only when you change its wording.
Can I re-run only the failed tests of a run?
Section titled “Can I re-run only the failed tests of a run?”Re-run in a run’s menu repeats the whole run on the same environment. To retry one failed test, open it and click Re-run on its page.
Do the tests in a run run one after another?
Section titled “Do the tests in a run run one after another?”No. Each test runs in its own fresh cloud browser, at the same time as the others, in no guaranteed order, even inside a test plan. Write every test so it sets up what it needs.
What does a run cost?
Section titled “What does a run cost?”One credit per action its tests run: each click, typed value, wait or check, and the final Expected Outcome check. A typical test is about ten. Tests that never ran, failed at login, or failed on Testmode’s side are not charged. See How credits are counted.
Can my teammates see the passwords I store in credentials?
Section titled “Can my teammates see the passwords I store in credentials?”No. Passwords are stored encrypted and never shown again, to anyone. Teammates see a credential’s name, username and login URL. Variable values, on the other hand, are visible to every project member.
Can people outside my organization receive run reports?
Section titled “Can people outside my organization receive run reports?”Yes, unless the organization limits email domains. Schedules can send reports to any address; the link in a report opens only for members.
Can I test my app on localhost?
Section titled “Can I test my app on localhost?”Not directly. Testmode’s browsers run in the cloud and need a URL reachable from the public internet, such as a staging or preview deployment.
Can Testmode test mobile apps or APIs?
Section titled “Can Testmode test mobile apps or APIs?”Testmode tests web apps in a desktop browser. It doesn’t test native mobile apps, desktop apps or APIs on their own.
Can I start runs from CI or an AI agent?
Section titled “Can I start runs from CI or an AI agent?”Yes. Create a project API key under Settings > API & CI, then use the GitHub Action, the REST API from any CI, or connect an AI agent over MCP.
Does the assistant run tests?
Section titled “Does the assistant run tests?”No. It writes and changes test cases, plans, schedules and variables, explains your suite, starts explorations and speaks for Self-driving. You start runs from Run tests, a schedule, CI or an agent.
Will Self-driving change my tests without asking?
Section titled “Will Self-driving change my tests without asking?”It writes, fixes and switches off test cases and schedules them, and lists every change under Activity with Undo. Choose Suggest them in its settings and it only suggests. Fixes from investigating a failed run always wait in the Inbox for Apply to test.
Does Self-driving explore production?
Section titled “Does Self-driving explore production?”It can. Its crawl only reads pages, and its exploratory tests stop short of keeping data on a production environment that does not allow tests that change data. Still, learn the app on staging when you have it, and list paths whose links change data under Paths it stays out of.
Is there a free plan?
Section titled “Is there a free plan?”Yes. Free has 100 credits a month for the whole organization, with no card: write and run tests and ask the assistant, in one project with one environment. To try Self-driving, start the 7-day Pro trial: 2,500 credits, card required, nothing charged until it ends.