# Email run reports

URL: https://testmode.ai/docs/email-run-reports/

> A run report is an email Testmode sends when a run finishes. Set recipients and timing per schedule, opt in for runs you start, and see what it contains.

Testmode can email a report when a run finishes, with the verdict, every test's result and a link to the run. You set reports in two places: on each schedule, for scheduled runs, and on your profile, for runs you start yourself.

## Reports for scheduled runs

Each schedule has its own report settings, under **Email reports** in the schedule dialog.

1. Open the plan from **Test Plans**, select **Schedules**, and click **Add Schedule**, or the pencil icon on an existing schedule.

2. Under **Email reports**, choose when to send. The options are described in the table below.

3. Add at least one address under **Recipients**, unless you chose **Never**.

4. Click **Save**.

| Option | Sends a report |
| --- | --- |
| **Only when a test fails** (default) | When the run ends `Failed` |
| **After every run** | When the run ends `Passed` or `Failed` |
| **Never** | Never |

On the **Schedules** tab, the schedule then shows its recipients followed by "on failure" or "every run".

For example, Pellbrook Digital's **Storefront smoke** schedule sends a report only when a test fails, to `qa@example.com` and `maren.veld@example.com`.

## Add recipients

Type an address and press `Enter`, a comma or a space, or click away, to turn it into a chip. You can also paste several addresses at once, separated by commas, semicolons or spaces.

- To remove an address, click the x on its chip, or press `Backspace` in the empty field to remove the last one.
- You can add up to 20 addresses per schedule.
- As the dialog says: "Any address works, not only members of this organisation." A client or a shared team inbox can receive reports without a Testmode account.

Testmode reads the recipient list when a run finishes. An address you add later receives reports for later runs, not for runs that already finished.

**Note**

Recipients who are not members of your organization can read the email, but the **View run in Testmode** link only opens for members.

## Reports for runs you start

Runs you start yourself, from the Run tests dialog or with **Re-run**, do not use any schedule's list. Instead, each person chooses on their own profile.

1. Open the organization menu at the bottom of the sidebar and choose **Profile**.

2. In **Email Notifications**, open **Runs I start** and choose **Don't email me** (the default), **Email me when a test fails** or **Email me after every run**.

3. Click **Save**.

Reports go to your profile's email address, which the page shows under the setting. The setting covers every run you start, including plan runs, in every organization you belong to. It does not cover scheduled runs.

If a run qualifies under a schedule's list and your own setting, you receive one email, not two.

## When a report is sent

- Testmode sends one report per run, when the run ends `Passed` or `Failed`.
- **Only when a test fails** means the run ended `Failed`, which happens when any test in it failed.
- Runs recorded as `Skipped` send no report. A scheduled run is skipped when the organization does not have enough credits, or when none of the plan's enabled test cases has steps or an Expected Outcome. See [When a schedule does not run](https://testmode.ai/docs/schedule-test-plans/#when-a-schedule-does-not-run).
- The email can arrive a little after the run ends.

## What the report contains

The subject line tells you the verdict before you open it. After `[Testmode]` it has a check mark emoji for a passed run or a cross mark emoji for a failed one, then the result:

```text
[Testmode] (check mark) Storefront smoke passed on Production
[Testmode] (cross mark) Checkout regression: 1 of 4 tests failed on Production
```

For a plan run, the run name is the plan name.

[Screenshot: Run report email for Checkout regression, started by Priya Nair: a Failed banner reading 1 of 4 tests failed with 3 passed, 1 failed and 4 total, the project, the Production environment and its URL, the start time in UTC and the duration, then the tests, with Long Nose Pliers can be added to the cart failed with its Stopped early reason above three passed tests, and a View run in Testmode button. Caption: A report for a failed plan run: the verdict first, then the run's details, every test's result and a link to the run.]

The email body has:

| Section | What it shows |
| --- | --- |
| Status banner | `Passed` or `Failed`, with passed, failed and total counts |
| **Project** | The project name |
| **Environment** | The environment name and its base URL |
| **Triggered by** | `Schedule`, or the name of the person who started the run |
| **Started** | The start time, in UTC |
| **Duration** | How long the run took |
| Tests | Each test with its status and duration, linking to its result page. Tests that did not pass include their failure summary, such as a "Timed out: …" or "Stopped early: …" reason. |
| **View run in Testmode** | A button that opens the run |

Under the button, the email repeats the run's address as a plain link, for mail clients that block buttons. The footer says why you received the report and where to change that.

A plain-text version is included for mail clients that do not show HTML.

**Note: Good to know**

- The **Started** time is always shown in UTC, whatever timezone the schedule uses.
- Reports are sent for runs, not for [explorations](https://testmode.ai/docs/start-an-exploration/).

## Related

  - [Schedule test plans](https://testmode.ai/docs/schedule-test-plans/): Set up the schedules whose runs send reports.
  - [Read run results](https://testmode.ai/docs/read-run-results/): What you find when you open the run from the report.
  - [What Testmode records](https://testmode.ai/docs/what-testmode-records/): Everything saved for each run and test.
  - [Sign up and sign in](https://testmode.ai/docs/sign-up-and-sign-in/): Your account and its email address.