Automations and A/B

Set it up once, then test the subject line

An automation welcomes a new reader or tags them for later. An A/B test tries a few subject lines on a slice of your list and sends the winner to everyone else.

Automations

An automation is a trigger and a list of steps. You switch it on and off from the Automations page.

Readers enter when the trigger fires, and each step runs in order after its wait. A welcome series is the typical use: send the first email when a reader confirms, wait three days, add a tag, send the second.

Automations
Trigger: subscriber confirmedA reader clicks the confirmation link. This is the one trigger that starts an automation today.
Step: send emailMail a chosen email to the reader.
Step: waitPause for a set time before the next step.
Step: add tag or remove tagChange the reader's tags.

The API also accepts tag-added and tag-removed triggers, but nothing fires them yet. There are no branches or conditions, and no trigger for inactivity or a click.

Subject-line A/B tests

Testing is switched on per list and is off by default.

  1. Generate

    Mercury 3 writes alternative subject lines for the email. You get the original as the control plus up to seven others, four in all by default. If the model is unavailable Herald falls back to simple variants instead of failing.

  2. Review

    Edit or remove variants in the composer, choose the share of the list to test on (5 to 50 percent, 10 by default), and how long to wait.

  3. Test

    Herald sends each variant to its slice of the test group. Nobody outside the group is mailed yet.

  4. Decide

    When the window closes, the scheduler picks the variant with the highest open rate and sends it to everyone else. Cancel a running test and the control goes to the rest of the list.

The winner is chosen by open rate, which needs open events, so turn tracking on for the list first. The composer offers windows of 1, 2, 4, 8, or 24 hours; the API accepts 30 minutes to 24 hours.

Contact

Questions about this tool?

Write to Renkara Media Group and a person will answer.