Skip to main content

How to Use A/B Testing in BlockSurvey

A/B Testing in BlockSurvey let's you show different text, images, or video variants to different respondents and compare how each variant affects their answers. Each respondent is randomly assigned one or more variants, and results are broken down by variant in the analytics screen.

Steps to set up A/B testing

  1. In the Builder screen and click on Add Question.

  2. Select A/B Testing as the question type.

  3. The A/B Testing question appears as a parent block. By default, it includes four pre-filled variant examples - Urgency, Social Proof, Benefit, and Direct , which you can edit or replace with your own variants.

  4. Each variant card displays the variant name and description.

  • To edit a variant, click the Edit icon on the card.

  • To delete a variant, click the Delete icon.

  • To add a new variant, click the Add Variant button.

5. In the Add/Edit Variant popup, fill in the variant name and description fields. You can also attach media such as an image or video to the variant.

6. Under the Options tab, you can:

  • Control how many variants each respondent sees (Variants per Respondent).

  • Choose whether all variants should be shown to every respondent.

How Variants Are Assigned

When a respondent receives a survey, BlockSurvey randomly assigns them one variant (or more, based on your settings). The assigned variant content - title, description, and media is shown above the child questions. The respondent's answers are recorded alongside the variant they were shown.

How to view A/B testing responses & Analytics

In the Responses tab (individual response view), each response shows which variant was assigned to that respondent under the A/B Testing question row, and a Variant label above the child question's answer.

In the Results table, the A/B Testing columns are labelled A/B Testing - Variant 1, A/B Testing - Variant 2, and so on, so you can filter and sort responses by the variant shown.

Navigate to Analytics→ Response Analytics and select the A/B Testing question. The A/B Testing Overview section shows a card for each variant with the number of respondents assigned to it and its percentage of total responses.

Below the overview, child question analytics include a Responses by Variant table showing how respondents answered under each variant.

Did this answer your question?