Now let’s understand why Magento 2’s A/B testing is amazing:
- Built into Magento, so you don’t need any plugins or custom development.
- If you’re using The Magento 2 Enterprise edition, the set up is ready for you.
- Test up to 10 variants of a page to see which ones your customers like the most.
- Test against any metric that you can track in Google Analytics, including bounce rate, page views, add to cart rate, and more.
- Designed to test on any product, category or CMS pages.
- No ‘flicker’ effect that you get with some A/B testing tools when they load another variant.
What is A/B testing?
A/B testing is the practice of sending proportions of your audience two versions of a webpage in order to compare the difference in engagement or performance. Another variant of A/B testing, MVT (Multivariate testing) is similar but doesn’t restrict to two variants but multiple versions. With MVT, you can create up to 10 variants to find the best-performing version of your store pages.
Why should PO (Product Owner)/Business Owners choose A/B testing?
The ultimate goal for any business is to generate revenue or increase the current revenue. A/B testing can most likely help to grow the revenue margins. Let’s understand how A/B test can do this.
- Higher the testing frequency, the more we learn what works and what does not for our customers.
- Build a culture of learning and improvement.
- Before the final release, we will know which design customers like most.
- We can reduce design iterations as well based on the customer most liked design.
How does A/B testing work?
There are two types of A/B testing for eCommerce stores: client-side and server-side testing.
Server-side testing: In this form of A/B testing, a customer requests for a web page and your server delivers it. However, the experimental tool works on the server-side to determine the best-fit version of a web page based on targeting rules and then delivers that variant to the user.
For example, you can send 50% of your visitors version A and the rest version B of a web page. You can then test them for performance and the goal setup prior to executing the test (conversion rate, CTR, sales, product variant, etc). The one that achieves a score above the threshold can be implemented site-wide.
What can you test with A/B testing?
In terms of your eCommerce website, here a few things you can test:
- Page layouts
- Different pages like homepage, product page, category page, landing page & product descriptions
- CTA copies and button placement
- Product photos and videos
- Push notifications
- Keyword placement and meta descriptions
- Social proofs like reviews, testimonials, social media posts
You can set up a process of testing different items of your eCommerce website and then incrementally go around it. For example, you can first start with page layouts and then test pop-ups, push notifications, etc.
Let’s start A/B testing with Magento 2: The Steps
Before starting with the actual test, let’s summarize what we will do in this test and what we will achieve after this test is successfully executed. We will create a service CMS page with two variants A & B, expected results we will compare with bounce rate of the page.
Pre-requirements before beginning the test: Google Analytics should be configured and active on your Magento site and should be Magento 2 enterprise edition. Followed the below steps to prepare for the first A/B test.
Step 1: Lets create CMS page
1. Go to Magento 2 Admin > Content> Pages
2. Click on the “Add New Page” button.
3. Fillup the all required fields & save the CMS page.
Note : Repeat the step 1 for creating the second CMS page but make sure the URL will be different for both the CMS pages.
After followed by all above steps CMS page display in grid looks like this: