# A/B testing for Shopware 6: setup manual · Stone & Water > Manual for A/B testing: create an experiment, define variants and traffic shares, estimate the runtime, read the results and publish the winner. Quelle / Source: https://stoneandwater.online/en/manual-ab-testing.html # A/B testing manual. From setup to decision: create the experiment, split variants and traffic, estimate the runtime, read the results correctly and publish the winner safely. [To the product page](https://stoneandwater.online/en/ab-testing.html)[Get in touch](https://stoneandwater.online/en/contact.html) #### Contents / ## System requirements Shopware 6.7 with Storefront and shopping experiences, PHP 8.2 or newer. Meaningful results need enough visitors - the runtime estimate tells you how many upfront. ## Installation Upload the ZIP in the admin under Extensions, install and activate it. Then enter the licence token; it is bound to your shop domain. ## Creating an experiment Under A/B experiments you create a new experiment: name, description, page type and the original shopping experience (A). Then add the variants - each with its own layout and traffic share. **Rules:** at least one variant is required, every variant needs its own layout, and none may be the same as the original. The sum of shares must not exceed one hundred percent. ## Audience and measurement An experiment can be limited to one sales channel; without a selection it applies to all. Bots and crawlers should stay excluded, otherwise search engines count as visitors. The confidence level defines from which certainty a result counts as significant. On top you can require a minimum number of impressions per variant. ## Estimating the runtime Enter the expected conversion rate of the control group and the smallest difference you want to detect. From that the plugin estimates the sample size needed per variant. Both values are optional and only used for the estimate - they do not influence the measurement. But they answer the decisive question: is my traffic enough for this test? ## Start, pause, complete On start, visitors are randomly assigned to a variant and stay with it. A running experiment can be paused and resumed later. Completing determines the winner. Publishing happens on your command - or automatically if you enabled that setting. ## Reading the results Reported per variant are conversion rate, revenue per visitor and the path through the funnel. **Patience:** as long as the minimum sample is not reached, a lead means little. Early swings almost always even out. ## Publishing the winner Publishing overwrites the original page with the winning variant. A rollback restores the original, so the decision is reversible. ## Cleaning up Variants create copies of the shopping experience, marked in the name. After the test the cleanup function removes all clones that no longer belong to an experiment. ## Troubleshooting **No data:** the experiment has to be started and the tested page needs visitors. Nothing is collected before the start. **Result keeps flipping:** a sign of small numbers. Raise the minimum sample and let the test run longer. **Licence not recognised:** the token is bound to the shop domain. Without a domain in the sales channel the check fails. ## Support Questions come straight to us - support is from the developer. You can also request a feature through the Plugin Suite in the admin. ## All settings Every setting of the plugin with its default value and explanation, in the same order as in the administration. The texts come straight from the plugin (version 2.3.0). ### General **Name** Default: empty Name of the experiment in the overview. **Description** Default: empty Free description, such as the hypothesis behind the test. Only shown in the administration. **Page type** Default: Category Which kind of page is tested: a category, a layout or a product detail page. This determines which selection appears below. **Original layout (A)** Default: - The existing layout that serves as control group A. The variants compete against it. **Category** Default: - The category on which the experiment runs. ### Variants **Name** Default: Variant B Name of the variant, such as variant B. New experiments start with one variant B. **Layout** Default: - The layout shown to visitors of this variant. **Traffic %** Default: 50 Share of visitors in percent who see this variant. The rest see the original. ### Configuration **Min. sample size** Default: 200 Minimum number of impressions per variant, before a result is evaluated. **Publish winner automatically** Default: off If enabled, the winning variant goes live automatically when the experiment ends. ### Audience and evaluation **Sales channel** Default: all The experiment only runs in this sales channel. Without a selection it applies to all. **Exclude bots and crawlers** Default: on Search engines and other automated visits always receive the control variant and are not counted. **Confidence level** Default: 95 % How certain a result has to be before it counts as significant. Choose 90, 95 or 99 percent. **Expected conversion rate of the control group in percent** Default: empty Both values are optional and only used for the runtime estimate. **Minimum detectable difference in percent** Default: empty Both values are optional and only used for the runtime estimate. ### Schedule **Start date** Default: empty A draft starts automatically once this time is reached. The plugin checks every five minutes. Left empty, the experiment only starts manually. **End date** Default: empty A running experiment is completed and evaluated automatically after this time. Left empty, it runs until completed manually. ### License **License token** Default: empty You receive the token with your purchase from Stone & Water. It is bound to your shop domain. ## Availability Directly from Stone & Water ### Available now Monthly 19,99 € Best value Yearly 203,90 € 15 % cheaper All prices net, plus VAT. Download the free Plugin Suite and upload it in the admin, no SSH needed. It installs and updates the plugin with one click. You buy the licence directly from us, with an invoice from us and support straight from the developer. [Download Plugin Suite](https://stoneandwater.online/en/plugin-suite.html)[+49 2555 9997342](tel:+4925559997342) Shopware Store ### In preparation The plugin will be listed in the official Shopware Community Store. Installation and automatic updates then run through the plugin manager in the backend, billing through your Shopware account. We will link it here as soon as it is available. [Image: Stone & Water] Shopware e-commerce agency from Schöppingen, Germany. Consulting, implementation and optimisation - from the first concept to long-term growth. ### Shopware - [Shopware overview](https://stoneandwater.online/en/shopware.html) - [Migration (5 to 6)](https://stoneandwater.online/en/shopware-migration.html) - [SEO optimisation](https://stoneandwater.online/en/shopware-seo.html) - [Performance](https://stoneandwater.online/en/shopware-performance.html) - [Template development](https://stoneandwater.online/en/shopware-template-development.html) - [Plugin development](https://stoneandwater.online/en/shopware-plugin-development.html) - [PIM for Shopware](https://stoneandwater.online/en/pim.html) - [Shopware Plugins](https://stoneandwater.online/en/plugins.html) ### Plugins [Plugin Suite free ](https://stoneandwater.online/en/plugin-suite.html)[All plugins](https://stoneandwater.online/en/plugins.html)[All videos](https://stoneandwater.online/en/videos.html) - [A/B Testing](https://stoneandwater.online/en/ab-testing.html) - [AI Blog & Landing Page](https://stoneandwater.online/en/ai-landingpage.html) - [AI Content Blocks](https://stoneandwater.online/en/ai-content-blocks.html) - [AI Cross-Selling](https://stoneandwater.online/en/ki-cross-selling.html) - [AI Image Badge](https://stoneandwater.online/en/ai-image-badge.html) - [AI Image SEO](https://stoneandwater.online/en/ai-image-seo.html) - [AI Newsletter](https://stoneandwater.online/en/ai-newsletter.html) - [AI Newsletter Agent](https://stoneandwater.online/en/ai-newsletter-agent.html) - [AI Product Advisor](https://stoneandwater.online/en/ki-product-advisor.html) - [AI Product Bundles](https://stoneandwater.online/en/ai-product-bundles.html) - [AI Product Questions](https://stoneandwater.online/en/ki-product-questions.html) - [AI Product Search](https://stoneandwater.online/en/ki-product-search.html) - [AI Product Videos](https://stoneandwater.online/en/ai-product-videos.html) - [AI Translation Manager](https://stoneandwater.online/en/ai-translation-manager.html) - [Category Levels](https://stoneandwater.online/en/category-levels.html) - [CLP Information](https://stoneandwater.online/en/clp-information.html) - [Cross-selling at checkout](https://stoneandwater.online/en/checkout-cross-selling.html) - [Crypto Payment](https://stoneandwater.online/en/crypto-payment.html) - [Customer Reviews](https://stoneandwater.online/en/customer-reviews.html) - [Database Cleanup & Optimizer](https://stoneandwater.online/en/db-cleaner.html) - [Lite YouTube](https://stoneandwater.online/en/lite-youtube.html) - [Live Viewer & Sales Counter](https://stoneandwater.online/en/live-viewer.html) - [Manufacturer Pages](https://stoneandwater.online/en/manufacturer-pages.html) - [Page Speed Optimization](https://stoneandwater.online/en/page-speed.html) - [Payment information on PDF documents](https://stoneandwater.online/en/payment-info-pdf.html) - [Plugin Update Manager](https://stoneandwater.online/en/update-manager.html) - [Read More - Description](https://stoneandwater.online/en/read-more.html) - [robots.txt Manager](https://stoneandwater.online/en/robots-txt.html) - [Shipping Calculator](https://stoneandwater.online/en/shipping-calculator.html) - [Shopping Like Dating](https://stoneandwater.online/en/shopping-like-dating.html) - [Variant preselection](https://stoneandwater.online/en/variant-preselection.html) More plugins [ALBIS Leasing](https://stoneandwater.online/en/albis-leasing.html)[Cache Warmer](https://stoneandwater.online/en/cache-warmer.html)[Shopware CDN](https://stoneandwater.online/en/shopware-cdn.html) ### Company - [Contact](https://stoneandwater.online/en/contact.html) - [Legal notice](https://stoneandwater.online/en/legal-notice.html) - [Privacy](https://stoneandwater.online/en/privacy.html) - Cookie settings © 2026 Stone & Water · Dominic Steiner Hosted on [Creoline](https://www.creoline.com/ref/tYq4UkumEqLtMCi3PpwEJo9JspG66udf) [LinkedIn](https://www.linkedin.com/company/18043592/) · [Xing](https://www.xing.com/pages/stone-water) · [Facebook](https://www.facebook.com/stoneandwateragency/)