How can a marketing team run A/B tests without waiting on developers?

5 min readCamden

Most marketing teams end up choosing between two options. They can keep tests small enough for a visual editor, such as headline, image and button changes. Or they can test bigger ideas, like a new layout or page section, and wait for a developer to build them. At Coframe, we remove that trade-off. After a one-time script install, we prepare the variants, including larger page changes, and your team reviews and approves them before launch. StartEngine, one of our customers, reported "zero engineering cycles required" across its program.

What A/B tests can a marketing team run without a developer?

Visual editors cover a lot of ground. Optimizely's certification guide says "The visual editor handles most visual changes." Convert's guide for solo marketers says many tools have visual editors and point-and-click variation creation, "so you don't need to touch code for basic tests." These are vendors describing their own category, but they agree on the basics: headlines, copy, images, buttons and simple layout edits are within a marketer's reach.

Setup is a separate step. Mida says "After a developer places the snippet in the page head once, marketers can create variants with the visual editor." GrowthBook's documentation also has you put a script tag in the page head. It doesn't say who does that.

Which A/B tests still need a developer?

Several vendors describe code, snippets or developer help for cases like these:

  • New components or complex page changes. Varify lists "Complex DOM manipulations beyond visual drag-and-drop are needed" as a case for its code editor. Optimizely says custom code is "for everything else," including changes to elements the visual editor can't select.
  • Dynamic or app-style pages. Convert lists "Your site framework is complex (SPAs, headless setups)" among the times you may need light dev help. Varify says "on heavily JavaScript-rendered pages, the Code Editor may be needed for certain element selections."
  • Custom tracking. Convert lists "You need custom integrations or event tracking." Wingify, the company behind VWO, says a custom conversion goal is "typically" defined for goals "not directly related to clicks or URLs," and that it "generates a code snippet that you can add to your test pages to track conversions."
  • Keeping a winner. GrowthBook says its Temporary Rollouts are temporary because "long-term you should re-implement the winning variation in your site's code."

None of these sources says how often a marketing team runs into these cases. Convert's wording is also careful: you may need light dev help "when" a test hits one of them. It doesn't say every such test needs one.

What are the trade-offs of different ways to run A/B tests without developers?

Without Coframe, teams have a few options, each with trade-offs.

  • Test inside the editor's range. Headline, copy, image and button tests are the cases the vendors above describe as editor-friendly. The trade-off is scope, since bigger ideas wait.
  • Test separate landing pages. Landing page builders let marketers build and test pages themselves. Unbounce's tool promises to let you "A/B test your landing pages without a designer, developer, or deep pockets." The trade-off is that you test a separate page instead of the pages you already have.
  • Build bigger variants with AI coding tools. Tools such as ChatGPT, Claude Code and Cursor can write code for a new layout or page section, so a marketer can attempt a larger change without a developer. We've seen teams try this. The hard part comes after the code is written. The variant has to be tested across devices and browsers, checked so the rest of the site still works, and reviewed by someone who can say it is safe to ship. In our experience, AI tools can be finicky with visual results. One can report that a change is finished when the result doesn't match what was asked for. A change that works on its own can also behave differently next to other live changes. Testing and QA is where we've seen these attempts struggle.
  • Bring in a developer for the tests that need one. The trade-off is waiting for developer time. The cases in the previous section are the ones to check for when you pick a test. For how long the rest of setup takes, see How long does it take to set up and launch an A/B test?

How does Coframe run bigger A/B tests without your developers building them?

The options above mostly leave a team choosing between small tests it can run alone and bigger tests that need developer time. At Coframe, we start with a one-time script install on your site. After that, we prepare the variants, including larger page changes, without your developers building them. The install is a one-time step on your site, and a developer may be involved in it. We prepare each variant and your team reviews and approves it before anything launches. The people who need to look at it, such as product, engineering or QA, can review the same implemented version.

StartEngine, a consumer investing company in a regulated industry, is one example. Its case study says "shipping tests meant pulling engineering resources from product work," and reports a program run "with zero engineering cycles required and full compliance maintained." It also says "All variants went through proper compliance and legal review before launch." That is one company's program as reported in a Coframe case study, so treat it as one example.

One limit applies. Preparing variants faster doesn't make a test on a low-traffic page conclusive. We also work out with each customer what counts as a winner and help the team interpret test results.

Bring one test idea that you've been putting off because it needs a developer. Talk to us and we can walk through what it would take to launch it.