AI UGC vs human UGC: what the evidence says

The three matched comparisons all favour human UGC per ad

Only R2 to R4 held the hooks constant, and R3 and R4 the offer too.

The supplements store in R2 ran one hook script through three production paths for 90 days, spending $30,000 to $80,000 a month on Meta. AI UGC from three vendors ran 0.5 to 0.7 times the CTR of directed human UGC. The poster’s verdict: “Unusable for paid in our account”.

The agency in R3 sells AI UGC, and its own split still put human UGC ahead. Across three clients’ cold ad sets, the gap was small on hook rate and wide on conversion from click.

The media buyer in R4 remade the best of 12 AI presenter ads with a human creator they have used for about two years. With script, offer and landing page unchanged, the human version’s conversion from click was “about eleven percent higher”. One ad a side, picked after the AI ad won, is the thinnest design of the three.

R3 and R4 settled on the same workflow: AI tests the hooks, and people film the winners. R2 keeps AI off camera altogether, using it for hook scripts and post-production.

aubado’s R5 has the largest sample: 220 videos and $100,000 of Meta spend. aubado says AI’s higher ROAS “is driven by production economics”, since each AI video needs “far less revenue to be profitable”.

aubado is describing profit after production cost. ROAS divides revenue by ad spend, so production cost cannot move it unless aubado changed the formula, which the post does not say.

NIM’s R1 is the only controlled result, and it tests the label alone. People shown the same ad as a photo or as AI-generated rated the AI version lower and said they were less inclined to click.

Only two reports count the extra winners that volume finds. Both put human UGC ahead per ad and still favour AI on volume: more concepts run and more winners found for the same spend.

R6 found “net winners per week” higher with 4 times the AI concepts. R5 counts 5 to 7 winners a cycle mixing both, 2 to 3 with human UGC alone. R2 found the opposite: its AI “filler” variants “die in the first 48 hours”.

Why most of the evidence is weak

None of the 12 reports publishes a randomised split of AI and human UGC ads with its method. Six come from people who build tools for making ads or sell AI UGC or human creators.

Nine set the two side by side on ad metrics. Five of those come from authors with no ad-making tool or UGC service of their own: R2, R4, R5, R6 and R9. All five put human UGC ahead on click-through or conversion. With R3, the agency’s own split, they make the six comparisons that favour human UGC.

Where AI comes out ahead, it is on cost or return: cost per result or CPC (R3’s hook tests, Creatify’s R7, R9), CPM (R10) and R5’s ROAS. Only two rows put AI ahead on engagement or click-through. Both come from sellers or builders: Superscale’s figure (R11) and R8’s photo CTR, posted by the developer of the tool used.

Creatify’s case study sets “The AI-generated ad”, one of five new ones, against the single best UGC ad. It names no spend or brand.

inBeat, an agency selling both kinds of UGC, links it as “28% lower Cost Per Result and 31% lower CPA”. Creatify’s page says 31 per cent lower CPC. A Wayback capture shows the line there on 19 April 2026, though the post is now dated 27 April 2026.

Superscale’s “Performance Study” names no sample or method for its 18.5 per cent engagement figure. Creator.co, which sells human creators, has no AI arm: its “4x” compares UGC with brand creative.

R6’s story reappeared under a second account on 21 September 2026, reworded, and under a third on 23 September, nearly word for word.

R3, R4, R6 and R9 name the AI tools they used; none states a tie. R6 and R9, posted the same day in different subreddits, and both R6 reposts all name Creatify. We cannot tell who wrote them.

Mismatched reports also compare averages over different sets of ads. More AI ads means more chances of a lucky winner, so “winners per week” favours the side that made more ads.

The nearest thing to a graded list, Playcut’s, comes from a seller of AI actors. It calls R5, which this register grades Mismatched, “The cleanest split test on record”.

How to run a fair test in your own account

A fair test changes the production source and nothing else.

1. Match everything else: script, offer, landing page, placement, length and the number of ads on each side. Give both sides a presenter script. A claim to have used the product may be a line only a real customer can make, whoever the actor (see the rules section).
2. Split with the platform’s test tool. Meta’s A/B testing shows each version to a separate segment “and ensure nobody sees both”. It recommends “the same budget for both versions” and advises against turning ad sets on and off by hand. R4 ran its pair in a CBO scaling campaign instead.
3. Log the AI label as part of the treatment. R1 found a label alone lowered people’s stated willingness to click, so record each ad’s label: the result reads “labelled AI against human”, the choice you actually face. TikTok’s ads policy (April 2026) allows AI content with the “AIGC label” or “a clear disclaimer, caption, watermark, or sticker of your own”. If TikTok finds undisclosed AI, the ad “will be rejected or restricted”. Meta labels ads from some of its own AI tools. Its update of 1 June 2026 said it would detect and label ads made with third-party AI tools “through industry-standard signals” (Meta’s AI disclosure rules).
4. Size it before launch. Pick the metric and the end date first. Cost per purchase mixes click cost with conversion; R9 reports cheaper AI clicks offsetting a lower CTR. R6 reported per-ad conversion, then judged on winners per week.

If human ads convert 3.4 per cent of clicks (R3) and AI 20 per cent fewer (R6), detecting the gap takes about 10,070 clicks a side. That is around 342 purchases against 274. A CTR gap like R5’s (2.4 against 1.9 per cent) shows in about 13,209 impressions a side.

At a 2 per cent CTR, 10,070 clicks is about 500,000 impressions. The CTR answer comes first, but it may not predict purchases: in R5, human UGC led on CTR and AI on reported ROAS.

n = (1.96*sqrt(2*p*(1-p)) + 0.8416*sqrt(p1*(1-p1) + p2*(1-p2)))^2 / (p1-p2)^2

A creative testing framework for Meta ads covers the test beyond this one question, from the testing campaign to when to call a result.

What it costs to find out

On those inputs, media is the main cost of a conversion test: about 20,140 clicks across both sides, at your own cost per click. Production is small beside it on the register’s figures. R3 put a human creative at $280 and an AI one at $12; R5 put AI at about $3 a video.

The creative testing budget calculator turns your cost per purchase and the conversions you want per variant into a test budget and run time.

AI UGC price per ad works out each tool’s cost for a 30-second video from its official plans. The cost per AI ad calculator runs the same sums for your ad length, hook count and keep rate. Best AI UGC generators for ads compares the tools on price and ad rights.

Tools that report on your own ads after the spend, and how each is priced, are mapped in AI creative testing tools.

Rules to check before you test

Two rules change how the test is built. The AI UGC legal guide reads the FTC’s fake-testimonial rule (16 CFR 465.2) as reaching an AI actor who claims to have used the product. And TikTok’s label, quoted above, puts a disclosure on the AI side only; TikTok’s AI-generated content label for ads covers when it applies.

AI disclosure in advertising, platform by platform sets Meta, TikTok and the laws side by side.

AI UGC meaning quotes HeyGen’s and Captions’ terms, which bar presenting their output as solely human-made.

When the evidence behind the register changed

The latest change is R6’s story posted a third time, on 23 September 2026.