Jones Road Beauty Doubles New Customer Orders in YouTube

The Jones Road Beauty team has been running YouTube ads but suspected that platform reporting might be underestimating the true impact. More than half of US Youtube viewing happens on TV where attribution and click tracking is severely limited. The JRB team hypothesized that YouTube was driving more value than could be measured by clicks. JRB sought to answer two key questions: how incremental is YouTube, and is there room to increase spend efficiently?

‍

Jones Road Beauty set up a 3-Cell test in the Haus platform. The Haus platform produced a geo split that divided the United States into thirds using a stratified sample - ⅓ of the US received standard business as usual (BAU) YT spend levels, ⅓ received 2X BAU spend levels, and ⅓ of the US represented the ‘holdout’ or control with no Youtube ads running. The holdout allowed JRB to measure incrementality of both the test cells.

The power calculator in the Haus platform ensured that a 2 week test would provide sufficient statistical power to detect lift in the primary KPI.

The team’s hypothesis was correct! Platform and click-based reporting was understating the performance of Youtube ads. The test showed that Youtube ads at BAU spend levels drove 1.82X more orders than they were tracking via click attribution. More importantly, they learned that doubling their spend on Youtube resulted in 2.26X more new customer orders, providing evidence that they could confidently increase spend on YT efficiently. With YouTube under their belt, the JRB team is now moving on to test the effectiveness of including upper funnel campaigns to their mix in Meta.