TWICM 207: Samsung Ads’ Matt Butts on Marketing Science and the Rigour Behind Better Decisions

Matt Butts, Head of Marketing Science at Samsung Ads Europe, joins That’s What I Call Marketing to discuss marketing science, incrementality, connected TV measurement and why rigorous testing matters more than a positive result. This episode explains how marketers can move beyond convenient metrics, design better experiments and connect advertising activity to meaningful business outcomes. Matt also explores how changing television behaviours are reshaping media planning, audience measurement and the role of connected TV.

In this episode, we cover:

– Why marketers often measure metrics without questioning whether they matter

– The difference between basic A/B testing and genuine incrementality testing

– Why the quality of the test matters more than whether the result is positive

– How marketing scientists translate complex analysis into commercial decisions

– How Samsung Ads measures viewing across linear television, streaming and gaming

– Why reported reach can hide significant audience duplication

– How incremental reach can reduce media waste and identify missed audiences

– The role of connected TV data in advertising planning and measurement

– Why marketers need to communicate measurement differently to CMOs, CFOs and media teams

– How rigorous measurement helped one advertiser move from zero investment to a seven-figure commitment

Matt argues that marketing science should not simply validate decisions that have already been made. Its role is to challenge assumptions, identify what would have happened without the advertising and give marketers evidence they can confidently use to make better investment decisions.

A useful listen for marketers interested in marketing science, advertising effectiveness, connected TV, incrementality, media measurement, experimentation and commercial impact.

Timestamps

01:16 How Matt found his way into marketing science

02:19 How advertising measurement has changed

03:27 Are marketers measuring things without knowing why?

04:27 Why measurement assumptions must be tested continually

05:02 Do marketers know how to test properly?

06:00 The limitations of basic A/B testing

06:17 Why incrementality is the missing part of marketing testing

07:18 The importance of statisticians, data scientists and translation

08:13 Matt’s journey to Samsung Ads

08:18 What Samsung Ads does

09:00 How television viewing behaviour has changed

10:18 Balancing audience precision, relevance and scale

11:02 Relevance without intrusive personalisation

12:19 Samsung Ads’ Total View measurement capability

12:36 Audience duplication, incremental reach and missed audiences

13:40 Why platform reach figures can be misleading

14:06 What a Head of Marketing Science actually does

14:40 Building advertiser-specific measurement playbooks

15:16 Using measurement to improve future advertising investment

15:23 How to explain incrementality to senior business leaders

15:41 Why marketers need to understand marketing science

17:00 How measurement feeds into marketing mix models

17:33 A real example of fixing incomplete advertising data

19:00 How a geo test led to a seven-figure investment

19:43 Why negative test results should not frighten marketers

20:40 Combining scientific rigour with commercial thinking

21:51 What comes next for connected TV measurement

22:00 Connecting television and mobile data

23:30 Why marketing measurement must keep pace with human behaviour

That’s What I Call Marketing is the podcast for marketers who care about brand, B2B, creativity, effectiveness and the future of the profession.

Follow the show for more conversations with CMOs, marketing leaders, agency leaders, professors, authors, thinkers and practitioners.

Find more episodes at: https://www.thatswhaticallmarketing.com

Thanks to the Digital Voice for their partnership https://www.thedigitalvoice.co.uk/

That’s What I Call Marketing is where marketers come for real conversations about brand, B2B, creativity, effectiveness and the future of the profession.

Hosted by Conor Byrne, the show features conversations with CMOs, marketing leaders, agency leaders, authors, thinkers and practitioners about what good marketing looks like in practice.

Listen, follow and find more episodes at: https://www.thatswhaticallmarketing.com

Connect with Conor on LinkedIn: https://www.linkedin.com/in/conorbyrneirl/

If you enjoy the show, please follow, subscribe and leave a review. It helps more marketers find the conversations.

Hosted on Acast. See acast.com/privacy for more information.