Blogs

Why it is not worth debating if MMM can measure Long-Term Brand Impact

Why it is not worth debating if MMM can measure Long-Term Brand Impact “Can Marketing Mix Modeling (MMM) measure long-term brand impact?” In my opinion, this debate is largely misplaced. 📌 No consensus on what “Long Term” actually means There is a joke in statistics – ask 3 statisticians for an opinion and you get 5. Marketing is no different. Every marketer seems to have their own definition of what long term means. Before asking whether MMM measures long-term impact, we should ask a more basic question: What exactly is long term? 3 months? 6 months? 1 year? Even marketing experiments such as Geo-Lift or Brand Lift measure impact only

Read More »

Dynamic Base MMM Models May Not Be Worth the Effort

Dynamic Base MMM Models May Not Be Worth the Effort So what is Dynamic Base? In MMM, the Base is nothing but the intercept and one interprets it as the ‘organic sales (or any KPI) that one could get if there were no marketing / media efforts or extraneous factors’. Marketing theory says that the Base (Brand Equity) of a brand is very sticky and hardly moves. Even in our experience of more than a decade, we have seen a established CPG brands base go up or down only by 2 -3 percentage points. Even for E-commerce brands, Pharma, Banking, sports clubs, Streaming companies we have not seen Base vary

Read More »

The Effect of Meta’s Click-Based Attribution Recategorization

The Effect of Meta’s Click-Based Attribution Recategorization Meta recently informed marketers that they are changing how click-through attribution is defined. Historically, Meta attributed conversions to all types of clicks including likes, shares, saves, comments and link clicks. However, most third-party platforms count only website link clicks. As Meta noted: “This difference in what is attributed as a ‘click’ conversion can lead to inconsistency between what an advertiser sees in Meta Ads Manager compared to third-party reporting tools.” To address this discrepancy, Meta has decided to restrict click-through attribution only to link clicks. At the same time, a new attribution category called “Engaged-Through Attribution” is introduced. This includes signals such as

Read More »

The Alpha Fold – MMM Parallel

The Alpha Fold – MMM Parallel I finally managed to catch up on the famous documentary “The Thinking Game”. What a story !! I noticed many parallels between protein folding and Marketing Mix Modeling (MMM). 📌The Hidden Structure AlphaFold In AlphaFold, we observe an amino acid sequence and want the hidden 3D protein structure. MMM We observe marketing/media spends and the corresponding KPI (Sales, net user addition, Awareness). We want to know the causal structure – which variables resulted in the KPI, by how much, and the interaction effects between them (if any). This causal discovery is not as difficult as protein structure but it is not easy either. 📌

Read More »

Nothing Credible about Credible Intervals and Why this matters when reading ROAS or iROAS from Bayesian MMM

Nothing Credible about Credible Intervals and Why this matters when reading ROAS or iROAS from Bayesian MMM Credebile : Able to be believed or capable of persuading Many people think Credible intervals are equivalent to confidence interval. They are not. Frequentist methods focus on the apparatus or the experiments. Every commentary like p-value and confidence interval is actually a commentary about the apparatus and not the phenomenon. The phenomenon is assumed to be ‘there’ – ‘fixed’ and ‘true’. The question then boils down to – is apparatus good enough to capture this phenomenon (the parameter). The question that frequentist confidence Interval answers is that – if the parameter is found,

Read More »

Marketing Mix Modeling (MMM) is Anti-Fragile

Marketing Mix Modeling (MMM) is Anti-Fragile Sometimes Bangalore traffic is not bad after all. Especially if one can finish a podcast while in transit 😅. I was hearing a podcast featuring Nassim Taleb (Link in comments). In it he was discussing the idea of Anti-Fragile (also a great book by the same name) I couldn’t but connect this concept to MMM because just few days ago one of our client asked – “why do you say you need variation in the data for MMM to work?” Taleb said in the podcast “Some things benefit from shocks; they thrive and grow when exposed to volatility, randomness, disorder and stressors” He calls

Read More »
Chebyshev's Inequality for Marketing Mix Model Diagnostics

Chebyshev’s Inequality for Marketing Mix Model Diagnostics

At Aryma Labs, we constantly endeavor to add as much science as possible to marketing. MMM model calibration historically has had parallels with multi-linear regression calibration methods. But MMM is not just linear regression (see link in resources). It has more bells and whistles. As a result, it needs better calibration techniques. In our MMM calibration process, we innovatively use KL Divergence, Population stability Index and Information theoretic measures (see link in resources). In addition, we recently started to apply Chebyshev’s inequality as MMM model diagnostic. 📌 Firstly What is Chebyshev’s Inequality? Simply put, It states that for any random variable with mean μ and a variance σ², the probability of

Read More »

How to use Robyn’s Decomp RSSD Metric Effectively

In my last post (ICYMI link in resources), I talked about the similarities and differences between Robyn’s Business metric Decomp RSSD and Bayesian Priors. Decomp RSSD is a good metric but at the same time it also runs the risk of confining the user to historical spends as yardstick. Given this limitation, the question arises – How best to use Decomp RSSD. Here is how we use it at Aryma Labs. We rely on our own methods to fit the MMM models and we don’t try to optimize on Decomp RSSD. But we just use the Decomp RSSD metric in following cases: 1) For Immediate model updates If you have

Read More »
Similarities between Decomp RSSD and Bayesian Priors in Marketing Mix Modeling (MMM)

Similarities between Decomp RSSD and Bayesian Priors in Marketing Mix Modeling (MMM)

Open source Marketing Mix Modeling (MMM) tools are great for democratizing MMM. But they will never provide you with an accurate MMM model off the shelf. Why? Because of Flintstones curse (see Ridhima’s post – link in resources). But that does not mean we can’t appreciate some innovative methods in these open source MMM tools. Robyn may not be perfect but as somebody in a post said “it has flashes of brilliance”. One of the those flashes of brilliance is – Decomp RSSD. Robyn markets it as business fit metric. While others call it controversial (check out Mike Taylor’s tweet in resources).   📌 So it Decomp RSSD controversial? Does

Read More »
Is there one true Marketing Mix Model (MMM) model ?

Is there one true Marketing Mix Model (MMM) model ?

Is there one true Marketing Mix Model (MMM) model ? Short answer: Yes “All models are wrong, some are useful” I have seen various vendors use the above statement to tell client that “there could be many MMM models and no one model is absolutely right”. They thus push the decision to pick a model back to the client. I think vendors saying this is a cop out. First lets try to dispel the misunderstanding behind this statement “All models are wrong, some are useful.” “All models are wrong, some are useful” is an aphorism (meaning it is a concise expression of general truth). But the aphorism in this case

Read More »
Scroll to Top