FLAIR
  1. Foundation
  2. Leverage
  3. Activation
  4. Iteration
  5. Realisation
AI statistic checkChapter 2

Five questions for any AI statistic

What is the unit of analysis? A task, a workflow, a firm or an economy. Numbers do not transfer between levels.
Who paid for the study? Vendor-funded work sets the ceiling. Independent randomised work sets the floor.
Is this task-level or firm-level? A task-level gain has to survive the structure of the firm before it reaches the P&L.
Is this a base rate or a ceiling? A case study is a ceiling. A survey of everyone who tried is closer to a base rate.
Has anyone replicated it? A single study is a hypothesis. Three studies with different methods pointing the same way is a finding.