01 / METHODOLOGICAL FOUNDATIONS
From reference to procedure.
These are conceptual lenses and families of analysis. Their inclusion does not mean they are all automatically applied to every study.
01Daniel Kahneman
Systems 1 and 2
Kahneman distinguishes fast, intuitive processes from deliberate, effortful ones. This lens helps examine judgment, wording, and cognitive load.
Does the question require recall, calculation, or an immediate impression?
IN PRACTICEReview response effort, wording, and anchors. A stated response does not directly identify a mental system.
Kahneman’s Nobel lecture02John Nash
Strategic interdependence
Game theory provides a framework for studying decisions whose outcomes also depend on other agents’ choices.
Which incentives and possible responses belong in the scenario?
IN PRACTICEState the agents, incentives, and scenario assumptions. The result is not a guaranteed prediction.
Nash’s work on game theory03Karl Popper
Testable hypotheses
A critical assessment of hypotheses requires seeking evidence that could contradict them and stating the limits of conclusions.
What evidence would make us revise this interpretation?
IN PRACTICERecord the hypothesis and the evidence that would lead us to reject it. A single survey does not establish causation.
The Logic of Scientific Discovery04Critical assessment of the sample
Survivorship bias
Looking only at cases that remain visible can exclude important experiences. The design must consider who was left out of the sample.
Are we only listening to people who stayed as customers?
IN PRACTICEDocument who was invited, who responded, and which experiences may have been left out.
05Statistical tools
Multivariate analysis
Studying variables together can help investigate relationships and profiles. Model selection depends on the design, variables, and available data.
Is this model appropriate for these data and this decision?
IN PRACTICEDefine variables, usable sample size, and model diagnostic criteria before interpreting relationships.
06Nassim Nicholas Taleb
Sensitivity of the assessment
Nassim Nicholas Taleb studies uncertainty, model error, and extreme events. His work encourages caution with extrapolation and conclusions that depend on fragile assumptions.
Does the interpretation hold when assumptions change?
IN PRACTICECompare plausible scenarios and disclose when a conclusion depends heavily on an assumption.
Taleb’s research on model error07Priming and context
Effects of preceding questions
Earlier questions can influence later answers. Reviewing the sequence and testing alternative orders helps investigate this effect in the instrument.
Is the preceding question suggesting what the person should consider?
IN PRACTICERecord question order and justify changes between rounds. Priming is not an automatic platform index.
Question order and wording — Pew Research Center08Pretesting and equivalence
Quality before collection
Testing comprehension, answer choices, and the flow before collection helps identify problems. Instruments in another language need their own review and pretest.
Do people interpret this question as intended?
IN PRACTICEReview each translation with the intended audience before treating it as equivalent.
Survey best practices — AAPOR09Richard Thaler
Behavioral economics
Richard Thaler studies economic decisions with psychological factors in view. His work helps frame hypotheses about preferences, self-control, and choice context.
Can the choice context help explain the gap between intention and behavior?
IN PRACTICEDistinguish stated intentions from observed behavior and test hypotheses before recommending an intervention.
Richard Thaler — contributions to behavioral economics