Concept videos

Short reviews of the big ideas behind data work in economics, one idea per video, 3 to 6 minutes each. Each one stands alone: watch it when the idea comes up in a lab, a project or an interview, in any order. They are grouped by the stage of the data science process where the idea first matters.

0 of 16 recorded so far; 5 up next.
Question3Data1Clean1Explore1Model5Evaluate4Communicate1

Question

What do you want to know, for whom, and is it a prediction or an effect?

Regression for prediction and regression for inference

Coming

The same fitted line does two different jobs, and the job decides what you check.

About 5 minutes when recorded.

Random assignment as an estimator

Up next

Why a coin flip turns a difference in means into an estimate of a causal effect.

About 5 minutes when recorded.

Statistical power

Up next

How many observations you need before you look, and what an underpowered study can and cannot find.

About 5 minutes when recorded.

Data

Where the rows came from, who is in them, and who is missing.

Sampling bias

Up next

Why a huge sample can still give the wrong answer when the people in it chose to be there.

About 4 minutes when recorded.

Clean

Types, dates, missing values, joins, and the test set kept out of sight.

Train-test split and leakage

Coming

Why a model must be scored on data it never saw, and the quiet ways test information leaks into training.

About 5 minutes when recorded.

Explore

Look before you model, and know what a picture can and cannot tell you.

Confounding and causal diagrams

Coming

How to draw the story behind the data and read off which variables to control for, and which not to.

About 6 minutes when recorded.

Model

The estimator or the learner, and the assumption each one rests on.

Difference-in-differences

Coming

How two groups and two periods estimate an effect when nothing was randomized, and the parallel-trends bet it rests on.

About 6 minutes when recorded.

Instrumental variables

Coming

How a variable that moves the treatment and nothing else recovers a causal effect, and why a weak one is worse than none.

About 6 minutes when recorded.

Regression discontinuity

Coming

Why a cutoff rule is a natural experiment for the people just either side of it.

About 5 minutes when recorded.

Regularization: ridge and lasso

Coming

How shrinking coefficients buys a little bias for a lot less variance, and why you standardize first.

About 5 minutes when recorded.

Logistic regression

Coming

How to model a yes-or-no outcome as a probability and read a coefficient on the odds scale.

About 5 minutes when recorded.

Evaluate

How wrong could you be, and on data the model never saw?

The p-value

Up next

What a p-value measures, what it does not, and why 0.049 and 0.051 are the same news.

About 4 minutes when recorded.

The permutation test

Coming

How shuffling the labels gives you a p-value with no distribution assumed.

About 4 minutes when recorded.

The bias-variance trade-off

Coming

Why a model that fits the data you have can predict the data you do not have worse, and where the sweet spot sits.

About 5 minutes when recorded.

Precision, recall and the ROC curve

Coming

Why accuracy misleads when one class is rare, and how to choose a cutoff for the mistake you care about.

About 5 minutes when recorded.

Communicate

One number with its interval, one chart that does not mislead.

Bootstrap confidence intervals

Up next

How to put an interval around an estimate when there is no formula for its standard error.

About 5 minutes when recorded.