Task catalog
Tasks in the paper
The paper’s econometric tasks, with methods, task definitions, sources, and results for Claude Sonnet 4.6 and GPT-5.4.
In the benchmark (21)
| Task | Group | Software | Identifier |
|---|---|---|---|
| Probit Regression and Latent Gaussian Choice | Binary regression | Stata, R, Python | probit |
| Logit Regression and the Geometry of Odds | Binary regression | Stata, R, Python | logit |
| Heteroskedasticity-Robust Inference for OLS | OLS | Stata, R, Python | ols_robust |
| Cluster-Robust Standard Errors | OLS | Stata, R, Python | cluster_ols |
| Two-Way Clustered Standard Errors | OLS | Stata, R, Python | two_way_cluster |
| Difference-in-Differences with Staggered Treatment Timing | Difference-in-differences | Stata, R, Python | staggered_did |
| Two-Way Fixed Effects | Difference-in-differences | Stata, R, Python | twoway_fe |
| Two-Stage Least Squares with Robust Inference | Instrumental variables | Stata, R, Python | iv2sls_robust |
| Sharp Regression Discontinuity | Regression discontinuity | Stata, R, Python | rdd_sharp |
| ARIMA Forecasting after Differencing | Time series | Stata, R, Python | arima_forecast |
| Granger Predictive Causality in a VAR | Time series | Stata, R, Python | var_granger |
| Impulse Responses in a Vector Autoregression | Time series | Stata, R, Python | var_irf |
| Impulse Responses by Local Projections | Time series | Stata, R, Python | lp_irf |
| Poisson Regression with Exposure | Poisson regression | Stata, R, Python | poisson_offset |
| Cook's Distance and Influential Observations | Other | Stata, R, Python | cooks_distance |
| Variance Inflation from Collinear Regressors | Other | Stata, R, Python | vif |
| Arellano-Bond Estimation for Dynamic Panels | Other | Stata, R, Python | dynpanel_ab |
| Welch's Two-Sample Test | Other | Stata, R, Python | ttest_welch |
| One-Way Analysis of Variance | Other | Stata, R, Python | anova_oneway |
| Pearson's Chi-Square Test of Independence | Other | Stata, R, Python | chisq_indep |
| The Cox Proportional Hazards Model | Other | Stata, R, Python | cox_hazard |