Fiona Burlig

How should researchers design experiments to detect treatment effects with panel data? In this paper, we derive analytical expressions for the variance of panel estimators under non-i.i.d. error structures, which inform power calculations in panel data settings. Using Monte Carlo simulation, we demonstrate that, with correlated errors, traditional methods for experimental design result in experiments that are incorrectly powered with proper inference. Failing to account for serial correlation yields overpowered experiments in short panels and underpowered experiments in long panels. Using both data from a randomized experiment in China and a high-frequency dataset of U.S. electricity consumption, we show that these results hold in real-world settings. Our theoretical results enable us to achieve correctly powered experiments in both simulated and real data. This paper provides researchers with the tools to design well-powered experiments in panel data settings.

View NBER Working Paper

Areas of Focus: Energy Markets
Definition
Energy Markets
Well-functioning markets are essential for providing access to reliable, affordable energy. EPIC research is uncovering the policies, prices and information needed to help energy markets work efficiently.
Electric Power
Definition
Electric Power
As the electric power system faces new pressures and opportunities, EPIC research is working to identify the mix of policies needed to accelerate the global transition to clean, reliable, affordable...