FISH 113
Diagnosing common sources of lack of fit to composition data in fisheries stock assessment models using One-Step-Ahead (OSA) residuals
Modern fisheries stock assessments rely on multiple sources of data to estimate population parameters and management quantities. Age and length data provides demographic information on recruitment strengths and mortality rates and is commonly fit as numbers- or proportions-at-age or -length. These data are inherently correlated among categories (bins) and residuals are therefore not independent. One-Step-Ahead (OSA) residuals have been proposed as a statistically valid replacement for the commonly used (but incorrect) Pearson residuals. However, there is no clear best practice for how to efficiently evaluate and diagnose model fit when using OSA residuals. We begin by providing an intuitive introduction to OSA residuals for multinomial data, including why Pearson residuals are incorrect and can mislead and why OSA residuals are correct statistically. We then demonstrate how OSA residuals are calculated and why this leads to some counterintuitive properties. Next, we illustrate a series of cases with and without sources of model misspecification common in stock assessments based on age compositions from a simplified fished population. For each case, we provide a comparison of visual and quantitative diagnostics based on the properties of OSA residuals. Model misspecification was identifiable in all cases using a combination of statistical analysis of OSA residuals, aggregate fits, and/or visual inspection of (scaled) Pearson residuals. However, the statistical power to detect minor model misspecification depends on the sample size, the number of bins, and the number of years of data. Analysts accustomed to visual inspection of Pearson residuals may have to adjust their interpretation for OSA residuals, and adopt new diagnostic tools to be able to identify common types of model misspecification properly. By illustrating common problems and accurate interpretation when the correct answer is known, we provide guidelines for model diagnostics using OSA residuals that can serve as a starting point for evaluating more complex operational stock assessments.
Webinar Link: https://attendee.gotowebinar.com/register/8099446196859219552