Should I use Poisson or negative binomial for overdispersed count data?
#1
I’m trying to decide if I should use a Poisson or a negative binomial model for my count data on website errors per day. The variance is about 1.8 times the mean, so it’s overdispersed, but I’m not sure if that’s enough to justify the more complex model.
Reply
#2
I started with Poisson, and the residuals flagged overdispersion. The mean and variance didn’t track, so I tried the alternative and it fit noticeably better.
Reply
#3
1.8 times the mean is not tiny in practice; with that level of spread you tend to misstate precision if you cling to the simplest count model.
Reply
#4
If you have covariates like day of week or traffic volume, the more flexible model can absorb that extra variance without blaming random noise.
Reply
#5
I added a covariate and the dispersion dropped but it still didn't look perfect; the fit was clearly better though.
Reply
#6
I briefly toyed with zero inflation, but in my data zeros weren't dominant, so I dropped it.
Reply
#7
I also wondered if the problem was data collection gaps on weekends; after cleaning those days the dispersion softened a bit.
Reply
#8
Do you have evidence of clustering in days, like bursts after outages?
Reply


[-]
Quick Reply
Message
Type your reply to this message here.

Image Verification
Please enter the text contained within the image into the text box below it. This process is used to prevent automated spam bots.
Image Verification
(case insensitive)

Forum Jump: