Recently, I encountered a problem with using PSIS and Pareto k for model diagnostics and selection. Some models have good posterior predictive checking performance but a few terrible Pareto k values. And sometimes, a model with more high k values might be misspecified.

A discussion is at Stan forum.


Dr. Zhanglong Cao

Statistician, Biometrician