It is difficult to construct a post-inflation QCD axion model that solves the axion quality problem (and hence the Strong CP problem) without introducing a cosmological disaster. Firstly, generic solutions to the quality problem complicates the solution to the cosmological domain wall problem, leading to a cosmology where domain walls dominate the energy density of the universe. Secondly, post-inflation axion models also face a potential problem from fractionally charged relics; solving this problem often leads to low-energy Landau poles for Standard Model gauge couplings, reintroducing the quality problem. We study several examples, finding that models that solve the quality problem face cosmological problems, and vice versa. Successful examples may have a nonstandard cosmological history, undermining the widespread expectation that the post-inflation QCD axion scenario predicts a unique mass for axion dark matter.