I wonder if this has anything at all to do with Stewart's bashing of the show during his appearance on Crossfire? Like maybe that planted a seed in viewers' heads that led to poor ratings or something...
Stewart didn't plant the seed, but merely pointed out the crap which is harvested by the already existing hollow tree of commercial TV.