The toxicity level of the Psilocybin, Psilocin, and Baeocystin is extremely high. You would be more likely to die of an overdose of any other drug than an overdose of active mushrooms. Conservatively, you would need to eat 2000+ mushrooms in one sitting before it became toxic.
Man, I think if you took anywhere near that amount you'd probably want to die.