That all depends on what one picks to put into their mouth. Nothing wrong with almost all things out there, in moderation, with the exception of certain foods or snacks.
Our garden never made it this year, due to some personal problems, so we didn't get a chance to eat anything outta our garden, yet, June 3rd, I took my wife into emergency and after some days of testing, they declared she had listeria. Never heard of it. They claimed she got it from our garden, then this, then that and they just kept guessing. She had to have gotten it from something from a store. She was totally outta commission for a month and she's still recuperating from its affects.
You do hafta be careful, but I don't believe you need to give up everything to be healthy, unless you have a legit problem.