There is no amount of meth or heroine or cocaine or LSD (et al.) that does not ruin lives.
As LSD isn’t addictive, I don’t see how it can ruin lives.
The biggest risk with LSD use is the potential to cause an earlier onset of mental illnesses like schizophrenia, but it won’t make someone schizophrenic who wasn’t already going to develop the condition, just make it manifest earlier.