Ultimately, one does just gotta have faith when it comes to religion. The outstanding question for me is always: okay, well why should I have faith in this or that particular set of beliefs?
When it comes to something like the Garden of Eden being in America, such assertions will not make sense to the many of us who are not Mormons. But it is useful to recognize that every religion has such faith-bound elements that are not supported (and sometimes even contradicted by) known facts. I suspect such a critique of Mormonism might be more pronounced because it is a newer religion with an unusually America-centric slant that many construe as a corruption of Christianity, or as you say "weird."
My question is why have you chosen to put your faith into Mormonism?