Yeah, I'd recommend trying out Firefox. It is free, so you've got nothing to loose, and I am fairly certain you won't go back. You can even import your bookmarks from IE. In the end if it doesn't float your boat, it is easy enough to uninstall the thing.

One thing it has over IE is the ability to install plug-ins, which can be of all sorts of use, or not, depending on what you do online. If that last sentence doesn't make any sense to you, a more simple way to put it would be to say it very customizable, not in appearance (might be, I'm not sure) but in functionality. There are all sorts of third party add-ons you can get for it.