I can understand loving Empire... I can even understanding wanting to up the others to its level... but by looking at the other films through that sort of stigma, you will loose a great deal of wealth and depth available within the films.
Respectfully, no, I will not. When I approach Star Wars as escapist entertainment, I can enjoy it any way I want, and that does not diminish my ability to perceive depth even in something I enjoy less. I could view Star Wars entirely through the lens of "Tales from the Mos Eisley Cantina" and it would not occlude any facet of the Star Wars films. It would simply be my preferred mode of escaping into fantasy.
I'm a big fan of world-creating fiction. I know ANH established the SW universe, but ESB consolidated it and made it real. That's why it became, inevitably and irrevocably, my lens into the SW universe. The stories set in the Star Wars universe are told in various modes--Dark Empire is dystopian science fantasy, the Thrawn Trilogy is almost hard sci-fi, the Holiday Special is kitschy entertainment--but to me, Empire is the real Star Wars universe. The other stories are no less valid, but they don't satisfy my preference for reality in created worlds.
When approaching Star Wars as art, I like to think I practice connoisseurship, no matter how amateur it may be. And as a connoisseur, I feel that Empire is the best of the films, and the others succeed where they most resemble Empire. I think this is true in pretty much every respect; whether it's direction, dialogue, plot, music, set design, miniature work, costuming, sound effects, or poster art. I did not arrive at this opinion capriciously, but by plumbing the depths of the other films.
So my use of Empire as a lens to view the saga is both the result of unconscious and conscious factors. It is the "kind" of story I like, and it also compares favorably to the rest of the saga on technical grounds. In the latter case, I am not deprived of the "wealth and depth" of the rest of the saga; I could not have made my conscious choice for Empire unless I had already explored the rest of the saga.