From what I can make out it wasn't taken away because it was lightsaber shaped but because it was telescopic.
Lots of people have telescopic canes, especially blind people.
It's like taking someone's eyes away because they look a bit like hand grenades.
