I'm guessing that your decision was that the plaintiff wasn't that seriously injured or that whatever injuries he had were due to a pre-existing condition?
It's tough being in a room you don't want to be in, full of doubt about what you've seen and heard, and then try convince 5 people. Maybe your initial impression was simply wrong. In that case, you saved everyone trouble (yourself included) by seeing the flaws in your first conclusion. It sounds like you tried to do your best.