I always interpreted the ‘First Order’ to be a reference to a religious order such as the Jedi Order. However, I recently invented a more amusing reason for the name: The Imperial officers who did not desert when the Empire was routed took to calling themselves ‘officers of the first order’. The praise stuck and became the official name of the new movement.
That would fit with canon, so I think that is pretty much the reason why. Good theory.