And I would think, maybe the fleet was stationed at the planet, similar to the Endor moon scenario, for security, ferrying supplies and so forth.
When they set course for the Alderaan system, the Death Star presumably travels at a different speed than star destroyers are capable of, so whether it was over-confidence or simply for technical reasons they left the fleet behind at the construction site.