Have you connected the power (molex plug from the PS) to the drives as well as the IDE cable?
How many drives, how many IDE channels and have you got the master/slave configuration correct?
Isolate the drive causing the problem; start by connecting one hard drive first, if the computer boots, turn off and add another drive until it fails to boot up.