My starter has been acting up so I changed it with a new one. Now when every the battery is connected the starter starts spinning away. Does anyone have any suggestions?

If anyone else has this problem, the solution is to just tap the Solenoid on the starter with a hammer. Primitive by effective.