Well, it might be for several reasons, first that comes to my mind is: have you checked the playback speed to play every frame?
That way simulation is calculated for every frame, also you can cache your simulation and after you did that you can play it at real time (24fps)
The other thing might be the mass of your rigid body object, try setting it to higher value.
I\’m not sure for the gravity but try to leave it at default value.
Hope it helps and good luck.