I slowly made friends with the unity physics engine during this time. And was mainly responsible for the blocks' behavior.