Well it sounds as if the transfer case is not engaging fully and that is where the whine comes from. The brakes really have nothing to do with it unless you are trying to go to 4wd low.
Have you tried engaging 4wd at a full standstill. Is at a stand still if you engage and then start going does...