I never heard of the fact that much RAM given by host to guest would cause problems.
Problems could be if one of the RAM sticks are not properly set in connector or the RAM sticks are of different model. And finally if one of the RAM sticks is damaged.