Investigating more, it does appear Drupal sets those file permissions. I looked for an easy solution to the problem, but was only able to find some somewhat incomplete patches. You may be able to find the chmod call inside Drupal and just comment it out.