Unfortunately this is not possible, you can only sync the primary Exchange Mailbox of the user you are connecting.
What you could do is create a public folder with the shared contacts in and then use IMAP to connect to this, but it's not very reliable.