I resolved this issue myself.
SQL Server Report Builder is a 32 bit client application, it will not be able to use 64 bit version Oracle client and gives error when connecting to Oracle from Report Builder using 64bit client.
Steps for the Solution
1) To solve this, install Oracle client 32 bit version on the client machine to use with Report Builder.
2) Install Oracle client 64 bit version on Reporting Services server.