I posted a message on the Microsoft Tech.net and a developer from Microsoft says that they have improved the Firefox performance in Reporting Services 2008. Since we are in the process of upgrading to SQL Server 2008 and so the Reporting will be getting upgraded, I've decided to what until that's completed and see what happens with 2008 on.
Cheers