asp:button has an event "OnClientClick" which will not postback... u can directly call the javascript function to close the window...
its basically posting back with the huge amount of View State content and that's where its getting delayed.