What does your ACL settings look like? Are the approvers fixed users, roles or SQL Filters? It doesn't help if your ACLs are quick if it has to be run for each of the 3500 pending approvals you have each time someone opens their To Do tab.
Br,
Chris