I noticed as well that sometimes an export to Excel is very slow. My work around was to use the Export to CSV standard option. This is considerably faster, and the output can be opened in Excel as well.
We actually have determined the issue is related to two calculated fields we are exporting. We are going to make a change to remove these calculations. The export can complete in under a minute without them.