As teh large delay is seen less than 1% of times, we are not exactly sure of what is causing this. can you please verify if the delay is not caused on the host application side?
In Fx2LP's side, we can try increasing the GPIF Clock further, but I cannot surely say whether this fixes the issue.
Please investigate further,
- Madhu Sudhan