I suppose you are talking about TX2-UL. It supports both FS and. HS, so this part won't be the bottleneck. Please check the associated peripheral on your board to see if the data it self is driven at a lesser rate, also see if the queuing from the host is not the bottleneck. You can try to capture a hardware protocol trace to record the activities on the USB bus, which will give some idea on this.