What is the throughout/data-rate you are streaming ? What's your resolution/fps and image format? Please enable uart debug messages in the FX3 firmware and check if there is any failure during the streaming. Also, register for PIB callback and check if there are any PIB error. CyU3PPibRegisterCallback (CyFxUvcAppPibCallback, CYU3P_PIB_INTR_ERROR); Streaming can stop for any reason, but we need to identify the cause. I suggest you that you also check with one lower resolution. Please refer to AN75779 to see the implementation of the PIB callback.
Thanks for your suggestions.
I have fixed the issue with Linux for FX3 camera. Basically, certain queries are not handled at our firmware side. I have tested with v4l2 and uvcvideo drivers in debug mode which captured all these failures.