9 Replies Latest reply on Sep 16, 2018 11:30 PM by srnt

    FX3 UVC Aptina Sensor Isochronous

    user_317362459

      Hi,

       

      I'm trying to convert AN75779 example to Isochronous. I followed your existing examples UVCVideoClass and FX3UVCDemo_BULK_ISO to convert the AN75779 sample to isochronous. After the modification, the windows (Windows 10) can see the device as a UVC. But when I open the webcam viewer app (Camera/VLC player) it doesn't display any video. On UART terminal, I can see UVC: Completed x frame and y buffers as debug output. But viewer can't display any video to the screen. I'm sending 640x480 at 15 frame rate on USB 3.0 as well. Could you please let me know what might be causing this issue? I'm also attaching my project with this email. If you can help on this issue would be greatly appreciated. 

       

      /* UVC Probe Control Settings for a USB 3.0 connection. */
      uint8_t glProbeCtrl[CY_FX_UVC_MAX_PROBE_SETTING] = {
        0x00, 0x00,                 /* bmHint : no hit */
        0x01,                       /* Use 1st Video format index */
        0x01,                       /* Use 1st Video frame index */
        //  0x15, 0x16, 0x05, 0x00,     /* Desired frame interval in the unit of 100ns: 30 fps */
        0x2A, 0x2C, 0x0A, 0x00,
        0x00, 0x00,                 /* Key frame rate in key frame/video frame units: only applicable
                                         to video streaming with adjustable compression parameters */
        0x00, 0x00,                 /* PFrame rate in PFrame / key frame units: only applicable to
                                         video streaming with adjustable compression parameters */
        0x00, 0x00,                 /* Compression quality control: only applicable to video streaming
                                         with adjustable compression parameters */
        0x00, 0x00,                 /* Window size for average bit rate: only applicable to video
                                         streaming with adjustable compression parameters */
        0x00, 0x00,                 /* Internal video streaming i/f latency in ms */
        //  0x00, 0x48, 0x3F, 0x00,     /* Max video frame size in bytes */
        0x00, 0x60, 0x09, 0x00,
        0x00, 0x0C, 0x00, 0x00,      /* No. of bytes device can rx in single payload = 16 KB */

      #ifndef FX3_UVC_1_0_SUPPORT
        /* UVC 1.1 Probe Control has additional fields from UVC 1.0 */
        0x00, 0x60, 0xE3, 0x16,             /* Device Clock */
        0x00,                               /* Framing Information - Ignored for uncompressed format*/
        0x00,                               /* Preferred payload format version */
        0x00,                               /* Minimum payload format version */
        0x00                                /* Maximum payload format version */
      #endif
      };

       

      Here are the changes I made to the code

      endPointConfig.enable   = 1;

      //    endPointConfig.epType   = CY_U3P_USB_EP_BULK;

      endPointConfig.epType   = CY_U3P_USB_EP_ISO;

      endPointConfig.pcktSize = CY_FX_EP_BULK_VIDEO_PKT_SIZE;

      endPointConfig.isoPkts  = 1;

      //endPointConfig.burstLen = 16;

      endPointConfig.burstLen = 3;

      endPointConfig.streams  = 0;

       

      dmaMultiConfig.size           = 3 * 0x400;//3 * 0x400;//CY_FX_UVC_STREAM_BUF_SIZE;

      dmaMultiConfig.count          =  16;//CY_FX_UVC_STREAM_BUF_COUNT;

      dmaMultiConfig.validSckCount  = 2;

      dmaMultiConfig.prodSckId [0]  = (CyU3PDmaSocketId_t)CY_U3P_PIB_SOCKET_0;

      dmaMultiConfig.prodSckId [1]  = (CyU3PDmaSocketId_t)CY_U3P_PIB_SOCKET_1;

      dmaMultiConfig.consSckId [0]  = (CyU3PDmaSocketId_t)(CY_U3P_UIB_SOCKET_CONS_0 | CY_FX_EP_VIDEO_CONS_SOCKET);

      dmaMultiConfig.prodAvailCount = 0;

      dmaMultiConfig.prodHeader     = 12;                 /* 12 byte UVC header to be added. */

      dmaMultiConfig.prodFooter     = 132;                  /* 4 byte footer to compensate for the 12 byte header. */

      dmaMultiConfig.consHeader     = 0;

      dmaMultiConfig.dmaMode        = CY_U3P_DMA_MODE_BYTE;

      dmaMultiConfig.notification   = CY_U3P_DMA_CB_PROD_EVENT | CY_U3P_DMA_CB_CONS_EVENT;

      dmaMultiConfig.cb             = CyFxUvcApplnDmaCallback;

      apiRetStatus = CyU3PDmaMultiChannelCreate (&glChHandleUVCStream, CY_U3P_DMA_TYPE_MANUAL_MANY_TO_ONE,

         &dmaMultiConfig);

       

      /* Super Speed Configuration Descriptor */
      const uint8_t CyFxUSBSSConfigDscr[] =
          {
              /* Configuration Descriptor Type */
              0x09,                           /* Descriptor Size */
              CY_U3P_USB_CONFIG_DESCR,        /* Configuration Descriptor Type */
              0xE3,0x00,                      /* Length of this descriptor and all sub descriptors */
              0x02,                           /* Number of interfaces */
              0x01,                           /* Configuration number */
              0x00,                           /* Configuration string index */
              0x80,                           /* Config characteristics - Bus powered */
              0x32,                           /* Max power consumption of device (in 8mA unit) : 400mA */

              /* Interface Association Descriptor */
              0x08,                           /* Descriptor Size */
              CY_FX_INTF_ASSN_DSCR_TYPE,      /* Interface Association Descr Type: 11 */
              0x00,                           /* I/f number of first VideoControl i/f */
              0x02,                           /* Number of Video i/f */
              0x0E,                           /* CC_VIDEO : Video i/f class code */
              0x03,                           /* SC_VIDEO_INTERFACE_COLLECTION : Subclass code */
              0x00,                           /* Protocol : Not used */
              0x00,                           /* String desc index for interface */

              /* Standard Video Control Interface Descriptor */
              0x09,                           /* Descriptor size */
              CY_U3P_USB_INTRFC_DESCR,        /* Interface Descriptor type */
              0x00,                           /* Interface number */
              0x00,                           /* Alternate setting number */
              0x01,                           /* Number of end points */
              0x0E,                           /* CC_VIDEO : Interface class */
              0x01,                           /* CC_VIDEOCONTROL : Interface sub class */
              0x00,                           /* Interface protocol code */
              0x00,                           /* Interface descriptor string index */

              /* Class specific VC Interface Header Descriptor */
              0x0D,                           /* Descriptor size */
              0x24,                           /* Class Specific I/f Header Descriptor type */
              0x01,                           /* Descriptor Sub type : VC_HEADER */
              0x10, 0x01,                     /* Revision of UVC class spec: 1.1 - Minimum version required
                                                 for USB Compliance. Not supported on Windows XP*/
              0x51, 0x00,                     /* Total Size of class specific descriptors (till Output terminal) */
              0x00,0x6C,0xDC,0x02,            /* Clock frequency : 48MHz(Deprecated) */
              0x01,                           /* Number of streaming interfaces */
              0x01,                           /* Video streaming I/f 1 belongs to VC i/f */

              /* Input (Camera) Terminal Descriptor */
              0x12,                           /* Descriptor size */
              0x24,                           /* Class specific interface desc type */
              0x02,                           /* Input Terminal Descriptor type */
              0x01,                           /* ID of this terminal */
              0x01,0x02,                      /* Camera terminal type */
              0x00,                           /* No association terminal */
              0x00,                           /* String desc index : Not used */
              0x00,0x00,                      /* No optical zoom supported */
              0x00,0x00,                      /* No optical zoom supported */
              0x00,0x00,                      /* No optical zoom supported */
              0x03,                           /* Size of controls field for this terminal : 3 bytes */
                                              /* A bit set to 1 in the bmControls field indicates that
                                               * the mentioned Control is supported for the video stream.
                                               * D0: Scanning Mode
                                               * D1: Auto-Exposure Mode
                                               * D2: Auto-Exposure Priority
                                               * D3: Exposure Time (Absolute)
                                               * D4: Exposure Time (Relative)
                                               * D5: Focus (Absolute)
                                               * D6: Focus (Relative)
                                               * D7: Iris (Absolute)
                                               * D8: Iris (Relative)
                                               * D9: Zoom (Absolute)
                                               * D10: Zoom (Relative)
                                               * D11: PanTilt (Absolute)
                                               * D12: PanTilt (Relative)
                                               * D13: Roll (Absolute)
                                               * D14: Roll (Relative)
                                               * D15: Reserved
                                               * D16: Reserved
                                               * D17: Focus, Auto
                                               * D18: Privacy
                                               * D19: Focus, Simple
                                               * D20: Window
                                               * D21: Region of Interest
                                               * D22 – D23: Reserved, set to zero
                                               */
              0x00,0x00,0x00,                 /* bmControls field of camera terminal: No controls supported */
              /* Processing Unit Descriptor */
              0x0D,                           /* Descriptor size */
              0x24,                           /* Class specific interface desc type */
              0x05,                           /* Processing Unit Descriptor type */
              0x02,                           /* ID of this terminal */
              0x01,                           /* Source ID : 1 : Connected to input terminal */
              0x00,0x40,                      /* Digital multiplier */
              0x03,                           /* Size of controls field for this terminal : 3 bytes */
              0x01,0x00,0x00,                 /* bmControls field of processing unit: Brightness control supported */
              0x00,                           /* String desc index : Not used */
              0x00,                           /* Analog Video Standards Supported: None */

              /* Extension Unit Descriptor */
              0x1C,                           /* Descriptor size */
              0x24,                           /* Class specific interface desc type */
              0x06,                           /* Extension Unit Descriptor type */
              0x03,                           /* ID of this terminal */
              0xFF,0xFF,0xFF,0xFF,            /* 16 byte GUID */
              0xFF,0xFF,0xFF,0xFF,
              0xFF,0xFF,0xFF,0xFF,
              0xFF,0xFF,0xFF,0xFF,
              0x00,                           /* Number of controls in this terminal */
              0x01,                           /* Number of input pins in this terminal */
              0x02,                           /* Source ID : 2 : Connected to Proc Unit */
              0x03,                           /* Size of controls field for this terminal : 3 bytes */
              0x00,0x00,0x00,                 /* No controls supported */
              0x00,                           /* String desc index : Not used */

              /* Output Terminal Descriptor */
              0x09,                           /* Descriptor size */
              0x24,                           /* Class specific interface desc type */
              0x03,                           /* Output Terminal Descriptor type */
              0x04,                           /* ID of this terminal */
              0x01,0x01,                      /* USB Streaming terminal type */
              0x00,                           /* No association terminal */
              0x03,                           /* Source ID : 3 : Connected to Extn Unit */
              0x00,                           /* String desc index : Not used */

              /* Video Control Status Interrupt Endpoint Descriptor */
              0x07,                           /* Descriptor size */
              CY_U3P_USB_ENDPNT_DESCR,        /* Endpoint Descriptor Type */
              CY_FX_EP_CONTROL_STATUS,        /* Endpoint address and description */
              CY_U3P_USB_EP_INTR,             /* Interrupt End point Type */
              0x40,0x00,                      /* Max packet size = 64 bytes */
              0x01,                           /* Servicing interval */

              /* Super Speed Endpoint Companion Descriptor */
              0x06,                           /* Descriptor size */
              CY_U3P_SS_EP_COMPN_DESCR,       /* SS Endpoint Companion Descriptor Type */
              0x00,                           /* Max no. of packets in a Burst : 1 */
              0x00,                           /* Attribute: N.A. */
              0x04, 0x00,                          /* Bytes per interval:1024 */

              /* Class Specific Interrupt Endpoint Descriptor */
              0x05,                           /* Descriptor size */
              0x25,                           /* Class Specific Endpoint Descriptor Type */
              CY_U3P_USB_EP_INTR,             /* End point Sub Type */
              0x40,0x00,                      /* Max packet size = 64 bytes */


              /* Standard Video Streaming Interface Descriptor (Alternate Setting 0) */
              0x09,                           /* Descriptor size */
              CY_U3P_USB_INTRFC_DESCR,        /* Interface Descriptor type */
              0x01,                           /* Interface number */
              0x00,                           /* Alternate setting number */
              0x00,                           /* Number of end points */
              0x0E,                           /* Interface class : CC_VIDEO */
              0x02,                           /* Interface sub class : CC_VIDEOSTREAMING */
              0x00,                           /* Interface protocol code : Undefined */
              0x00,                           /* Interface descriptor string index */

             /* Class-specific Video Streaming Input Header Descriptor */
              0x0E,                           /* Descriptor size */
              0x24,                           /* Class-specific VS I/f Type */
              0x01,                           /* Descriptotor Subtype : Input Header */
              0x01,                           /* 1 format desciptor follows */
              0x47,0x00,                      /* Total size of Class specific VS descr */
              CY_FX_EP_BULK_VIDEO,            /* EP address for BULK video data */
              0x00,                           /* No dynamic format change supported */
              0x04,                           /* Output terminal ID : 4 */
              0x00,                           /* Still image capture method 1 supported */
              0x00,                           /* Hardware trigger NOT supported */
              0x00,                           /* Hardware to initiate still image capture NOT supported */
              0x01,                           /* Size of controls field : 1 byte */
              0x00,                           /* D2 : Compression quality supported */

              /* Class specific Uncompressed VS format descriptor */
              0x1B,                           /* Descriptor size */
              0x24,                           /* Class-specific VS I/f Type */
              0x04,                           /* Subtype : uncompressed format I/F */
              0x01,                           /* Format desciptor index */
              0x01,                           /* Number of frame descriptor followed */
              0x59,0x55,0x59,0x32,            /* GUID used to identify streaming-encoding format: YUY2  */
              0x00,0x00,0x10,0x00,
              0x80,0x00,0x00,0xAA,
              0x00,0x38,0x9B,0x71,
              0x10,                           /* Number of bits per pixel */
              0x01,                           /* Optimum Frame Index for this stream: 1 */
              0x10,                           /* X dimension of the picture aspect ratio; Non-interlaced */
              0x09,                           /* Y dimension of the pictuer aspect ratio: Non-interlaced */
              0x00,                           /* Interlace Flags: Progressive scanning, no interlace */
              0x00,                           /* duplication of the video stream restriction: 0 - no restriction */

              /* Class specific Uncompressed VS frame descriptor */
              0x1E,                           /* Descriptor size */
              0x24,                           /* Descriptor type*/
              0x05,                           /* Subtype: uncompressed frame I/F */
              0x01,                           /* Frame Descriptor Index */
              0x00,                           /* Still image capture method 1 supported */
          //    0x00, 0x05,                     /* Width in pixel */
            //  0xD0, 0x02,                     /* Height in pixel */
              0x80,0x02,                      /* Width in pixel: 320-QVGA */
              0xE0,0x01,
              //0x00,0x50,0x97,0x31,            /* Min bit rate bits/s. */
              //0x00,0x50,0x97,0x31,            /* Max bit rate bits/s. */
              0x00,0x00,0x05,0x46,
              0x00,0x00,0x05,0x46,
              0x00,0xA4,0x1F,0x00,            /* Maximum video or still frame size in bytes(Deprecated)*/
              0x2A,0x2C,0x0A,0x00,            /* Default Frame Interval */
              0x01,                           /* Frame interval(Frame Rate) types: Only one frame interval supported */
              0x2A,0x2C,0x0A,0x00,            /* Shortest Frame Interval */
             // 0x15, 0x16, 0x05, 0x00,         /* 30fps */
             // 0x01,
             // 0x15,0x16,0x05,0x00,

              /* Standard video streaming interface descriptor (Alternate setting 1) */
              0x09,                           /* Descriptor size */
              CY_U3P_USB_INTRFC_DESCR,        /* Interface descriptor type */
              0x01,                           /* Interface number */
              0x01,                           /* Alternate setting number */
              0x01,                           /* Number of end points : 1 ISO EP */
              0x0E,                           /* Interface class : CC_VIDEO */
              0x02,                           /* Interface sub class : CC_VIDEOSTREAMING */
              0x00,                           /* Interface protocol code : Undefined */
              0x00,                           /* Interface descriptor string index */

              /* Endpoint Descriptor for BULK Streaming Video Data */
              0x07,                           /* Descriptor size */
              CY_U3P_USB_ENDPNT_DESCR,        /* Endpoint Descriptor Type */
              CY_FX_EP_BULK_VIDEO,            /* Endpoint address and description */
              CY_U3P_USB_EP_ISO | 0x04,             /* BULK End point */
              0x00, /* EP MaxPcktSize: 1024B */
              0x04, /* EP MaxPcktSize: 1024B */
              0x01,                           /* Servicing interval for data transfers */

              /* Super Speed Endpoint Companion Descriptor */
              0x06,                           /* Descriptor size */
              CY_U3P_SS_EP_COMPN_DESCR,       /* SS Endpoint Companion Descriptor Type */
              CY_FX_EP_ISO_VIDEO_SS_BURST - 1,                           /* Max number of packets per burst: 16 */
              CY_FX_EP_ISO_VIDEO_SS_MULT - 1,                           /* Attribute: Streams not defined */
              0x00,                           /* No meaning for bulk */
              0x04 * CY_FX_EP_ISO_VIDEO_PKTS_COUNT
          };

        • 1. Re: FX3 UVC Aptina Sensor Isochronous
          srnt

          Hello,

           

          - Are you using the same image sensor as mentioned in the App Note AN75779. If yes, please check with the BULK endpoint first and see if the video streaming is fine.

          - The project that you have attached confuses between the terms BULK and ISOC. Can you kindly modify?

           

          Best regards,

          Srinath S

          • 2. Re: FX3 UVC Aptina Sensor Isochronous
            user_317362459

            Srinath,

             

            I'm attaching the new firmware. Hopefully, this won't be confusing now.

            • 3. Re: FX3 UVC Aptina Sensor Isochronous
              user_317362459

              Srinath S,

               

               

               

              Thank you for your reply. I’m using the same Aptina sensor that mentioned in your AN75779. The bulk example as it is run fine on my machine. But not the isochronous. The example is Isochronous. You may be thought that as I didn’t rename the endpoint. I wanted to make minimum changes and see if I can convert the bulk example to isochronous. If you compile the program and load the image to your DVK board, you would see it comes as a isochronous mode.

              • 4. Re: FX3 UVC Aptina Sensor Isochronous
                user_317362459

                Srinath,

                 

                 

                 

                I able to get the Isochronous working. But I have another issue now. On Windows, it runs fine. I’m running the aptina sensor on USB 2.0 at resolution 640x480 frame rate 15FPS. On Windows, I can get the video at 15 FPS consistently. But our main aim is to run the camera on an embedded device like Raspberry Pi. When I run the camera on the linux (SBC), I see a lot of data loss and I get variable frame rate from 2 FPS to 8 FPS. After debugging, I think the problem exists in the following code:

                 

                if(CurrentMultVal != CY_FX_EP_ISO_VIDEO_PKTS_COUNT)

                 

                {

                 

                CyU3PUsbSetEpNak (CY_FX_EP_ISO_VIDEO, CyTrue);

                 

                      CyU3PBusyWait (10);

                 

                      status = CyU3PDmaMultiChannelCommitBuffer (chHandle, commitLength, 0);

                 

                      if(CY_U3P_SUCCESS != status)

                 

                      {

                 

                            CyU3PDebugPrint(4,"Error in committing buffer CurrentMultVal %d\r\n", CurrentMultVal);

                 

                            CyU3PUsbSetEpNak (CY_FX_EP_ISO_VIDEO, CyFalse);

                 

                            return;//Don’t know what to yet. May be send a reset event to restart the app? For now just return

                 

                }

                 

                      CyU3PBusyWait (3* USB_MICROFRAME_DURATION); // USB_MICROFRAME_DURATION = 125 microseconds

                 

                      CyFxUvcAppSetMultByEpm (CY_FX_EP_ISO_VIDEO & 0x0F);

                 

                      CyU3PUsbSetEpNak (CY_FX_EP_ISO_VIDEO, CyFalse);

                 

                }

                 

                else

                 

                {

                 

                status = CyU3PDmaMultiChannelCommitBuffer (chHandle, commitLength, 0);

                 

                      if(CY_U3P_SUCCESS != status)

                 

                      {

                 

                            CyU3PDebugPrint(4,"Error in committing buffer\r\n");

                 

                            CyU3PUsbSetEpNak (CY_FX_EP_ISO_VIDEO, CyFalse);

                 

                return;//Don’t know what to yet. May be send a reset event to restart the app? For now just return

                 

                      }

                 

                }

                 

                 

                 

                The reason I’m thinking the issue is with the above code, as I can play with the delay (CyU3PBusyWait) and get a higher frame rate. But I can never get a consistent frame rate.

                 

                What is the purpose of CyFXUvcAppSetMultByEpm function on USB 2.0? Comments said it has to do something with Isochronous packets. It didn’t make much sense to me.

                 

                 

                 

                If you can help with this issue it would be greatly appreciated.

                 

                 

                 

                For your reference, here is the CyFXUvcAppSetMultByEpm function

                 

                 

                 

                /* Definitions for the DEV_EPI_CS register on FX3. */

                 

                #define FX3_USB2_INEP_CFG_ADDR_BASE     (0xe0031418)

                 

                #define FX3_USB2_INEP_MULT_MASK         (0x00003000)

                 

                #define FX3_USB2_INEP_MULT_POS          (12)

                 

                 

                 

                /* Definitions for the EEPM_ENDPOINT register on FX3. */

                 

                #define FX3_USB2_INEP_EPM_ADDR_BASE     (0xe0031c40)

                 

                #define FX3_USB2_INEP_EPM_READY_MASK    (0x40000000)

                 

                #define FX3_USB2_INEP_EPM_DSIZE_MASK    (0x07FFF800)

                 

                #define FX3_USB2_INEP_EPM_DSIZE_POS     (11)

                 

                /* Set the MULT value for an ISO endpoint based on the EPM state. */

                 

                void

                 

                CyFxUvcAppSetMultByEpm (

                 

                        uint8_t ep)

                 

                {

                 

                    uint32_t val1 = *((uvint32_t *)(FX3_USB2_INEP_CFG_ADDR_BASE + (4 * ep)));

                 

                    uint32_t val2 = *((uvint32_t *)(FX3_USB2_INEP_EPM_ADDR_BASE + (4 * ep)));

                 

                    uint8_t  multVal = 0;

                 

                 

                 

                    /* If the EPM is ready, find out how much data is present and then update the MULT setting. */

                 

                    if ((val2 & FX3_USB2_INEP_EPM_READY_MASK) != 0)

                 

                    {

                 

                        val2 = (val2 & FX3_USB2_INEP_EPM_DSIZE_MASK) >> FX3_USB2_INEP_EPM_DSIZE_POS;

                 

                        multVal = (val2 / 1024) + 1;

                 

                    }

                 

                 

                 

                    CurrentMultVal = multVal;

                 

                 

                 

                    /* Adjust multVal to a value between 1 and 3. */

                 

                    multVal = CY_U3P_MIN (multVal, 3);

                 

                    multVal = CY_U3P_MAX (multVal, 1);

                 

                 

                 

                    val1 = (val1 & ~FX3_USB2_INEP_MULT_MASK) | (multVal << FX3_USB2_INEP_MULT_POS);

                 

                    *((uvint32_t *)(FX3_USB2_INEP_CFG_ADDR_BASE + (4 * ep))) = val1;

                 

                }

                • 5. Re: FX3 UVC Aptina Sensor Isochronous
                  user_317362459

                  Srinath,

                   

                  Could you please help me on this matter? I still would like to know what is the purpose of CyFxUvcAppSetMultByEpm function.

                   

                  Also, on our isochronous uvc code, when I try to run the aptina sensor at 720p resolution at 30 Hz, I can never commit successfully. I always get INVALID_SEQUENCE_NUMBER when I call CyU3PDmaMultiChannelCommitBuffer function. I'm running your example on Windows 10.

                   

                   

                  • 6. Re: FX3 UVC Aptina Sensor Isochronous
                    srnt

                    Hello,

                     

                    - Please refer to section 2.6 of the FX3_SDK_TroubleShooting_Guide.pdf file for the MULT setting errata item on FX3.

                    - INVALID_SEQUENCE_NUMBER indicates that the buffers are not in the desired state when the data is being committed to the consumer. Can you please post the complete UART logs during the failure?

                     

                    Best regards,

                    Srinath S

                    • 7. Re: FX3 UVC Aptina Sensor Isochronous
                      user_317362459

                      Srinath,

                       

                       

                       

                      What do you mean by buffers are not in the desired state? I’m trying to commit inside CyFxUvcApplnDmaCallback. Is there any way to know if the buffer is ready to commit before calling CyU3PDmaMultiChannelCommitBuffer?

                       

                       

                       

                      I’m not in the office for this week. I can get you the UART output by next week.

                      • 8. Re: FX3 UVC Aptina Sensor Isochronous
                        user_317362459

                        Srinath,

                         

                         

                         

                        I have a custom board that is running at 640x480 2 bytes per pixel single channel at 30 Hz. It uses a MT9M001 sensor. I can’t even get a single frame rate out of the camera. The only difference between the Aptina sensor and MT9M001 sensor is that I’m using a 16 bits GPIF bus.

                         

                         

                         

                        I see a lot of developers has INVALID_SEQUENCE_NUMBER issue when I search this in Google. The only response I see from Cypress is that host isn’t able to poll data fast enough. So, you guys are saying on USB 3.0 a host can’t handle 640x480 resolution camera? Also, aptina sensor works fine with the same firmware. So, bandwidth didn’t increase. The only thing changed is the bus size. I’m also using Isochronous mode so I believe the host is polling at 125 microseconds interval. Am I correct?

                         

                         

                         

                        There must be another reason to get INVALID_SEQUENCE_NUMBER. Please help me to resolve this issue as we need to go to production.

                        • 9. Re: FX3 UVC Aptina Sensor Isochronous
                          srnt

                          Hello,

                           

                          - Does the 16-bit image sensor work fine with the BULK endpoints on Windows and Linux based OS?

                          - What is the host OS and the UVC based host application that you are using when the 640x480 resolution fails.

                          - Also, increase the size of the DMA buffer used for video transmission. I find that you are using 16 buffers are 3kB each. Using low buffer size can cause the buffers to be filled quickly leading to buffer overflow errors.

                          - Please mention why you have used the footer size to be 132 bytes. 4 byte footer can be sufficient to compensate for the 12 byte UVC header.

                          - Also, provide the UART logs during the failure.

                           

                          Best regards,

                          Srinath S