Please confirm that have you changed the #define CY_U3P_SYS_MEM_TOP (0x40078000) to #define CY_U3P_SYS_MEM_TOP (0x40080000).
If you don't do so the DMA buffer Area will be reduced by 32 KB as you have increased 32 KB in data area.
If you change the mem top to this #define CY_U3P_SYS_MEM_TOP (0x40080000). The DMA area will again be 224 KB (for 512 KB SRAM) as second stage bootloader ares which is 32 KB will be removed
Error = 0x10 - channel creation
This the memory error when the DMA buffers asked cannot be allocated while creating DMA channel. Please let me know hat is the DMA buffer size, DMA buffer count and how many such channels are you creating.
error = 0x40 channel reset
This error is when the argument passed to the API is not proper. In this case if the DMA channel is not created the DMA channel reset will also fail.
Please refer to this KBA for understanding Modifying the Default Memory Map in FX3, CX3, FX3S, SD3, FX2G2, and SD2 - KBA229114
Let me know if any queries on this