This is rather hard to diagnose without knowing anything of your custom app. How is rendering driven – a CVDisplayLink, some sort of timer, by the delivery of new frames…?
Are you drawing the frame on screen in the custom app, and is that required for your setup? Avoiding drawing on screens you aren’t using for output sounds like a likely and simple solution.