Here's a way to counter your proposal:

- Fetch the video multiple times

- Cut out the non-overlapping segments from the video shown to the user.

This assumes that a different ad is shown every time. Crowd-sourcing like with Sponsor Block could come in handy here.