It looks like a dead end. But wait. How did videojs-youtube managed it?
What is pointer-events? Quote:
The CSS property
pointer-events allows authors to control under what circumstances (if any) a particular graphic element can become the target of mouse events. When this property is unspecified, the same characteristics of the
visiblePainted value apply to SVG content.
In addition to indicating that the element is not the target of mouse events, the value
none instructs the mouse event to go “through” the element and target whatever is “underneath” that element instead.
And with property “none”, when user clicks on the div, it behaves as if the click goes right through this div and lands on the layer underneath.