[HDRP] Lighting in scene flickers when camera is moved

When navigating through the scene, the light sometimes turns itself off in the scene.

To repro:
- download and open this project
- the scene camera view should be saved at the exact position where the scene appears dark
- if you move the camera a bit, the scene will render correctly, but as you navigate the scene a bit more it will flicker on and off a lot.

Reproduced with:
HDRP 7.3.1 and 2019.3.11f1
HDRP 8.1.0 and 2020.1.0b8
HDRP 9.0.0 and 2020.2.a8

This particular project couldn't be opened with earlier versions.