FPS drops to 40-45 after driving through festival??

Hey folks,

I have gotten my game to run seamlessly on 60fps High, to the point where I was really happy with it. I kept randomly getting stuck at ~40fps which frustrated me, until I figured out it was only driving through the festival when I would encounter this. I would be at 60fps and 60-70% gpu until driving through the festival (specifically the north entrance) after which it would drop to around 40-45fps without returning. It would stay there unless I restarted.

GTX 1050
i7-7700HQ
16GB RAM
Dell XPS 15 9560

I appreciate any help here.