However, you can also fix this by adding a so called DisallowGPUDrivenRendering component to the prefab.
But doesn't that disable gpu rendering and put it on the cpu??? That's not really good.
I will try playing around with both methods you said though.