Your comments

got the same problem is only broken in deferred mode for me though

I have the same issue with Unity version 2017.3.0f3 neither skybox nor gradient nor color work as ambient sources on shader forge custom shaders.