Light Direction for Light Probes

I would love to have an option that would allow me to use light probes for my lighting, but take the directional light in the scene only for its direction to compute specular highlights and normals but not have it contribute to the lighting of the shader (don't attenuate and apply to diffuse).