I figured it out. When I checked "Write to depth buffer" it worked as intended :)

Hi thanks for the quick reply!

Disabling batching seems to fix the issue. I would really like to be able to batch these objects though :P Do you have any recommendations on how to get around this issue or any other method to achieve the same effect?