It was Taking me forever to come up with a design that I could machine on the mill, and then it hit me, 3D print them!
I have make simple mounts for the TEMCO limit switches found here.
X axis mount:
This was the easiest because the adjustable stops were already on the cross slide. I also extended the bottom so that it would protect the Y axis lead screw that gets exposed.