I promised myself I would never do this but I guess I must. Why do you want to do this? I don't like asking but if we know why you want such a strange set up we can help better or just tell you it is not a good idea and a reason. I can't imagine why you would need to restrict access to something that only you have physical access to. Most times it is more trouble than it is worth and often introduces issues all for something you may not need.
So explain why you need to do that and what your desired end result is.
So explain why you need to do that and what your desired end result is.