"If you want to be free, there is but one way; it is to guarantee an equally full measure of liberty to all your neighbors. There is no other." ~ Carl Shurz
What I think is important to remember here are two things:
1. Guaranteeing liberty for your neighbor means not forcing something other than liberty on your neighbor and it also means not forcing liberty itself on your neighbor. It means using no force against your neighbor, period, except in defense.
2. When all your neighbors exercise the same freedom you have, it does not mean they will choose the same way of life or even the same form of government as you.
...And that's okay.
Anything else is not liberty or freedom.