I have many, many guests ask me if the tap water here in Burgundy is okay to drink.
Rest assured, all tap water in France is very strictly regulated and subject to weekly testing and analysis. As a general rule, it is just as safe to drink as tap water back home.
The taste, however, can be very different from what you are used to, especially where we are around Beaune where the ground is unbelievably rich in limestone.
I know the water here in Villers-la-Faye tastes completely different from that back home in Victoria, which runs through granite before coming out our taps.
One gets used to the taste pretty quickly though. Besides, I go by the rule of thumb that if the limestone is good for Romanée-Conti grape vines, it is good enough for me.