Le Vigan was the seat of the "Arisitum" diocese during the 6th century , and also that of an Archpriest who seperated from the diocese of Nimes to form that of Alès in the 17th century.

During the Middle-Ages , the Benedictine monks built the Priory Saint-Pierre of Le Vigan
(present site of the "maison de Pays"). The town was constructed around this Priory. By the 16th century the inhabitants were surrounded by quadrilateral remparts with five gates and six towers.