Before 1309, the hermits of Saint-Augustin were established extra muros in the insalubrious district of Matabiau. Then, in 1309, they obtained authorisation from the pope Clement V, to build their own conventinside the city walls. From then on the convent expanded and its influence significantly spread. In 1396, the cloister was completed. Damaged by fire in 1463, the architectural ensemble could not be finished before 1504 (due to lack of funds) when the church was consecrated. This date also marks the beginning of a difficult passage when the monks were forced to undertake quite extensive conversions that gradually changed the face of the buildings.