The hermitage was built with adobe walls and a thatched roof, known as "Las Lágrimas de San Pedro" (The Tears of Saint Peter).

In 1862, the hermitage was destroyed by a fire and was later reconstructed. From its beginnings, it was intended for the native population of Oaxaca.

When the church was dedicated to the Virgin of Carmen, it began to be called "El Carmen de Abajo" to distinguish it from the church of Carmen Alto, which belonged to the colonial nobility of Antequera.

The facade is simple, and the church has a Latin cross shape. It has a nave covered with a barrel vault with some skylights. It has two chapels, several rooms, and two small atriums.

Inside the church, there are 19th-century altarpieces and some early 20th-century paintings.