Some remains of the fortress are still visible in the current Mirador de la Virgen, while others have been integrated into private dwellings. There is evidence of its existence at least since the Nasrid period, when Canillas de Aceituno formed part of the Taha or district of Bentomiz, dominating a large territory. Its location in the centre of the farmstead suggests that it was a fortified settlement similar to others in the same Taha. It was particularly important during the Moorish uprising in La Axarquía that began in Canillas in 1568. Later, in 1572, it was destroyed by order of Felipe II.