At the top of the hill where Frigiliana is located is the Castle of Lízar, whose suburb could be the origin of the Frigiliana of today. Barely any remains remain of the framework of the wall that surrounded it, some towers and the western access to it. Although there were prehistoric settlements on the site, the first construction phase of the castle could date back to the Umayyad Caliphate period, according to the ceramic remains found. Another representative construction phase was during the Nasrid period, when it appears in the sources as the administrative centre of the taha of Frigiliana.