This paper presents results of a case study on cliff recession mechanism and progressive development of talus deposits around Xiangshan of the Sishou Hills in the southeast of the Taipei Basin. Based on photogrammetric analysis and physical modeling, the geomorphologic changes of talus deposits are carefully examined and the cliff recession rates from 1904 to 2005 are thus measured and tabulated. Our study identified the fundamental control factors on mechanisms of cliff recession and proposed a possible scenario of cliff recession and progressive development of talus deposits around the Xiangshan region from 1904 to 2005.