If you are looking for academic literature on the broader technology used for such tasks, you might find the following topics relevant: Web Scraping and Data Extraction

A functional “hairyaunty-photos downloader” would likely consist of the following modules: