The pipeline code is available for review of the mechanics of http requests made if you follow the ArchiveTeam wiki links.