国产探花免费观看_亚洲丰满少妇自慰呻吟_97日韩有码在线_资源在线日韩欧美_一区二区精品毛片,辰东完美世界有声小说,欢乐颂第一季,yy玄幻小说排行榜完本

首頁 > 編程 > Python > 正文

python制作最美應用的爬蟲

2019-11-25 17:03:11
字體:
來源:轉載
供稿:網友

安卓最美應用頁面爬蟲,爬蟲很簡單,設計的東西到挺多的
文件操作
正則表達式
字符串替換等等

import requestsimport reurl = "http://zuimeia.com"r = requests.get('http://zuimeia.com/community/app/hot/?platform=2')pattern = re.compile(r'<a class="community-app-cover-wrapper" href="(.*?)" target="_blank">')urlList = pattern.findall(r.content)def requestsUrl(url): r = requests.get(url) title = re.findall(r'"app-title"><h1>(.*?)</h1>',r.content) #print title category = re.findall(r'<a class="app-tag" href="/community/app/category/title/.*?/?platform=2">(.*?)</a>',r.content) #print category describe = re.findall(r'<div id="article_content">(.*?)<div class="community-image-wrapper">',r.content) #print type(describe[0]) strdescribe = srtReplace(describe[0]) #print strdescribe downloadUrl = re.findall(r'<a class="download-button direct hidden" href="(.*?)"',r.content) #print downloadUrl return title,category,strdescribe,downloadUrldef srtReplace(string): listReplace = ['<p>', '<br>', '<h1>', '<h2>', '<h3>', '<h4>', '<h5>', '<h6>', '<h7>','<strong>','</p>', '<br/>', '</h1>', '</h2>', '</h3>', '</h4>', '</h5>',     '</h6>', '</h7>','</strong>','<b>', '</b>'] for eachListReplace in listReplace:  string = string.replace(str(eachListReplace),'/n') string = string.replace('/n/n','') return stringdef categornFinal(category): categoryFinal ='' for eachCategory in category:  categoryFinal = categoryFinal+str(eachCategory)+'-->' return categoryFinaldef urlReplace(url): url = url.replace('&', '&') return urlrequestsUrl("http://zuimeia.com/community/app/27369/?platform=2")for eachUrl in urlList: eachUrl = url+eachUrl content = requestsUrl(eachUrl) categoryFinal ='' title = content[0][0] category = categornFinal(content[1]) strdescribe = content[2] downloadUrl = urlReplace(content[3][0]) with open('c:/wqa.txt', 'a+') as fd:  fd.write('title:'+title+'/n'+'category:'+category+'/n'+'strdescribe:'+strdescribe+'/n'+'downloadUrl:'+downloadUrl+'/n/n/n-----------------------------------------------------------------------------------------------------------------------------/n/n/n')

發表評論 共有條評論
用戶名: 密碼:
驗證碼: 匿名發表
主站蜘蛛池模板: 景泰县| 家居| 个旧市| 房山区| 满洲里市| 左云县| 龙游县| 吉隆县| 巴林右旗| 龙海市| 吉林市| 天台县| 酉阳| 乌鲁木齐县| 宜州市| 上饶县| 当涂县| 道孚县| 仁化县| 嘉兴市| 霍林郭勒市| 石泉县| 岳普湖县| 潮州市| 澎湖县| 宜章县| 富蕴县| 政和县| 宿州市| 南乐县| 独山县| 鲁甸县| 永定县| 方正县| 新巴尔虎右旗| 西安市| 高尔夫| 南昌县| 遂川县| 南丰县| 龙游县|