比較常用
# -*-coding:utf8-*-import requestsfrom lxml import etreeurl="http://econpy.pythonanywhere.com/ex/001.html"page=requests.get(url)html=page.textselector = etree.HTML(html)buyer=selector.xpath('//div[@title="buyer-name"]/text()')這個(gè)用的少一些# -*-coding:utf8-*-import requestsfrom lxml import htmlurl="http://econpy.pythonanywhere.com/ex/001.html"page=requests.get(url)tree=html.fromstring(page.text)buyer=tree.xpath('//div[@title="buyer-name"]/text()')prices=tree.xpath('//span[@class="item-price"]/text()')print (buyer)print (prices)Xpath的語(yǔ)法參考 http://m.survivalescaperooms.com.cn/xpath/xpath_syntax.aspChrome中使用時(shí)可以下載插件:Xpath helper參考使用requests和lxml編寫python爬蟲小記 http://www.tuicool.com/articles/vABNRbRXPath在python中的高級(jí)應(yīng)用 參見:http://blog.csdn.net/winterto1990/article/details/47903653
但是遇到中文網(wǎng)頁(yè)時(shí),中文出現(xiàn)亂碼。
req = requests.get("http://news.sina.com.cn/")print (req.text)為了解決這個(gè)問(wèn)題,請(qǐng)參考這篇文章: http://blog.csdn.net/chaowanghn/article/details/54889835
新聞熱點(diǎn)
疑難解答
圖片精選
網(wǎng)友關(guān)注