爬取豆瓣书评

爬取豆瓣书评

在爬取过程中运行程序出现了以下错误，回到原网页查看发现评论中出现表情导致出错，百度后可以加入以下语句解决此问题

 Traceback (most recent call last):File "C:Users萌萌哒炸鸡腿Desktoppython豆瓣书评.py", line 29, in <module>print(x,')',comment)
UnicodeEncodeError: 'UCS-2' codec can't encode characters in position 5-5: Non-BMP character not supported in Tk

import sys
non_bmp_map = dict.fromkeys(range(0x10000, sys.maxunicode + 1), 0xfffd)
x = 'This works! U0001F44D'
anslate(non_bmp_map))

 code：

import re
import requests
from bs4 import BeautifulSoupimport sys
non_bmp_map = dict.fromkeys(range(0x10000, sys.maxunicode + 1), 0xfffd)LIST = []
urls = []
url = '='
for i in range(1,25):urls.append(url + str(i))
for u in urls:response = (u)html = soup = BeautifulSoup(html,'lxml')List = soup.find_all('span',class_ = "short")for i in List:LIST.)print(len(LIST))
x = 1
for comment in LIST:print('(',x,')',anslate(non_bmp_map))x += 1''' 
import sys
non_bmp_map = dict.fromkeys(range(0x10000, sys.maxunicode + 1), 0xfffd)
x = 'This works! U0001F44D'
anslate(non_bmp_map))
'''

错误解决参考博客