首页下载资源后端Python爬虫爬取51Job职位数据

ZIPPython爬虫爬取51Job职位数据

rainflower_1982_93534.15KB需要积分:1

资源文件列表:

job51_hlink.zip 大约有29个文件
  1. job51_hlink/
  2. job51_hlink/.idea/
  3. job51_hlink/.idea/encodings.xml 218B
  4. job51_hlink/.idea/job51_hlink.iml 453B
  5. job51_hlink/.idea/misc.xml 298B
  6. job51_hlink/.idea/modules.xml 274B
  7. job51_hlink/.idea/workspace.xml 11.06KB
  8. job51_hlink/job51.json 482.04KB
  9. job51_hlink/job51_detail.json 1.27MB
  10. job51_hlink/job51_hlink/
  11. job51_hlink/job51_hlink/__init__.py
  12. job51_hlink/job51_hlink/__pycache__/
  13. job51_hlink/job51_hlink/__pycache__/__init__.cpython-37.pyc 151B
  14. job51_hlink/job51_hlink/__pycache__/items.cpython-37.pyc 1.01KB
  15. job51_hlink/job51_hlink/__pycache__/pipelines.cpython-37.pyc 1.34KB
  16. job51_hlink/job51_hlink/__pycache__/settings.cpython-37.pyc 486B
  17. job51_hlink/job51_hlink/items.py 1.63KB
  18. job51_hlink/job51_hlink/middlewares.py 3.52KB
  19. job51_hlink/job51_hlink/pipelines.py 1.24KB
  20. job51_hlink/job51_hlink/settings.py 3.15KB
  21. job51_hlink/job51_hlink/spiders/
  22. job51_hlink/job51_hlink/spiders/__init__.py 161B
  23. job51_hlink/job51_hlink/spiders/__pycache__/
  24. job51_hlink/job51_hlink/spiders/__pycache__/__init__.cpython-37.pyc 159B
  25. job51_hlink/job51_hlink/spiders/__pycache__/job51Hlink.cpython-37.pyc 4.52KB
  26. job51_hlink/job51_hlink/spiders/job51Hlink.py 6KB
  27. job51_hlink/myLog.log 965.14KB
  28. job51_hlink/scrapy.cfg 265B
  29. job51_hlink/shell命令.txt 994B

资源介绍:

使用Python Scrapy框架爬取51Job职位信息,包括职位所在地、所属公司、薪酬、招聘需求、福利待遇等等。
1、创建项目 scrapy startproject job51_link 2、自动生成Spider scrapy genspider job51Hlink 51job.com 3、运行爬虫 scrapy crawl job51Hlink 4、使用scrapy shell(需要指定用户代理) scrapy shell crapy shell -s USER_AGENT="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36" "https://jobs.51job.com/ningbo-yzq/108714907.html?s=01&t=0" 'beijing','tianjin','shanghai','chongqing','hebeisheng', 'shanxisheng','liaoningsheng','jilinsheng','heilongjiangsheng', 'jiangsusheng','zhejiangsheng','anhuisheng','fujiansheng', 'jiangxisheng','shandongsheng','henansheng','hubeisheng', 'hunansheng','guangdongsheng','hainansheng','sichuansheng', 'guizhousheng','yunnansheng','shaanxisheng','gansusheng', 'qinghaisheng','innermongolia','guangxi','tibet','ningxia', 'xinjiang'
100+评论
captcha