3. 什麼是網路爬蟲?
A Web crawler is an Internet bot that systematically
browses the World Wide Web, typically for the purpose
of Web indexing. A Web crawler may also be called a Web
spider.(From wiki)
10. 1.創建新的scrapy project
$ scrapy startproject <project_name>
scrapy.cfg: the project configuration file.
tutorial/:the project’s python module.
items.py: the project’s items file.
pipelines.py : the project’s pipelines file.
setting.py : the project’s setting file.
spiders/ : a directory where you’ll later put your spiders.