Due to the difficulties encountered in installing Scrapy under Windows python3, I have written about the challenges I faced in a blog to help others as well as myself.
Of course, it is also because Scrapy now supports python3.
This is the official website of Scrapy
System Environment
- Windows 10 environment
- Python 3.5.1 (download here https://www.python.org/downloads/windows/)
There are some prerequisites to handle before installing Scrapy.
Prerequisites
-
http://www.lfd.uci.edu/~gohlke/pythonlibs/#lxml
- Download the lxml version that matches your version
- Below is an example based on my current environment
pip3 install lxml-3.6.0-cp35-cp35m-win32.whl -
https://sourceforge.net/projects/pywin32/files/pywin32/Build 220/
- Download the exe file that matches your environment
- Below is an example based on my current environment
easy_install pywin32-220.win32-py3.5.exe
Once everything is ready, you can start installing Scrapy.
- Only Scrapy version 1.1 and above support python3
pip install scrapy