Installing Python 3 + Scrapy on Ubuntu 16.04

You may prepare a Linux VM on laptop using VirtualBox.

For participants at Python 101 + Web Scraping on Python workshop, alternatively you can download a VirtualBox image from here.

Downloading software.

  1. Download Oracle VM VirtualBox
  2. Download Ubuntu Server 16.04.02 LTS 64-bit
    1. How to verify Ubuntu ISO image
    2. $ md5 ubuntu-16.04.2-server-amd64.iso
      MD5 (ubuntu-16.04.2-server-amd64.iso) = 2bce60d18248df9980612619ff0b34e6
  3. Optional Download JetBrains PyCharm Community Edition
English is suggested for system language, and Python 3 is default version of python software on Ubuntu Server 16.04. I suggests to install standard system utilities and OpenSSH server at Software Selection part during VM creation & installation.

After we created a VM successfully, we update installed software packages and installs other require program as root user.

$ sudo su –
$ apt update; apt upgrade
$ apt install virtualenv python3-pip libssl-dev
$ exit

As normal user:
[email protected]$ mkdir ~/env
[email protected]$ virtualenv –python=python3 ~/env/scrapy
[email protected]$ source ~/env/scrapy/bin/activate
(scrapy) [email protected]$ pip3 install scrapy

Sammy Fung

The President at Open Source Hong Kong, an open source developer, a Mozilla Rep, a member at GNOME Asia committee and Python Software Foundation, and the blogger at sammy.hk.

Leave a Reply

Your email address will not be published. Required fields are marked *