COSCUP 2014

July 19-20 (Saturday-Sunday), 2014

Sammy Fung conducted a Software Technology and Devloping talk “Scrapy: DIY creating machine-readable data we need before data open” and a Lightning talk “Open Source Job Board” in COSCUP 2014 Taipei.

Website: https://coscup.org/2014/en/

Post Event report: https://sammy.hk/coscup-2014/

Scrapy: DIY creating machine-readable data we need before data open

Abstract

Scrapy is a open source python web scraping framework. Nowaday, many information are still not available in open data or machine-readable data format in the world. Open data movements are still a very beginning in some countries, and it is still lack of open data datasets in Hong Kong, so Sammy develops web scraper programs for 12+ years, and starts to release few open source web scraper programs since 2012, such as weather data web scrapers, air quality data web scrapers.

In this presentation, with Sammy’s open source web scraping / open data projects, Sammy will introduce how to write python codes to use scrapy and django to scrap the web, to produce machine-readable data or even open data.

Weather data web scraper – https://github.com/sammyfung/hk0weather 

Air quality data web scraper https://github.com/sammyfung/hkaqhi

Biography

Sammy is a python developer in Hong Kong and also a startup person. He is founder of some open source communities (HKLUG, Open Source Hong Kong) in Hong Kong. He is also participating in GNOME, Mozilla, Open Data, other Open Source communities over 17+ years.

Sammy Fung

The President at Open Source Hong Kong, the blogger at sammyfun.com, an open source developer, a Mozilla Rep, the lead of GNOME Asia committee and the contributing member of Python Software Foundation.

Leave a Reply

Your email address will not be published. Required fields are marked *