GitHub - mdinacci/careers-crawler: Scrape careers.stackoverflow.com to find out the most required technologies by employers.

mdinacci / careers-crawler Public

Notifications You must be signed in to change notification settings
Fork 2
Star 2

Scrape careers.stackoverflow.com to find out the most required technologies by employers.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 19 Commits
css		css
js		js
json		json
README		README
countrylist.rb		countrylist.rb
countrylist.txt		countrylist.txt
cumulus.html		cumulus.html
index.html		index.html
job.rb		job.rb
jobs.dump.gz		jobs.dump.gz
objectstore.rb		objectstore.rb
proxy.php		proxy.php
raw_data.csv		raw_data.csv
runme.rb		runme.rb
spider.rb		spider.rb

Repository files navigation

Careers Crawler

Scrape the contents of careers.stackoverflow.com and make pretty graphs using the Google Visualization API.
Just run runme.rb, it will generate json files ready to be fed to the google visualization api. 
It requires nokogiri.