v0.7.0

What's Changed

• Proxy support by @gosom in #6

Full Changelog: v0.6.1...v0.7.0

What's Changed

• Proxy support by @gosom in #6

Full Changelog: v0.6.1...v0.7.0

v0.6.0

• Updates playwright to latest version
• Adds option when crawling using playwright browser to disable images

v0.5.3

adds option to process a job even if the fetching of the url failed

v0.5.2

Full Changelog: v0.5.1...v0.5.2

v0.5.0

Adds option to exit on inactivity and prints simple stats

Full Changelog: v0.4.3...v0.5.0

v.0.4.3

What's Changed

• Adds automatic cookie support by @gosom in #2

Full Changelog: v0.4.2...v0.4.3

v0.4.2

Full Changelog: v0.4.1...v0.4.2

v0.4.0

Note: Slightly incompatible

What's Changed

• lints the code by @gosom in #1
• API is slightly different:
  • the Job Process method accepts a point to a scrapemate.Response
  • a few other functions now accept a pointer to the response object
  • HttpFetcher -> HTTPFetcher
  • HtmlParser -> HTMLParser
  • UrlParams -> URLParams

High Level API

Introduces a simpler and higher level api to reduce the boilerplate code we have to write to start a scraper

v0.1.1

updates README