Skip to content

Releases: webrecorder/browsertrix-crawler

Browsertrix Crawler v1.5.0

01 Feb 06:31
Compare
Choose a tag to compare

What's Changed

  • Autoclick Support by @ikreymer in #729
  • clear out core dumps to avoid using up volume space: by @ikreymer in #740
  • Retry Failed Pages + Ignore Hashtags in Redirect Check by @ikreymer in #739
  • Retry support and additional fixes by @ikreymer in #743
  • Apply exclusions to redirects by @ikreymer in #745
  • if uploading wacz files, compute waczfile name on load to be able to … by @ikreymer in #748
  • pages redis: include 'depth', 'seed' and 'favIconUrl' in page data added to redis by @ikreymer in #749
  • hang protection: wrap remaining evaluate() calls to avoid rare hangs by @ikreymer in #750

Full Changelog: v1.4.2...v1.5.0

Browsertrix Crawler v1.5.0-beta.3

29 Jan 06:12
a00866b
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: v1.5.0-beta.2...v1.5.0-beta.3

Browsertrix Crawler v1.5.0-beta.2

16 Jan 23:51
5d9c62e
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: v1.4.2...v1.5.0-beta.2

Browsertrix Crawler v1.4.2

06 Jan 20:47
8714907
Compare
Choose a tag to compare

What's Changed

  • separate fetch api for autofetch behavior + additional improvements on partial responses: by @ikreymer in #736
  • Dependency Update for 1.4.2 by @ikreymer in #737

Full Changelog: v1.4.1...v1.4.2

Browsertrix Crawler v1.5.0-beta.1 (autoclick testing)

07 Dec 01:54
Compare
Choose a tag to compare

Fix bug in previous beta that incorrectly added autoclick

Full Changelog: v1.4.1...v1.5.0-beta.1

Browsertrix Crawler v1.5.0-beta.0 (autoclick testing)

06 Dec 23:18
Compare
Choose a tag to compare

Initial testing for autoclick behavior, always enabled.

Full Changelog: v1.4.1...v1.5.0-beta.0

Browsertrix Crawler v1.4.1

26 Nov 02:44
fb8ed18
Compare
Choose a tag to compare

What's Changed

  • package: pin @novnc/novnc to 1.4.0 to prevent accidental upgrades by @ikreymer in #727

Full Changelog: v1.4.0...v1.4.1

Browsertrix Crawler v1.4.0

25 Nov 08:54
Compare
Choose a tag to compare

What's Changed

  • Support loading custom behaviors from URLs and/or filepaths by @tw4l in #707
  • support custom css selectors for extracting links by @ikreymer in #689
  • Dependency Update by @ikreymer in #718
  • add disable-lazy-loading flag, should fix #699 by @ikreymer in #720
  • Support loading custom behaviors from git repo by @tw4l in #717
  • fix indexing of cookie header: by @ikreymer in #714
  • Ensure partial responses are not written by @ikreymer in #721
  • support removing range from query (via wabac.js 2.20.6): by @ikreymer in #724
  • Implemented option for FullPage screenshot after the behaviours have run by @fservida in #656
  • Dependency Update by @ikreymer in #725

New Contributors

Full Changelog: v1.3.5...v1.4.0

Browsertrix Crawler v1.4.0-beta.1

24 Nov 19:28
6bfa7d5
Compare
Choose a tag to compare
Pre-release

What's Changed

  • support removing range from query (via wabac.js 2.20.6): by @ikreymer in #724
  • Implemented option for FullPage screenshot after the behaviours have run by @fservida in #656
  • Dependency Update by @ikreymer in #725

New Contributors

Full Changelog: v1.4.0-beta.0...v1.4.0-beta.1

Browsertrix Crawler v1.4.0-beta.0

14 Nov 07:29
0b9cd71
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: v1.3.4...v1.4.0-beta.0