Majority of Colnect links aren't crawled at all

[dfernandezm]

Task

Lots of messages in logs of crawler job similar to the following:

[WARNING] Cannot find data in url https://colnect.com/en/banknotes/series/country/442-China

https://cloudlogging.app.goo.gl/rsYYxULnpgHepCbz5

For example: https://colnect.com/en/banknotes/series/country/17-Bahrain

Ideally a test should be written to avoid situations like this where many urls cannot be written. Checking the Cloud Storage bucket, what is in there is very few JSON files,

https://console.cloud.google.com/storage/browser/moneycol-import/colnect/01-11-2022?pageState=(%22StorageObjectListTable%22:(%22f%22:%22%255B%255D%22))&project=moneycol&prefix=&forceOnObjectsSortingFiltering=false

Acceptance criteria

• All countries listed should be crawled properly

Definition of Done

1. • Current tests pass
2. • New tests added
3. • Pull Request and self review
4. • Clean build
5. • Parent story linked