You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The CrawlerSource object holds information and methods about sources.
Right now, we have a separate function which takes that source to generate a collection of features (via ijson and a download function). Because that code will never be used without access to a specific feature, I believe it would be better to turn it into a method on the CrawlerSource object.
The main question here is whether to download the entire JSON data from the source, then parse the local file, or whether it is safe to create Feature instances from the network stream directly.
The
CrawlerSource
object holds information and methods about sources.Right now, we have a separate function which takes that source to generate a collection of features (via
ijson
and a download function). Because that code will never be used without access to a specific feature, I believe it would be better to turn it into a method on theCrawlerSource
object.The text was updated successfully, but these errors were encountered: