Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: add additional schema strategies and make configurable #10

Open
pnadolny13 opened this issue Apr 12, 2023 · 0 comments
Open

feature: add additional schema strategies and make configurable #10

pnadolny13 opened this issue Apr 12, 2023 · 0 comments

Comments

@pnadolny13
Copy link
Contributor

Right now the tap always uses the "infer" strategy based on sample records to build a json schema with genson. From tap-mongodb theres 3 common strategies that we'd probably want to support:

The strategy to use for schema resolution. Defaults to 'raw'. The 'raw' strategy uses a relaxed schema using additionalProperties: true to accept the document as-is leaving the target to respect it. Useful for blob or jsonl. The 'envelope' strategy will envelope the document under a key named document. The target should use a variant type for this key. The 'infer' strategy will infer the schema from the data based on a configurable number of documents.

  • infer
  • raw
  • envelope
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant