Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Weaviate Auto Schema #42

Open
Tracked by #97
samos123 opened this issue Nov 28, 2022 · 2 comments
Open
Tracked by #97

Support Weaviate Auto Schema #42

samos123 opened this issue Nov 28, 2022 · 2 comments

Comments

@samos123
Copy link
Contributor

Currently the class has to be precreated in Weaviate for the Spark Connector to work. However, it might be possible to rely on auto schema creation instead, but this would require some changes to how inferSchema works in the Spark Connector: https://weaviate.io/developers/weaviate/current/schema/schema-configuration.html#auto-schema
@trengrj trengrj mentioned this issue Aug 1, 2023
Closed
7 tasks
@tickx-cegeka
Copy link

This would be a great addition still in 2024, could someone look at this again?

@hsm207
Copy link
Contributor

hsm207 commented May 29, 2024 •
edited
Loading

auto schema might not be a good idea. what if the doc to be ingested has an unexpected field?

maybe make it make it toggle-able? like, use it only for dev, and when go to prod, turn it off?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@samos123 @hsm207 @tickx-cegeka