What's Changed
- Document chunking logic added by @amisha29sh in #39
- Document attachment put inside a transaction by @amisha29sh in #40
- Document chunking done with overlap by @amisha29sh in #42
- Start work on monolith by @agamble in #41
- Remove obsolete claude models by @agamble in #44
- Cache docker image builds by @agamble in #45
- Add grouping to model selector by provider by @agamble in #43
- Put chat inside a turbo_frame tag so that the whole page doesn't reload on each chat message by @agamble in #46
- bump rexml to fix security issue by @agamble in #50
- documentable_id from integer to uuid by @amisha29sh in #49
- Add encryption to chunk content so that it can only be read at the application layer by @agamble in #48
- Embeddings added for chunks by @amisha29sh in #47
- Move use_live_llm into the application config layer, it should be the default in production and is now toggleable in dev by @agamble in #51
- Add a stable ID to documents so they can be tracked and changed across revisions by @agamble in #52
- Add an 'ownership' table to represent relationships between users and documents by @agamble in #53
- File chunking in background task by @amisha29sh in #55
- Move chunking of attachments into uploaded file since that logic is specific to that implementation. by @agamble in #54
- Top 5 most relevant chunks by @amisha29sh in #58
- Add console audit logging by @agamble in #59
- Add ability to sync google docs into documents/chunks by @agamble in #56
- Bypass syncing if modified recently by @agamble in #60
- Refactor layouts into separate files by @agamble in #61
- Add a first revision of a rag search experience by @agamble in #62
- Add sidebar navigation. by @agamble in #63
- Gmail ingestor setup by @amisha29sh in #65
- Slightly improve RAG search by decoupling results page from empty search page by @agamble in #64
- User never assigned by @amisha29sh in #66
- Included gmail readonly scope by @amisha29sh in #68
- Begin to decouple the process of signing in from assigning permissions to integrations. by @agamble in #69
- Refactor settings integration into a reusable component by @agamble in #70
- Decouple gmail authorization from login by @agamble in #71
- Gmail ingest e2e by @amisha29sh in #72
- Do not override the credentials on sign-in by @agamble in #73
- Fetch Gmail list with pagination by @amisha29sh in #74
- Create multiple priority queues, and increase the priority of the generate response + search jobs by @agamble in #76
- Gmail query updated to pass 'after' parameter and further filter the query by @amisha29sh in #77
- Fix CSRF bug on authentication by @agamble in #75
- Fix small bug where the file payload was not persisted correctly by @agamble in #78
- Store the google drive metadata as JSONB rather than a string by @agamble in #80
- Cron job for email sync by @amisha29sh in #81
- Allow for regular embedding search over the results. by @agamble in #79
- Change gmail to persist message metadata as an unencrypted JSON rather than an encrypted string. by @agamble in #83
- Dropzone allow multiple files by default by @amisha29sh in #84
- Move the syncing jobs into a shared namespace by @agamble in #85
- Parse and strip HTML from gmail messages by @agamble in #86
- Further improve the HTML sanitzation of gmail messages by @agamble in #87
- Fix bug in message ingestion where we would ignore some valid messages that had multiple 'parts'. by @agamble in #88
- Add gmail message previews in search results. by @agamble in #90
- Logging added for sync jobs by @amisha29sh in #89
- Allow for manually trigerring backfills from the settings page by @agamble in #91
- Key the sync log by the integration key rather than the class name by @agamble in #92
- Fix small bug with resync hover by @agamble in #93
- Sync integrations using log table by @amisha29sh in #95
- Add script to automatically generate secure encryption keys for the .env file by @agamble in #96
- Show the sync as in progress on the settings page when the sync job is running by @agamble in #94
New Contributors
- @amisha29sh made their first contribution in #39
Full Changelog: 0.0.1-alpha...0.0.2