Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tile fix sign off #11

Merged
merged 118 commits into from
Aug 22, 2024
Merged

Tile fix sign off #11

merged 118 commits into from
Aug 22, 2024

Conversation

tileintel
Copy link
Collaborator

Description

The summary of the proposed changes as long as the relevant motivation and context.

Issues

List the issue or RFC link this PR is working on. If there is no such link, please mark it as n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

siddhivelankar23 and others added 30 commits August 22, 2024 21:36
@siddhivelankar23
add data classes for multimodality
e47299d
@siddhivelankar23
add bridgetower_custom.py
93c3e45 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add MMEmbeddings.py
af5e7c5 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add __init__.py
1419efd 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add Dockerfile
d2a6ea7 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add docker_compose_embedding.yaml
b14e77e 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add mm_embedding.py
e6f584e 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add requirements.txt
cf8534f 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add docs to init
30748a6 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
redefine global vars
aae0549 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
clean up
dcf060b 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add EmbedDoc1024
3bfae49 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
add EmbedDoc1024
f9c360f 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
update microservice with EmbedDoc1024
479693d 
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
remove SearchedMultimodalDoc
2df207b 
Signed-off-by: siddhivelankar23 <[email protected]>
@yogeshmpandey @siddhivelankar23
Added support for Unified Port, GET/DELETE endpoints in pgvector (ope…
08618f8 
…a-project#444)

Signed-off-by: Yogesh <[email protected]>
Co-authored-by: Yogesh <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@ZePan110 @pre-commit-ci @siddhivelankar23
Fix validation failure without exit. (opea-project#460)
51c6e84 
* Fix validation failure without exit.

Signed-off-by: zepan <[email protected]>

* Change validate log.

Signed-off-by: zepan <[email protected]>

* Fix validation failure without exit.

Signed-off-by: zepan <[email protected]>

* Change validate log.

Signed-off-by: zepan <[email protected]>

* Change validate log.

Signed-off-by: zepan <[email protected]>

* Fix issue for reranking-langchain-mosec.

Signed-off-by: zepan <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix script issue

Signed-off-by: zepan <[email protected]>

---------

Signed-off-by: zepan <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: siddhivelankar23 <[email protected]>
@lianhao @siddhivelankar23
whisper: Fix container build failure (opea-project#470)
6f5f6f3 
Signed-off-by: Lianhao Lu <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@letonghan @siddhivelankar23
Update Milvus docker-compose.yaml (opea-project#459)
6866aed 
Signed-off-by: letonghan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@letonghan @siddhivelankar23
Refine robustness of Dataprep Redis (opea-project#463)
a61b503 
Signed-off-by: letonghan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@chensuyue @siddhivelankar23
clean local images before test (opea-project#471)
3bf6d40 
* clean test images before test

Signed-off-by: chensuyue <[email protected]>

* add --no-cache for image build

Signed-off-by: chensuyue <[email protected]>

---------

Signed-off-by: chensuyue <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@ZePan110 @siddhivelankar23
Fix embeddings_langchain-mosec issue. (opea-project#473)
4d80cc8 
Signed-off-by: zepan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@ganesanintel @siddhivelankar23
Address test case failure (opea-project#462)
d0ff2c8 
Signed-off-by: V, Ganesan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@letonghan @siddhivelankar23
Fix Dataprep qdrant issues and add Test Script (opea-project#474)
15dfa55 
Signed-off-by: letonghan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@wangkl2 @siddhivelankar23
Refine the instructions to run the retriever example with qdrant (ope…
bc21ae1 
…a-project#442)

Signed-off-by: Wang, Kai Lawrence <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@rbrugaro @pre-commit-ci @siddhivelankar23
fix HuggingFaceEmbedding deprecated in favor of HuggingFaceInferenceA…
5aafc23 
…PIEmbedding (opea-project#466)

* Fix HuggingFaceEmbedding deprecated in favor of HuggingFaceInferenceAPIEmbedding

Signed-off-by: rbrugaro <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: rbrugaro <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: siddhivelankar23 <[email protected]>
@ZePan110 @siddhivelankar23
update test scripts and bug fix (opea-project#464)
9016390 
Signed-off-by: chensuyue <[email protected]>
Signed-off-by: zepan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
Add output evaluation for guardrails (opea-project#332)
b9dd8ad 
* add single query input/output guardrails

Signed-off-by: Tyler Wilbers <[email protected]>

* removed comment

Signed-off-by: Tyler Wilbers <[email protected]>

---------

Signed-off-by: Tyler Wilbers <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@lvliang-intel @siddhivelankar23
Revert max_new_tokens to 1024 (opea-project#479)
386cc7e 
Signed-off-by: lvliang-intel <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@letonghan @siddhivelankar23
fix empty content issue (opea-project#476)
9f92b08 
Signed-off-by: letonghan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
tileintel and others added 29 commits August 22, 2024 21:36
@tileintel @siddhivelankar23
Update README and change environment variable name
b5fd904 
Signed-off-by: siddhivelankar23 <[email protected]>
@tileintel @siddhivelankar23
add test for embedding
9044dcc 
Signed-off-by: siddhivelankar23 <[email protected]>
@tileintel @siddhivelankar23
fix test
88eaa10 
Signed-off-by: siddhivelankar23 <[email protected]>
@tileintel @siddhivelankar23
fix test
35d4dd7 
Signed-off-by: siddhivelankar23 <[email protected]>
@tileintel @siddhivelankar23
fix test
ed47aca 
Signed-off-by: siddhivelankar23 <[email protected]>
@xuechendi @pre-commit-ci @siddhivelankar23
Add Assistant API for agent (opea-project#490)
74253b7 
* Add assistants api support

Signed-off-by: Chendi.Xue <[email protected]>

* update UT to match new port definition

Signed-off-by: Chendi.Xue <[email protected]>

* rebase

Signed-off-by: Chendi.Xue <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix gramma in Test

Signed-off-by: Chendi.Xue <[email protected]>

---------

Signed-off-by: Chendi.Xue <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: siddhivelankar23 <[email protected]>
@XuehaoSun @siddhivelankar23
fix freeze workflow (opea-project#522)
a3495f1 
Signed-off-by: Sun, Xuehao <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@letonghan @pre-commit-ci @siddhivelankar23
Fix Dataprep Potential Error in get_file (opea-project#540)
27441ba 
* fix get file error & refine logs

Signed-off-by: letonghan <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: letonghan <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: siddhivelankar23 <[email protected]>
@letonghan @siddhivelankar23
Support SearchedDoc input type in LLM for No Rerank Pipeline (opea-pr…
74e469d 
…oject#541)

Signed-off-by: letonghan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@ZailiWang @siddhivelankar23
Add dependency for pdf2image and OCR processing (opea-project#421)
7bb4cdf 
Signed-off-by: siddhivelankar23 <[email protected]>
@xuechendi @siddhivelankar23
Add local_embedding return 768 length to align with chatqna example (o…
be8cc01 
…pea-project#313)

Signed-off-by: Chendi.Xue <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@Spycsh @pre-commit-ci @siddhivelankar23
add telemetry doc (opea-project#536)
93ed628 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: siddhivelankar23 <[email protected]>
@BaoHuiling @pre-commit-ci @siddhivelankar23
Add video-llama LVM microservice under lvms (opea-project#495)
099dc19 
Signed-off-by: BaoHuiling <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@XuhuiRen @siddhivelankar23
Fix the data load issue for structured files (opea-project#505)
817489c 
Signed-off-by: XuhuiRen <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@XinyuYe-Intel @pre-commit-ci
@lkk12014402 @letonghan @siddhivelankar23
Add finetuning component (opea-project#502)
165013c 
Signed-off-by: Xinyu Ye <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lkk <[email protected]>
Co-authored-by: test <[email protected]>
Co-authored-by: root <[email protected]>
Co-authored-by: Letong Han <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@chensuyue @siddhivelankar23
add torchvision into requirements (opea-project#546)
2994231 
Signed-off-by: chensuyue <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
Rename test_multimodal_embeddings_langchain.sh to test_multimodal_emb…
8c81574 
…eddings_langchain_cpu.sh

Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
Create test_multimodal_embeddings_langchain_hpu.sh
016c893 
Signed-off-by: siddhivelankar23 <[email protected]>
@pre-commit-ci @siddhivelankar23
[pre-commit.ci] auto fixes from pre-commit.com hooks
4d1b525 
for more information, see https://pre-commit.ci
@ashahba @siddhivelankar23
Use Gaudi base images from Dockerhub (opea-project#526)
5f2e740 
* Use Gaudi base images from Dockerhub

Signed-off-by: Abolfazl Shahbazi <[email protected]>

* Fixing the malformed tag

Signed-off-by: Abolfazl Shahbazi <[email protected]>

* fix another malformed tag

Signed-off-by: Abolfazl Shahbazi <[email protected]>

---------

Signed-off-by: Abolfazl Shahbazi <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@qgao007 @pre-commit-ci
@ashahba @siddhivelankar23
Add toxicity detection microservice (opea-project#338)
da60d70 
* Add toxicity detection microservice

Signed-off-by: Qun Gao <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Modification to toxicity plugin PR  (opea-project#432)

* changed microservice to use Service.GUARDRAILS and input/output to TextDoc

Signed-off-by: Tyler Wilbers <[email protected]>

* simplify dockerfile to use langchain

Signed-off-by: Tyler Wilbers <[email protected]>

* sort requirements

Signed-off-by: Tyler Wilbers <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Tyler Wilbers <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Minor SPDX header update (opea-project#434)

Signed-off-by: Abolfazl Shahbazi <[email protected]>

* Remove 'langsmith' per code review (opea-project#534)

Signed-off-by: Abolfazl Shahbazi <[email protected]>

* Add toxicity detection microservices with E2E testing

Signed-off-by: Qun Gao <[email protected]>

---------

Signed-off-by: Qun Gao <[email protected]>
Signed-off-by: Tyler Wilbers <[email protected]>
Signed-off-by: Abolfazl Shahbazi <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <[email protected]>
Co-authored-by: Tyler W <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@chensuyue @siddhivelankar23
update the requirements.txt for tts and asr (opea-project#550)
01fde41 
Signed-off-by: chensuyue <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@huiyan2021 @chensuyue @siddhivelankar23
Fix deps opea-project#568 (opea-project#542)
d8dd26e 
Co-authored-by: chen, suyue <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@letonghan @siddhivelankar23
Refine LLM for No Rerank (opea-project#551)
ec38f92 
Signed-off-by: letonghan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@Spycsh @siddhivelankar23
fix searchqna readme (opea-project#549)
f26d55d 
Signed-off-by: siddhivelankar23 <[email protected]>
@ashahba @siddhivelankar23
Remove redundant dependency from 'vllm-ray' comps (opea-project#548)
ec635a4 
Signed-off-by: Abolfazl Shahbazi <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
@tileintel @siddhivelankar23
change ImportModuleError into ImportError
107ba13 
Signed-off-by: siddhivelankar23 <[email protected]>
@pre-commit-ci @siddhivelankar23
[pre-commit.ci] auto fixes from pre-commit.com hooks
d9707ab 
for more information, see https://pre-commit.ci

Signed-off-by: siddhivelankar23 <[email protected]>
@siddhivelankar23
resolve conflict after rebase
a2b832e
@tileintel tileintel merged commit a557770 into main Aug 22, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.