Demo: RAG service

[nerdalert]

Demo APIs for a basic RAG service.

• Add /collections endpoint: Lists all existing collections in the Milvus vector database.
• Add /collections/{collection_name} DELETE endpoint: Deletes a specified collection from the Milvus vector database.
• Add /collections/{collection_name}/documents/file endpoint: Converts and Ingests a document file into the specified Milvus collection after conversion.
• Add /collections/{collection_name}/documents/url endpoint: Converts and Ingests a document from a URL into the specified Milvus collection after conversion.
• Add /collections/{collection_name}/query endpoint: Queries a specified collection.

Example curl commands:

# Ingest/Convert a URL
curl -X POST "http://localhost:8000/collections/demo_collection/documents/http" \
-H "Content-Type: application/json" \
-d '{
  "http_source": {
    "url": "https://arxiv.org/pdf/2206.01060",
    "headers": {}
  }
}'


# Ingest/Convert a file
curl -X POST "http://localhost:8000/collections/demo_collection/documents/file" \
-F "file=@/Users/brent/code/docling/docling-serve/Amazon-com-Inc-2023-Annual-Report.pdf"



### Query a collection:
curl -X POST "http://127.0.0.1:8000/collections/demo_collection/query" -H "Content-Type: application/json" -d '{
      "question": "What are the content of the PDF?"
    }'


# List collections
curl -X GET "http://127.0.0.1:8000/collections"


# Delete a collection
curl -X DELETE "http://127.0.0.1:8000/collections/demo_collection2"

[nerdalert]

A demo with an instructlab UI can be viewed here instructlab/ui#287