Azure-RAI-Hax

Azure Responsible AI hackathon - AI Studio GenAI evalution metrics and Azure Machine Learning RAI dashboard.

This repo provides data & scenarios with walkthrough, and agenda, to be used at a hackathon to learn Microsoft Responsible AI tooling.

QUICKSTART - I want to hack now!

Get started: Choose scenario 1 or 2. You can do both, in whatever order you like.

• Scenario 1 - RAI dashboard in Azure ML
• Scenario 2 - GenAI Evaluation in AI Studio

GOAL with this hackathon "Azure RAI Hax"

• Learn RAI tooling
• Networking with fellow peers
• Have fun doing it

AGENDA "Live agenda"

"Live" agenda

Hackathon- more info

SCENARIOS & DATA

Scenario 1 - Responsible AI Dashboard and Scorecard i Azure machine learning for: TABULAR, TEXT, IMAGES

See instructions: ./instructions/scenarios/scenario-1-rai-dashboard.md

Scenario 2 - Generative AI evaluation in AI studio with RAG for: Chatbots, GenAI solutions

See instructions: ./instructions/scenarios/scenario-2-genai-evaluation.md

DATA

• PRODUCT DATA for "on your data", e.g. RAG to create index on: ./data/scenario-2-genai/3-product-info/
• CUSTOMER DATA for "on your data", e.g. RAG to create index on: ./data/scenario-2-genai/1-customer-info/
• EVALUATION DATA: data/scenario-2-genai/6-evaluation-jsonl