README.md

README

TODO:

• Create volumes for Codegemma & Phi3 RAG
• Finish fleshing out agentic logic via LangChain in Streamlit app.py
• Rework password & auth
• Add in RBAC

Overview

This project is aimed at creating a local, Dockerized environment for ML and DevOps projects. In order to maintain a robust security posture, I intend to integrate +1 of the following: Renovate, DependaBot, Trivy, and Copa

Running the Environment

docker-compose run --build

Endpoints

• Ollama: curl -X POST http://localhost:11434/api/generate -d '{ "model": "phi3:medium", "prompt": "What is the capital of Zimbabwe?" }'
  • Running a new model: docker exec -it ollama ollama run llama3
• Neo4j: http://localhost:7474 (default http endpoint)

References

General Dev References

• .gitignore from GitHub: https://github.com/github/gitignore/tree/main
• Create an automatically updating CHANGELOG
• CloudFlared registry key on Windows host: [HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\EventLog\Application\Cloudflared]
• To get the dependencies for a particular Python module: pip show <module_name>
• Creating new certificates for TLS: openssl req -x509 -nodes -days 365 -newkey rsa:2048 -keyout ./Nginx/certificates/dev.elatedmaniac.io.key -out ./Nginx/certificates/dev.elatedmaniac.io.crt -subj "/C=GR/ST=Attica/L=Athens/O=Olympus/OU=Gods/CN=dev.elatedmaniac.io"
• Using Mermaid in Drawio: https://www.drawio.com/blog/mermaid-diagrams
• Converting fonts to other formats
• Button styling

Security

• OAuth + Jupyter: https://tljh.jupyter.org/en/latest/howto/auth/google.html

Networking

• Explanation of Nginx as a reverse-proxy: https://medium.com/globant/understanding-nginx-as-a-reverse-proxy-564f76e856b2
• HTTP/2 in Nginx: https://www.tutorialspoint.com/how-to-enable-http2-0-in-nginx

ML/ AI Datasets and Things I Found Helpful

• StackOverflow dataset
• AI profile search platform
• Ollama Modelfile parameters

Docker Images

• Draw.io
• Nginx
• Neo4J
• Nvidia CUDA & Jupyter
• Ollama
• Trivy