Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added a Gradio UI for multi-modal inferencing using Llama 3.2 Vision/ #718

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Added a Gradio UI for multi-modal inferencing using Llama 3.2 Vision/ #718

wants to merge 13 commits into from
+164 −0

Commits on Oct 8, 2024

  1. added a file to start with Inferencing on llama3.2 vision using gradi… 

    …o UI
    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    0c985d8 View commit details
    Browse the repository at this point in the history

  2. Added basic LlamaInference class structure, model loading functionali… 

    …ty, image processing and text generation
    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    4053712 View commit details
    Browse the repository at this point in the history

  3. Implemented memory management to release GPU resources after inference

    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    22be586 View commit details
    Browse the repository at this point in the history

  4. Modified requirements.txt by adding the gradio dependency

    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b2f9655 View commit details
    Browse the repository at this point in the history

  5. Added instructions in README.md for using the Gradio UI

    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    19938dd View commit details
    Browse the repository at this point in the history

  6. Merge branch 'meta-llama:main' into main

    @himanshushukla12
    himanshushukla12 authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b94a340 View commit details
    Browse the repository at this point in the history

  7. Change Gradio -> gradio

    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c609a44 View commit details
    Browse the repository at this point in the history

  8. Added passing of Hugging-face token from the arguments

    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    750b499 View commit details
    Browse the repository at this point in the history

  9. Changed readme for usage of multimodal inferencing of gradio UI by pa… 

    …sssing hugigng-face token from the arguments
    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    3170c27 View commit details
    Browse the repository at this point in the history

  10. Changes the UI from textbox to chatbox with max_tokens, rop_k, temper… 

    …ature and top_p sliders there.
    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c0405b6 View commit details
    Browse the repository at this point in the history

  11. added the passing of hugging-face token from the argument

    @himanshushukla12
    himanshushukla12 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    6f7c028 View commit details
    Browse the repository at this point in the history

  12. Update README.md 

    Modified readme for new code for passing token via argument
    @himanshushukla12
    himanshushukla12 authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    a261aea View commit details
    Browse the repository at this point in the history

  13. Update README.md 

    Used small case "g" in gradio
    @himanshushukla12
    himanshushukla12 authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    597e44e View commit details
    Browse the repository at this point in the history