Skip to content

Commit

Permalink
Merge pull request #35 from dusty-nv/20231020-walkthrough
Browse files Browse the repository at this point in the history
updated blogs
  • Loading branch information
dusty-nv authored Oct 20, 2023
2 parents c5975e5 + e3a997f commit ed74836
Show file tree
Hide file tree
Showing 3 changed files with 62 additions and 34 deletions.
49 changes: 28 additions & 21 deletions docs/community_articles.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,84 +5,91 @@ hide:

# Community Articles

Below, you'll find a collection of community articles showcasing the implementation of generative AIs on the Jetson platform.
Below, you'll find a collection of community articles showcasing the implementation of generative AI on the Jetson platform.


## <span class="blobMedium">Medium</span> `[10-02-2023]` [How to set up your Jetson device for LLM inference and fine-tuning](https://medium.com/@michaelyuan_88928/how-to-set-up-your-jetson-device-for-llm-inference-and-fine-tuning-682e36444d43){:target="_blank"}
## <span class="blobNvidia">NVIDIA</span> [Bringing Generative AI to Life with NVIDIA Jetson](https://developer.nvidia.com/blog/bringing-generative-ai-to-life-with-jetson/){:target="_blank"} <sup><small>(10-19-2023)</small></sup>

Follow this walkthrough of the Jetson AI Lab tutorials along with coverage of the latest features and advances coming to JetPack 6 and beyond:

<iframe width="640" height="360" src="https://www.youtube.com/embed/BAMOw7qlVXw" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>

> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://developer.nvidia.com/blog/bringing-generative-ai-to-life-with-jetson/](https://developer.nvidia.com/blog/bringing-generative-ai-to-life-with-jetson/){:target="_blank"}

## <span class="blobMedium">Medium</span> [How to set up your Jetson device for LLM inference and fine-tuning](https://medium.com/@michaelyuan_88928/how-to-set-up-your-jetson-device-for-llm-inference-and-fine-tuning-682e36444d43){:target="_blank"} <sup><small>(10-02-2023)</small></sup>

Michael Yuan's guide demonstrating how to set up the <span class="blobDarkGreen4">Jetson AGX Orin 64GB Developer Kit</span> specifically for large language model (LLM) inference, highlighting the crucial role of GPUs and the cost-effectiveness of the Jetson AGX Orin for LLM tasks.

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://medium.com/@michaelyuan_88928/how-to-set-up-your-jetson-device-for-llm-inference-and-fine-tuning-682e36444d43](https://medium.com/@michaelyuan_88928/how-to-set-up-your-jetson-device-for-llm-inference-and-fine-tuning-682e36444d43){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://medium.com/@michaelyuan_88928/how-to-set-up-your-jetson-device-for-llm-inference-and-fine-tuning-682e36444d43](https://medium.com/@michaelyuan_88928/how-to-set-up-your-jetson-device-for-llm-inference-and-fine-tuning-682e36444d43){:target="_blank"}

## <span class="blobHackster">Hackster</span> `[09-16-2023]` [Getting Started with AI on Nvidia Jetson AGX Orin Dev Kit](https://www.hackster.io/shahizat/getting-started-with-ai-on-nvidia-jetson-agx-orin-dev-kit-5a55b5){:target="_blank"}
## <span class="blobHackster">Hackster</span> [Getting Started with AI on Nvidia Jetson AGX Orin Dev Kit](https://www.hackster.io/shahizat/getting-started-with-ai-on-nvidia-jetson-agx-orin-dev-kit-5a55b5){:target="_blank"} <sup><small>(09-16-2023)</small></sup>

Nurgaliyev Shakhizat demonstrates `llamaspeak` on <span class="blobDarkGreen4">Jetson AGX Orin 64GB Developer Kit</span>.

![](https://hackster.imgix.net/uploads/attachments/1634209/_YUIZvPChHh.blob?auto=compress%2Cformat&w=640&h=458&fit=min)

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://www.hackster.io/shahizat/getting-started-with-ai-on-nvidia-jetson-agx-orin-dev-kit-5a55b5](https://www.hackster.io/shahizat/getting-started-with-ai-on-nvidia-jetson-agx-orin-dev-kit-5a55b5){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://www.hackster.io/shahizat/getting-started-with-ai-on-nvidia-jetson-agx-orin-dev-kit-5a55b5](https://www.hackster.io/shahizat/getting-started-with-ai-on-nvidia-jetson-agx-orin-dev-kit-5a55b5){:target="_blank"}

## <span class="blobHackster">Hackster</span> `[09-13-2023]` [New AI Tool Is Generating a Lot of Buzz](https://www.hackster.io/news/new-ai-tool-is-generating-a-lot-of-buzz-3cc5f23a3598){:target="_blank"}
## <span class="blobHackster">Hackster</span> [New AI Tool Is Generating a Lot of Buzz](https://www.hackster.io/news/new-ai-tool-is-generating-a-lot-of-buzz-3cc5f23a3598){:target="_blank"} <sup><small>(09-13-2023)</small></sup>

Nick Bild provides an insightful introduction to the Jetson Generative AI Playground.

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://www.hackster.io/news/new-ai-tool-is-generating-a-lot-of-buzz-3cc5f23a3598](https://www.hackster.io/news/new-ai-tool-is-generating-a-lot-of-buzz-3cc5f23a3598){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://www.hackster.io/news/new-ai-tool-is-generating-a-lot-of-buzz-3cc5f23a3598](https://www.hackster.io/news/new-ai-tool-is-generating-a-lot-of-buzz-3cc5f23a3598){:target="_blank"}

## <span class="blobJetsonHacks">JetsonHacks</span> `[09-04-2023]` [Use These! Jetson Docker Containers Tutorial](https://jetsonhacks.com/2023/09/04/use-these-jetson-docker-containers-tutorial/){:target="_blank"}
## <span class="blobJetsonHacks">JetsonHacks</span> [Use These! Jetson Docker Containers Tutorial](https://jetsonhacks.com/2023/09/04/use-these-jetson-docker-containers-tutorial/){:target="_blank"} <sup><small>(09-04-2023)</small></sup>

JetsonHacks has a in-depth tutorial on how to use `jetson-containers` and even show `text-generation-webui` and `stable-diffusion-webui` containers in action!

<iframe width="640" height="360" src="https://www.youtube.com/embed/HlH3QkS1F5Y" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://jetsonhacks.com/2023/09/04/use-these-jetson-docker-containers-tutorial/](https://jetsonhacks.com/2023/09/04/use-these-jetson-docker-containers-tutorial/){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://jetsonhacks.com/2023/09/04/use-these-jetson-docker-containers-tutorial/](https://jetsonhacks.com/2023/09/04/use-these-jetson-docker-containers-tutorial/){:target="_blank"}

## <span class="blobHackster">Hackster</span> `[08-17-2023]` [LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui](https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070){:target="_blank"}
## <span class="blobHackster">Hackster</span> [LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui](https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070){:target="_blank"} <sup><small>(08-17-2023)</small></sup>

Paul DeCarlo demonstrates 13B and 70B parameter LLama 2 models running locally on <span class="blobDarkGreen4">Jetson AGX Orin 64GB Developer Kit</span>.

![](https://hackster.imgix.net/uploads/attachments/1621246/img_1231_RqW30jjm1q.gif?auto=format%2Ccompress&gifq=35&w=640&h=458&fit=min&fm=mp4)

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070](https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070](https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070){:target="_blank"}

## <span class="blobHackster">Hackster</span> `[08-14-2023]` [Running a ChatGPT-Like LLM-LLaMA2 on a Nvidia Jetson Cluster](https://www.hackster.io/shahizat/running-a-chatgpt-like-llm-llama2-on-a-nvidia-jetson-cluster-cbc7d4){:target="_blank"}
## <span class="blobHackster">Hackster</span> [Running a ChatGPT-Like LLM-LLaMA2 on a Nvidia Jetson Cluster](https://www.hackster.io/shahizat/running-a-chatgpt-like-llm-llama2-on-a-nvidia-jetson-cluster-cbc7d4){:target="_blank"} <sup><small>(08-14-2023)</small></sup>

Discover how to run a LLaMA-2 7B model on an NVIDIA Jetson cluster in this insightful tutorial by Nurgaliyev Shakhizat.

![](https://hackster.imgix.net/uploads/attachments/1621367/_NioNNBZrnm.blob?auto=compress%2Cformat&w=640&h=458&fit=min)

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://www.hackster.io/shahizat/running-a-chatgpt-like-llm-llama2-on-a-nvidia-jetson-cluster-cbc7d4](https://www.hackster.io/shahizat/running-a-chatgpt-like-llm-llama2-on-a-nvidia-jetson-cluster-cbc7d4){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://www.hackster.io/shahizat/running-a-chatgpt-like-llm-llama2-on-a-nvidia-jetson-cluster-cbc7d4](https://www.hackster.io/shahizat/running-a-chatgpt-like-llm-llama2-on-a-nvidia-jetson-cluster-cbc7d4){:target="_blank"}

## <span class="blobJetsonHacks">JetsonHacks</span> `[08-07-2023]` [Speech AI on NVIDIA Jetson Tutorial](https://jetsonhacks.com/2023/08/07/speech-ai-on-nvidia-jetson-tutorial/){:target="_blank"}
## <span class="blobJetsonHacks">JetsonHacks</span> [Speech AI on NVIDIA Jetson Tutorial](https://jetsonhacks.com/2023/08/07/speech-ai-on-nvidia-jetson-tutorial/){:target="_blank"} <sup><small>(08-07-2023)</small></sup>

JetsonHacks gives a nice introduction to NVIDIA RIVA SDK and demonstrate its automated speech recognition (ASR) capability on <span class="blobLightGreen4">Jetson Orin Nano Developer Kit</span>.

<iframe width="640" height="360" src="https://www.youtube.com/embed/FZWgQvI7MxE" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://jetsonhacks.com/2023/08/07/speech-ai-on-nvidia-jetson-tutorial/](https://jetsonhacks.com/2023/08/07/speech-ai-on-nvidia-jetson-tutorial/){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://jetsonhacks.com/2023/08/07/speech-ai-on-nvidia-jetson-tutorial/](https://jetsonhacks.com/2023/08/07/speech-ai-on-nvidia-jetson-tutorial/){:target="_blank"}

## <span class="blobHackster">Hackster</span> `[07-12-2023]` [LLM based Multimodal AI w/ Azure Open AI & NVIDIA Jetson](https://www.hackster.io/pjdecarlo/llm-based-multimodal-ai-w-azure-open-ai-nvidia-jetson-135ff2){:target="_blank"}
## <span class="blobHackster">Hackster</span> [LLM based Multimodal AI w/ Azure Open AI & NVIDIA Jetson](https://www.hackster.io/pjdecarlo/llm-based-multimodal-ai-w-azure-open-ai-nvidia-jetson-135ff2){:target="_blank"} <sup><small>(07-12-2023)</small></sup>

Learn how to harness the power of Multimodal AI by running Microsoft JARVIS on an <span class="blobDarkGreen4">Jetson AGX Orin 64GB Developer Kit</span>, enabling a wide range of AI tasks with ChatGPT-like capabilities, image generation, and more, in this comprehensive guide by Paul DeCarlo.

![](https://hackster.imgix.net/uploads/attachments/1610773/2023-07-12_21-40-55_YHOalYh1xU.gif?auto=format%2Ccompress&gifq=35&w=640&h=458&fit=min&fm=mp4)

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://www.hackster.io/pjdecarlo/llm-based-multimodal-ai-w-azure-open-ai-nvidia-jetson-135ff2](https://www.hackster.io/pjdecarlo/llm-based-multimodal-ai-w-azure-open-ai-nvidia-jetson-135ff2){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://www.hackster.io/pjdecarlo/llm-based-multimodal-ai-w-azure-open-ai-nvidia-jetson-135ff2](https://www.hackster.io/pjdecarlo/llm-based-multimodal-ai-w-azure-open-ai-nvidia-jetson-135ff2){:target="_blank"}

## <span class="blobHackster">Hackster</span> `[06-13-2023]` [How to Run a ChatGPT-Like LLM on NVIDIA Jetson board](https://www.hackster.io/shahizat/how-to-run-a-chatgpt-like-llm-on-nvidia-jetson-board-41fd79){:target="_blank"}
## <span class="blobHackster">Hackster</span> [How to Run a ChatGPT-Like LLM on NVIDIA Jetson board](https://www.hackster.io/shahizat/how-to-run-a-chatgpt-like-llm-on-nvidia-jetson-board-41fd79){:target="_blank"} <sup><small>(06-13-2023)</small></sup>

Nurgaliyev Shakhizat explores voice AI assistant on Jetson using FastChat and VoskAPI.

![](https://hackster.imgix.net/uploads/attachments/1599748/_51IDaX5X5J.blob?auto=compress%2Cformat&w=640&h=458&fit=min)

> Link :fontawesome-solid-arrow-up-right-from-square: : [https://www.hackster.io/shahizat/how-to-run-a-chatgpt-like-llm-on-nvidia-jetson-board-41fd79](https://www.hackster.io/shahizat/how-to-run-a-chatgpt-like-llm-on-nvidia-jetson-board-41fd79){:target="_blank"}
> :fontawesome-solid-arrow-up-right-from-square: &nbsp; [https://www.hackster.io/shahizat/how-to-run-a-chatgpt-like-llm-on-nvidia-jetson-board-41fd79](https://www.hackster.io/shahizat/how-to-run-a-chatgpt-like-llm-on-nvidia-jetson-board-41fd79){:target="_blank"}
22 changes: 18 additions & 4 deletions docs/css/colors.css
Original file line number Diff line number Diff line change
@@ -1,15 +1,25 @@
[data-md-color-scheme="playful-purple"] {

--md-accent-fg-color: #b12bff;
--md-accent-fg-color--light: hsl(278, 100%, 78%);
--md-accent-bg-color: #ffffff;
--md-accent-fg-color--rgb: 177, 43, 255; /* #b12bff */
--md-accent-fg-color--hsl: 278, 100%, 58%;
--md-accent-fg-color: hsl(var(--md-accent-fg-color--hsl));

--md-accent-fg-color--dark-hsl: 278, 100%, 51%;
--md-accent-fg-color--dark: hsl(var(--md-accent-fg-color--dark-hsl));

--md-accent-fg-color--light-rgb: 214, 143, 255; /* D68FFF */
--md-accent-fg-color--light-hsl: 278, 100%, 78%;
--md-accent-fg-color--light: hsla(var(--md-accent-fg-color--light-hsl), 1.0);

--md-accent-bg-color--rgb: 255, 255, 255; /* #ffffff */
--md-accent-bg-color: rgb(var(--md-accent-bg-color--rgb));

--md-primary-fg-color: hsl(210, 100%, 40%);
--md-primary-fg-color--light: hsl(210, 100%, 50%);
--md-primary-fg-color--dark: hsl(210, 100%, 20%);

--md-mermaid-node-bg-color: #e3f5c5;
--md-mermaid-node-fg-color: #518000;
--md-mermaid-node-fg-color: #518000;
--md-default-fg-color--lightest: #f9fff2;
}

Expand Down Expand Up @@ -181,6 +191,10 @@ a.nv-buy-link:hover,.load-buy-link:hover {
background: #292929; color: #fff; font-size: 0.8em; border-radius: 0.1em; padding-left: 0.3em; padding-right: 0.3em; margin: 0.2em;
}

.blobNvidia {
background: #76b900; color: #fff; font-size: 0.8em; border-radius: 0.1em; padding-left: 0.3em; padding-right: 0.3em; margin: 0.2em;
}

.highlightYellow {
background: #ffc105;
border-radius: 0.5em;
Expand Down
25 changes: 16 additions & 9 deletions docs/overrides/home.html
Original file line number Diff line number Diff line change
Expand Up @@ -50,17 +50,24 @@
color: var(--md-primary-fg-color)
}

.tx-hero .md-button:focus,
.tx-hero .md-button:hover {
background-color: rgba(255,255,255,0.5);
color: var(--md-primary-fg-color);
border-color: var(--md-primary-fg-color);
}

.tx-hero .md-button--primary {
background-color: var(--md-accent-fg-color);
color: var(--md-accent-bg-color);
border-color: var(--md-accent-bg-color)
color: hsl(0, 0%, 96%);
border-color: hsl(0, 0%, 93%);
}

.tx-hero .md-button:focus,
.tx-hero .md-button:hover {
background-color: var(--md-accent-fg-color--light);
color: var(--md-default-fg-color);
border-color: var(--md-accent-bg-color)
.tx-hero .md-button--primary:focus,
.tx-hero .md-button--primary:hover {
background-color: var(--md-accent-fg-color--dark);
color: hsl(0, 0%, 99%);
border-color: hsl(0, 0%, 86%);
}

.feature-item h2 svg {
Expand Down Expand Up @@ -343,8 +350,8 @@ <h1> Generative AI at the Edge </h1>
<a href="{{ page.next_page.url | url }}" title="{{ page.next_page.title | striptags }}" class="md-button md-button--primary">
Explore Tutorials
</a>
<a href="benchmarks.html" title="{{ page.next_page.title | striptags }}" class="md-button">
Benchmarks
<a href="https://developer.nvidia.com/blog/bringing-generative-ai-to-life-with-jetson/" title="Walkthrough Blog" class="md-button" target="_blank">
Walkthrough
</a>
</div>
</div>
Expand Down

0 comments on commit ed74836

Please sign in to comment.