From 0a903989f5fb63dc697889c62099640cfdcc1264 Mon Sep 17 00:00:00 2001 From: "galaxy-social-bot[bot]" <171031730+galaxy-social-bot[bot]@users.noreply.github.com> Date: Thu, 28 Nov 2024 00:45:19 +0000 Subject: [PATCH] Add Text-to-Image Magic: FLUX Models Now in Galaxy! for group2 --- .../galaxy_europe/2024-11-26-flux-group2.md | 83 +++++++++++++++++++ 1 file changed, 83 insertions(+) create mode 100644 posts/feed_bot/galaxy_europe/2024-11-26-flux-group2.md diff --git a/posts/feed_bot/galaxy_europe/2024-11-26-flux-group2.md b/posts/feed_bot/galaxy_europe/2024-11-26-flux-group2.md new file mode 100644 index 0000000..a6621ec --- /dev/null +++ b/posts/feed_bot/galaxy_europe/2024-11-26-flux-group2.md @@ -0,0 +1,83 @@ +--- +media: +- bluesky-galaxyproject +mentions: + bluesky-galaxyproject: + - galaxyproject.bsky.social +hashtags: + bluesky-galaxyproject: + - UseGalaxy + - GalaxyProject + - UniFreiburg + - EOSC + - EuroScienceGateway +--- +📝 New blog post Released! +https://galaxyproject.org/news/2024-11-26-flux/ + +Using Black Forest Labs' FLUX Models Inside Galaxy: A Guide to Text-to-Image Integration +---------------------------------------------------------------------------------------- + +In previous news, we have written about [the speech-to-text tool Whisper](https://galaxyproject.org/news/2024-04-25-whisper-tool/) and [the ChatGPT tool](https://galaxyproject.org/news/2024-09-02-chat-gpt/) in Galaxy. Today, we would like to talk about a new tool that allows you to create images from text. +[The Black Forest Labs (BFL)](https://blackforestlabs.ai/) FLUX series has made significant strides in the world of generative AI, providing robust text-to-image capabilities +tailored for various use cases. At Freiburg University, we've integrated FLUX.1 [schnell] and FLUX.1 [dev] into the Galaxy platform, enabling researchers and developers to generate +high-quality images directly within Galaxy's user-friendly environment. + +In this blog post, we'll explore the FLUX.1 models, their unique attributes, and how to use them effectively inside Galaxy. + +Overview of FLUX Models +----------------------- + +**FLUX.1 [schnell]** + +* Purpose: Designed for speed. +* [License](https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-schnell): Openly available under the Apache 2.0 license. +* Use Case: Ideal for personal use and rapid prototyping. + +**FLUX.1 [dev]** + +* Purpose: Guidance-distilled model for non-commercial applications, offering near-professional quality. +* [License](https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev): Open-weight model intended for non-commercial contexts. +* Use Case: Suited for research and non-commercial exploration. + +Both models provide easy access and versatility, making them excellent choices for text-to-image projects. While FLUX.1 [schnell] focuses on performance, FLUX.1 [dev] bridges the gap between quality and efficiency. + +Why Use FLUX Models Inside Galaxy? +---------------------------------- + +Galaxy's open platform supports workflows across life sciences, data analysis, and beyond. By integrating FLUX models, users can: + +* Generate visualizations: Convert textual descriptions into detailed images. +* Streamline workflows: Incorporate generative AI into multi-step Galaxy pipelines. +* Leverage open weights: FLUX's availability under open licenses aligns with Galaxy's ethos of accessibility and reproducibility. + +To ensure high performance and speed, we are using a CUDA-based container to run the FLUX models on GPUs. This setup allows for fast inference times when working with the models from Hugging Face. +By leveraging Hugging Face’s pre-trained models, we can efficiently load the weights and run inference directly within the Galaxy environment. The CUDA-based container ensures that the heavy +computations involved in text-to-image generation are handled smoothly, providing users with a seamless experience. + +Setting Up FLUX in Galaxy +------------------------- + +The FLUX models are already available on UseGalaxy.eu. + +[Run FLUX on usegalaxy.eu!](https://usegalaxy.eu/root?tool_id=black_forest_labs_flux) + +Simply log in to your Galaxy instance and search for the FLUX tool in the tool panel. + +Select the desired model (FLUX.1 [schnell] or FLUX.1 [dev]) based on your requirements. + +Please be adviced that dev model can not be used for commercial use. + +Choose between File or Text based input and select your txt file or enter your text prompt in the designated input field. +Click "Run Tool" and let Galaxy handle the rest! +Once the process is complete, you’ll find the generated image in your Galaxy history, ready to view, share, or use in your workflows. + +For example, I used the text prompt "A galaxy full of stars" to generate an image. Here's [the result history](https://usegalaxy.eu/u/brilliantarash/h/flux): + +Text Prompt: `A galaxy full of stars` + +Generated Image: + +![FLUX_on_text_prompt_(A_galaxy_full_of_stars)](https://galaxyproject.org/news/2024-11-26-flux/FLUX_on_text_prompt-a_galaxy_full_of_stars.png) + +You can try out your own prompts and see what unique images FLUX can generate! \ No newline at end of file