Skip to content

Commit

Permalink
Add the diagram and some other edits
Browse files Browse the repository at this point in the history
  • Loading branch information
FrancescAlted committed Jul 6, 2024
1 parent bfd5808 commit 42ca72d
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 6 deletions.
10 changes: 4 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,12 @@
# Btune for Blosc2

Btune is a dynamic plugin for Blosc2 that assists in finding the optimal combination of compression parameters. It works by training a neural network on your most representative datasets.

By default, this software uses a genetic algorithm to test different combinations of compression parameters that meet your requirements for both compression ratio and speed for every chunk in the dataset. It assigns a score to each combination and, after a number of iterations, the software stops and uses the best score (minimal value) found for the rest of the dataset. For more info and a graphical visualization, visit https://ironarray.io/btune .
<img src="img/btune-preview-running.png">

The process of finding optimal compression parameters in Blosc2 can be slow because of the large number of combinations of compression parameters (codec, compression level, filter, split mode, number of threads, etc.). This can require a significant amount of trial and error to find the best combinations. However, you can significantly accelerate this process by training a neural network on your own datasets.
Btune is a dynamic plugin for Blosc2 that assists in finding the optimal combination of compression parameters. It works by training a neural network on your most representative datasets.

To begin the training process, you should buy a license from [ironArray SLU](https://ironarray.io/btune) and provide us with a representative sample of your datasets. We will then perform the training and provide neural network models tailored to your needs, along with general tuning advice for Blosc2.
By default, this software uses a genetic algorithm to test different combinations of compression parameters that meet your requirements for both compression ratio and speed for every chunk in the dataset. It assigns a score to each combination and, after a number of iterations, it stops and uses the best score (minimal value) found for the rest of the dataset. For more info and a graphical visualization, visit https://ironarray.io/btune.

If interested, please mail us at [email protected]
The process of finding optimal compression parameters in Blosc2 can be slow because of the large number of combinations of compression parameters (codec, compression level, filter, split mode, number of threads, etc.). This can require a significant amount of trial and error to find the best combinations. However, you can significantly accelerate this process by training a neural network on your own datasets; [ironArray SLU](https://ironarray.io) provides professional services for doing that. If interested, [contact them](mailto:contact@ironarray.io).

## Install the Btune wheel

Expand Down
Binary file added img/btune-preview-running.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 42ca72d

Please sign in to comment.