Deployed 6e91a70 with MkDocs version: 1.5.3

SupaeroDataScience · Oct 7, 2024 · 74b67c6 · 74b67c6
1 parent f335b12
commit 74b67c6
Show file tree

Hide file tree

Showing 36 changed files with 277 additions and 764 deletions.
diff --git a/1_2_setup_codespace.html b/1_2_setup_codespace.html
diff --git a/1_3_gcp_handson.html b/1_3_gcp_handson.html
@@ -1796,9 +1796,11 @@
 
 <h1 id="google-cloud-platform-hands-on">Google Cloud Platform Hands-on<a class="headerlink" href="#google-cloud-platform-hands-on" title="Permanent link">🔗</a></h1>
 <h2 id="0-abstract">0. Abstract<a class="headerlink" href="#0-abstract" title="Permanent link">🔗</a></h2>
-<p>!! abstract
-    In this hands on you will configure your GCP account, the google cloud SDK and access the cloud console using Google Cloud Shell,
-    You will also discover a very useful tool, a managed jupyter notebook service from google named Google Colab which may be very important for your future developments this year</p>
+<div class="admonition abstract">
+<p class="admonition-title">Abstract</p>
+<p>In this hands on you will configure your GCP account, the google cloud SDK and access the cloud console using Google Cloud Shell,
+You will also discover a very useful tool, a managed jupyter notebook service from google named Google Colab which may be very important for your future developments this year</p>
+</div>
 <div class="admonition warning">
 <p class="admonition-title">Warning</p>
 <p>Some things may only work on <strong>eduroam</strong> or in 4G...</p>

diff --git a/search/search_index.json b/search/search_index.json
diff --git a/sitemap.xml.gz b/sitemap.xml.gz
diff --git a/slides/1_1_intro.html b/slides/1_1_intro.html
@@ -34,25 +34,17 @@
 
 Florient CHOUTEAU
 
-</script></section><section data-markdown><script type="text/template">
-<!-- .slide: data-background="http://i.giphy.com/90F8aUepslB84.gif" -->
-
-### Lesson #1
-
-These slides are built using [reveal.js](https://revealjs.com) and [reveal-md](
-https://github.com/webpro/reveal-md)
-
-This is awesome ! Stop using powerpoint !
-
 </script></section><section data-markdown><script type="text/template">
 
 ### Who ?
 
 <img src="static/img/ads_logo.jpg" alt="" width="128px" height="128px" style="background:none; border:none; box-shadow:none;"/>
 
-- Computer Vision Research Engineer at **Airbus Defence and Space**
+- **Florient CHOUTEAU**, SDD 2016
+- Expert (Staff Engineer) in Artificial Intelligence for Space Systems at **Airbus Defence and Space**
+- Computer Vision Team (Earth Observation, Space Exploration, Space Domain Awareness)
 - Specialized in Satellite Imagery Processing & Deep Learning
-- Working daily with Google Cloud Platform & Docker
+- Working regularly on cloud infra, remote development environment, docker
 
 Any question ? contact me on slack !
 
@@ -101,20 +93,22 @@
 
 |  Date | Length | Content                                              |
 |:-----:|:------:|------------------------------------------------------|
-| 21/11 |   3h   | Intro to Cloud Computing & GCP                       |
-| 28/11 |   3h   | Containers & Docker                                  |
-| 29/11 |   3h   | BE Docker & GCP : Deploy your Machine Learning Model |
+| 08/10 |   3h   | Intro to Cloud Computing & Remote Dev Env            |
+| 15/10 |   3h   | Google Cloud Platform                                |
+| 22/10 |   3h   | Containers & Docker                                  |
+| 05/11 |   3h   | BE Docker & GCP                                      |
+| 13/11 |   3h   | BE Deploy your ML Model in Production                |
 
 </script></section><section data-markdown><script type="text/template">
 
 ### ⚠️
 
 Some things may go wrong, especially because of :
 - The ISAE WIFI / 4G connection inside the room
-- Your computer configuration
+- Your computer configuration (OS, browser, etc.)
 - Google Cloud Platform responsiveness
 
-Brace yourself 💪
+Brace yourselves 💪
 </script></section></section></div>
     </div>
     <!-- <div id="footer-container" style="display:none;"> -->

diff --git a/slides/1_2_cloud_computing.html b/slides/1_2_cloud_computing.html
@@ -20,13 +20,13 @@
 
 <body>
     <div class="reveal">
-        <div class="slides"><section  data-markdown><script type="text/template">
+        <div class="slides"><section ><section data-markdown><script type="text/template">
 
 ## Intro to Cloud Computing
 
 ![the office](https://media.giphy.com/media/5wWf7H89PisM6An8UAU/giphy.gif)
 
-</script></section><section ><section data-markdown><script type="text/template">
+</script></section><section data-markdown><script type="text/template">
 
 ### What is the Cloud ?
 
@@ -40,11 +40,7 @@
 
 But it's a bit bigger...
 
-<img src="static/img/fb_datacenter.jpg" alt="" width="30%" height="30%" style="background:none; border:none; box-shadow:none; float:left;margin:0 10px 0 20px;"/>
-
-<img src="https://www.datacenterknowledge.com/sites/datacenterknowledge.com/files/wp-content/uploads/2013/06/lulea-rows.jpg" alt="" width="25%" height="25%" style="background:none; border:none; box-shadow:none;"/>
-
-<img src="https://www.datacenterknowledge.com/sites/datacenterknowledge.com/files/wp-content/uploads/2013/06/fb-lulea-external-fans.jpg" alt="" width="25%" height="25%" style="background:none; border:none; box-shadow:none;"/>
+<img src="static/img/fb_datacenter.jpg" alt="" width="25%" height="25%" style="background:none; border:none; box-shadow:none;"/>
 
 <img src="https://cdn.arstechnica.net/wp-content/uploads/2013/02/openrack2-640x426.jpg" alt="" width="25%" height="25%" style="background:none; border:none; box-shadow:none;"/>
 
@@ -262,11 +258,13 @@
 
 #### It gets harder
 
-![cloud](https://lh3.googleusercontent.com/Zpw-v4ZOiAkbLm9ARSl68tGaZFYsFsz1ABwRbl8Cj_ozj12jCTPmgVGKBARz3Xwum1CUsMQ7Hog=e14-rj-sc0xffffff-h2000-w2000)  <!-- .element: height="50%" width="50%" -->
+![cloud](https://lh3.googleusercontent.com/Zpw-v4ZOiAkbLm9ARSl68tGaZFYsFsz1ABwRbl8Cj_ozj12jCTPmgVGKBARz3Xwum1CUsMQ7Hog=e14-rj-sc0xffffff-h2000-w2000)  <!-- .element: height="65%" width="65%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
-![cloud](https://www.catapultsystems.com/wp-content/uploads/2020/03/pizza-model-vert.jpeg)  <!-- .element: height="50%" width="50%" -->
+#### Useful analogy
+
+![cloud](static/img/pizzaasaservicev2.jpg)  <!-- .element: height="65%" width="65%" -->
 
 
 </script></section></section><section ><section data-markdown><script type="text/template">
@@ -346,6 +344,13 @@
 - Google : https://cloud.google.com/sustainability
 - Earth.org : https://earth.org/environmental-impact-of-cloud-computing/
 
+</script></section><section data-markdown><script type="text/template">
+
+On "Artificial Intelligence" & sustainability, entry points
+
+- [Power Hungry Processing: Watts Driving the Cost of AI Deployment?](https://arxiv.org/abs/2311.16863)
+- [ The Environmental Impacts of AI -- Primer ](https://huggingface.co/blog/sasha/ai-environment-primer)
+
 </script></section></section><section ><section data-markdown><script type="text/template">
 
 ## "Using" the Cloud
@@ -526,69 +531,81 @@
 
 ## Cloud Computing & AI
 
-What does it mean for YOU ?
+</script></section><section data-markdown><script type="text/template">
 
-![me](https://media.giphy.com/media/cRKRlRJkEmoxglbufw/giphy.gif)
+### All about that scale
 
-</script></section><section data-markdown><script type="text/template">
+This was in 2022,
 
-<img src="static/img/mlroles2.png" alt="" width="50%" height="50%" style="background:none; border:none; box-shadow:none;"/>
+[BLOOM: A 176B-Parameter Open-Access Multilingual Language Model](https://arxiv.org/pdf/2211.05100)
+
+> Training BLOOM took about 3.5 months to complete and consumed 1,082,990 compute hours. Training was conducted on 48 nodes, each having 8 NVIDIA A100 80GB GPUs (a total of 384 GPUs);
 
 </script></section><section data-markdown><script type="text/template">
 
-<img src="static/img/mlroles.png" alt="" width="50%" height="50%" style="background:none; border:none; box-shadow:none;"/>
+### All about that scale
 
-</script></section><section data-markdown><script type="text/template">
+This is 2024,
 
-#### Your mileage may vary
+![alt text](https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06b6c30c-ad4e-48b8-a506-328b16529a66_2390x570.png)
 
-depending on:
+https://dblalock.substack.com/p/2024-8-4-arxiv-roundup-llama-31-training 
 
-- Your company
-- Your role
+</script></section><section data-markdown><script type="text/template">
 
-but you will "deal with" cloud computing one way or another !
+### AI Distributed Computing
+
+![](static/img/distributed_computing.png)
 
 </script></section><section data-markdown><script type="text/template">
 
-#### Personal experience
+### Stable Diffusion
+
+![](https://assets-global.website-files.com/61fd4eb76a8d78bc0676b47d/63cf7cb6264c4050ed2ea00e_Screen%20Shot%202023-01-23%20at%2010.37.19%20PM.png) <!-- .element: height="60%" width="60%" -->
+
+[Stable Diffusion Training Times](https://www.mosaicml.com/blog/training-stable-diffusion-from-scratch-costs-160k)
+
+</script></section><section data-markdown><script type="text/template"> 
+
+### AI Cloud Providers
 
-- What do I use ?
-- Why do I use it ?
-- How do I do ?
+![](https://salesforceventures.com/wp-content/uploads/2024/03/4.png)  <!-- .element: height="50%" width="50%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
 ## Very quick intro to MLOps
 
+- https://huyenchip.com/machine-learning-systems-design/toc.html
+- https://ml-ops.org/content/references.html
+
+
 </script></section><section data-markdown><script type="text/template">
 
 ![mlsystems](https://huyenchip.com/machine-learning-systems-design/assets/ml_project_flow.png) <!-- .element: height="40%" width="40%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
+MLOps Lifecycle
+
 ![mlops](static/img/mlops_lifecycle.png)  <!-- .element: height="50%" width="50%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
+MLOps Loop
+
 ![mlops](https://ml-ops.org/img/mlops-loop-en.jpg) <!-- .element: height="50%" width="50%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
-### Layers of "enabling technology"
-
-![mlops](static/img/mlopsinfra.png) <!-- .element: height="75%" width="75%" -->
+Deployment architecture
 
-</script></section><section data-markdown><script type="text/template">
-
-- https://huyenchip.com/machine-learning-systems-design/toc.html
-- https://ml-ops.org/content/references.html
+![mlops](https://cdn.analyticsvidhya.com/wp-content/uploads/2024/07/Intro.png) <!-- .element: height="50%" width="50%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
-### My usage : Flexibility
+### Layers of "enabling technology"
 
-![gcp](static/img/infra_army_of_one.png)
+![mlops](static/img/mlopsinfra.png) <!-- .element: height="75%" width="75%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
@@ -598,39 +615,44 @@
 
 </script></section><section data-markdown><script type="text/template">
 
-### All about that scale
+### The need for tech
 
-[BLOOM: A 176B-Parameter Open-Access Multilingual Language Model](https://arxiv.org/pdf/2211.05100)
+![](static/img/anyscale.png)  <!-- .element: height="50%" width="50%" -->
 
-> Training BLOOM took about 3.5 months to complete and consumed 1,082,990 compute hours. Training was conducted on 48 nodes, each having 8 NVIDIA A100 80GB GPUs (a total of 384 GPUs);
+And dask !
 
-</script></section><section data-markdown><script type="text/template">
+</script></section></section><section ><section data-markdown><script type="text/template">
 
-### AI Distributed Computing
+## What about me ?
 
-![](static/img/distributed_computing.png)
+What does it mean for YOU ?
+
+![me](https://media.giphy.com/media/cRKRlRJkEmoxglbufw/giphy.gif)
 
 </script></section><section data-markdown><script type="text/template">
 
-### Stable Diffusion
+<img src="static/img/mlroles2.png" alt="" width="50%" height="50%" style="background:none; border:none; box-shadow:none;"/>
 
-![](https://assets-global.website-files.com/61fd4eb76a8d78bc0676b47d/63cf7cb6264c4050ed2ea00e_Screen%20Shot%202023-01-23%20at%2010.37.19%20PM.png) <!-- .element: height="60%" width="60%" -->
+</script></section><section data-markdown><script type="text/template">
 
-[Stable Diffusion Training Times](https://www.mosaicml.com/blog/training-stable-diffusion-from-scratch-costs-160k)
+<img src="static/img/mlroles.png" alt="" width="50%" height="50%" style="background:none; border:none; box-shadow:none;"/>
 
-</script></section><section data-markdown><script type="text/template"> 
+</script></section><section data-markdown><script type="text/template">
 
-### AI Cloud Providers
+#### Your mileage may vary
 
-![](https://salesforceventures.com/wp-content/uploads/2024/03/4.png)  <!-- .element: height="50%" width="50%" -->
+depending on:
 
-</script></section><section data-markdown><script type="text/template">
+- Your company
+- Your role
 
-### The need for tech
+but you will "deal with" cloud computing one way or another !
 
-![](static/img/anyscale.png)  <!-- .element: height="50%" width="50%" -->
+</script></section><section data-markdown><script type="text/template">
 
-And dask !
+### Personal Experience
+
+![gcp](static/img/infra_army_of_one.png)
 </script></section></section></div>
     </div>
     <!-- <div id="footer-container" style="display:none;"> -->

diff --git a/slides/1_2_remote_development.html b/slides/1_2_remote_development.html
@@ -26,29 +26,67 @@
 
 </script></section><section data-markdown><script type="text/template">
 
-#### Fully virtual development environment
+### Why "remote development" ?
+
+AI / Data Science = Data + Compute + Software
+
+- Your job consist in handling huge volume of data
+- Your job requires high computational resources
+- You're working as a team with centralized computing platform
+- You're working remotely
 
 </script></section><section data-markdown><script type="text/template">
 
-![codespaces](https://github.blog/wp-content/uploads/2021/08/1200x630-codespaces-social.png)
+### Key use case
+
+![remote](https://cf-assets.www.cloudflare.com/slt3lc6tev37/yTvHLFlopPBrpiKavwp9M/0c9b06fb175472bf20f7310a67e1bdcd/access-replicated_2x--1-.png) <!-- .element: height="30%" width="30%" -->
 
 </script></section><section data-markdown><script type="text/template">
 
-#### [Github Codespaces](https://docs.github.com/en/codespaces/overview)
+### Key use case
 
-* [Github Codespaces](https://docs.github.com/en/codespaces) : A managed development environment by Microsoft Azure
-* A virtual machine and a [containerized development environment](https://docs.github.com/en/codespaces/setting-up-your-project-for-codespaces/adding-a-dev-container-configuration/introduction-to-dev-containers)
-* A lot of built-in bonuses including "in-browser" connection & TCP port forwarding with reverse proxy
+![remote](https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5f009c59-64f4-46ff-8097-c5be8f865eaf_1616x1372.png) <!-- .element: height="30%" width="30%" -->
 
-![](https://docs.github.com/assets/cb-79257/images/help/codespaces/port-forwarding.png)  <!-- .element: height="50%" width="50%" -->
+https://newsletter.pragmaticengineer.com/p/cloud-development-environments-why-now
 
 </script></section><section data-markdown><script type="text/template">
 
-#### Remote Development : Your future daily routine
+#### Your future daily routine
+
+![hub](https://geohackweek.github.io/Introductory/fig/geohackweek_aws_setup.png)  <!-- .element: height="40%" width="40%" -->
 
-![remote](https://blog.uber-cdn.com/cdn-cgi/image/width=1810,quality=80,onerror=redirect,format=auto/wp-content/uploads/2022/12/Figure-2-Devpod-overview-Remote-development-environment-@-Uber.png)  <!-- .element: height="50%" width="50%" -->
+Also Google Colab
+
+</script></section><section data-markdown><script type="text/template">
+
+#### Your future daily routine
+
+![remote](https://blog.uber-cdn.com/cdn-cgi/image/width=1810,quality=80,onerror=redirect,format=auto/wp-content/uploads/2022/12/Figure-2-Devpod-overview-Remote-development-environment-@-Uber.png)  <!-- .element: height="40%" width="40%" -->
 
 [Uber Blog describing their way of working](https://www.uber.com/en-FR/blog/devpod-improving-developer-productivity-at-uber/)
+
+</script></section><section data-markdown><script type="text/template">
+
+### Problematics
+
+- How to transfer code ?
+- How to interact with the machines ?
+- How to get access to the data ?
+
+</script></section><section data-markdown><script type="text/template">
+
+![codespaces](https://github.blog/wp-content/uploads/2021/08/1200x630-codespaces-social.png) <!-- .element: height="50%" width="50%" -->
+
+</script></section><section data-markdown><script type="text/template">
+
+#### [Github Codespaces](https://docs.github.com/en/codespaces/overview)
+
+* [Github Codespaces](https://docs.github.com/en/codespaces) : A managed development environment by Microsoft Azure
+* A virtual machine and a [containerized development environment](https://docs.github.com/en/codespaces/setting-up-your-project-for-codespaces/adding-a-dev-container-configuration/introduction-to-dev-containers)
+* A lot of built-in bonuses including "in-browser" connection & TCP port forwarding with reverse proxy
+
+![](https://docs.github.com/assets/cb-79257/images/help/codespaces/port-forwarding.png)  <!-- .element: height="40%" width="40%" -->
+
 </script></section></section></div>
     </div>
     <!-- <div id="footer-container" style="display:none;"> -->

diff --git a/slides/dist/theme/fonts/league-gothic/league-gothic.eot b/slides/dist/theme/fonts/league-gothic/league-gothic.eot
diff --git a/slides/dist/theme/fonts/league-gothic/league-gothic.ttf b/slides/dist/theme/fonts/league-gothic/league-gothic.ttf
diff --git a/slides/dist/theme/fonts/league-gothic/league-gothic.woff b/slides/dist/theme/fonts/league-gothic/league-gothic.woff
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-italic.eot b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-italic.eot
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-italic.ttf b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-italic.ttf
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-italic.woff b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-italic.woff
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-regular.eot b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-regular.eot
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-regular.ttf b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-regular.ttf
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-regular.woff b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-regular.woff
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibold.eot b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibold.eot
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibold.ttf b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibold.ttf
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibold.woff b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibold.woff
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibolditalic.eot b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibolditalic.eot
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibolditalic.ttf b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibolditalic.ttf
diff --git a/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibolditalic.woff b/slides/dist/theme/fonts/source-sans-pro/source-sans-pro-semibolditalic.woff
diff --git a/slides/plugin/markdown/plugin.js b/slides/plugin/markdown/plugin.js
diff --git a/slides/plugin/math/katex.js b/slides/plugin/math/katex.js
diff --git a/slides/static/.DS_Store b/slides/static/.DS_Store
diff --git a/slides/static/img/.DS_Store b/slides/static/img/.DS_Store
diff --git a/slides/static/img/ads_logo.jpg b/slides/static/img/ads_logo.jpg
diff --git a/slides/static/img/docker_logo.png b/slides/static/img/docker_logo.png
diff --git a/slides/static/img/docker_pratique.png b/slides/static/img/docker_pratique.png
diff --git a/slides/static/img/docker_workflow.png b/slides/static/img/docker_workflow.png
diff --git a/slides/static/img/ec2.png b/slides/static/img/ec2.png
diff --git a/slides/static/img/meme_1.jpg b/slides/static/img/meme_1.jpg
diff --git a/slides/static/img/pet-vs-cattle-2.png b/slides/static/img/pet-vs-cattle-2.png
diff --git a/slides/static/img/pet-vs-cattle.png b/slides/static/img/pet-vs-cattle.png
diff --git a/slides/static/img/pizzaasaservicev2.jpg b/slides/static/img/pizzaasaservicev2.jpg
diff --git a/slides/static/img/scaleway_logo_2018.png b/slides/static/img/scaleway_logo_2018.png