From c4e113e2285d60ef27a6a20fa62d6dfcb35e00bb Mon Sep 17 00:00:00 2001 From: Paul-Louis NECH Date: Thu, 1 Dec 2022 18:50:14 +0100 Subject: [PATCH] Slides: V0.5 intro + skeleton --- slides/00-intro.md | 355 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ slides/01-choisir.md | 10 ++++++++++ slides/01-intro.marp.md | 277 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- slides/02-entrainer.md | 10 ++++++++++ slides/03-tester.md | 15 +++++++++++++++ slides/04-utiliser.md | 21 +++++++++++++++++++++ slides/img/01-cheater.png | Bin 0 -> 348177 bytes slides/img/01-information.png | Bin 0 -> 163015 bytes slides/img/01-information2.png | Bin 0 -> 127343 bytes slides/img/01-information3.png | Bin 0 -> 127013 bytes slides/img/01-operant.png | Bin 0 -> 99904 bytes slides/img/01-reinforcement.png | Bin 0 -> 86552 bytes 12 files changed, 411 insertions(+), 277 deletions(-) create mode 100644 slides/00-intro.md create mode 100644 slides/01-choisir.md delete mode 100644 slides/01-intro.marp.md create mode 100644 slides/02-entrainer.md create mode 100644 slides/03-tester.md create mode 100644 slides/04-utiliser.md create mode 100644 slides/img/01-cheater.png create mode 100644 slides/img/01-information.png create mode 100644 slides/img/01-information2.png create mode 100644 slides/img/01-information3.png create mode 100644 slides/img/01-operant.png create mode 100644 slides/img/01-reinforcement.png diff --git a/slides/00-intro.md b/slides/00-intro.md new file mode 100644 index 0000000..22cab75 --- /dev/null +++ b/slides/00-intro.md @@ -0,0 +1,355 @@ +--- +marp: true +theme: uncover +color: #eee +colorSecondary: #333 +backgroundColor: #111 +paginate: true +--- + +# Hello World + +ROBOTS ARE UPRISING. WHAT SIDE ARE YOU ON? + + + + +--- + + +### On va parler de +# Machine Learning + + +--- + +## Mais pas comme ça + +
+ +$$ I_{xx}=\int\int_Ry^2f(x,y)\cdot{}dydx $$ + +
+ +#### (Le moins possible) + +--- + +## Ni comme ça + + +![bg right](https://uproxx.com/wp-content/uploads/2015/05/angry-bender.jpg?w=650) + +###### - [the Fallacy of generalization from Fictional evidence](https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logical-fallacy-of-generalization-from-fictional) + +--- + +## Encore que... + +![bg right grayscale](https://uproxx.com/wp-content/uploads/2015/05/angry-bender.jpg?w=650) + +###### - [AGI Ruin: A List of Lethalities](https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities) + +--- + +## On va parler des derniers succès + +#### - [Meta AI Research: CICERO](https://ai.facebook.com/blog/cicero-ai-negotiates-persuades-and-cooperates-with-people/) + +![bg left](./img/01-cicero.png) + +--- + +## Et d'échecs intéressants + +##### - [MIT Tech review: 100s of AI tools built for covid... None helped.](https://www.technologyreview.com/2021/07/30/1030329/machine-learning-ai-failed-covid-hospital-diagnosis-pandemic/) + +![bg left 100%](./img/01-covid-failed.png) + +---- + +## Mais aussi de révolutions en cours + + +##### - [Midjourney](fixme) + +![bg left](./img/01-midjourney.png) + +--- +![bg 100%](./img/01-diffusion.png) +
+
+
+
+
+##### - [The Illustrated Stable Diffusion by Jay Alamar](https://jalammar.github.io/illustrated-stable-diffusion/) + +--- +### Comment les modèles... peuvent raconter des histoires + +##### - [AI Dungeon 2](https://aidungeon.cc/) + +![bg left 100%](./img/01-dungeon.jpg) + +---- +### Comment ils nous comprennent + + +##### - [OpenAI Jukebox: a neural net that generates music, including rudimentary singing](https://openai.com/blog/jukebox/) + +![bg left 100%](./img/01-jukebox.png) + +---- +## Comment vous pourriez les comprendre + + + + +--- +## Et comment leur faire faire ce que vous voulez + + + + +--- + +
+ +## Qui suis-je? + + + +### Paul-Louis Nech +- ###### ✉ formation@nech.pl +- ###### 🔗 LinkedIn.com/in/PLNech +- ###### 💡 GitHub.com/PLNech + +![bg right grayscale](./img/01-me.jpg) + +--- + + +
+ +## Parcours + +- #### EPITA 2016 | MTI +- #### Software Engineer @Algolia +- #### Senior ML Engineer @Algolia +![bg right](./img/01-me2.jpg) + +--- +## C'est quoi ce cours ? + + +--- +#### Des connaissances +## & +#### Des compétences +![bg right](./img/01-map-center.png) + +--- +#### Ce que vous saurez +![bg right](./img/01-map-known.png) + +--- +###### (Et ce que vous saurez... que vous ne savez pas) +![bg right 99%](./img/01-map-unknown.png) + +--- +#### Ce que vous saurez faire +![bg right](./img/01-map-practice.png) + +--- +# Prêts ? +--- +# Les bases + +--- +## C'est quoi apprendre ? + +--- + +## C'est quoi apprendre ? +#### voir... +- [WP: Learning](https://en.wikipedia.org/wiki/Learning) +- [WP: _Machine_ Learning](https://en.wikipedia.org/wiki/Machine_Learning) +- [WP: Operant Conditioning](https://en.wikipedia.org/wiki/Operant_conditioning) + +--- +### Conditionnement +## Opérant +![bg right 99%](./img/01-operant.png) + +--- + +### Reinforcement +## Learning + +![bg right 90%](./img/01-reinforcement.png) + +--- +### Le par-coeur, un problème ? + +--- +### Guessing the teachers password + + +
+
+
+ +- Voir [LessWrong](https://www.lesswrong.com/posts/NMoLJuDJEms7Ku9XS/guessing-the-teacher-s-password) +--- +## Apprendre +## c'est oublier + + +![bg right 90%](./img/01-information.png) + + +--- +## Apprendre +## c'est oublier + +![bg right 90%](./img/01-information2.png) + + +--- +## Apprendre +### c'est +###### (pas tout) +#### oublier + + +- ###### [[Towards Data Science] _Information theory of Neural Networks_](https://towardsdatascience.com/information-theory-of-neural-networks-ad4053f8e177) +![bg right 90%](./img/01-information3.png) + + + +--- +Comment je sais ce que je sais pas ? + +--- +# Failures of ML + +--- +MIT COVID FAILS + +--- +### Gaming the game: IAs flemmardes + +
+ +- [Régalez vous
avec ce tableau](https://docs.google.com/spreadsheets/u/1/d/e/2PACX-1vRPiprOaC3HsCf5Tuum8bRfzYUiKLRqJmbOoC-32JorNdfyTiRRsR7Ea5eWtvsWzuxo8bjOxCG84dAg/pubhtml) + +![bg right 90%](./img/01-cheater.png) + +--- +### Short-term goals vs long-term goals + +--- +### Dangerous goals : Paperclip maximizer? + + +--- +# C'est quoi du ML ? + +--- +Un thermostat ? + +--- +Sacs de ifs + +--- +Amazon mechanical turk + +--- +Elisa? Turing test ? + +--- +Akinator ? + +--- +Quelles limites aux possibilités du ML ? + +--- +Andrew ng's quote on limits + + +--- +## Formalisme: features + +--- +## métriques + +--- +Precision + +--- +Rappel (Recall) + +--- +Supervisé ou non + + +--- +## Pionniers & Penseurs + +--- +### Turing + +--- +### Dartmouth + +--- +### Summer + +--- +### Yann LeCun + +--- +### Andrew Ng + +--- +### Yudkowsky \ No newline at end of file diff --git a/slides/01-choisir.md b/slides/01-choisir.md new file mode 100644 index 0000000..7f41341 --- /dev/null +++ b/slides/01-choisir.md @@ -0,0 +1,10 @@ +--- +marp: true +theme: uncover +color: #eee +colorSecondary: #333 +backgroundColor: #111 +paginate: true +--- + +# Choisir un Modèle \ No newline at end of file diff --git a/slides/01-intro.marp.md b/slides/01-intro.marp.md deleted file mode 100644 index 9e508cc..0000000 --- a/slides/01-intro.marp.md +++ /dev/null @@ -1,277 +0,0 @@ ---- -marp: true -theme: uncover -color: #eee -colorSecondary: #333 -backgroundColor: #111 -paginate: true ---- - -# Hello World - -ROBOTS ARE UPRISING. WHAT SIDE ARE YOU ON? - - - - ---- - - -### On va parler de -# Machine Learning - - ---- - -## Mais pas comme ça - -
- -$$ I_{xx}=\int\int_Ry^2f(x,y)\cdot{}dydx $$ - -
- -#### (Le moins possible) - ---- - -## Ni comme ça - - -![bg right](https://uproxx.com/wp-content/uploads/2015/05/angry-bender.jpg?w=650) - -###### - [the Fallacy of generalization from Fictional evidence](https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logical-fallacy-of-generalization-from-fictional) - ---- - -## Encore que... - -![bg right grayscale](https://uproxx.com/wp-content/uploads/2015/05/angry-bender.jpg?w=650) - -###### - [AGI Ruin: A List of Lethalities](https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities) - ---- - -## On va parler des derniers succès - -#### - [Meta AI Research: CICERO](https://ai.facebook.com/blog/cicero-ai-negotiates-persuades-and-cooperates-with-people/) - -![bg left](./img/01-cicero.png) - ---- - -## Et d'échecs intéressants - -##### - [MIT Tech review: 100s of AI tools built for covid... None helped.](https://www.technologyreview.com/2021/07/30/1030329/machine-learning-ai-failed-covid-hospital-diagnosis-pandemic/) - -![bg left 100%](./img/01-covid-failed.png) - ----- - -## Mais aussi de révolutions en cours - - -##### - [Midjourney](fixme) - -![bg left](./img/01-midjourney.png) - ---- -![bg 100%](./img/01-diffusion.png) -
-
-
-
-
-##### - [The Illustrated Stable Diffusion by Jay Alamar](https://jalammar.github.io/illustrated-stable-diffusion/) - ---- -### Comment les modèles... peuvent raconter des histoires - -##### - [AI Dungeon 2](https://aidungeon.cc/) - -![bg left 100%](./img/01-dungeon.jpg) - ----- -### Comment ils nous comprennent - - -##### - [OpenAI Jukebox: a neural net that generates music, including rudimentary singing](https://openai.com/blog/jukebox/) - -![bg left 100%](./img/01-jukebox.png) - ----- -## Comment vous pourriez les comprendre - - - - ---- -## Et comment leur faire faire ce que vous voulez - - - - ---- - -
- -## Qui suis-je? - - - -### Paul-Louis Nech -- ###### ✉ formation@nech.pl -- ###### 🔗 LinkedIn.com/in/PLNech -- ###### 💡 GitHub.com/PLNech - -![bg right grayscale](./img/01-me.jpg) - ---- - - -
- -## Parcours - -- #### EPITA 2016 | MTI -- #### Software Engineer @Algolia -- #### Senior ML Engineer @Algolia -![bg right](./img/01-me2.jpg) - ---- -## C'est quoi ce cours ? - - ---- -#### Des connaissances -## & -#### Des compétences -![bg right](./img/01-map-center.png) - ---- -#### Ce que vous saurez -![bg right](./img/01-map-known.png) - ---- -###### (Et ce que vous saurez... que vous ne savez pas) -![bg right 99%](./img/01-map-unknown.png) - ---- -#### Ce que vous saurez faire -![bg right](./img/01-map-practice.png) - ---- -# Prêts ? ---- -# Les bases - ---- -## C'est quoi apprendre ? ---- -Le par-coeur, un problème ? - ---- -Guessing the teachers password - ---- -Learning to forget - ---- -Comment je sais ce que je sais pas ? - ---- -# Failures of ML - ---- -MIT COVID FAILS - ---- -Gaming the game: IAs flemmardes - ---- -Short-term goals vs long-term goals - ---- -Dangerous goals : Paperclip maximizer? - - ---- -# C'est quoi du ML ? - ---- -Un thermostat ? - ---- -Sacs de ifs - ---- -Amazon mechanical turk - ---- -Elisa? Turing test ? - ---- -Akinator ? - ---- -Quelles limites aux possibilités du ML ? - ---- -Andrew ng's quote on limits - - ---- -## Formalisme: features - ---- -## métriques - ---- -Precision - ---- -Rappel (Recall) - ---- -Supervisé ou non - - ---- -## Pionniers & Penseurs - ---- -### Turing - ---- -### Dartmouth - ---- -### Summer - ---- -### Yann LeCun - ---- -### Andrew Ng - ---- -### Yudkowsky ---- -## Adversarial perturbations - - -## Méthodes -### Train/test/val split - -## Outils \ No newline at end of file diff --git a/slides/02-entrainer.md b/slides/02-entrainer.md new file mode 100644 index 0000000..89c762f --- /dev/null +++ b/slides/02-entrainer.md @@ -0,0 +1,10 @@ +--- +marp: true +theme: uncover +color: #eee +colorSecondary: #333 +backgroundColor: #111 +paginate: true +--- + +# Entrainer son Modèle \ No newline at end of file diff --git a/slides/03-tester.md b/slides/03-tester.md new file mode 100644 index 0000000..1161e9a --- /dev/null +++ b/slides/03-tester.md @@ -0,0 +1,15 @@ +--- +marp: true +theme: uncover +color: #eee +colorSecondary: #333 +backgroundColor: #111 +paginate: true +--- + +# Tester son Modèle + + +--- +## Adversarial perturbations + diff --git a/slides/04-utiliser.md b/slides/04-utiliser.md new file mode 100644 index 0000000..12bad72 --- /dev/null +++ b/slides/04-utiliser.md @@ -0,0 +1,21 @@ +--- +marp: true +theme: uncover +color: #eee +colorSecondary: #333 +backgroundColor: #111 +paginate: true +--- + +# Utiliser un Modèle + +--- + +HuggingFace! + + +--- + +## Outils + +Dev, Collab, etc \ No newline at end of file diff --git a/slides/img/01-cheater.png b/slides/img/01-cheater.png new file mode 100644 index 0000000..cfa41ad Binary files /dev/null and b/slides/img/01-cheater.png differ diff --git a/slides/img/01-information.png b/slides/img/01-information.png new file mode 100644 index 0000000..38c3367 Binary files /dev/null and b/slides/img/01-information.png differ diff --git a/slides/img/01-information2.png b/slides/img/01-information2.png new file mode 100644 index 0000000..5bb76e0 Binary files /dev/null and b/slides/img/01-information2.png differ diff --git a/slides/img/01-information3.png b/slides/img/01-information3.png new file mode 100644 index 0000000..f9bc3c5 Binary files /dev/null and b/slides/img/01-information3.png differ diff --git a/slides/img/01-operant.png b/slides/img/01-operant.png new file mode 100644 index 0000000..ad7a928 Binary files /dev/null and b/slides/img/01-operant.png differ diff --git a/slides/img/01-reinforcement.png b/slides/img/01-reinforcement.png new file mode 100644 index 0000000..97a989f Binary files /dev/null and b/slides/img/01-reinforcement.png differ -- libgit2 0.27.0