Turmas
- CIC1205 – Aprendizado de Máquina (Pós-graduação)
- GCC1932 – Aprendizado de Máquina (Graduação)
Local/horário
- CEFET/RJ, Maracanã, Bloco E, 5º andar, sala 513
- 5ᵃˢ-feiras, das 07h55 às 11h30
Visão geral
Aprendizado de Máquina (Machine Learning) é um campo de estudo da Inteligência Artificial cujo objeto de estudo são sistemas que podem aprender a realizar alguma tarefa por meio de experiências. Neste curso, o objetivo é apresentar uma introdução aos conceitos, modelos, métodos, técnicas e aplicações do Aprendizado de Máquina. São também apresentados alguns algoritmos pertencentes a diferentes famílias de métodos em AM (simbolistas, conexionistas, probabilísticos, baseados em proximidade).
Plano do curso
| Date | Lecture |
| 26/02 | Course logistics ML overview Linear Regression (slides, lecture notes, code) |
| 05/03 | Logistic Regression (slides, lecture notes, code) Decision Trees (slides, lecture notes, code) kNN (slides, lecture notes, code) |
| 12/03 | Model evaluation (slides, lecture notes, code) |
| 19/03 | Model selection (lecture notes, code) |
| 26/03 | Hyperparameter search strategies (lecture notes) Class Imbalance (lecture_notes, code) |
| 02/04 | Feature encoding (notebook) Model calibration (notebook) |
| 09/04 | 1st exam (first one hour of this class) Polynomial features (slides, lecture notes, code) Model regularization (notebook) |
| 16/04 | Multi-layer Perceptron (notebook) Model diagnostics (notebook) |
| 23/04 | –Feriado– |
| 30/04 | Conformal Prediction (notebooks: 1, 2) |
| 07/05 | Dimension Reduction (notebooks: 1, 2) |
| 14/05 | Ensemble Learning (notebooks: 1, 2, 3, 4) |
| 21/05 | 2nd exam (first one hour of this class) SHAP Values (notebooks: 1, 2, 3, 4) Closing Thoughs |
| Date | Lecture |
| 28/05 | PyTorch basics (notebook) Perceptron; backpropagation (notebook) |
| 04/06 | Autoencoders (notebook, notebook) Convolutional Neural Nets – 2D (notebook) Convolutional Neural Nets – 1D (notebook) |
| 11/06 | LSTM nets (notebook, notebook) Dropout & Early Stopping (notebook) |
| 18/06 | Word2Vec (slides, notebook) Transformer Architecture (slides, notebook) |
| 25/06 | Project Presentations |
| 02/07 | Final exam |
Additional resources
- Video: Recurrent Neural Networks, Image Captioning, LSTM, Andrej Karpathy.
- Online course: Practical Deep Learning For Coders
- Online course: Neural Networks and Deep Learning
- Online course: (Codecademy) Learn Python
- Word Embeddings
- Representation Learning for Reading Comprehension
- Practical Generative Adversarial Networks for Beginners
Readings
- (r1) Tom Mitchel, Key Ideas in Machine Learning
- (r2) Pedro Domingos, A Few Useful Things to Know About Machine Learning
- (r3) Sebastian Raschka, Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning
- (r4) Eric Bauer & Ron Kohavi, An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants
- (r5) Matriz Factorization for Recommender Systems
- (r6) Empirical Analysis of Predictive Algorithms for Collaborative Filtering
Books
- Ani Adhikari & John DeNero, Artificial Intelligence: Foundations of Computational Agents, second edition, Cambridge University Press, 2017.
- Aurélien Géron, Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, 2nd Edition, 2019.
- Brett Lantz. Machine Learning with R . Packt Publishing, Birmingham, October 2013.
- Christopher Bishop, Pattern Recognition and Machine Learning, Springer, 2006. pdf github
- Ethen Alpaydin, Introduction to Machine Learning, MIT Press, 2010.
- Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani. An Introduction to Statistical Learning: with Applications in R . Springer, 1st ed. 2013. corr. 4th printing 2014
- Ian Goodfellow et al, Deep Learning, MIT Press, 2016.
- Jake VanderPlas, Python Data Science Handbook, 2016.
- Jeremy Watt et al, Machine Learning Refined: Foundations, Algorithms, and Applications
- Kevin P. Murphy. Machine Learning: A Probabilistic Perspective. The MIT Press, Cambridge, MA, 1 edition edition, August 2012.
- Marc Peter et al, Mathematics for Machine Learning.
- Max Kuhn and Kjell Johnson, Feature Engineering and Selection: A Practical Approach for Predictive Models
- Peter Flach. Machine Learning: The Art and Science of Algorithms that Make Sense of Data. Cambridge University Press, Cambridge ; New York, 1st edition, 2012.
- Sebastian Raschka, Python Machine Learning, 3rd ed, Packt Publishing, 2019.
- Simon O. Haykin. Neural Networks and Learning Machines . Prentice Hall, New York, 3 edition edition, November 2008.
- Tom Mitchell, Machine Learning, McGraw-Hill, 1997.
- Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin. Learning From Data . AMLBook, S.l., March 2012.
Livros de interesse geral sobre Aprendizado de Máquina
- Gary Marcus & Ernest Davis, Rebooting AI: Building Artificial Intelligence We Can Trust, 2019.
- Melanie Mitchel, Artificial Intelligence: A Guide for Thinking Humans, 2019.
- Jimmy Soni & Rob Goodman, A Mind at Play: How Claude Shannon Invented the Information Age, 2017.
- Pedro Domingos, The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World, 2015.
- Nick Bostrom, Superintelligence: Paths, Dangers, Strategies, 2014.