10702 工程學群 資訊工程學系

深度學習

吳尚鴻 教授

資訊工程學系
國立清華大學資訊工程學系    教授 
國立台灣大學資訊工程學系       博士

【教學】 機器學習理論、雲端資料庫、APP創業與實作
【研究】 機器學習、巨量資料處理、App 智能
  http://www.cs.nthu.edu.tw/~shwu/
【榮譽】 New Faculty Research Award, NTHU, 2015 
  Outstanding Research Award, EECS, NTHU, 2014
Outstanding Teaching Award, EECS, NTHU, 2013
IBM Ph.D. Fellowship Award, 2008 (70/575 worldwide)


News

最新公告

2025-01-08 周志遠教授〡作業系統 - 全集字幕版
2025-01-03 ❤ 開放式課程授權合作推薦 Open Course Cooperation Recommendation ❤
2025-01-03 【2025開放式課程工讀招募】沒有穩定的工作、只有穩定的能力,誠摯地歡迎您加入我們的行列!!滿!
2024-12-25 11301白先勇清華文學講座 5〡文學 X 電影二重奏課程活動花絮
2024-12-23 【隨時❤️開放式課程*超猛筆記大募集】我們深信學習不是少數人的事,而是所有人的事,敬邀您的熱血參與!!!
2024-12-10 【白先勇教授:文學改編電影──從《玉卿嫂》改編講起】報名至【12月13日(五)17:00截止】!
2024-12-09 2023 引領教學潮流 : 大學教授的魅力品牌之路 !
2024-12-06 【開放式課程魅力專題報導】馬斯克時間拳擊法!馬斯克是1年當8年用、而我們是8年當1年用,如何對症下藥逆轉人生一窺箇中奧秘!
2024-12-04 【轉發EMI中心】12/10(二) 黃舒屏教授提升EMI課堂學習動機的實用技巧,誠摯地歡迎您踴躍報名! ! !
2024-12-02 2024/12/18 白先勇教授【白先勇文學改編電影-從《玉卿嫂》改編講起】於旺宏館國際會議廳舉行「即將放報名」!!!請您留意相關訊息,謝謝您!
2024-11-25 恭喜潘詠庭教授榮獲國科會113年度吳大猷先生紀念獎
2024-11-25 庖丁解牛擴散與相變化,材料系朝和大師帶你乘著理論飛向應用!
2024-11-25 白先勇清華文學講座4〡文化的記憶與重建 〡台灣篇❤️倒數計時上架中 !
2024-11-25 白先勇清華文學講座 5〡文學 X 電影二重奏❤️溫馨小提醒! 
2024-11-25 113年資訊月 「傑出資訊人才獎」 選拔活動得獎名單如下:(12位)

Syllabus

課程大綱

This class introduces the concepts and practices of deep learning. The course consists of three parts. In the first part, we give a quick introduction of classical machine learning and review some key concepts required to understand deep learning.In the second part......
 
  

Description
This class introduces the concepts and practices of deep learning. The course consists of three parts. In the first part, we give a quick introduction of classical machine learning and review some key concepts required to understand deep learning.In the second part, we discuss how deep learning differs from classical machine learning and explain why it is effective in dealing with complex problems such as the image and natural language processing. Various CNN and RNN models will becovered. In the third part, we introduce the deep reinforcement learning and its applications.This course also gives coding labs. We will use Python 3 as the main programming language throughout the course. Some popular machine learning libraries such as Scikit-learn and Tensorflow will be used and explained in detials.

 
 
 
Syllabus  
Lecture 01  
Introduction/Scientific Python 101
Lecture 02     
Linear Algebra/Data Exploration & PCA
Lecture 03
Probability & Information Theory/Decision Trees & Random Forest

Lecture 04

Numerical Optimization/Perceptron & Adaline/Regression
Lecture 05
Learning Theory & Regularization /Regularization
Lecture 06
Probabilistic Models/Logistic Regression & Metrics 
Lecture 07
Non-Parametric Methods & SVMs/SVMs & Scikit-Learn Pipelines
Lecture 08
Cross Validation & Ensembling/CV & Ensembling

Competition01  

Predicting Appropriate Response
Lecture 09
Large-Scale Machine Learning
Lecture 10
Neural Networks: Design/TensorFlow101 & Word2Vec
Lecture 11
Neural Networks: Optimization & Regularization
Lecture 12

Convolutional Neural Networks/Nuts and Bolts of Convolutional Neural Networks/Visualization and Style Transfer

Competition 02

Image Object Detection & Localization

Lecture 13

Recurrent Neural Networks/Seq2Seq Learning for Machine Translation
Competition 03 Image Caption
Lecture 14
Unsupervised Learning/Autoencoders/GANs
Competition 04 Reverse Image Caption 
Lecture 15
Semisupervised/Transfer Learning and the Future
Lecture 16
Reinforcement Learning/Q-learning
Lecture 17
Deep Reinforcement Learning/ DQN & Policy Network
Competition 05 You Draw I Draw
   
 

 

Reference Books 
Ian Goodfellow, Yoshua Bengio, Aaron Courville, Deep Learning, MIT Press, 2016, ISBN: 0387848576
Trevor Hastie, Robert Tibshirani, Jerome Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition, Springer, 2009, ISBN: 0387848576
Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, 2006, ISBN: 0387310738
Sebastian Raschka, Python Machine Learning, Packt Publishing, 2015, ISBN: 1783555130
  
 
 
 
Online Courses 
CS231n: Convolutional Neural Networks for Visual Recognition, Stanford
 CS224d: Deep Learning for Natural Language Processing, Stanford
CS 294: Deep Reinforcement Learning, Berkeley
 MIT 6.S094: Deep Learning for Self-Driving Cars, MIT
   

Keyword

關鍵字

  • 深度學習
  • Deep Learning
  • Scientific Python
  • Neural Networks
  • Numerical Optimization

Teachers

吳尚鴻 教授

Social Share

Details