Presentation is loading. Please wait.

Presentation is loading. Please wait.

深層學習 暑期訓練 (2017).

Similar presentations


Presentation on theme: "深層學習 暑期訓練 (2017)."— Presentation transcript:

1 深層學習 暑期訓練 (2017)

2 助教 大助教: 萬家宏 作業一: 許宗嫄 作業二: 陳奕禎 作業三: 蔡哲平  作業四: 萬家宏 作業五: 黃淞楓  作業問題在社團上討論

3 作業繳交 五個作業 因為是暑假,所以並不強迫繳交 請加入 FB 社團「深度學習暑期訓練」
等一下會講作業大概的內容 都很簡單 作業詳細內容和做法都已經公告在社團上 會使用 keras 這套工具 (歡迎自學 Tensorflow ) 教材:李宏毅教授在台大計中的十二小時演講錄影 內容公告於社團上

4 工作站 專題工作站的 IP 是 140.112.21.80 密碼統一是 speech,再自行修改密碼
在以下 google doc 登記(8/3 23:59截止) J6rbxFMN2yBNUnApgJYxvjM7v- brbiiVqucNGhOsnY/viewform?edit_requested=tr ue 如果每組自己有 linux 系統會比較快樂 如果每組自己有 GPU 會更快樂

5 機器學習

6 Machine Learning You said “Hello” Learning ...... “Hi” “How are you”
“Good bye” You write the program for learning. A large amount of audio data

7 Machine Learning This is “cat” Learning ...... “monkey” “cat” “dog”
You write the program for learning. A large amount of images

8 Machine Learning ≈ Looking for a Function
Speech Recognition Image Recognition Playing Go Dialogue System “How are you” “Cat” “5-5” (next move) “Hi” “Hello” (what the user said) (system response)

9 Framework Model Image Recognition: “cat” A set of function “cat”
“money” Repeat again “dot” “snake”

10 Framework Model Supervised Learning Image Recognition: “cat”
A set of function Model Better! Goodness of function f Repeat again Supervised Learning Training Data function input: function output: “monkey” “cat” “dog”

11 Pick the “Best” Function
Image Recognition: Framework “cat” A set of function Neural Network Training Testing Model “cat” Step 1 Goodness of function f Using Pick the “Best” Function Repeat again Step 2 Step 3 Training Data “monkey” “cat” “dog”

12 Deep means many hidden layers
Neural Network neuron Input Layer 1 …… Layer 2 …… Layer L …… Output …… y1 …… y2 …… …… You can connect the neurons by other ways you like  How many layer is deep? CNN just another way to connect the neuros. You can always connect the neurons in your own way. “+” is ignored Each dimension corresponds to a digit (10 dimension is needed) …… yM Input Layer Output Layer Hidden Layers Deep means many hidden layers

13 作業說明

14 作業一 作業說明(Lecture 1~5) Task 1 “5” “0” “4” “1”
basic:higher than a specific accuracy (98.0%) option:analyze the output of each layer

15 作業一 Task 2 Network 政治 體育 政治 財經
體育 政治 財經 basic:higher than a specific accuracy (78.0%) option:analyze the output of each layer

16 作業一 More reference: Example code of task 1: s/mnist_mlp.py Example code of task 2: s/reuters_mlp.py Neural Networks and Deep Learning Chapter 1 - 3

17 作業二 作業說明(Lecture 6) Image Recognition Network “monkey” “monkey” “cat”
“dog” “dog”

18 作業二 Basic:higher than a specific accuracy (81.0%)
option:analyze the functionality of “filter” More Reference: Example code: s/cifar10_cnn.py Neural Networks and Deep Learning (Chapter 6)

19 作業三 作業說明、Corpus(Lecture 7, 9) Machine learns human language
Machine writes documents The life is ……. You do not have to teach machine grammars ……. Basic: Let machine generate an English sentence Option: Let machine generate a Chinese sentence

20 作業三 Machine learns human language More reference
Example code: examples/lstm_text_generation.py effectiveness/ Understanding-LSTMs/

21 作業四 作業說明(Lecture 8) Auto-encoder: unsupervised learning NN Encoder
Basic: visualize the “code”. Does different digits represent by different “code”? NN Decoder code Option: Given a “code”, can machine write a digit?

22 作業四 Auto-encoder: unsupervised learning More reference:
keras.html Advanced: Auto-Encoding Variational Bayes, Generative Adversarial Networks, Replacing “digits” with “images”

23 作業五 Anime Face Generation
復旦大學 作業說明(何之源的知乎): DCGAN:

24 The evolution of generation
NN Generator v1 NN Generator v2 NN Generator v3 Discri-minator v1 Discri-minator v2 Discri-minator v3 Binary Classifier Real images: Using a discriminator to help training the generator

25 Basic Idea of GAN Normal Distribution NN Generator v1 Step 1 1 1 1 1
Step 1 1 1 1 1 Discri-minator v1 image Optimizing the Discriminator by minimizing the loss of discriminator. 1/0

26 Basic Idea of GAN Normal Distribution NN Generator Next step: v1
Updating the generator by minimizing the JS divergence between the two images but fixing the discriminator. v2 The output be classified as “real” (as close to 1 as possible) Discri-minator v1 Generator + Discriminator = a network 1.0 0.13

27 Anime Face Generation 100 updates

28 Anime Face Generation 1000 updates

29 Anime Face Generation 2000 updates

30 Anime Face Generation 5000 updates

31 Anime Face Generation 10,000 updates

32 Anime Face Generation 20,000 updates

33 Anime Face Generation 50,000 updates

34 Have Fun! 


Download ppt "深層學習 暑期訓練 (2017)."

Similar presentations


Ads by Google