Chevron Left
返回到 Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization

學生對 deeplearning.ai 提供的 Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization 的評價和反饋

4.9
42,297 個評分
4,513 條評論

課程概述

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow. After 3 weeks, you will: - Understand industry best-practices for building deep learning applications. - Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking, - Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence. - Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance - Be able to implement a neural network in TensorFlow. This is the second course of the Deep Learning Specialization....

熱門審閱

XG

Oct 31, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

AM

Oct 09, 2019

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

篩選依據:

126 - Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization 的 150 個評論(共 4,447 個)

創建者 Shangjin T

Mar 02, 2018

I've learnt much from course including preprocessing (mini-batch, regularization, normalization), gradient descent algorithm (batch gradient descent, stochastic gradient descent, mini-batch gradient descent) and the variants (momentum, RMSProp, Adam). Also there's TensorFlow tutorials which I love best.

Thanks for Andrew Ng for bringing us such an amazing fundamental course of DNN!

創建者 sourabh

Oct 17, 2019

This course really helped me getting the deep insight into the hyper-parameters which need to be tuned to get the optimal learning of the algorithm with the different algorithms necessary for improving learning rate.Andrew Ng really simplified the tough things and arranged them in a proper series of videos that is easy to understand.This will really help me lot in future.Cheers!

創建者 Danilo Đ

Dec 04, 2017

I suppose Hyperparameter tuning, Regularization and Optimization are some of the most important aspects of Deep Learning, since 90% of most of the DL projects come down to just that. Andrew masterfully dives into the intuitions behind some of the most widely used approaches, and the programing assignments are designed to show the impact good tuning could have on a DL algorithm.

創建者 Mohammed A

Jan 07, 2018

Great explanation of optimizations that can help speed up deep learning algorithms. Loved the little tips and tricks that are covered in different sections. The easy with which Prof. Ng explains complex concepts and analogies is commendable. The programming assignments are very helpful to people without expert programming experience too, that makes the experience very smooth.

創建者 Anirudh S

Nov 06, 2017

In my opinion it would be a good to have a short video describing how to drive the ml project in the company. As i am taking ml course and this specialization, I started with working on octave, then numpy then tensorflow, so it would be good to have some advice/tips on when to use octave or numpy or tensorflow for building a model when you get a project in ml in your job.

創建者 saad a

Oct 04, 2017

Post the first course, this course would is the one that is going to make you feel like a deep learning practitioner. You get to understand why deep learning is sometimes called an art how much difference in terms of speed and accuracy can be made just by tuning the hyper parameters. Highly recommended if you know deep neural networks and willing to dive deeper into them.

創建者 xun y

Apr 07, 2019

Again a great course about deep learning. The course structure is very well defined, with step by step to build technical foundations in the beginning and later using open source deep learning framework to connect all the pieces together. Dr. Andrew Ng made all of them very easy to learn and sometimes I feel like I should jump out the comfortable zone he created for us.

創建者 Willismar M C

May 22, 2018

Very nice course about important subjects of Vanilla Neural Networks, as optimizations algorithms , regularization methods, hyper-parameters used and how to implement them in practice. A very nice chapter on the sequence of the specialization that give me understanding on important aspects of it, how to use and how to implement them. I really enjoyed each detail of it.

創建者 Bharath S

Jul 08, 2019

This course gives a very good idea of the overfitting problem in deep learning and different ways to overcome it. It also introduces commonly used optimization methods in deep learning. A nice introduction to tensorflow is provided in the last week's programming assignment. Overall it is a very satisfying course. Many thanks to the instructor and the entire team!

創建者 Hari K M

Jan 04, 2018

Key course in the specialization and covers wide array of topics which are responsible for improving the DNNs. Complicated than the first course but very well explained by Andrew Ng. Things definitely get clear after doing the programming assignments. One should definitely complete this course if one has already completed the first course. I totally recommend it.

創建者 Bilal A

Jan 12, 2020

Course was amazing, content was amazing, assignments was amazing.

Andrew Ng is the best teacher I have ever experienced in my life. I learned a lot from this course, these things are very difficult to learn from research papers it takes a lot of time but person with great passion of deep learning can learn all these things in just three weeks. Highly Recommended.

創建者 Hiep P

Nov 29, 2017

In era of deep learning bloom, know how to control network model is an important thing. And this course has them all, from tuning learning rate to speed-up convergence or applying drop-out for avoiding overfit, etc... It shows you the under-the-hood theory and brings you the knowledge to grasp the basics yourself, and actually can apply back into your projects.

創建者 WALEED E

Jan 08, 2019

The course is very useful for being acquainted with tuning hyper-parameters and modern optimization algorithms like momentum, RMSProp an Adam. It is also introducing how to prevent over-fitting efficiently from recent papers in addition to mini batching training data. Although it introduces TensorFlow in a brief way, the overall assessment needs some revision.

創建者 Jaime A

Sep 08, 2017

Very clear, straight to the point, explanations with very well guided programming assignments in Python to hammer the concepts. A lot of knowledge and experience condensed in just a few hours and materials. I recommend previous exposure to Python and Machine Learning to make the most of this course (Ng's Coursera's course provides a very solid foundation)

創建者 Amaranath B

Oct 13, 2019

This is an amazing course , the way they had designed the transition from numpy to tensorflow was amazing. The the concepts of gradient descent with momentum to adam optimizer was great coming from your previous course , I can't express how much this has grounded my understanding. I'm pushing myself to complete the specialization. Thanks a lot everyone !

創建者 Naveen K

Sep 25, 2017

The course if very structured. Can't think of any improvement in course structure. Will like to thank Andrew Sir for this great effort.

As an improvement it would be great if people can be encouraged to solve problems on different dataset on internet such as kaggle. Such sources with other help can be provided as work to do after the completion of Kaggle.

創建者 Gaurab B

Jun 19, 2019

Brilliant material altogether.. almost a compulsory course for researchers diving on the ocean of deep learning.. While I was reading papers on deep learning I came across all these terms but couldn't understand it.. Now the picture is pretty clear... Thanks Prof. Andrew Ng for this wonderful effort. I have already recommended this course to everyone.

創建者 zhijun l

Dec 06, 2018

A great course talks about the detail in building Neural networks. With the first course as a foundation, student taking this definitely will get a better understanding on hyperparameter tuning and optimization, in addition on training neural networks. I recommend this course to those who would like to know neural networks more than just the concept!!

創建者 Oliver M

Aug 14, 2017

Having completed Udacity 730 on Tensorflow, I found Andrew Ng filled crucial gaps in my understanding. He is not afraid of presenting some maths to build intuition, but he always presents it in a straightforward way. Compare his explanation of Adam optimisation with the source paper on the subject. Andrew boils it down and serves it up beautifully.

創建者 Adail M R

Sep 13, 2017

Once more, Prof. Ng show in his simple style how to tackle the tough subject of hyperparameter tuning, pointing to several techniques and helping us selecting the most appropriate ones for the task at hand. The Tensorflow introduction is also very effective and engaging! Looking forward to advance my knowledge and experience with the next courses!

創建者 Diego A P B

Mar 06, 2018

Hyperparameter tuning and the other techniques seen in this course are not perceived to be the most fashionable areas of machine learning and deep learning. Nonetheless, they are crucial parts, and thus the techniques shown in this course will show you how to save great amounts of time and headache when trying to improve and finetune your models.

創建者 Nestor H

Jun 06, 2018

It was a great course to take. I could grab basic knowledge on TensorFlow and on some optimization techniques. I consider all the optimization algorithms are based on gradient descent, it is just that they tweak some parameters, but they are gradient-descent like algorithms. In summary, Dr. Ng is a genius and it is worth taking all his classes.

創建者 Jay P G

Dec 31, 2019

After knowing the basics of Deep Learning and Neural Networks (From the course 1) , this course explains the crux of improving and tuning of the neural networks and it's parameters and Hyper parameters . And the intro to tensor flow at last was just awesome(not exaggerating it!!!) . Congrats to Andrew and his team for such an awesome course .

創建者 Shivdas P

Dec 24, 2019

This course extends what has been taught in the preceding course, especially the different hyper parameters and optimisation strategies. Getting started with TensorFlow in a complete end-to-end example has been one of the things I was looking for and this course puts all that and many other things into perspective. Thanks Andrew and team !!

創建者 Tamas K

Aug 03, 2019

The course was great, thank you! However, I'm really looking forward using Tensorflow in C++ or Swift. The obscure, untyped nature of Python facilitates cargo-cult habits, creates some mystic fog around the variables (since it's not explicit if e.g. 'cost' is a concrete float or an entire computation waiting to be executed) and error-prone.