Chevron Left
返回到 Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

學生對 提供的 Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization 的評價和反饋

57,892 個評分
6,657 條評論


In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....



Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.


After completion of this course I know which values to look at if my ML model is not performing up to the task. It is a detailed but not too complicated course to understand the parameters used by ML.


5526 - Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization 的 5550 個評論(共 6,582 個)

創建者 AK


Very good course. But unlike the previous one, I got the feeling we covered too much ground before the quizes. Perhaps having multiple quizes could make the learning stick a bit more.

Also, the intermediate verification of the programming assignment (tensorflow) was a little less satisfying than before because the intermediate "expected results" were mostly results of variable initialization or allocation. This is understandable because the "run" doesnt happen until a few steps later. But overall, the previous exercises were more rewarding even leading up to the big final "run everything together" part.

創建者 Christian M N


Videos are very good, can't really criticize much there. The assignments are WAY too easy though. There's really no reason why they can't just let you implement more of the boiler/helper code, since everything is already auto graded. I think that guiding the user with the notebook structure and providing a description for what each function should do and the output shape should be more than enough for any user to do these assignments. As it is, these assignments don't really provide any assurance that that you understand the material, since the answer is always in the description.

創建者 Abhishek R


It's a very useful course. The course material is well spaces out and encompasses the basics requires to utilise an algorithm. The programming exercises are easy to implement and rather rewarding when completed. Perhaps the only issue I had with the course was that it only taught enough tensorflow to allow us to implement the functions necessary for that particular problem. A more general understanding could have helped. Also, it, like most other ML/DL courses, never addresses the issue of actually accumulating or acquiring a dataset, which I find to be rather important to learn.

創建者 Eric W



just a brief feedback from my side. As a beginner in Deep Learning and Machine Learning in general the course was really the teaching style I was looking for, quite close to what I was and am used to at the University. One particular thing that was not so easy to come to terms with was the switch from mathematical notation in the slides to the Python expressions used in the assignments. Of course it was possible to learn them after some time, but I felt the learning curve a bit steep at that point assuming one has barely practical experience with it.

Anyway, a great course!

創建者 Daniel C K


Good overview of techniques to use in deep learning. I especially appreciated the introduction to Tensorflow. The projects felt like they held your hand a bit too much. I'd like to see more rigorous assignments in the future. The Tensorflow tutorial felt unpolished. It contained a few errata and the tutorials were sometimes vague about how to use the syntax. I ended up having to look up the documentation for a few of the commands to understand how to use them. That's a minor issue for me, I have experience working in python, but for other learners it might be an issue.

創建者 Andrew F


I enjoyed everything in this course. As always, the concepts and motivations for the various deep learning techniques are very well explained. I feel like I could have a conversation with members of the industry and not come across as a total novice (although I am).

The only real issue I had was regarding Tensorflow. I felt more time should be spent on Tensorflow before assigning homework on it. I believe in a certain amount of learning though struggle when it comes to programming, but I think the foundations for tensorflow were lacking to sufficiently struggle through.

創建者 Rajesh R


A continuation of the Deep Learning specialization, this course actually teaches many of the latest ideas in hyperparameter optimization and builds up the ideas nicely. Concepts like EWMA, RMSProp, Momentum and Adam were well explained and logically introduced. One gripe I have is Tensorflow - despite not liking the framework much (primarily because of its terrible error messages), I found that the foundational learning for key concepts in TF were not well introduced. There was only one video which served as a Tensorflow introduction. Other than this, the course was great.

創建者 Nachiketa M


TensorFlow uses slightly different terminology. That took some time to get used to. Also, because of so many algorithms, parameters, it becomes difficult to remember everything. It would be nice, if we could search for terms and either get to the point in video where the terms are mentioned and explained or results contain sections of slides as presented in the video. If this kind of search works across all the courses in a specialization, that would also be great. Overall, Andrew Ng makes it really easy to understand and I am glad I am making progress.

創建者 Deepak K G S


Very good presentation material and deep intuitive explanation by Professor Andrew NG . Quizzes are structured in a way that it will test all the sections you have learned in that week.Programming assignments will provide an idea on how to approach each of the problems.In addition to taking this course,I would also recommend you to try and code using the basic code structure presented in the lecture and assignments to build upon and see what works and what does not in the problems.Only then,you can see the benefit of what is taught in this lecture.

創建者 Ravi R


Very good course for those who wants to start their career in Deep learning. One thing which disappointed me was programming assignments. Some functions and libraries of python and Tensorflow used in assignments are not well explained for students. How can a student understand if he wants to write code from scratch to develop an algorithm. Only small function or some logics are allowed to write by students in assignments which is not enough to build confidence. Many libraries imported are not explained. Theory part of course was excellent.

創建者 Lucas S


Theoretical part amazing, explanations very comprehensive. I think is the best course on deep learning right now. The one thing i would like to see improved is the structural choice for the practical part: this concept of functions that already built in and we come in and fill in the code is ok, and it helps, but i think there should be some kind of path where we can build everything from scratch and you guys could provide the answers as something we can check to see if we got it right...i don't maybe could help, but overall amzing course.

創建者 Markus B


Pro: The course content is well explained and the examples are usually understandable. There are some well explained programming exercises that allow you to get in touch with the "machine room".

Con: Not enough programming exercises to explain all concepts and also the programming exercises sometimes boil down to copy&pasting some code from the instructions. Furthermore, I would expect that this couse with "intermediate" difficulty would allow you to really write code from scratch at some point instead of filling in "Jupiter" notebooks.

創建者 Mijael M


The content is great as usual, but I have two minor complaints: the quality of prof. Ng's handwriting went down, which sometimes makes it more difficult to follow the explanation, or taking notes; the second one is that the error reporting for the grader on the programming exercises is not very user-friendly. I had to try a couple times on weeks 2 and 3 not because my code was wrong at all, but because the grader was finicky. Due to the honor code, I believe I won't be able to post more details here, but check on the forums.

創建者 Aaron L


The content is great, let me say that first and foremost. I feel like some small improvements would be that there were some typos in the notebooks, but not big deal. Helps one learn about debugging and think independently.

About the TensorFlow section of week 3. It was a pretty deep dive into TensorFlow, and I ended up going to the documentation a lot. Maybe some background on the framework would help. I will probably next go through the TensorFlow "getting started" tutorial, to better understand it.

創建者 Eddson E M N


The course is pretty good. I just feel notation used by Andrew is quite confusing for people with matrix algebra and matrix calculus. I understand the course is intended for people with different knowledge leveles but generalizing notation with matrix algebra could be save time for students.

There are some little bugs on the last Jupyter implementation with TensorFlow. Nothing too serious but reading the forums I noticed bugs were reported one year ago and nothing has been done to fix them.

創建者 Sudhir K


This was a great course with a great assignment. The assignments were moderately hard to complete. I think if students were challenged to improve accuracy of the model by a X%(10%) for extra credit. It this would have triggered independent thinking. I think Students can do it without extra credit also. I think extra credit from Instructor triggers different incentive to complete it. This was done to some extent in the 1st course. I think doing it in this course also would have been ideal.

創建者 Hamidreza C


Many many thanks for putting this great deep learning specialization together!!!

For course 2, it took long long to get to the meat of the course, i.e. hyper parameter tuning, and yet there were no exercises to grasp how we can tune (more than one) hyper parameters through programming exercise. Perhaps we will learn that in course 3. I haven't done it yet.

The first course exercises were more effective.

Other than this comment, everything else for this specialization course looks awesome.

創建者 Amit P W


Hyperparameter tuning to improve performance of model is one of the most important part of lifecycle of development of any machine learning model. I would say with confidence now that I have at least got intuition of how different hyper parameters affect the performance of model and how to obtain the optimal value of them. I have got some imagination around hyper-parameters. Thank you Andrew and all team for taking diligent efforts to make this course easy to understand.

創建者 Shiraz R


Course content was complex, yet progressive, helping to grasp key concepts easily. I think the assignment material can be improved. For instance, I got a full grade on the Tensorflow assignment, but my compute_cost function was wrong (hadn't passed the right arguments to the tf cross-entropy cost function). Some of the assignment instructions are also unclear at times.

Overall, this course helps build some invaluable skills for practical machine learning applications.

創建者 André M


4* only because the TensorFlow lectures and assignment were too much in too little time. Also from what I see, TF has massively changed syntax to 2.0 so it felt a bit pointless to learn TF1 syntax (which is ***horrible***) at this point. To me it detracted a lot from the learning experience.

The remaining lectures and modules were excellent as usual though. I'd still recommend this highly, and Andrew's insights into what tends to work and why are brilliant as always.

創建者 Roudy E


Another great course, the amount of information per week is right on point (not too packed and not too poor). Also, it was interesting to go behind the scenes and learn what batch normalization and regularization actually does and how it can actually help a neural network perform better. And, to top it off, it gives a brief introduction on TensorFlow and how to use it, although it would have been better if the course thought the material on TF 2.0 instead of 1.0.

創建者 Konstantinos K


The course is great!

It really helps in understanding how the algorithms work, under the hood and the implementation tips

are very helpful! (This is visible in both the Optimization and Batch Normalization algorithms sections)

It is awesome that a programming framework is also introduced in the course, Tensorflow. But to be honest PyTorch could be also introduced, in order to select the framework in which the student could implement the last programming assignment.

創建者 Joshua H


The content covers a wide variety of useful topics in deep learning. Andrew's explanations are sufficient, as are his use of both examples and analogies. I was only slightly disappointed to see that he has left the derivation of the equations governing back propagation along a batch normalized neural network as an exercise to his audience. The quizzes were sufficiently challenging, and the programming exercises were either informative or insightful, or both.

創建者 Dheeraj I


I felt this interesting but bit easier compared to the first course. Please don't provide the parameters of a method directly in the description above. I want to learn how this method can be executed by thinking and understanding the parameters I have to pass to this method. So, I felt the tensorflow assignment little straight forward. But overall a very good course. I need to practice a lot to actually understand and write the code from scratch. Thank you.

創建者 Jian L


I wish to give 4.5 instead. The only pitfall is the whole video series have a high frequent sound which keep distracting me when try to concentrate to the content.

content vise is very good. Coding practice is very helpful in understand the process. However there is only a basic level. With giving too much help on the background, it's very easy forget afterwards. May be a suggestion more practice would be better.

After all, it's the best course in DL for me.