返回到 Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization

4.9

星

54,387 個評分

•

6,212 條評論

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow.
After 3 weeks, you will:
- Understand industry best-practices for building deep learning applications.
- Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking,
- Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence.
- Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance
- Be able to implement a neural network in TensorFlow.
This is the second course of the Deep Learning Specialization....

NA

Jan 14, 2020

After completion of this course I know which values to look at if my ML model is not performing up to the task. It is a detailed but not too complicated course to understand the parameters used by ML.

XG

Oct 31, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

篩選依據：

創建者 Mihai L

•Jan 21, 2018

This course is also interesting. The art of tuning hyper parameters and other optimization techniques are very interesting and nicely explained.

The introduction to Tensorflow and assignment is also interesting.Overall the difficulty is not high but the concepts are really powerful and important ,most scaffollding is done

創建者 Vlad M

•Sep 07, 2018

The course part is overall good.

The last assignment can be improved in two key ways:

The comment # Z3 = np.dot(W3,Z2) + b3 should be # Z3 = np.dot(W3,A2) + b3 - figured this out by myself without help from forums. :)

Also, the Adam optimization is not very apparent in the instructions - searched in the forums for issues.

創建者 Brad M

•Aug 22, 2019

In my deep learning classes in academia, hyperparameter tuning was always "hand-waved" away - my questions were always deflected, or put off. This class answered every one of my questions, and made me more confident I'd be able to implement a DL system in industry, and be satisfied with the results. Very good course!

創建者 Zeinab B

•May 04, 2020

This course will cover everything you need regarding your neural network performance. I always had questions on why and when you use Adam, SGD, etc. and after this course, I have a much better understanding of how to choose hyperparameters and optimization methods. I highly recommend this course to ML practitioners.

創建者 Toby K

•Nov 01, 2019

I am working through the DL specialisation. Consistently good teaching style and the programming assignments are suitably pitched for getting the learner to pick up methods quickly e.g. Tensorflow syntax for self-application later. Good course and looking forward to the next in the series. Well done Andrew and team.

創建者 Ankur T

•Nov 21, 2018

word is not sufficient signup and experience it. For a deep learning beginner who already have math background can easily understand concept behind it but for implementation you need to refer extra materials on internet and book too. Andrew Ng explain only concept and recipe but for practice you will struggle hard.

創建者 afshin m

•Feb 05, 2018

This course is continuation and a requirement of the first course. Really like the learning style of how first course and the first 2 weeks of the second course taught neural networks by doing all the math and calculations manually and finally introduced Tensorflow with parallels of what was taught in the class.

創建者 arulvenugopal

•Dec 17, 2017

This is another excellent course in this specialization. I enjoyed the programming assignments. The instructions, tips made Tensor flow coding section to be easy . However, few blocks consumed more than few hours, due to placeholders. logic and the TF documentation is overwhelming. I am proceeding to next course.

創建者 Wei L

•Aug 26, 2017

This course is harder than the previous one. It teaches more details of tuning parameters and optimization in deep learning. In the end it also teaches tensorflow which is really helpful. It's like a programming course, nerally all the commands have been already provided, so it's not hard to get the code correct.

創建者 Muhammad T

•May 26, 2020

As usual, Andrew is a great instructor. He taught very complex concepts in very simple language and used notations that were easy to understand and were consistent throughout the length of the course. WOULD DEFINITELY RECOMMEND. I am hoping to complete the specialization in less than a month. 2 down, 3 to go!!!

創建者 姜云鹏

•Nov 21, 2017

It is really good and teach me the basic understanding of DeepLearning back propagation and gradients optimization like Momentum, RMPS, Adam finally I learn how to use Tensorflow to train my model.

But there are some mistakes in the assignments and also in the grade so that it costs me a lot of time but useless.

創建者 Mushfiqur R

•May 03, 2020

It was a good course on understanding various hyper-parameters, some regularization method, optimization of algorithms, various gradients and gradient checking, batch - mini batch, exponentially weighted average , some tuning algorithms and finally a small introduction to deep learning frameworks. RECOMMENDED!

創建者 Vinodh R

•Nov 12, 2017

The course content was excellent. The only issue is that there were some glitches with the grading of the second week programming assignment, in that I could obtain the expected output, but with repeated submissions, there would be (different) sections which could not be graded due to unnamed technical issues.

創建者 Altaf K

•Apr 06, 2020

5/5.Thank you sir for helping me in my career.I recommend everyone to go through this course if you really want to learn detail about hyper parameter tuning , optimizers and regularization used to make neural network better. It helps to open black box of Neural network and know in detail about how all works.

創建者 Renato L

•Jul 03, 2019

Excellent content and very well explained. Thanks for this amazing course.

The course cover the building blocks of a Neural network. Andrew (and his team) did a great job by organizing the content in an evolving way in which you have the chance to build the knowledge from each piece of a (deep) Neural Network.

創建者 Bryan H

•May 28, 2018

Practical programming lessons, and well-paced enjoyable lectures.

Comments:

Move tutorials on TensorFlow to Course 3, which was the most obscure part of the course. TensorFlow isn't as intuitive as other numerical toolboxes, so spending more time on the foundations of TensorFlow might reduce the learning curve.

創建者 LIUZHENTAO

•Sep 05, 2020

A wonderful AI course! In most Ai courses we could only learn some specific algorithms. In this course, however, we could learn beyond AI itself. There are many practical AI skills in this course like hyperparameter tuning, regularization method and optimization strategies! I benefit a lot from this course!

創建者 Mojtaba H

•Feb 11, 2020

It covers very good tips and tricks to build and enhance deep learning model.

Andrew is the best teacher for ML and Deep Learning, he covers all theory and practice simultaneously.

In this course you can understand all mathematical intuitions and implementation of neural network from scratch by your own codes.

創建者 B G

•Sep 14, 2020

Another great class taught by the incredible Prof. Ng! I have to admit there were time I felt a bit overwhelmed but by the time the course came to an end, I felt like everything "clicked". Very much looking forward to the next course and can't wait to dive deeper in ML frameworks. TensorFlow, here I come :D

創建者 Shrikrishna B R

•Jul 17, 2020

It is a very good follow up course in this Specialization. It is about how we can improve our a accuracy/predictions by tuning hyperparameters, using better optimization techniques and it also talks about deep learning frameworks. Overall it was a good course. Thank You Andrew Ng for this wonderful course.

創建者 Juan C B

•Mar 08, 2020

Good second course to understand how we can improve our deep learning models with a good hyperparameter selection, some regularization techniques to reduce overfitting such as dropout, l2, early stopping and some optimization techniques for when we have a large datasets like momentum, RMS prop, adam, etc..

創建者 Rob v P

•Oct 02, 2017

This second course in the specialization is really great. I have gained a lot of insight in hyperparameter tuning and the reason why they work (or don't ;-). It is much easier now to understand what models are doing and why we need certain techniques. This is again one of the best courses for deep learning.

創建者 Abdallah D

•Feb 03, 2020

Fantastic course providing a broad overview of hyperparameter tuning in deep neural networks. The introduction on TensorFlow is informative. Looking forward to the three remaining courses of this great specialization on machine leaning. Thanks Andrew and their assistants for putting those courses together!

創建者 Daniel R B

•Jun 06, 2018

I really liked the course. The forum is very helpful navigating programming errors during the assignments.

A thing to improve would be to get the feedback from the forums to the lectures. Specially in corrections that should be made to the programming assignments that don't match the expected result. Thanks

創建者 Steve S

•Dec 11, 2017

Provided a lot of deeper insights passed over in the previous course in the specialization. Between this course and the previous course, you feel like you have a very solid beginner's understanding of deep learning, but one that is also practical enough and comprehensive enough to start coding on your own.

- Finding Purpose & Meaning in Life
- Understanding Medical Research
- Japanese for Beginners
- Introduction to Cloud Computing
- Foundations of Mindfulness
- Fundamentals of Finance
- 機器學習
- 使用 SAS Viya 進行機器學習
- 幸福科學
- Covid-19 Contact Tracing
- 適用於所有人的人工智能課程
- 金融市場
- 心理學導論
- Getting Started with AWS
- International Marketing
- C++
- Predictive Analytics & Data Mining
- UCSD Learning How to Learn
- Michigan Programming for Everybody
- JHU R Programming
- Google CBRS CPI Training

- Natural Language Processing (NLP)
- AI for Medicine
- Good with Words: Writing & Editing
- Infections Disease Modeling
- The Pronounciation of American English
- Software Testing Automation
- 深度學習
- 零基礎 Python 入門
- 數據科學
- 商務基礎
- Excel 辦公技能
- Data Science with Python
- Finance for Everyone
- Communication Skills for Engineers
- Sales Training
- 職業品牌管理職業生涯品牌管理
- Wharton Business Analytics
- Penn Positive Psychology
- Washington Machine Learning
- CalArts Graphic Design

- 專業證書
- MasterTrack 證書
- Google IT 支持
- IBM 數據科學
- Google Cloud Data Engineering
- IBM Applied AI
- Google Cloud Architecture
- IBM Cybersecurity Analyst
- Google IT Automation with Python
- IBM z/OS Mainframe Practitioner
- UCI Applied Project Management
- Instructional Design Certificate
- Construction Engineering and Management Certificate
- Big Data Certificate
- Machine Learning for Analytics Certificate
- Innovation Management & Entrepreneurship Certificate
- Sustainabaility and Development Certificate
- Social Work Certificate
- AI and Machine Learning Certificate
- Spatial Data Analysis and Visualization Certificate

- Computer Science Degrees
- Business Degrees
- 公共衛生學位
- Data Science Degrees
- 學士學位
- 計算機科學學士
- MS Electrical Engineering
- Bachelor Completion Degree
- MS Management
- MS Computer Science
- MPH
- Accounting Master's Degree
- MCIT
- MBA Online
- 數據科學應用碩士
- Global MBA
- Master's of Innovation & Entrepreneurship
- MCS Data Science
- Master's in Computer Science
- 公共健康碩士