返回到 Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

4.9

星

56,647 個評分

•

6,498 條評論

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow.
After 3 weeks, you will:
- Understand industry best-practices for building deep learning applications.
- Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking,
- Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence.
- Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance
- Be able to implement a neural network in TensorFlow.
This is the second course of the Deep Learning Specialization....

XG

2017年10月30日

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

NA

2020年1月13日

After completion of this course I know which values to look at if my ML model is not performing up to the task. It is a detailed but not too complicated course to understand the parameters used by ML.

篩選依據：

創建者 Anoop P P

•2020年6月5日

NIce Course on hyperparameters search and tuning. The optimization functions and its relation to the hyperparameters is well taught. Mini-bacth normalization during training and application of learned parameters in testing is discussed very well. At last, deep learning frameworks were introduced and the practical training on tensorflow framework was awesome. Thaks for the well designed content.

創建者 Ram N

•2020年1月1日

The course covers the theory and implementation details of advanced optimization algorithms. A good amount of intuition was provided in the explanation of these algorithms. A basic explanation of bias and variance and how hyper parameters affect them both is explained clearly. I liked the hands on part, as it allowed me to implement the algorithms discussed and gain more clarity in the process.

創建者 Harry ( D

•2018年7月20日

Very useful follow up to the first course in this specialization. Learned all the details of how to tune and optimize a deep neural network, as well as nice introduction to Tensorflow. Some typos in the comments of the final assignments but they were easy to spot. This time Jupiter notebooks worked better that during the time I was working on the previous course with less or no resets required.

創建者 Mukund C

•2019年10月14日

Excellent Course. Really structured way of learning the importance of hyper parameters and their effects on the learning/training and hammering concepts like "regularization" home.

Just an observations, but it seems like the mentors are not that engaged in these courses anymore, but there are enough help threads that one can figure out the questions - specifically on the programming exercises.

創建者 Ayush K

•2018年6月16日

What an amazing course it is. Perfect explanation how we can use optimize our cost more efficiently and effectively. Also this course includes techniques to overcome problems like over fitting i.e Regularization and Dropout techniques. Information about Batch Normalization is very splendid. Also got little intuition about tensor flow. Thank You Andrew Ng for providing such a wonderful course.

創建者 colinyu

•2018年1月15日

Prof Ng is a great teacher and is good at making the difficult material very easy to learn. I am very interested in the DL. Before I took this class, I found that since this field is very new so all the material you can find is a little piece and not systematical. This specialization is a wonderful and systematical, easy to learn and fun. Thanks for the great work those teacher have done .

創建者 Zhou S

•2018年3月8日

Awesome illustration on deep network's regularization techniques, weight initialization techniques and gradient checking, and more. This class provides you with hands-on experience with how to tune a deep network efficiently. You will not only learn the techniques but also understand many of the intuitions of how each technique works. A must take if you are dedicated into machine learning!

創建者 Rahul B

•2020年9月5日

This has been a very useful course and helps you to understand much more about neural networks including regularization, optimization algorithms, hyper parameter tuning and programming frameworks. The style of teaching and the programming assignments are of a really good standard. The quizes could be improved to be a bit more challenging but they still help to review content quite well.

創建者 Rusty M

•2018年12月7日

I learned a lot about the area that is not much talked about in deep learning, which is hyperparameter tuning! The forum was very helpful in debugging the programming assignments! Thank you Prof. Ng for the wonderful course. I thank Coursera as well for believing in me and granting me Financial Aid. It wouldn't have been possible without your help, Coursera Team. THANK YOU VERY MUCH! :D

創建者 Neeraj B

•2019年10月2日

This was an excellent follow-up of the first course. Having used adam optimization for almost all the neural network models I have build it was great to understand the mathematical intuition behind adam optimizers. Also the programming assignment gave a wonderful refresher and practice of tensorflow. Overall I'm glad hyperparameter tuning and optimization was chosen as a seperate course

創建者 MANRAJ S C

•2019年10月16日

The course is great and will help you in understanding on how to optimize your deep learning algorithm and tune your hyper-parameters. The course provides insights into the exponentially weighted averages concept too which helps you understand how things work behind the scenes when trying to optimize your algorithm. Dropout and regularization have also been explained to a good extent.

創建者 Chan-Se-Yeun

•2018年5月1日

This course is very useful for practical purpose. I've learnt a systematic method to develop and iterate my algorithms, which saves me a lot of time. And it's been the first time that I get to know so many variants of gradient descent method, such as Adam and RMSprop. By the way, the programming assignments get a bit hard, but it help me better understand the algorithms. Thanks a lot!

創建者 Andreea A

•2019年2月1日

This was a useful course for newbies in neural networks. It gave useful hints regarding how to update the model one is using based on what problems one observes, as well as how to tune the hyperparameters (if there is enough computational power or one runs a small problem). Obviously, this is just a starting point and one should invest a lot of time and energy to become experienced.

創建者 Jay G

•2018年9月23日

All the quality of the first course, but even better. My 4-stars for course one were addressed in these Jupyter notebooks. They were still manageable but the prompts provided very good reinforcement to the various tuning algorithms. A top-notch offering...one I'll be sure to recommend broadly. I'm very much looking forward to the remaining courses in the Specialization. Thanks!

創建者 Sarthak k

•2019年8月12日

I had a very good time getting teaching sessions from ANDREW NG .., I am a second year student and have entered in this field of deep learning since some months then i encountered this specialization and with the deep concepts of Sir ANDREW NG ,i am now able to make much more complicated models ever before...I hope i could get an autograph from my Ideal in this field

Mr.Andrew Ng

創建者 SUJITH V

•2018年10月26日

This is a great course to learn about practical aspects of neural networks. Some parts are challenging to consume as most of the material relies on intuition rather than detailed mathematical explanation. This helps to involve more people in the course who are intimidated by mathematical equations. A great addition would be to have optional mathematical details in separate videos.

創建者 Shangjin T

•2018年3月2日

I've learnt much from course including preprocessing (mini-batch, regularization, normalization), gradient descent algorithm (batch gradient descent, stochastic gradient descent, mini-batch gradient descent) and the variants (momentum, RMSProp, Adam). Also there's TensorFlow tutorials which I love best.

Thanks for Andrew Ng for bringing us such an amazing fundamental course of DNN!

創建者 Aakash K S

•2020年10月30日

Very well structured and thorough course. Instructor did a very good job in teaching the topics of NN such as Regularization, Optimization etc. and explaining the mathematical concepts such as moving average.

Lab made coding assignments easy to understand and code. Lab made it easy for me to understand the structure of NN and how to code clean NN functions for easy implementation.

創建者 sourabh

•2019年10月17日

This course really helped me getting the deep insight into the hyper-parameters which need to be tuned to get the optimal learning of the algorithm with the different algorithms necessary for improving learning rate.Andrew Ng really simplified the tough things and arranged them in a proper series of videos that is easy to understand.This will really help me lot in future.Cheers!

創建者 Danilo Đ

•2017年12月3日

I suppose Hyperparameter tuning, Regularization and Optimization are some of the most important aspects of Deep Learning, since 90% of most of the DL projects come down to just that. Andrew masterfully dives into the intuitions behind some of the most widely used approaches, and the programing assignments are designed to show the impact good tuning could have on a DL algorithm.

創建者 Mohammed A

•2018年1月7日

Great explanation of optimizations that can help speed up deep learning algorithms. Loved the little tips and tricks that are covered in different sections. The easy with which Prof. Ng explains complex concepts and analogies is commendable. The programming assignments are very helpful to people without expert programming experience too, that makes the experience very smooth.

創建者 Francisco G A

•2020年10月24日

An Excelent course on learning how to tune hyperparameters and also a peek in using TensorFlow (in the last week, and trust me, it's worth the wating) it's complete, educational and the professor Andrew Ng it's an excelent teacher! I would have liked some more practice on parameter tuning in the programming excercises. But in a nutshell it was a awesome learning experience!

創建者 Anirudh S

•2017年11月6日

In my opinion it would be a good to have a short video describing how to drive the ml project in the company. As i am taking ml course and this specialization, I started with working on octave, then numpy then tensorflow, so it would be good to have some advice/tips on when to use octave or numpy or tensorflow for building a model when you get a project in ml in your job.

創建者 Saad A

•2017年10月4日

Post the first course, this course would is the one that is going to make you feel like a deep learning practitioner. You get to understand why deep learning is sometimes called an art how much difference in terms of speed and accuracy can be made just by tuning the hyper parameters. Highly recommended if you know deep neural networks and willing to dive deeper into them.

創建者 xun y

•2019年4月7日

Again a great course about deep learning. The course structure is very well defined, with step by step to build technical foundations in the beginning and later using open source deep learning framework to connect all the pieces together. Dr. Andrew Ng made all of them very easy to learn and sometimes I feel like I should jump out the comfortable zone he created for us.

- Finding Purpose & Meaning in Life
- Understanding Medical Research
- Japanese for Beginners
- Introduction to Cloud Computing
- Foundations of Mindfulness
- Fundamentals of Finance
- 機器學習
- 使用 SAS Viya 進行機器學習
- 幸福科學
- Covid-19 Contact Tracing
- 適用於所有人的人工智能課程
- 金融市場
- 心理學導論
- Getting Started with AWS
- International Marketing
- C++
- Predictive Analytics & Data Mining
- UCSD Learning How to Learn
- Michigan Programming for Everybody
- JHU R Programming
- Google CBRS CPI Training

- Natural Language Processing (NLP)
- AI for Medicine
- Good with Words: Writing & Editing
- Infections Disease Modeling
- The Pronounciation of American English
- Software Testing Automation
- 深度學習
- 零基礎 Python 入門
- 數據科學
- 商務基礎
- Excel 辦公技能
- Data Science with Python
- Finance for Everyone
- Communication Skills for Engineers
- Sales Training
- 職業品牌管理職業生涯品牌管理
- Wharton Business Analytics
- Penn Positive Psychology
- Washington Machine Learning
- CalArts Graphic Design

- 專業證書
- MasterTrack 證書
- Google IT 支持
- IBM 數據科學
- Google Cloud Data Engineering
- IBM Applied AI
- Google Cloud Architecture
- IBM Cybersecurity Analyst
- Google IT Automation with Python
- IBM z/OS Mainframe Practitioner
- UCI Applied Project Management
- Instructional Design Certificate
- Construction Engineering and Management Certificate
- Big Data Certificate
- Machine Learning for Analytics Certificate
- Innovation Management & Entrepreneurship Certificate
- Sustainabaility and Development Certificate
- Social Work Certificate
- AI and Machine Learning Certificate
- Spatial Data Analysis and Visualization Certificate

- Computer Science Degrees
- Business Degrees
- 公共衛生學位
- Data Science Degrees
- 學士學位
- 計算機科學學士
- MS Electrical Engineering
- Bachelor Completion Degree
- MS Management
- MS Computer Science
- MPH
- Accounting Master's Degree
- MCIT
- MBA Online
- 數據科學應用碩士
- Global MBA
- Master's of Innovation & Entrepreneurship
- MCS Data Science
- Master's in Computer Science
- 公共健康碩士