This course is for novice programmers or business people who would like to understand the core tools used to wrangle and analyze big data. With no prior experience, you will have the opportunity to walk through hands-on examples with Hadoop and Spark frameworks, two of the most common in the industry. You will be comfortable explaining the specific components and basic processes of the Hadoop architecture, software stack, and execution environment. In the assignments you will be guided in how data scientists apply the important concepts and techniques such as Map-Reduce that are used to solve fundamental problems in big data. You'll feel empowered to have conversations about big data and the data analysis process.
提供方
加州大学圣地亚哥分校
課程信息
51,286 次近期查看
學習Course的學生是
- Data Engineers
- Data Scientists
- Data Analysts
- Machine Learning Engineers
- Software Engineers
您將獲得的技能
Python ProgrammingApache HadoopMapreduceApache Spark
教學大綱 - 您將從這門課程中學到什麼
週
1完成時間為 2 小時
Hadoop Basics
Welcome to the first module of the Big Data Platform course. This first module will provide insight into Big Data Hype, its technologies opportunities and challenges. We will take a deeper look into the Hadoop stack and tool and technologies associated with Big Data solutions.
7 個視頻 （總計 53 分鐘）, 4 個閱讀材料, 1 個測驗
7 個視頻
The Apache Framework: Basic Modules3分鐘
Hadoop Distributed File System (HDFS)5分鐘
The Hadoop "Zoo"5分鐘
Hadoop Ecosystem Major Components11分鐘
Exploring the Cloudera VM: Hands-On Part 116分鐘
Exploring the Cloudera VM: Hands-On Part 26分鐘
4 個閱讀材料
Apache Hadoop Ecosystem10分鐘
Lesson 1 Slides (PDF)10分鐘
Hardware & Software Requirements10分鐘
Lesson 2 Slides - Cloudera VM Tour10分鐘
1 個練習
Basic Hadoop Stack20分鐘
週
2完成時間為 3 小時
Introduction to the Hadoop Stack
In this module we will take a detailed look at the Hadoop stack ranging from the basic HDFS components, to application execution frameworks, and languages, services.
10 個視頻 （總計 70 分鐘）, 6 個閱讀材料, 3 個測驗
10 個視頻
The Hadoop Distributed File System (HDFS) and HDFS28分鐘
MapReduce Framework and YARN8分鐘
The Hadoop Execution Environment4分鐘
YARN, Tez, and Spark11分鐘
Hadoop Resource Scheduling6分鐘
Hadoop-Based Applications3分鐘
Introduction to Apache Pig7分鐘
Introduction to Apache HIVE7分鐘
Introduction to Apache HBASE7分鐘
6 個閱讀材料
Hadoop Basics - Lesson 1 Slides10分鐘
Lesson 2: Hadoop Execution Environment - Slides10分鐘
Lesson 3: Hadoop-Based Applications Overview - All Slides10分鐘
Command list for Applications Slides10分鐘
Tips to handle service connection errors10分鐘
References for Applications10分鐘
3 個練習
Overview of Hadoop Stack10分鐘
Hadoop Execution Environment14分鐘
Hadoop Applications12分鐘
週
3完成時間為 2 小時
Introduction to Hadoop Distributed File System (HDFS)
In this module we will take a detailed look at the Hadoop Distributed File System (HDFS). We will cover the main design goals of HDFS, understand the read/write process to HDFS, the main configuration parameters that can be tuned to control HDFS performance and robustness, and get an overview of the different ways you can access data on HDFS.
9 個視頻 （總計 58 分鐘）, 5 個閱讀材料, 3 個測驗
9 個視頻
The HDFS Performance Envelope5分鐘
Read/Write Processes in HDFS4分鐘
HDFS Tuning Parameters6分鐘
HDFS Performance and Robustness9分鐘
Overview of HDFS Access, APIs, and Applications5分鐘
HDFS Commands8分鐘
Native Java API for HDFS4分鐘
REST API for HDFS8分鐘
5 個閱讀材料
Lesson 1: Introduction to HDFS - Slides10分鐘
HDFS references10分鐘
Lesson 2: HDFS Performance and Tuning - Slides10分鐘
HDFS Access, APIs10分鐘
Lesson 3: HDFS Access, APIs, Applications - Slides10分鐘
3 個練習
HDFS Architecture12分鐘
HDFS performance,tuning, and robustness10分鐘
Accessing HDFS12分鐘
週
4完成時間為 7 小時
Introduction to Map/Reduce
This module will introduce Map/Reduce concepts and practice. You will learn about the big idea of Map/Reduce and you will learn how to design, implement, and execute tasks in the map/reduce framework. You will also learn the trade-offs in map/reduce and how that motivates other tools.
9 個視頻 （總計 27 分鐘）, 3 個閱讀材料, 3 個測驗
9 個視頻
The Map/Reduce Framework2分鐘
A MapReduce Example: Wordcount in detail4分鐘
MapReduce: Intro to Examples and Principles2分鐘
MapReduce Example: Trending Wordcount1分鐘
MapReduce Example: Joining Data4分鐘
MapReduce Example: Vector Multiplication2分鐘
Computational Costs of Vector Multiplication3分鐘
MapReduce Summary2分鐘
3 個閱讀材料
Lesson 1: Introduction to MapReduce - Slides10分鐘
A note on debugging map/reduce programs.10分鐘
Lesson 2: MapReduce Examples and Principles - Slides10分鐘
1 個練習
Lesson 1 Review14分鐘
3.9
696 個審閱31%
完成這些課程後已開始新的職業生涯
26%
通過此課程獲得實實在在的工作福利
來自Hadoop 平台和应用程序框架的熱門評論
I'm forced to give 5 stars. I don't want to have a certification on a poor quality course (another coursera mistake). This material needs tremendous amount of work to get finished and revised.
Super hands on introduction to key Hadoop components, such as Spark, Map Reduce, Hive, Pig, HBase, HDFS, YARN, Squoop and Flume.\n\nI can't wait to the next course on the specialization.
講師
Natasha Balac, Ph.D.
Interdisciplinary Center for Data ScienceQualcomm Institute/CalIT2
Paul Rodriguez
Research ProgrammerSan Diego Supercomputer Center (SDSC)
Andrea Zonca
HPC Applications SpecialistSan Diego Supercomputer Center (SDSC)
關於 加州大学圣地亚哥分校
UC San Diego is an academic powerhouse and economic engine, recognized as one of the top 10 public universities by U.S. News and World Report. Innovation is central to who we are and what we do. Here, students learn that knowledge isn't just acquired in the classroom—life is their laboratory.
常見問題
我什么时候能够访问课程视频和作业？
注册以便获得证书后，您将有权访问所有视频、测验和编程作业（如果适用）。只有在您的班次开课之后，才可以提交和审阅同学互评作业。如果您选择在不购买的情况下浏览课程，可能无法访问某些作业。
我购买证书后会得到什么？
您购买证书后，将有权访问所有课程材料，包括评分作业。完成课程后，您的电子课程证书将添加到您的成就页中，您可以通过该页打印您的课程证书或将其添加到您的领英档案中。如果您只想阅读和查看课程内容，可以免费旁听课程。
退款政策是如何规定的？
有助学金吗？
還有其他問題嗎？請訪問 學生幫助中心。