Explore
For Enterprise
Join for Free
Log In

艺术与人文
商务
计算机科学
数据科学
信息技术
健康
数学和逻辑
个人发展
物理科学与工程
社会科学
语言学习
學位
證書

瀏覽 Coursera 的全部課程

瀏覽
搜索
企業版
登錄
免費加入

Reading JSON

Loading...

获取和整理数据

约翰霍普金斯大学

4.6（6,286 個評分） | 120K 名學生已註冊

課程 3（共 10 門，数据科学專項課程）

Before you can work with data you have to get some. This course will cover the basic ways that data can be obtained. The course will cover obtaining data from the web, from APIs, from databases and from colleagues in various formats. It will also cover the basics of data cleaning and how to make data “tidy”. Tidy data dramatically speed downstream data analysis tasks. The course will also cover the components of a complete data set including raw data, processing instructions, codebooks, and processed data. The course will cover the basics needed for collecting, cleaning, and sharing data.

查看授課大綱

您將學習的技能

Data Manipulation, Regular Expression (REGEX), R Programming, Data Cleansing

審閱

4.6（6,286 個評分）

5 stars
4,254 ratings
4 stars
1,541 ratings
3 stars
340 ratings
2 stars
87 ratings
1 star
64 ratings

AR

May 14, 2018

Loved the structure of the course. Learned a lot. The course project seemed a little funky , especially creating the codebook for an already existing set of data but was a useful teaching aid.

WC

Nov 01, 2016

This course is amazing! I have spent the majority of my time in R merely doing analytics. This course taught me the tools needed to go out and grab the data that I need for those analytics.

從本節課中

Week 1

In this first week of the course, we look at finding data and reading different file types.

Obtaining Data Motivation5:38

Raw and Processed Data7:07

Components of Tidy Data9:25

Downloading Files7:09

Reading Local Files4:55

Reading Excel Files3:50

Reading XML12:39

Reading JSON5:03

The data.table Package11:18

教學方

Jeff Leek, PhD
Associate Professor, Biostatistics
Roger D. Peng, PhD
Associate Professor, Biostatistics
Brian Caffo, PhD
Professor, Biostatistics

腳本

This lecture's gonna be about reading JSON.

JSON's another file format.

It's a little bit similar to XML in the sense that it's structured, and

it's also very commonly used on the internet.

So JSON is short for Javascript Object Navigation.

It's lightweight for data storage.

So it's very common in application programming interfaces

which are ways that you can programmatically detect access to data for

companies like Twitter or Facebook through URLs.

Similar structure to XML in the sense that it's a structured language, but

it's a very different syntax and format.

The data are stored as Numbers, Strings, Booleans, Arrays, or Objects.

So if you want to know a little bit more about JSON the best place to start again,

as usual, is actually Wikipedia.

This link will take you to a lot more information about JSON.

So this is an example JSON file.

It actually comes from, this is the API for github.

And this is actually the data about the repos that I am contributing to.

And so, what you can do is go here and look at this file.

And so, there's a overall curly bracket that

represents the sort of entire JSON object.

And then, each of the different repos is inside of its own separate curly bracket.

And so each repo has a bunch of variables associated with it, so for

example the ID variable or the full name of the repo and all that.

And so what you see is the structure of a JSON file and

sort of the ID followed by a colon followed by the value of the variable.

And so you can have nested sort of structures within, so

for example an array can be a component of the JSON objects.

So, for example, the owner variable here actually has an array as the value,

so you could see there's the colon, and then there's another open curly bracket.

And then there's a whole bunch of variables, like my login, and

the avatar URL, and all of that different information.

So there is actually a very nice package for reading this data in.

It's called the jsonlite package.

So what you do is you actually take the URL where the JSON appears, so

here's that URL, and you pass it to the fromJSON function.

And what you get out is a structured data frame.

So if you look at the names of that data frame, it's gonna be all the top level

variables, things like ID, and name, and full_name and so forth.

So one of those variables as you can see is owner.

So that's one of the components of this data frame.

So if we drill down a little bit and look at the names of that particular variable,

you see names(jsonData$owner).

So usually this would access one column of the data frame.

And so it turns out you can actually, because of the flexibility of data frames

in R store the data frame within a data frame.

So within that column of the data set,

the owner column, there's actually a bunch of other information.

Cuz you remember owner corresponding to an array of values.

So you get again, the login, the id, say, the avatar_url and so forth.

So we can drill down even further and so we can access, say, for

example the log n of all the different repos on this particular page.

And since we're only looking at the API for my repos, you can see that the login

is the same for all of them, it's jtleek in every single case.

And so you can see there's one time for

every single repo that exists in that data set.

And so another thing that you can do is actually,

you can take data sets that are data frames in R.

So one example of the very classic data set, the Iris data set.

You can turn it into a JSON dataset by saying, toJSON.

So this is nice if you're going to be exporting data that's gonna be

used by an API that requires JSON formatted data.

So here I've set pretty=TRUE, and that would give you nice indentations so

it's easy to read the file when you look at it.

So if you look at this variable, this variable is not a text variable, and

so what we can do is we can use the cat command to print it out and

you could see that it's nicely structured like that.

So you can actually take that JSON file we just created.

So we took the iris dataset, we turned it into a JSON file with the toJSON command.

We can then take that text and

send it right back to a data frame using the fromJSON command.

So the interesting thing here is,

in the first example that we used it was actually a URL here.

We actually passed it a URL for the JSON file.

And here we're just passing it a variable name which corresponds to a text variable

that can then be converted into a data frame.

So then if we look at the top of that data frame using the head command

you see that you get back the iris data sets.

So, if you just looked at the iris data set by itself,

it'll look exactly the same as using this file here.

So, if you want a little bit more information you can go to json.org.

This'll give you more information on JSON in general.

And then a really nice tutorial on jsonlite that was the basis for

a lot of this lecture is right here at r-bloggers.

So you can take that, take a look at that.

The jsonlite vignette is also quite good, it gives you a lot more information.

So if you have a more complicated JSON structure then you need to get access to,

you can go check out those resources and

they might give you a little bit more information.

探索我們的目錄

免費加入並獲得個性化推薦、更新和優惠。

Coursera 致力於普及全世界最好的教育，它與全球一流大學和機構合作提供在線課程。

© 2019 Coursera Inc. 保留所有權利。

通過 App Store 下載

通過 Google Play 獲取

Coursera
關於
管理團隊
工作機會
目錄
證書
MasterTrack™ 證書
學位
企業版
政府版

社區
Learners
Partners
Developers
Beta Testers
Translators

連接
博客
Facebook
領英
Twitter
Instagram
YouTube
技術博客

更多
條款
隱私
幫助
內容訪問
媒體
聯繫我們
目錄
附屬公司