Model Evaluation using Visualization

Loading...

Del curso dictado por IBM

Data Analysis with Python

576 calificaciones

IBM

Data Analysis with Python

576 calificaciones

Curso 6 de 9 en SpecializationIBM Data Science Professional Certificate

Learn how to analyze data using Python. This course will take you from the basics of Python to exploring many different types of data. You will learn how to prepare data for analysis, perform simple statistical analyses, create meaningful data visualizations, predict future trends from data, and more! Topics covered: 1) Importing Data sets 2) Cleaning the Data 3) Data frame manipulation 4) Summarizing the Data 5) Building machine learning Regression models 6) Building data pipelines Data Analysis with Python will be delivered through lecture, lab, and assignments. It includes following parts: Data Analysis libraries: will learn to use Pandas, Numpy and Scipy libraries to work with a sample dataset. We will introduce you to pandas, an open-source library, and we will use it to load, manipulate, analyze, and visualize cool datasets. Then we will introduce you to another open-source library, scikit-learn, and we will use some of its machine learning algorithms to build smart models and make cool predictions. If you choose to take this course and earn the Coursera course certificate, you will also earn an IBM digital badge. LIMITED TIME OFFER: Subscription is only $39 USD per month for access to graded materials and a certificate.

De la lección

Model Development

Model Development1:44

Linear Regression and Multiple Linear Regression6:34

Model Evaluation using Visualization4:44

Polynomial Regression and Pipelines4:25

Measures for In-Sample Evaluation3:37

Prediction and Decision Making5:03

Conoce a los instructores

Joseph Santarcangelo
Ph.D., Data Scientist at IBM
IBM Developer Skills Network

In this video, we'll look at Model Evaluation using Visualization.

Regression plots are a good estimate of the relationship between two variables,

the strength of the correlation,

and the direction of the relationship (positive or negative).

The horizontal axis is the independent variable.

The vertical axis is the dependent variable.

Each point represents a different target point.

The fitted line represents the predicted value.

There are several ways to plot a regression plot.

A simple ways to use regplot from the seaborn library.

First, "import seaborn."

Then use the "regplot" function.

The parameter x is the name of the column that

contains the dependent variable or feature.

The parameter y, contains the name of the column that

contains the name of the dependent variable or target.

The parameter data is the name of the dataframe.

The result is given by the plot.

The residual plot represents the error between the actual value.

Examining the predicted value and actual value we see a difference.

We obtain that value by subtracting the predicted value,

and the actual target value.

We then plot that value on

the vertical axis with the dependent variable as the horizontal axis.

Similarly, for the second sample,

we repeat the process.

Subtracting the target value from the predicted value.

Then plotting the value accordingly.

Looking at the plot gives us some insight into our data.

We expect to see the results to have zero mean,

distributed evenly around the x axis with similar variance.

There is no curvature.

This type of residual plot suggests a linear plot is appropriate.

In this residual plot, there is a curvature.

The values of the error change with x.

For example, in the region,

all the residual errors are positive.

In this area, the residuals are negative.

In the final location,

the error is large.

The residuals are not randomly separated.

This suggests the linear assumption is incorrect.

This plot suggests a nonlinear function.

We will deal with this in the next section.

In this plot, we see the variance of the residuals increases with x.

Therefore, our model is incorrect.

We can use seaborn to create a residual plot.

First, "import seabourn."

We use the "residplot" function.

The first parameter is a series of dependent variable or feature.

The second parameter is a series of dependent variable or target.

We see in this case, the residuals have the curvature.

A distribution plot counts the predicted value versus the actual value.

These plots are extremely useful for visualizing

models with more than one independent variable or feature.

Let's look at a simplified example.

We examined the vertical axis.

We then count and plot the number of

predicted points that are approximately equal to one.

We then, count and plot the number of

predicted points that are approximately equal to two.

We repeat the process.

For predicted points, they are approximately equal to three.

Then we repeat the process for the target values.

In this case, all the target values are approximately equal to two.

The values of the targets and predicted values are continuous.

A histogram is for discrete values.

Therefore, pandas will convert them to a distribution.

The vertical axis is scaled to make the area under the distribution equal to one.

This is an example of using a distribution plot.

The dependent variable or feature is price.

The fitted values that result from the model are in blue.

The actual values are red.

We see the predicted values for prices in the range from 40,000 to 50,000 are inaccurate.

The prices in the region from 10,000 to 20,000 are much closer to the target value.

In this example, we use multiple features or independent variables.

Comparing it to the plot on the last slide,

we see predicted values are much closer to the target values.

Here's the code to create a distribution plot.

The actual values are used as a parameter.

We wanted distribution instead of a histogram.

So we want the hist parameters set to false.

The color is red. The label is also included.

The predicted values are included for the second plot.

The rest of the parameters are set accordingly.

Explora nuestro catálogo

Inscríbete de manera gratuita y obtén recomendaciones personalizadas, actualizaciones y ofertas.

Coursera brinda acceso universal a la mejor educación del mundo, al asociarse con las mejores universidades y organizaciones, para ofrecer cursos en línea.

© 2018 Coursera Inc. Todos los derechos reservados.

Descargar en la App Store

Consíguelo en Google Play