your-first-machine-learning-model-971761.ipynb

{"cells":[{"metadata":{"_cell_guid":"dc1e7b02-f022-48ca-a270-21f4b0c70835","_uuid":"0696f41450f17b2e0ebbbbb30a29053cde7de211"},"cell_type":"markdown","source":"**[Machine Learning Course Home Page](kaggle.com/learn/machine-learning).**\n\n---\n\n# Selecting Data for Modeling\nYour dataset had  too many variables to wrap your head around, or even to print out nicely.  How can you pare down this overwhelming amount of data to something you can understand?\n\nWe'll start by picking a few variables using our intuition. Later courses will show you statistical techniques to automatically prioritize variables.\n\nTo choose variables/columns, we'll need to see a list of all columns in the dataset. That is done with the **columns** property of the DataFrame (the bottom line of code below).\n"},{"metadata":{"_uuid":"dd1f267e33f2f576e8f2007a47351775d141136c","trusted":true},"cell_type":"code","source":"import pandas as pd\n\nmelbourne_file_path = '../input/melbourne-housing-snapshot/melb_data.csv'\nmelbourne_data = pd.read_csv(melbourne_file_path) \nmelbourne_data.columns","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"73e70649f30b7a7f994dc81db7d3d876971f423e","trusted":true},"cell_type":"code","source":"# The Melbourne data has some missing values (some houses for which some variables weren't recorded.)\n# We'll learn to handle missing values in a later tutorial.  \n# Your Iowa data doesn't have missing values in the columns you use. \n# So we will take the simplest option for now, and drop houses from our data. \n# Don't worry about this much for now, though the code is:\n\n# dropna drops missing values (think of na as \"not available\")\nmelbourne_data = melbourne_data.dropna(axis=0)","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"b0dfbe94001d316d4e423923726901a7f993e883"},"cell_type":"markdown","source":"There are many ways to select a subset of your data. The [Pandas Course](https://www.kaggle.com/learn/pandas) covers these in more depth, but we will focus on two approaches for now.\n\n1. Dot notation, which we use to select the \"prediction target\"\n2. Selecting with a column list, which we use to select the \n\n## Selecting The Prediction Target \nYou can pull out a variable with **dot-notation**.  This single column is stored in a **Series**, which is broadly like a DataFrame with only a single column of data.  \n\nWe'll use the dot notation to select the column we want to predict, which is called the **prediction target**. By convention, the prediction target is called **y**. So the code we need to save the house prices in the Melbourne data is"},{"metadata":{"_cell_guid":"e5a6c21c-cda7-4df8-a9e9-15a2ae865026","_uuid":"599dc0855ff966c6e8d84b5bd447b315bf85e339","trusted":true},"cell_type":"code","source":"y = melbourne_data.Price","execution_count":null,"outputs":[]},{"metadata":{"_cell_guid":"a52b0b8d-ea0a-435b-bde1-1472f63977ba","_uuid":"a0fac0889241e77f2e2deefbd63bc9f057d0c826"},"cell_type":"markdown","source":"# Choosing \"Features\"\nThe columns that are inputted into our model (and later used to make predictions) are called \"features.\" In our case, those would be the columns used to determine the home price. Sometimes, you will use all columns except the target as features. Other times you'll be better off with fewer features. \n\nFor now, we'll build a model with only a few features. Later on you'll see how to iterate and compare models built with different features.\n\nWe select multiple features by providing a list of column names inside brackets. Each item in that list should be a string (with quotes).\n\nHere is an example:"},{"metadata":{"_cell_guid":"b45e6964-5379-44b5-980c-11e556f34a4f","_uuid":"001553f51fbd9c115b7728e625fd6c2830852071","trusted":true},"cell_type":"code","source":"melbourne_features = ['Rooms', 'Bathroom', 'Landsize', 'Lattitude', 'Longtitude']","execution_count":null,"outputs":[]},{"metadata":{"_cell_guid":"e30af6f8-45b8-4e33-9c3b-52a88266aee6","_uuid":"f9d9562f7d3a41042c3bb3beb64056993703735d"},"cell_type":"markdown","source":"By convention, this data is called **X**."},{"metadata":{"_cell_guid":"f3ce77d5-06e2-4433-b392-16d54014d2c8","_uuid":"19b3d59d66644a58125cb8d41636a169d4c10af9","trusted":true},"cell_type":"code","source":"X = melbourne_data[melbourne_features]","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"4a9b68856dbefd6a10ef6f5c7e4f61ce89530ef8"},"cell_type":"markdown","source":"Let's quickly review the data we'll be using to predict house prices using the `describe` method and the `head` method, which shows the top few rows."},{"metadata":{"_uuid":"c6484dba4dbf14a2038ee858f063995f41b05970","trusted":true},"cell_type":"code","source":"X.describe()","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"3bb25d514b936fa3f5af2e04913966a779e6edcc","trusted":true},"cell_type":"code","source":"X.head()","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"15fed98b232be607bdedb51c92ccbf9c01b7f266"},"cell_type":"markdown","source":"Visually checking your data with these commands is an important part of a data scientist's job.  You'll frequently find surprises in the dataset that deserve further inspection."},{"metadata":{"_cell_guid":"acd7ddac-58c4-403c-b39f-d648a6bd271c","_uuid":"8a4f43b00b0243645d5d12ef0ae402c8106bf10f"},"cell_type":"markdown","source":"---\n# Building Your Model\n\nYou will use the **scikit-learn** library to create your models.  When coding, this library is written as **sklearn**, as you will see in the sample code. Scikit-learn is easily the most popular library for modeling the types of data typically stored in DataFrames. \n\nThe steps to building and using a model are:\n* **Define:** What type of model will it be?  A decision tree?  Some other type of model? Some other parameters of the model type are specified too.\n* **Fit:** Capture patterns from provided data. This is the heart of modeling.\n* **Predict:** Just what it sounds like\n* **Evaluate**: Determine how accurate the model's predictions are.\n\nHere is an example of defining a decision tree model with scikit-learn and fitting it with the features and target variable."},{"metadata":{"_cell_guid":"8a390b1d-ae2a-4b73-b524-0dfde22879f7","_uuid":"4d35fb0ec4c75f00d91f1d7d668af4afdd6d19fe","trusted":true},"cell_type":"code","source":"from sklearn.tree import DecisionTreeRegressor\n\nmelbourne_model = DecisionTreeRegressor(random_state=1)\nmelbourne_model.fit(X, y)","execution_count":null,"outputs":[]},{"metadata":{"_cell_guid":"60aade6d-4f6c-482e-9e93-bffa1bc51e7b","_uuid":"1ff19fb070af2b731ce8343dbfea16708ce437bb"},"cell_type":"markdown","source":"Many machine learning models allow some randomness in model training. Specifying a number for `random_state` ensures you get the same results in each run. This is considered a good practice. You use any number, and model quality won't depend meaningfully on exactly what value you choose.\n\nWe now have a fitted model that we can use to make predictions.\n\nIn practice, you'll want to make predictions for new houses coming on the market rather than the houses we already have prices for. But we'll make predictions for the first few rows of the training data to see how the predict function works.\n"},{"metadata":{"_cell_guid":"cd6bded9-35a7-478a-8616-9d37e7a2a783","_uuid":"19bb827c7aa5a17feeef4dc368cc8da95cc9b09a","trusted":true},"cell_type":"code","source":"print(\"Making predictions for the following 5 houses:\")\nprint(X.head())\nprint(\"The predictions are\")\nprint(melbourne_model.predict(X.head()))\n","execution_count":null,"outputs":[]},{"metadata":{"_cell_guid":"ab6189e0-8a2c-4cc2-89dc-ac71ffac5e7c","_uuid":"ee8a624a186babbcdc09655089ba2067e206118e"},"cell_type":"markdown","source":"# Your Turn\nTry it out yourself in the **[Model Building Exercise](https://www.kaggle.com/kernels/fork/400771)**\n\n\n---\n**[Course Home Page](https://www.kaggle.com/learn/machine-learning)**\n"},{"metadata":{"trusted":true,"_uuid":"4a2c0c259fe95de6d2ae02e641dedb80c2d46a9b"},"cell_type":"code","source":"","execution_count":null,"outputs":[]}],"metadata":{"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"name":"python","version":"3.6.6","mimetype":"text/x-python","codemirror_mode":{"name":"ipython","version":3},"pygments_lexer":"ipython3","nbconvert_exporter":"python","file_extension":".py"}},"nbformat":4,"nbformat_minor":1}