Mehmet Ergün/

Duplicate of Sample Data Scientist Associate Solution


Data Scientist Associate

Example Case Study Solution

You can find the project information that accompanies this example solution in the resource center, Case Study Corner.

Use this template to complete your analysis and write up your summary for submission.

Data Validation

The dataset contains 200 rows and 9 columns with missing values before cleaning. I have validated all the columns against the criteria in the dataset table:

  • Region: Same as description, 10 Regions.
  • Place name: Same as description.
  • Rating: 2 missing values, so I decided to remove the missing values.
  • Enough Reviews: Same as description.
  • Price: Same as description, 3 categories.
  • Delivery option: Same as description.
  • Dine in option: 50+ missing values, so I replace missing values with 'False', and convert it into boolean data type.
  • Take out option: 50+ missing values, so I replace missing values with 'False',and convert it into boolean data type.

After the data validation, the dataset contains 198 rows and 9 columns.

Original Dataset

# Data Validation
# Check all variables in the data against the criteria in the dataset above

import pandas as pd
import matplotlib.pyplot as plt
import as style
import seaborn as sns
import numpy as np
df = pd.read_csv('data/coffee.csv')

After removing the missing values for Rating and Review columns

df = df.dropna(subset=['Rating'])

After replacing missing values with 'False'

df['Dine in option'] = df['Dine in option'].fillna(False)
df['Takeout option'] = df['Takeout option'].fillna(False)
df['Dine in option'] = df['Dine in option'].astype('bool')
df['Takeout option'] = df['Takeout option'].astype('bool')

Exploratory Analysis

From Graph 1 distribution of rating, we see some outliers. Since we don't have a lot of data, we decided not to remove outliers at this point. Enough Reviews variable is our target variable. From Graph 2, we can see the proportion of the minority class - True, indicating having enough reviews, is about 37%. Therefore, the imbalanced class issue is mild, so we decided not to address this issue at this point.

From investigating the relationship between the rating and target variable (Graph 3), we can see the rating variable might be a good indicator for prediction. Also, from investigating different options (Graph 4-6), we can see the Dine in and Take out options are good indicators for prediction.

Finally, to enable model fitting, I have made the following changes:

  • Remove the Place name column because it has unique values, so we won't use that feature.
  • Convert all the categorical variables into numeric variables

Inspecting the Rating and Enough Reviews variables

# Exploratory Analysis
# Explore the characteristics of the variables in the data
fig, axes = plt.subplots(1,2,figsize=(25,6))
sns.boxplot(df['Rating'],ax=axes[0]).set(title='Graph 1 The Distribution of Rating')
sns.countplot(df['Enough Reviews'],ax=axes[1]).set(title='Graph 2 The Distribution of Target Variable - Enough Reviews');

Inspecting the number of categories in categorical variables

#Inspect the categorical variables

Inspecting the Relationships between Ratings, Options and Target Variable (Enough Reviews)

sns.boxplot(data=df, x='Enough Reviews',y='Rating',linewidth=0.8).set(title='Graph 3 Ratings vs Enough Reviews');

  • AI Chat
  • Code