your_word_data problem

[dario25494]

Hi,
this is my code for vectorize_text:

#!/usr/bin/python3

import os
import joblib
import re
import sys
import os

sys.path.append(os.path.abspath("../tools/"))
from parse_out_email_text import parseOutText

"""
Starter code to process the emails from Sara and Chris to extract
the features and get the documents ready for classification.

The list of all the emails from Sara are in the from_sara list
likewise for emails from Chris (from_chris)

The actual documents are in the Enron email dataset, which
you downloaded/unpacked in Part 0 of the first mini-project. If you have
not obtained the Enron email corpus, run startup.py in the tools folder.

The data is stored in lists and packed away in pickle files at the end.

"""

from_sara = open("from_sara.txt", "r")
from_chris = open("from_chris.txt", "r")

from_data = []
word_data = []

temp_counter is a way to speed up the development--there are

thousands of emails from Sara and Chris, so running over all of them

can take a long time

temp_counter helps you only look at the first 200 emails in the list so you

can iterate your modifications quicker

temp_counter = 0

for name, from_person in [("sara", from_sara), ("chris", from_chris)]:
for path in from_person:
### only look at first 200 emails when developing
### once everything is working, remove this line to run over full dataset

    if temp_counter < 200:
        path = os.path.join('..', path[:-1])
        print(path)
        email = open(path, "r")

        ### use parseOutText to extract the text from the opened email
        text=parseOutText(email)
        ### use str.replace() to remove any instances of the words
        ### ["sara", "shackleton", "chris", "germani"]
        text=text.replace("sara", '')
        text=text.replace("shackleton", '')
        text=text.replace("chris", '')
        text=text.replace("germani", '')

        ### append the text to word_data
        word_data.append(text)

        ### append a 0 to from_data if email is from Sara, and 1 if email is from Chris
        if name == 'sara':
            from_data.append(0)
        else:
            from_data.append(1)

        email.close()

print("Emails Processed")
from_sara.close()
from_chris.close()

joblib.dump( word_data, open("your_word_data.pkl", "wb"))
joblib.dump( from_data, open("your_email_authors.pkl", "wb"))

in Part 4, do TfIdf vectorization here

from sklearn.feature_extraction import text
from sklearn.feature_extraction.text import TfidfVectorizer
vectorizer = TfidfVectorizer(stop_words=text.ENGLISH_STOP_WORDS)
vectorizer.fit_transform(word_data)
print(vectorizer.get_feature_names_out()[34597])

when i run find_signature.py i get this error:
"startswith first arg must be str or a tuple of str, not bytes" referred to the line
I suppose there's a problem with the creation of your_word_data.pkl and your_email_data.pkl because, when i open them using notepad++ it shows me something strange.
How can i fix this?