Assignment02.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "HARSSHAD PAWAR\n",
    "Assignment02:\n",
    "use twitter dataset and perform below activities on text feature:\n",
    "1. OHE\n",
    "2. BOW\n",
    "3. N-GRAM like 2-gram, 3-Gram, 4-Gram\n",
    "4. tf-idf\n",
    "\n",
    "Write 5 advantages and disadvantages of\n",
    " OHE VS BOW VS N-GRAM VS TF-IDF\n",
    "\n",
    "Note : Before we perform Encoding on text feature 1st we need to have text preprocessing done on text feature. \n",
    "\n",
    "Hence in my code PART 1 : Preprocessing and PART 2 is Encoding"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "PART 1 : Text Preprocessing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# importing data from the Kaggle dataset\n",
    "import pandas as pd\n",
    "import re\n",
    "data=pd.read_csv(\"testdata/twcs.csv\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>tweet_id</th>\n",
       "      <th>author_id</th>\n",
       "      <th>inbound</th>\n",
       "      <th>created_at</th>\n",
       "      <th>text</th>\n",
       "      <th>response_tweet_id</th>\n",
       "      <th>in_response_to_tweet_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>419673</th>\n",
       "      <td>478495</td>\n",
       "      <td>AmazonHelp</td>\n",
       "      <td>False</td>\n",
       "      <td>Fri Dec 01 12:40:34 +0000 2017</td>\n",
       "      <td>@228686 Hello- Can you explain further what yo...</td>\n",
       "      <td>478496,478497</td>\n",
       "      <td>478498.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2121903</th>\n",
       "      <td>2282854</td>\n",
       "      <td>663495</td>\n",
       "      <td>True</td>\n",
       "      <td>Sat Nov 11 21:50:16 +0000 2017</td>\n",
       "      <td>@123813 el capitulo 2 de Dos Lagos cuándo lo s...</td>\n",
       "      <td>2282852</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>420773</th>\n",
       "      <td>479697</td>\n",
       "      <td>ATVIAssist</td>\n",
       "      <td>False</td>\n",
       "      <td>Fri Dec 01 12:48:54 +0000 2017</td>\n",
       "      <td>@229001 Hello There Omar sorry for the delay, ...</td>\n",
       "      <td>479698</td>\n",
       "      <td>82869.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2456377</th>\n",
       "      <td>2625728</td>\n",
       "      <td>741683</td>\n",
       "      <td>True</td>\n",
       "      <td>Tue Oct 31 00:40:39 +0000 2017</td>\n",
       "      <td>@AmericanAir I did.</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2625727.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1944244</th>\n",
       "      <td>2099185</td>\n",
       "      <td>marksandspencer</td>\n",
       "      <td>False</td>\n",
       "      <td>Wed Nov 08 09:30:49 +0000 2017</td>\n",
       "      <td>@620035 Hi Abbie, could you DM us your email a...</td>\n",
       "      <td>2099186</td>\n",
       "      <td>2099187.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         tweet_id        author_id  inbound                      created_at  \\\n",
       "419673     478495       AmazonHelp    False  Fri Dec 01 12:40:34 +0000 2017   \n",
       "2121903   2282854           663495     True  Sat Nov 11 21:50:16 +0000 2017   \n",
       "420773     479697       ATVIAssist    False  Fri Dec 01 12:48:54 +0000 2017   \n",
       "2456377   2625728           741683     True  Tue Oct 31 00:40:39 +0000 2017   \n",
       "1944244   2099185  marksandspencer    False  Wed Nov 08 09:30:49 +0000 2017   \n",
       "\n",
       "                                                      text response_tweet_id  \\\n",
       "419673   @228686 Hello- Can you explain further what yo...     478496,478497   \n",
       "2121903  @123813 el capitulo 2 de Dos Lagos cuándo lo s...           2282852   \n",
       "420773   @229001 Hello There Omar sorry for the delay, ...            479698   \n",
       "2456377                                @AmericanAir I did.               NaN   \n",
       "1944244  @620035 Hi Abbie, could you DM us your email a...           2099186   \n",
       "\n",
       "         in_response_to_tweet_id  \n",
       "419673                  478498.0  \n",
       "2121903                      NaN  \n",
       "420773                   82869.0  \n",
       "2456377                2625727.0  \n",
       "1944244                2099187.0  "
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# we will start with the lowercase conversion:\n",
    "# 2.  lowercase / uppercase\n",
    "\n",
    "data[\"text\"]=data[\"text\"].str.lower()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "# we will now remove html tags and urls:\n",
    "import re\n",
    "def remove_html_tags(text1):\n",
    "    pattern=re.compile('<.*?>')\n",
    "    return pattern.sub(\"\",text1)\n",
    "def remove_url(text):\n",
    "    pattern=re.compile(r'https?://\\S+|www\\.\\S+')\n",
    "    return pattern.sub(\"\",text)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[\"text\"]=data[\"text\"].apply(remove_html_tags)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[\"text\"]=data[\"text\"].apply(remove_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1943318    @619835 hello there, tito. i noticed your twee...\n",
       "1040618    @391111 please dm us your tracking number, and...\n",
       "576964     i have ordered 3 monitors over the past five y...\n",
       "1229598    @436125 this is like music to our ears! thank ...\n",
       "2715053    @324984 @801248 @applesupport @104870 this yea...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "# now we will be removing Emojis:\n",
    "# 3.  Emojis\n",
    "\n",
    "import emoji\n",
    "def remove_emoji(text):\n",
    "    clean_text=emoji.demojize(text)\n",
    "    return clean_text"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[\"text\"]=data[\"text\"].apply(remove_emoji)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1962769    @624420 hey! our curation team are independent...\n",
       "2627924    @781234 can you dm us so we can look into this...\n",
       "454559           @upshelp sent you a dm with no response....\n",
       "369557     @215608 sorry for the trouble caused, your con...\n",
       "2220641    @687216 please fill in your details using the ...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "# now we will remove the punctuation:\n",
    "#4.  punctuation\n",
    "\n",
    "import string\n",
    "exclude=string.punctuation\n",
    "def remove_punc(text):\n",
    "    for char in exclude:\n",
    "        text=text.replace(char,\"\")\n",
    "    return text\n",
    "\n",
    "def remove_punc1(text):\n",
    "    return text.translate(str.maketrans(\"\",\"\",exclude))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[\"text\"]=data[\"text\"].apply(remove_punc)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[\"text\"]=data[\"text\"].apply(remove_punc1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1048349             392983 sorry we are now following youtom\n",
       "2042899    chasesupport how are people supposed to get cr...\n",
       "2579362    applesupport thanks  what password does icloud...\n",
       "887284     virgintrains no at seat service in 1st class a...\n",
       "1220447    433909 thats ok were here to answer your apple...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "# we will update abbravation or slang words:\n",
    "# 7.  abbravation\n",
    "\n",
    "chat_words={\n",
    "   \" AFAIK\":\"As Far As I Know\",\n",
    "\"AFK\": \"Away From Keyboard\",\n",
    "\"ASAP\":\"As Soon As Possible\",\n",
    "\"BTW\":\"By The Way\",\n",
    "\"B4\":\"Before\",\n",
    "\"LAMO\":\"Laugh My A.. Off\",\n",
    "\"FYI\":\"For your information\"\n",
    "}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "def chat_conversion(text):\n",
    "    \n",
    "    new_text=[]\n",
    "    words = text.split()\n",
    "    for w in words:\n",
    "        if w.upper() in chat_words:\n",
    "            new_text.append(chat_words[w.upper()])\n",
    "        else:\n",
    "            new_text.append(w)\n",
    "    return \" \".join(new_text)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "#data[\"text\"] = data[\"text\"].apply(lambda x: ' '.join(x))\n",
    "data[\"text\"] = data[\"text\"].apply(chat_conversion)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "220240     176886 team 116447 our crews continue to work ...\n",
       "2124105    spotifycares i was charged for premium but do ...\n",
       "523619     259319 marksandspencer how fab gorgeous girl t...\n",
       "732988     verizonsupport finally got a support person on...\n",
       "249657     184578 hi there id be happy to help whats the ...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "# we will rectify spelling mistakes:\n",
    "# 6.  spelling mistakes\n",
    "\n",
    "# The TextBlob library's spell correction function can be computationally expensive, especially for large datasets. Instead of applying the correction directly to each text entry in your dataframe using the lambda function, you can speed up the process by using parallelization.\n",
    "\n",
    "# Use the swifter library for parallel processing\n",
    "# data[\"text\"] = data[\"text\"].swifter.apply(spell_correction)\n",
    "\n",
    "# as it is taking more time to demonstrate so we will verify if function is correct by applying on only 1st 10 reocrds\n",
    "\n",
    "# Select the first 10 records for processing\n",
    "\n",
    "import textblob\n",
    "import swifter\n",
    "from textblob import TextBlob\n",
    "\n",
    "def spell_correction(text):\n",
    "    return str(TextBlob(text).correct())\n",
    "\n",
    "# Select the first 1000 records for processing\n",
    "subset_data = data.head(1000).copy()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "313a30766d3442a3bb6dcc242664e658",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Pandas Apply:   0%|          | 0/1000 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Use the swifter library for parallel processing\n",
    "subset_data.loc[:, \"text\"] = subset_data[\"text\"].swifter.apply(spell_correction)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "180    115769 what going on with your pp its totally ...\n",
       "540    115887 him can you try starting your device by...\n",
       "961    116025 if you still can see this please do us ...\n",
       "563    britishairways i assume that being sapphire do...\n",
       "349    bought an 115821 echo show and it won’t recogn...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "subset_data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[nltk_data] Downloading package stopwords to\n",
      "[nltk_data]     C:\\Users\\harsh\\AppData\\Roaming\\nltk_data...\n",
      "[nltk_data]   Package stopwords is already up-to-date!\n"
     ]
    }
   ],
   "source": [
    "# removing stop words\n",
    "# 6.  stopwords\n",
    "import nltk\n",
    "import re\n",
    "\n",
    "nltk.download('stopwords')\n",
    "\n",
    "def remove_stopwords(text, language='english'):\n",
    "    # Load stopwords for the specified language\n",
    "    stop_words = set(nltk.corpus.stopwords.words(language))\n",
    "\n",
    "    words = text.split()\n",
    "    cleaned_words = []\n",
    "\n",
    "    for word in words:\n",
    "        if word.lower() not in stop_words:\n",
    "            cleaned_words.append(word)\n",
    "\n",
    "    cleaned_text = ' '.join(cleaned_words)\n",
    "    cleaned_text = re.sub(r'\\s+', ' ', cleaned_text).strip()  # Remove extra spaces\n",
    "\n",
    "    return cleaned_text"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[\"text\"]=data[\"text\"].apply(remove_stopwords)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2615136    778161 i’d like take closer look could please ...\n",
       "1775007    frustrating local tesco wont take £20 note 540...\n",
       "1860419    500058 hey brooke sorry hear quality order les...\n",
       "225271     applesupport iphone 7 plus black screen phone ...\n",
       "2154587    671608 hi zuri kindly advise affected account ...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[nltk_data] Downloading package punkt to\n",
      "[nltk_data]     C:\\Users\\harsh\\AppData\\Roaming\\nltk_data...\n",
      "[nltk_data]   Package punkt is already up-to-date!\n"
     ]
    }
   ],
   "source": [
    "# now we will tokaniize the words:\n",
    "# 1.  Tokenization\n",
    "\n",
    "import nltk\n",
    "\n",
    "# Download the required NLTK resources\n",
    "nltk.download('punkt')\n",
    "\n",
    "# Define the function for tokenization\n",
    "def tokenize_text(text):\n",
    "    tokens = nltk.word_tokenize(text)\n",
    "    return tokens\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[\"text\"]=data[\"text\"].apply(tokenize_text)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1186320    [115725, horrible, customer, service, 4x, ’, s...\n",
       "888043                 [353834, system, kk, service, tag, 3]\n",
       "2385726    [atviassist, since, last, update10friday, many...\n",
       "2411219    [postmateshelp, 116057, would, love, it, ’, s,...\n",
       "1468571    [book, got, delivered, home, 115821, amazonhel...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2811774"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.shape[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "# At last we will doing steemming and lemmetization\n",
    "# 8.  steemming and lemmetization\n",
    "\n",
    "from textblob import TextBlob\n",
    "from nltk.stem import PorterStemmer\n",
    "from nltk.corpus import wordnet\n",
    "from nltk.stem import WordNetLemmatizer\n",
    "\n",
    "# Function for stemming using NLTK's PorterStemmer\n",
    "def stem_text(text):\n",
    "    stemmer = PorterStemmer()\n",
    "    stemmed_words = [stemmer.stem(word) for word in text.split()]\n",
    "    return ' '.join(stemmed_words)\n",
    "\n",
    "# Function for lemmatization using TextBlob\n",
    "def lemmatize_text(text):\n",
    "    # Join the list of words into a string before creating a TextBlob\n",
    "    blob = TextBlob(' '.join(text))\n",
    "    lemmatized_words = [word.lemmatize() for word in blob.words]\n",
    "    return ' '.join(lemmatized_words)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Apply stemming to the \"text\" column and update it\n",
    "#data[\"text\"] = data[\"text\"].apply(stem_text)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "1e9f976769a5433a8f39c49756122fb8",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Pandas Apply:   0%|          | 0/2811774 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Apply lemmatization to the \"text\" column and update it\n",
    "data[\"text\"] = data[\"text\"].swifter.apply(lemmatize_text)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2811774"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.shape[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1607305                            americanair well deserved\n",
       "291799                     195497 let look send u dm well go\n",
       "1792815                   tmobilehelp completed verification\n",
       "335965     115850 amazonhelp placed order 4 didnt recvd y...\n",
       "176588     165642 117627 117626 10717 10718 good morning ...\n",
       "Name: text, dtype: object"
      ]
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.sample(5)[\"text\"]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "PART 2 : ENCODING\n",
    "Now use twitter dataset's text feature and perform below Encoding:\n",
    "1. OHE\n",
    "2. BOW\n",
    "3. N-GRAM like 2-gram, 3-Gram, 4-Gram\n",
    "4. tf-idf"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "         tweet_id   author_id  inbound                      created_at  \\\n",
      "0               1  sprintcare    False  Tue Oct 31 22:10:47 +0000 2017   \n",
      "1               2      115712     True  Tue Oct 31 22:11:45 +0000 2017   \n",
      "2               3      115712     True  Tue Oct 31 22:08:27 +0000 2017   \n",
      "3               4  sprintcare    False  Tue Oct 31 21:54:49 +0000 2017   \n",
      "4               5      115712     True  Tue Oct 31 21:49:35 +0000 2017   \n",
      "...           ...         ...      ...                             ...   \n",
      "2811769   2987947  sprintcare    False  Wed Nov 22 08:43:51 +0000 2017   \n",
      "2811770   2987948      823869     True  Wed Nov 22 08:35:16 +0000 2017   \n",
      "2811771   2812240      121673     True  Thu Nov 23 04:13:07 +0000 2017   \n",
      "2811772   2987949      AldiUK    False  Wed Nov 22 08:31:24 +0000 2017   \n",
      "2811773   2987950      823870     True  Tue Nov 21 22:01:04 +0000 2017   \n",
      "\n",
      "                                                      text response_tweet_id  \\\n",
      "0        115712 understand would like assist would need...                 2   \n",
      "1                                       sprintcare propose               NaN   \n",
      "2        sprintcare sent several private message one re...                 1   \n",
      "3        115712 please send u private message assist cl...                 3   \n",
      "4                                               sprintcare                 4   \n",
      "...                                                    ...               ...   \n",
      "2811769  823869 hey wed happy look please send u direct...               NaN   \n",
      "2811770  115714 wtf i ’ ve really shitty service day ge...           2987947   \n",
      "2811771  143549 sprintcare go ask add hulu service acco...               NaN   \n",
      "2811772      823870 sound delicious sarah facesavoringfood               NaN   \n",
      "2811773  aldiuk warm sloe gin mince pie ice cream best ...   2987951,2987949   \n",
      "\n",
      "         in_response_to_tweet_id  text_  text_0 115873 driver seattle rn  \\\n",
      "0                            3.0  False                            False   \n",
      "1                            1.0  False                            False   \n",
      "2                            4.0  False                            False   \n",
      "3                            5.0  False                            False   \n",
      "4                            6.0  False                            False   \n",
      "...                          ...    ...                              ...   \n",
      "2811769                2987948.0  False                            False   \n",
      "2811770                      NaN  False                            False   \n",
      "2811771                2812239.0  False                            False   \n",
      "2811772                2987950.0  False                            False   \n",
      "2811773                      NaN  False                            False   \n",
      "\n",
      "         text_0 137434 employee delta flight guess get experience awesome experience delta flight airplane  \\\n",
      "0                                                    False                                                   \n",
      "1                                                    False                                                   \n",
      "2                                                    False                                                   \n",
      "3                                                    False                                                   \n",
      "4                                                    False                                                   \n",
      "...                                                    ...                                                   \n",
      "2811769                                              False                                                   \n",
      "2811770                                              False                                                   \n",
      "2811771                                              False                                                   \n",
      "2811772                                              False                                                   \n",
      "2811773                                              False                                                   \n",
      "\n",
      "         ...  \\\n",
      "0        ...   \n",
      "1        ...   \n",
      "2        ...   \n",
      "3        ...   \n",
      "4        ...   \n",
      "...      ...   \n",
      "2811769  ...   \n",
      "2811770  ...   \n",
      "2811771  ...   \n",
      "2811772  ...   \n",
      "2811773  ...   \n",
      "\n",
      "         text_ｗ（￣△￣；）ｗおおっ！ amazonから未納なんちゃらってメッセージきたけどさ ╬▔꒳​▔ 私、、、amazonで購入した事がないのよねृ ु ω´ु ｶﾞﾙﾙﾙ バカか  \\\n",
      "0                                                    False                                             \n",
      "1                                                    False                                             \n",
      "2                                                    False                                             \n",
      "3                                                    False                                             \n",
      "4                                                    False                                             \n",
      "...                                                    ...                                             \n",
      "2811769                                              False                                             \n",
      "2811770                                              False                                             \n",
      "2811771                                              False                                             \n",
      "2811772                                              False                                             \n",
      "2811773                                              False                                             \n",
      "\n",
      "         text_｢猫はamazonの箱が好き｣という話を聞いて、我が家でも届いた箱を放置してみたら、やはり入って寛いでた…w 今度毛布敷くね´ｰ｀  \\\n",
      "0                                                    False                        \n",
      "1                                                    False                        \n",
      "2                                                    False                        \n",
      "3                                                    False                        \n",
      "4                                                    False                        \n",
      "...                                                    ...                        \n",
      "2811769                                              False                        \n",
      "2811770                                              False                        \n",
      "2811771                                              False                        \n",
      "2811772                                              False                        \n",
      "2811773                                              False                        \n",
      "\n",
      "         text_ｱｱｱｱｱamazon個別発送しかできん！！ これ送料と手数料それぞれにかかるよね！！？  \\\n",
      "0                                                    False   \n",
      "1                                                    False   \n",
      "2                                                    False   \n",
      "3                                                    False   \n",
      "4                                                    False   \n",
      "...                                                    ...   \n",
      "2811769                                              False   \n",
      "2811770                                              False   \n",
      "2811771                                              False   \n",
      "2811772                                              False   \n",
      "2811773                                              False   \n",
      "\n",
      "         text_ｱﾏｿﾞﾝ…なぜまとめて配送するようお願いしたのに三度に分けた…  \\\n",
      "0                                        False   \n",
      "1                                        False   \n",
      "2                                        False   \n",
      "3                                        False   \n",
      "4                                        False   \n",
      "...                                        ...   \n",
      "2811769                                  False   \n",
      "2811770                                  False   \n",
      "2811771                                  False   \n",
      "2811772                                  False   \n",
      "2811773                                  False   \n",
      "\n",
      "         text_ｱﾏｿﾞﾝのやつ、ゼノブレイド2限定版を梱包なしメール便で送ってきやがった…ちょっと箱凹んでるangersymbol  \\\n",
      "0                                                    False                 \n",
      "1                                                    False                 \n",
      "2                                                    False                 \n",
      "3                                                    False                 \n",
      "4                                                    False                 \n",
      "...                                                    ...                 \n",
      "2811769                                              False                 \n",
      "2811770                                              False                 \n",
      "2811771                                              False                 \n",
      "2811772                                              False                 \n",
      "2811773                                              False                 \n",
      "\n",
      "         text_ｳﾞｧｱｱｱｱ 勝手にプライム会員になってるううううう  \\\n",
      "0                                   False   \n",
      "1                                   False   \n",
      "2                                   False   \n",
      "3                                   False   \n",
      "4                                   False   \n",
      "...                                   ...   \n",
      "2811769                             False   \n",
      "2811770                             False   \n",
      "2811771                             False   \n",
      "2811772                             False   \n",
      "2811773                             False   \n",
      "\n",
      "         text_ｷｬｰｺﾜｲq こんなものが届いた 有料コンテンツ登録料金が未納です。本日中にご連絡なき場合、法的手続きに移行します。amazon サービスセンター 0368121658  \\\n",
      "0                                                    False                                            \n",
      "1                                                    False                                            \n",
      "2                                                    False                                            \n",
      "3                                                    False                                            \n",
      "4                                                    False                                            \n",
      "...                                                    ...                                            \n",
      "2811769                                              False                                            \n",
      "2811770                                              False                                            \n",
      "2811771                                              False                                            \n",
      "2811772                                              False                                            \n",
      "2811773                                              False                                            \n",
      "\n",
      "         text_ｷﾀ━━━━ﾟ∀ﾟ━━━━ アマゾン早い！  \\\n",
      "0                             False   \n",
      "1                             False   \n",
      "2                             False   \n",
      "3                             False   \n",
      "4                             False   \n",
      "...                             ...   \n",
      "2811769                       False   \n",
      "2811770                       False   \n",
      "2811771                       False   \n",
      "2811772                       False   \n",
      "2811773                       False   \n",
      "\n",
      "         text_ﾀｸﾀｸ帰宅したら届いてた。amazonさん翌日配達ありがとう。来年の手帳。  \\\n",
      "0                                              False   \n",
      "1                                              False   \n",
      "2                                              False   \n",
      "3                                              False   \n",
      "4                                              False   \n",
      "...                                              ...   \n",
      "2811769                                        False   \n",
      "2811770                                        False   \n",
      "2811771                                        False   \n",
      "2811772                                        False   \n",
      "2811773                                        False   \n",
      "\n",
      "         text_ﾟεﾟ；ﾑﾑﾑ 変なﾒｯｾｰｼﾞがきた アマゾン？一瞬ドキッとしたが金だしてまで動画みないしrightarrowcurvingdownrightarrowcurvingdown 取り合えずamazonに登録してるアドレスのメール確認したがそんな連絡全く見当たらないし 普通は´ーσそっちにだよね  \n",
      "0                                                    False                                                                                                         \n",
      "1                                                    False                                                                                                         \n",
      "2                                                    False                                                                                                         \n",
      "3                                                    False                                                                                                         \n",
      "4                                                    False                                                                                                         \n",
      "...                                                    ...                                                                                                         \n",
      "2811769                                              False                                                                                                         \n",
      "2811770                                              False                                                                                                         \n",
      "2811771                                              False                                                                                                         \n",
      "2811772                                              False                                                                                                         \n",
      "2811773                                              False                                                                                                         \n",
      "\n",
      "[2811774 rows x 2742062 columns]\n"
     ]
    }
   ],
   "source": [
    "# Convert the \"text\" column to the categorical data type\n",
    "data[\"text\"] = data[\"text\"].astype(\"category\")\n",
    "\n",
    "# Perform one-hot encoding on the \"text\" column with sparse=True\n",
    "one_hot_encoded = pd.get_dummies(data[\"text\"], prefix=\"text\", sparse=True)\n",
    "\n",
    "# Concatenate the one-hot encoded DataFrame with the original DataFrame\n",
    "data = pd.concat([data, one_hot_encoded], axis=1)\n",
    "\n",
    "# Display the updated DataFrame\n",
    "print(data)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [],
   "source": [
    "# BOW\n",
    "\n",
    "from sklearn.feature_extraction.text import CountVectorizer\n",
    "\n",
    "# CountVectorizer library is used to convert a collection of text documents to a matrix of token counts\n",
    "BOW=CountVectorizer()\n",
    "document_matrix=BOW.fit_transform(data['text'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[0, 0, 0, ..., 0, 0, 0]], dtype=int64)"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "document_matrix[0].toarray() # 1st vector"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'115712': 15021,\n",
       " 'understand': 1155222,\n",
       " 'would': 1182653,\n",
       " 'like': 980546,\n",
       " 'assist': 800097,\n",
       " 'need': 1014862,\n",
       " 'get': 920370,\n",
       " 'private': 1058967,\n",
       " 'secured': 1094475,\n",
       " 'link': 981364,\n",
       " 'sprintcare': 1115736,\n",
       " 'propose': 1061268,\n",
       " 'sent': 1096255,\n",
       " 'several': 1098527,\n",
       " 'message': 999254,\n",
       " 'one': 1032138,\n",
       " 'responding': 1078693,\n",
       " 'usual': 1161053,\n",
       " 'please': 1051452,\n",
       " 'send': 1095948,\n",
       " 'click': 842935,\n",
       " 'top': 1144601,\n",
       " 'profile': 1060327,\n",
       " 'gain': 917294,\n",
       " 'detail': 868952,\n",
       " 'account': 773631,\n",
       " 'worst': 1182274,\n",
       " 'customer': 858125,\n",
       " 'service': 1097086,\n",
       " '115713': 15022,\n",
       " 'saddening': 1087831,\n",
       " 'hear': 934875,\n",
       " 'shoot': 1101304,\n",
       " 'dm': 876312,\n",
       " 'look': 985406,\n",
       " 'kc': 967831,\n",
       " 'gon': 923894,\n",
       " 'na': 1012278,\n",
       " 'magically': 990547,\n",
       " 'change': 836134,\n",
       " 'connectivity': 850113,\n",
       " 'whole': 1176487,\n",
       " 'family': 901955,\n",
       " 'lyingface': 988936,\n",
       " 'hundredpoints': 944153,\n",
       " 'concern': 848507,\n",
       " 'wed': 1172815,\n",
       " 'direct': 872121,\n",
       " 'aa': 770097,\n",
       " 'since': 1103970,\n",
       " 'signed': 1103224,\n",
       " 'yousince': 1189371,\n",
       " 'day': 861904,\n",
       " 'definitely': 864598,\n",
       " 'work': 1181165,\n",
       " 'long': 985108,\n",
       " 'experiencing': 896779,\n",
       " 'issue': 957651,\n",
       " '115714': 15023,\n",
       " 'all': 782740,\n",
       " 'lie': 979893,\n",
       " 'great': 925817,\n",
       " 'connection': 849978,\n",
       " 'bar': 810408,\n",
       " 'lte': 987826,\n",
       " 'still': 1118733,\n",
       " 'won': 1180685,\n",
       " 'load': 983802,\n",
       " 'something': 1111149,\n",
       " 'smh': 1107232,\n",
       " '115715': 15038,\n",
       " 'access': 773325,\n",
       " 'fr': 912433,\n",
       " 'whenever': 1175617,\n",
       " 'contact': 850916,\n",
       " 'support': 1124168,\n",
       " 'tell': 1131202,\n",
       " 'shortcode': 1101599,\n",
       " 'enabled': 888779,\n",
       " 'never': 1016460,\n",
       " 'year': 1186595,\n",
       " 'ive': 960132,\n",
       " 'tried': 1148037,\n",
       " '115716': 15039,\n",
       " 'information': 951895,\n",
       " 'incorrect': 950410,\n",
       " 'jk': 963642,\n",
       " 'askspectrum': 799712,\n",
       " 'email': 887470,\n",
       " 'copy': 852544,\n",
       " 'spectrum': 1114145,\n",
       " 'updating': 1158562,\n",
       " 'training': 1146191,\n",
       " 'department': 867382,\n",
       " 'part': 1041536,\n",
       " 'corporate': 852880,\n",
       " 'office': 1029321,\n",
       " 'youre': 1189099,\n",
       " 'particular': 1041644,\n",
       " 'area': 797218,\n",
       " 'gone': 923907,\n",
       " 'format': 911620,\n",
       " 'unawa': 1154616,\n",
       " 'received': 1070481,\n",
       " 'thank': 1133092,\n",
       " 'correct': 852950,\n",
       " 'way': 1171234,\n",
       " 'via': 1164840,\n",
       " 'ocs': 1028453,\n",
       " 'takeover': 1128039,\n",
       " 'consent': 850386,\n",
       " 'form': 911586,\n",
       " 'done': 877842,\n",
       " 'local': 983980,\n",
       " 'front': 914482,\n",
       " 'faxed': 903302,\n",
       " 'overmaybe': 1038089,\n",
       " 'maintain': 991080,\n",
       " 'date': 861383,\n",
       " 'pertaining': 1046804,\n",
       " 'assumption': 800621,\n",
       " 'outlet': 1037265,\n",
       " 'wit': 1179142,\n",
       " 'actually': 775266,\n",
       " 'thats': 1134076,\n",
       " 'broken': 824092,\n",
       " '115717': 15042,\n",
       " 'hello': 935722,\n",
       " 'apology': 795052,\n",
       " 'frustration': 914971,\n",
       " 'inconvenience': 950237,\n",
       " 'happy': 932690,\n",
       " 'mg': 1000148,\n",
       " 'yo': 1187946,\n",
       " 'rep': 1076054,\n",
       " 'super': 1123633,\n",
       " 'nice': 1017762,\n",
       " 'imma': 948640,\n",
       " 'start': 1117293,\n",
       " 'trippin': 1148284,\n",
       " 'don': 877785,\n",
       " 'going': 923582,\n",
       " '115718': 15044,\n",
       " 'apologize': 795018,\n",
       " 'glad': 922297,\n",
       " 'name': 1012950,\n",
       " 'acct': 774149,\n",
       " 'phone': 1047694,\n",
       " 'jb': 962124,\n",
       " 'picture': 1048784,\n",
       " 'pretty': 1057764,\n",
       " 'much': 1009171,\n",
       " 'every': 894839,\n",
       " 'pay': 1043237,\n",
       " '171': 76486,\n",
       " 'per': 1045470,\n",
       " 'month': 1006364,\n",
       " '115719': 15045,\n",
       " 'help': 936037,\n",
       " 'arrived': 798272,\n",
       " 'sorry': 1112214,\n",
       " 'see': 1094593,\n",
       " 'trouble': 1148665,\n",
       " 'hsb': 943436,\n",
       " 'verizonsupport': 1163906,\n",
       " 'finally': 905850,\n",
       " 'got': 924751,\n",
       " 'someone': 1111040,\n",
       " 'helped': 936251,\n",
       " 'thanks': 1133162,\n",
       " 'awesome': 804858,\n",
       " 'ever': 894623,\n",
       " 'tweet': 1150827,\n",
       " 'away': 804686,\n",
       " 'somebody': 1110979,\n",
       " 'meeeeee': 997289,\n",
       " 'wearyfacewearyfacewearyfacewearyface': 1172301,\n",
       " 'im': 948144,\n",
       " 'luck': 988076,\n",
       " '115720': 15047,\n",
       " 'friend': 913971,\n",
       " 'acm': 774642,\n",
       " 'without': 1179340,\n",
       " 'internet': 954436,\n",
       " 'play': 1051055,\n",
       " 'videogames': 1165289,\n",
       " 'together': 1143188,\n",
       " 'skill': 1105204,\n",
       " 'diminish': 871725,\n",
       " 'moment': 1005454,\n",
       " 'internetz': 954628,\n",
       " '115721': 15049,\n",
       " 'follow': 910484,\n",
       " 'order': 1035048,\n",
       " 'else': 887275,\n",
       " 'provide': 1061634,\n",
       " 'refuse': 1073756,\n",
       " 'can': 830332,\n",
       " 'not': 1022928,\n",
       " 'validate': 1162074,\n",
       " 'able': 772392,\n",
       " 'verify': 1163797,\n",
       " 'anything': 794119,\n",
       " 'authenticating': 803061,\n",
       " 'jay': 961979,\n",
       " 'number': 1026193,\n",
       " 'equipment': 891682,\n",
       " 'literally': 982003,\n",
       " 'trying': 1149269,\n",
       " 'nobody': 1019984,\n",
       " 'find': 905925,\n",
       " 'use': 1160229,\n",
       " 'locate': 984062,\n",
       " 'secure': 1094471,\n",
       " 'chat': 837316,\n",
       " '115722': 15050,\n",
       " 'md': 996413,\n",
       " 'wrong': 1183280,\n",
       " 'address': 775722,\n",
       " 'duke': 881904,\n",
       " 'bill': 816885,\n",
       " 'state': 1117508,\n",
       " 'located': 984064,\n",
       " 'nhp': 1017671,\n",
       " 'walked': 1169430,\n",
       " 'store': 1119782,\n",
       " 'explained': 896963,\n",
       " 'device': 869535,\n",
       " 'serial': 1096708,\n",
       " 'referring': 1073133,\n",
       " 'wireless': 1178950,\n",
       " 'residential': 1078002,\n",
       " '60': 529578,\n",
       " 'rude': 1085838,\n",
       " 'transfer': 1146670,\n",
       " 'give': 921971,\n",
       " '115723': 15055,\n",
       " 'light': 980353,\n",
       " 'red': 1071694,\n",
       " 'know': 971329,\n",
       " 'router': 1084734,\n",
       " 'downstairs': 879819,\n",
       " 'it': 958392,\n",
       " 'wifi': 1177326,\n",
       " 'nothing': 1023584,\n",
       " 'connected': 849912,\n",
       " 'ethernet': 893810,\n",
       " 'happened': 932419,\n",
       " 'randomly': 1067909,\n",
       " 'boot': 820920,\n",
       " 'offline': 1029476,\n",
       " 'go': 923167,\n",
       " 'fios': 906333,\n",
       " 'color': 845699,\n",
       " 'bcw': 811973,\n",
       " 'yep': 1187048,\n",
       " 'cutting': 858863,\n",
       " 'cut': 858759,\n",
       " '20': 109808,\n",
       " 'minute': 1002557,\n",
       " 'ridiculous': 1081684,\n",
       " 'make': 991278,\n",
       " 'feel': 904084,\n",
       " 'fix': 907174,\n",
       " 'thing': 1136101,\n",
       " 'kmg': 971079,\n",
       " 'isp': 957520,\n",
       " 've': 1162774,\n",
       " '115724': 15056,\n",
       " 'time': 1140225,\n",
       " '115725': 15057,\n",
       " '115726': 15070,\n",
       " 'gtall': 928147,\n",
       " 'verizon': 1163845,\n",
       " 'downlt': 879741,\n",
       " 'expect': 896388,\n",
       " '115727': 15072,\n",
       " 'app': 795134,\n",
       " 'wont': 1180778,\n",
       " 'even': 894442,\n",
       " 'open': 1033996,\n",
       " '115728': 15073,\n",
       " 'think': 1136274,\n",
       " 'becky': 812817,\n",
       " 'chipotletweets': 839522,\n",
       " '28': 195339,\n",
       " 'dont': 878167,\n",
       " 'fit': 907081,\n",
       " 'veggie': 1163018,\n",
       " 'burrito': 826385,\n",
       " 'costume': 853494,\n",
       " 'halloween': 931497,\n",
       " '115729': 15075,\n",
       " 'messed': 999533,\n",
       " 'today': 1142615,\n",
       " 'didn': 870841,\n",
       " 'although': 784221,\n",
       " 'dressed': 880446,\n",
       " 'loudlycryingface': 986282,\n",
       " '115730': 15077,\n",
       " 'hopefully': 941298,\n",
       " 'well': 1173804,\n",
       " 'point': 1052936,\n",
       " 'hey': 937801,\n",
       " 'wan': 1169701,\n",
       " 'come': 846083,\n",
       " 'mammoth': 991949,\n",
       " 'ill': 947826,\n",
       " 'least': 977434,\n",
       " 'eat': 884236,\n",
       " 'week': 1172994,\n",
       " 'promise': 1060761,\n",
       " '115731': 15078,\n",
       " 'guac': 928684,\n",
       " 'experience': 896612,\n",
       " 'excellent': 895630,\n",
       " 'tonight': 1143944,\n",
       " 'plenty': 1051938,\n",
       " 'people': 1045233,\n",
       " 'line': 981034,\n",
       " 'went': 1174271,\n",
       " 'fast': 902705,\n",
       " 'everyone': 894961,\n",
       " 'kind': 969964,\n",
       " 'smart': 1106983,\n",
       " 'tara': 1128774,\n",
       " 'boorito': 820879,\n",
       " '115732': 15079,\n",
       " 'incredibly': 950512,\n",
       " 'concerning': 848573,\n",
       " 'diet': 871051,\n",
       " 'coke': 845151,\n",
       " 'literal': 981997,\n",
       " 'bone': 820256,\n",
       " 'extra': 897624,\n",
       " 'spooky': 1115098,\n",
       " '115733': 15080,\n",
       " 'nope': 1022106,\n",
       " 'queso': 1065319,\n",
       " 'quac': 1064711,\n",
       " 'bowl': 821766,\n",
       " 'stop': 1119477,\n",
       " '1031': 10289,\n",
       " '3pmclose': 321795,\n",
       " 'official': 1029412,\n",
       " 'rule': 1086148,\n",
       " '115734': 15081,\n",
       " 'mean': 996732,\n",
       " 'basically': 810990,\n",
       " 'adult': 776742,\n",
       " 'version': 1164293,\n",
       " 'old': 1031057,\n",
       " 'trick': 1147982,\n",
       " 'treat': 1147643,\n",
       " 'forward': 912001,\n",
       " 'booritos': 820884,\n",
       " 'ghost': 921183,\n",
       " 'mine': 1002106,\n",
       " 'earlier': 883747,\n",
       " '115735': 15082,\n",
       " 'could': 853640,\n",
       " 'id': 945896,\n",
       " 'share': 1099578,\n",
       " 'praise': 1055931,\n",
       " 'resolving': 1078403,\n",
       " 'quickly': 1065703,\n",
       " 'best': 814761,\n",
       " 'smilingface': 1107351,\n",
       " 'fanforlife': 902166,\n",
       " 'frustrated': 914860,\n",
       " 'enragedface': 889913,\n",
       " 'ordered': 1035261,\n",
       " 'dinner': 871881,\n",
       " 'saturday': 1090731,\n",
       " 'using': 1160771,\n",
       " 'charged': 836745,\n",
       " 'credit': 855355,\n",
       " 'card': 831808,\n",
       " 'twice': 1151071,\n",
       " '115736': 15083,\n",
       " 'location': 984077,\n",
       " 'participating': 1041628,\n",
       " 'giving': 922181,\n",
       " 'dress': 880443,\n",
       " 'jackolantern': 960762,\n",
       " 'call': 829242,\n",
       " 'chipotle': 839429,\n",
       " 'sure': 1124616,\n",
       " 'they': 1135865,\n",
       " 're': 1069019,\n",
       " 'select': 1095303,\n",
       " '115737': 15084,\n",
       " 'didnt': 870853,\n",
       " 'try': 1149214,\n",
       " 'qualify': 1064785,\n",
       " '115738': 15085,\n",
       " 'trickortreating': 1148005,\n",
       " 'routine': 1084809,\n",
       " 'walking': 1169445,\n",
       " 'spending': 1114514,\n",
       " 'dollar': 877545,\n",
       " 'back': 807472,\n",
       " 'home': 940572,\n",
       " '115739': 15086,\n",
       " 'investigate': 955301,\n",
       " 'nasty': 1013665,\n",
       " 'used': 1160278,\n",
       " 'napkin': 1013400,\n",
       " 'food': 910669,\n",
       " '115740': 15088,\n",
       " 'bummer': 826007,\n",
       " 'far': 902293,\n",
       " 'closest': 843440,\n",
       " 'nowhere': 1025196,\n",
       " 'near': 1014628,\n",
       " 'manfacepalmingmediumdarkskintone': 992537,\n",
       " '115741': 15089,\n",
       " 'noted': 1023299,\n",
       " 'smilingfacewithsmilingeyes': 1108174,\n",
       " 'also': 783965,\n",
       " 'onesie': 1032504,\n",
       " 'target': 1128876,\n",
       " 'cozy': 854447,\n",
       " 'feeling': 904101,\n",
       " 'fiancé': 905130,\n",
       " 'driving': 880906,\n",
       " 'dc': 862842,\n",
       " 'mississippi': 1003446,\n",
       " 'alone': 783622,\n",
       " 'want': 1169811,\n",
       " 'llama': 983353,\n",
       " 'considering': 850495,\n",
       " '115742': 15091,\n",
       " 'love': 986897,\n",
       " 'stopping': 1119616,\n",
       " 'better': 815332,\n",
       " 'duo': 882155,\n",
       " 'speedwaybrick': 1114417,\n",
       " 'uttranscript': 1161401,\n",
       " '115743': 15092,\n",
       " 'info': 951654,\n",
       " 'free': 913000,\n",
       " 'keep': 968034,\n",
       " 'eye': 897837,\n",
       " 'blog': 818874,\n",
       " 'news': 1017157,\n",
       " 'update': 1158068,\n",
       " 'askplaystation': 799683,\n",
       " 'already': 783788,\n",
       " 'whats': 1175286,\n",
       " 'november': 1024820,\n",
       " 'plus': 1052274,\n",
       " 'game': 917524,\n",
       " '115745': 15093,\n",
       " 'downloading': 879681,\n",
       " 'download': 879642,\n",
       " 'waited': 1169017,\n",
       " 'hour': 942156,\n",
       " 'till': 1140129,\n",
       " 'bought': 821576,\n",
       " 'downloaded': 879653,\n",
       " 'data': 861163,\n",
       " 'corrupted': 853219,\n",
       " 'lego': 978005,\n",
       " 'star': 1117159,\n",
       " 'war': 1169992,\n",
       " 'playstation': 1051334,\n",
       " 'let': 978653,\n",
       " '115746': 15094,\n",
       " 'community': 846878,\n",
       " 'forum': 911958,\n",
       " 'investigation': 955361,\n",
       " 'block': 818783,\n",
       " 'sending': 1096007,\n",
       " 'invite': 955488,\n",
       " 'join': 964184,\n",
       " '115747': 15095,\n",
       " 'fun': 915873,\n",
       " 'sarah': 1090271,\n",
       " 'heard': 934885,\n",
       " 'count': 853742,\n",
       " 'collin': 845590,\n",
       " 'really': 1069623,\n",
       " 'suck': 1122357,\n",
       " 'life': 980092,\n",
       " 'party': 1041769,\n",
       " 'colin': 845355,\n",
       " 'yellowheart': 1186969,\n",
       " 'marksandspencer': 994205,\n",
       " 'xx': 1185603,\n",
       " '115748': 15096,\n",
       " 'weve': 1174685,\n",
       " 'team': 1129985,\n",
       " 'joel': 964001,\n",
       " 'sharing': 1099686,\n",
       " 'ere': 891776,\n",
       " 'mind': 1002013,\n",
       " 'avocado': 804386,\n",
       " 'how': 942685,\n",
       " 'ave': 804088,\n",
       " 'word': 1181071,\n",
       " 'necessary': 1014769,\n",
       " 'pair': 1040100,\n",
       " 'em': 887449,\n",
       " 'suffocating': 1122731,\n",
       " '115749': 15097,\n",
       " 'obligated': 1028033,\n",
       " 'bag': 808790,\n",
       " 'unpackaged': 1156862,\n",
       " 'meat': 996862,\n",
       " 'prepackaged': 1057206,\n",
       " 'charge': 836708,\n",
       " 'applied': 795998,\n",
       " 'raw': 1068629,\n",
       " 'say': 1091301,\n",
       " 'unwrapped': 1157813,\n",
       " 'sainsbury': 1088479,\n",
       " 'waitrose': 1169256,\n",
       " 'packaging': 1039280,\n",
       " 'sufficient': 1122718,\n",
       " 'wrapping': 1183068,\n",
       " 'require': 1077435,\n",
       " '5p': 529355,\n",
       " 'legislation': 977974,\n",
       " 'check': 837748,\n",
       " 'gov': 924981,\n",
       " 'legal': 977882,\n",
       " 'stated': 1117526,\n",
       " 'right': 1081870,\n",
       " 'funny': 916111,\n",
       " 'wonder': 1180689,\n",
       " 'lidl': 979883,\n",
       " 'rest': 1079128,\n",
       " 'beating': 812538,\n",
       " 'ou': 1036768,\n",
       " 'must': 1010567,\n",
       " 'including': 949997,\n",
       " 'vat': 1162632,\n",
       " 'carrier': 832761,\n",
       " 'following': 910515,\n",
       " 'unused': 1157702,\n",
       " 'new': 1016778,\n",
       " 'hasn': 933630,\n",
       " 'sold': 1110479,\n",
       " 'good': 924036,\n",
       " 'taken': 1127978,\n",
       " 'delivered': 865719,\n",
       " 'plastic': 1050802,\n",
       " '70': 631830,\n",
       " 'micron': 1000678,\n",
       " 'thick': 1136015,\n",
       " 'le': 977219,\n",
       " 'handle': 931984,\n",
       " 'opening': 1034108,\n",
       " 'isn': 957443,\n",
       " 'sealed': 1093688,\n",
       " 'aren': 797414,\n",
       " 'paper': 1040816,\n",
       " 'shop': 1101328,\n",
       " 'airport': 780534,\n",
       " 'board': 819658,\n",
       " 'train': 1146094,\n",
       " 'aeroplane': 777280,\n",
       " 'ship': 1100573,\n",
       " 'contain': 851136,\n",
       " 'certain': 835465,\n",
       " 'item': 958732,\n",
       " 'fish': 907001,\n",
       " 'safety': 1088171,\n",
       " 'risk': 1082545,\n",
       " 'prescription': 1057409,\n",
       " 'medicine': 997186,\n",
       " 'uncovered': 1154982,\n",
       " 'blade': 818273,\n",
       " 'seed': 1094616,\n",
       " 'bulb': 825808,\n",
       " 'amp': 790171,\n",
       " 'tulip': 1149873,\n",
       " 'collier': 845587,\n",
       " 'wood': 1180848,\n",
       " 'branch': 822462,\n",
       " 'buy': 827202,\n",
       " 'required': 1077437,\n",
       " 'supply': 1124144,\n",
       " 'poor': 1053725,\n",
       " '115750': 15099,\n",
       " 'aesthetic': 777308,\n",
       " 'creeperpillar': 855524,\n",
       " 'someday': 1110992,\n",
       " 'bugbutterflyghost': 825520,\n",
       " 'halloweening': 931518,\n",
       " 'okhandmediumlightskintone': 1030601,\n",
       " 'countcolin': 853745,\n",
       " '115751': 15102,\n",
       " 'josh': 964640,\n",
       " 'assistance': 800121,\n",
       " 'suggest': 1122824,\n",
       " 'post': 1054747,\n",
       " 'xboxsupport': 1184802,\n",
       " 'microsofthelps': 1000749,\n",
       " 'brilliant': 823427,\n",
       " 'hi': 938041,\n",
       " 'making': 991492,\n",
       " 'purchase': 1063426,\n",
       " 'xbox': 1184684,\n",
       " 'fifa': 905330,\n",
       " '115752': 15104,\n",
       " 'recovering': 1071484,\n",
       " 'recommend': 1071226,\n",
       " 'answer': 793180,\n",
       " 'desk': 868489,\n",
       " 'hotmail': 942011,\n",
       " 'filled': 905624,\n",
       " 'recovery': 1071493,\n",
       " 'told': 1143435,\n",
       " 'providing': 1061774,\n",
       " 'enough': 889802,\n",
       " '115753': 15105,\n",
       " 'appears': 795371,\n",
       " 'removed': 1075547,\n",
       " 'letting': 978890,\n",
       " 'mb': 995795,\n",
       " 'atviassist': 802166,\n",
       " '115754': 15106,\n",
       " 'umm': 1153935,\n",
       " 'streaming': 1120526,\n",
       " 'wwii': 1184193,\n",
       " '500': 427085,\n",
       " 'viewer': 1165510,\n",
       " '115755': 15107,\n",
       " 'problem': 1059255,\n",
       " 'across': 774833,\n",
       " 'question': 1065403,\n",
       " 'future': 916526,\n",
       " 'rk': 1082812,\n",
       " 'digital': 871395,\n",
       " 'deluxe': 866685,\n",
       " 'edition': 885207,\n",
       " 'receiving': 1070572,\n",
       " 'error': 892157,\n",
       " '115756': 15108,\n",
       " 'late': 975919,\n",
       " 'response': 1078796,\n",
       " 'checking': 837880,\n",
       " 'rn': 1082978,\n",
       " 'yes': 1187100,\n",
       " 'pre': 1056205,\n",
       " 'console': 850594,\n",
       " 'oder': 1028757,\n",
       " 'ww2': 1184106,\n",
       " '115757': 15110,\n",
       " 'afternoon': 777773,\n",
       " 'william': 1177736,\n",
       " 'unfortunately': 1155724,\n",
       " 'longer': 985164,\n",
       " 'supported': 1124235,\n",
       " 'sincerest': 1104011,\n",
       " 'jp': 964920,\n",
       " '115758': 15111,\n",
       " 'yous': 1189328,\n",
       " 'cod': 844546,\n",
       " 'zombie': 1191281,\n",
       " 'io': 955656,\n",
       " '11': 12528,\n",
       " '115759': 15112,\n",
       " 'jayden': 962015,\n",
       " 'sadly': 1087904,\n",
       " 'half': 931291,\n",
       " 'gig': 921488,\n",
       " 'world': 1181889,\n",
       " '115760': 15113,\n",
       " 'tv': 1150476,\n",
       " '108162': 11657,\n",
       " '115761': 15114,\n",
       " 'came': 830070,\n",
       " '115762': 15116,\n",
       " 'regard': 1073852,\n",
       " 'ko': 971625,\n",
       " 'friday': 913808,\n",
       " '2xp': 217327,\n",
       " 'code': 844566,\n",
       " 'receipt': 1070398,\n",
       " 'gamestop': 917794,\n",
       " 'payment': 1043419,\n",
       " 'needed': 1014944,\n",
       " 'redeem': 1071831,\n",
       " 'beta': 815174,\n",
       " 'redeemed': 1071837,\n",
       " 'tho': 1137733,\n",
       " 'bonus': 820380,\n",
       " 'linked': 981403,\n",
       " 'delay': 864988,\n",
       " 'clarify': 842389,\n",
       " 'preordered': 1057165,\n",
       " 'updated': 1158150,\n",
       " 'double': 879076,\n",
       " 'xp': 1185351,\n",
       " '115763': 15117,\n",
       " 'gamertag': 917710,\n",
       " 'platform': 1050902,\n",
       " 'playing': 1051154,\n",
       " 'pull': 1063112,\n",
       " 'cb': 834313,\n",
       " 'sethtubbs': 1098119,\n",
       " 'ps4': 1062237,\n",
       " 'stats': 1117763,\n",
       " 'reset': 1077858,\n",
       " 'mwr': 1010907,\n",
       " '115764': 15118,\n",
       " 'stay': 1117893,\n",
       " 'tuned': 1150023,\n",
       " 'jw': 966083,\n",
       " '115765': 15119,\n",
       " '115766': 15122,\n",
       " 'non': 1021027,\n",
       " 'season': 1093839,\n",
       " 'pas': 1041976,\n",
       " 'holder': 940237,\n",
       " 'bobus': 819824,\n",
       " 'man': 991999,\n",
       " 'carentan': 832257,\n",
       " '115767': 15124,\n",
       " 'isnt': 957458,\n",
       " 'simple': 1103815,\n",
       " 'step': 1118243,\n",
       " 'video': 1165232,\n",
       " 'madison': 990142,\n",
       " 'adobecare': 776400,\n",
       " 'another': 792960,\n",
       " 'computer': 848215,\n",
       " 'fresh': 913666,\n",
       " 'install': 953464,\n",
       " 'adobe': 776395,\n",
       " 'product': 1059960,\n",
       " 'ask': 799526,\n",
       " 'expert': 896830,\n",
       " 'raj': 1067514,\n",
       " 'ctrlaltshift': 857193,\n",
       " 'method': 999708,\n",
       " '22': 131840,\n",
       " 'jason': 961826,\n",
       " 'resetting': 1077915,\n",
       " 'preference': 1056609,\n",
       " 'photoshop': 1048334,\n",
       " 'sc': 1091641,\n",
       " 'quoted': 1066016,\n",
       " 'dragging': 880151,\n",
       " 'image': 948184,\n",
       " 'onto': 1033469,\n",
       " 'canvas': 831398,\n",
       " 'center': 835157,\n",
       " 'snap': 1109225,\n",
       " 'aj': 780984,\n",
       " '115768': 15125,\n",
       " 'jeffrey': 962426,\n",
       " 'lightroom': 980436,\n",
       " 'classic': 842500,\n",
       " 'cc': 834379,\n",
       " 'tanuj': 1128661,\n",
       " 'signing': 1103261,\n",
       " 'outback': 1037035,\n",
       " 'reinstalling': 1074589,\n",
       " 'desktop': 868519,\n",
       " 'multiple': 1009747,\n",
       " 'previous': 1057873,\n",
       " 'confirming': 849350,\n",
       " 'looping': 985654,\n",
       " 'reply': 1076584,\n",
       " 'soon': 1111702,\n",
       " 'theyre': 1135942,\n",
       " 'available': 803813,\n",
       " 'ok': 1030242,\n",
       " 'sowhen': 1113251,\n",
       " 'request': 1077280,\n",
       " 'possible': 1054597,\n",
       " 'frustrating': 914910,\n",
       " 'job': 963829,\n",
       " 'finished': 906216,\n",
       " 'application': 795956,\n",
       " 'helping': 936449,\n",
       " 'wanted': 1169842,\n",
       " 'managed': 992022,\n",
       " 'nr': 1025781,\n",
       " 'deleted': 865415,\n",
       " 'probably': 1059178,\n",
       " 'getting': 920699,\n",
       " 'rid': 1081479,\n",
       " 'membership': 998069,\n",
       " 'return': 1079997,\n",
       " 'working': 1181379,\n",
       " 'properly': 1061148,\n",
       " 'process': 1059725,\n",
       " 'listed': 981847,\n",
       " 'delete': 865407,\n",
       " 'jeff': 962396,\n",
       " 'wait': 1168983,\n",
       " 'next': 1017333,\n",
       " 'big': 816496,\n",
       " 'wasted': 1170542,\n",
       " 'patience': 1042789,\n",
       " 'face': 898496,\n",
       " 'review': 1080467,\n",
       " 'installation': 953472,\n",
       " 'log': 984431,\n",
       " 'yea': 1186482,\n",
       " 'everything': 895023,\n",
       " 'guy': 929503,\n",
       " 'mac': 989565,\n",
       " 'either': 886325,\n",
       " 'retina': 1079778,\n",
       " 'imac': 948157,\n",
       " 'fairly': 901361,\n",
       " 'mc': 995932,\n",
       " 'saying': 1091365,\n",
       " 'unable': 1154116,\n",
       " 'terrible': 1132059,\n",
       " 'disappointed': 872563,\n",
       " '115769': 15126,\n",
       " 'totally': 1145084,\n",
       " 'stuck': 1121040,\n",
       " 'prior': 1058774,\n",
       " 'froze': 914707,\n",
       " '115770': 15128,\n",
       " 'こんにちは': 1203519,\n",
       " 'アマゾン公式です': 1212775,\n",
       " 'fire': 906395,\n",
       " 'stickが見れないというのは': 1118599,\n",
       " 'どのような状況でしょうか': 1208374,\n",
       " '一般的なトラブルシューティングを記載したヘルプがございますので': 1218118,\n",
       " 'ご参照ください': 1204018,\n",
       " 'et': 893648,\n",
       " 'amazonhelp': 785238,\n",
       " 'ありがとうございます': 1198871,\n",
       " '電話で主人が対応していただいてます': 1235480,\n",
       " '電話で対応してもらいましたが改良されませんでした': 1235482,\n",
       " '保証期間も過ぎてるので買い直しになるんでしょうね': 1220948,\n",
       " 'カスタマーサービスにてお問い合わせ済みとのことで': 1213247,\n",
       " 'お手数をおかけいたしました': 1201077,\n",
       " 'リプライいただきありがとうございました': 1217617,\n",
       " 'こちらこそありがとうございました': 1202188,\n",
       " '恐れ入ります': 1226094,\n",
       " '至らない点も多々あるかとは存じますが': 1232312,\n",
       " '今後ともどうぞよろしくお願いします': 1219361,\n",
       " 'amazonのfiretvstickが見れないcryingface': 787300,\n",
       " '115771': 15129,\n",
       " 'microsoft': 1000720,\n",
       " 'son': 1111389,\n",
       " 'associated': 800545,\n",
       " 'youll': 1188841,\n",
       " 'switch': 1126032,\n",
       " 'zm': 1191194,\n",
       " 'live': 982177,\n",
       " 'currently': 857849,\n",
       " '115772': 15130,\n",
       " '701': 632913,\n",
       " 'launched': 976465,\n",
       " 'recently': 1070605,\n",
       " 'latest': 976224,\n",
       " 'release': 1074930,\n",
       " '115773': 15131,\n",
       " 'may': 995535,\n",
       " 'quick': 1065661,\n",
       " 'expired': 896875,\n",
       " '115774': 15132,\n",
       " 'feature': 903659,\n",
       " 'plan': 1050389,\n",
       " 'add': 775558,\n",
       " 'crop': 856088,\n",
       " 'mode': 1004914,\n",
       " 'ipad': 956024,\n",
       " 'lr': 987564,\n",
       " 'take': 1127898,\n",
       " 'many': 993427,\n",
       " 'tap': 1128693,\n",
       " 'slows': 1106711,\n",
       " 'workflow': 1181321,\n",
       " '115775': 15133,\n",
       " 'file': 905501,\n",
       " 'wren': 1183131,\n",
       " '115776': 15134,\n",
       " 'intermittent': 954325,\n",
       " 'fails': 901254,\n",
       " 'reliably': 1075044,\n",
       " 'create': 855248,\n",
       " 'subfolder': 1121751,\n",
       " 'option': 1034638,\n",
       " 'empty': 888660,\n",
       " 'svg': 1125349,\n",
       " 'folder': 910374,\n",
       " 'reproduce': 1077054,\n",
       " 'end': 889093,\n",
       " 'development': 869489,\n",
       " 'om': 1031475,\n",
       " 'seems': 1094723,\n",
       " 'widespread': 1177188,\n",
       " 'jerk': 962695,\n",
       " 'break': 822824,\n",
       " 'core': 852689,\n",
       " 'functionality': 915928,\n",
       " 'keelin': 968018,\n",
       " 'export': 897209,\n",
       " 'ai': 779386,\n",
       " '2018': 112136,\n",
       " 'sample': 1089502,\n",
       " 'filescreenshot': 905551,\n",
       " 'apparently': 795228,\n",
       " '115777': 15135,\n",
       " '115778': 15140,\n",
       " 'cool': 852279,\n",
       " 'cant': 831172,\n",
       " 'svgs': 1125353,\n",
       " 'sick': 1102723,\n",
       " '115779': 15142,\n",
       " 'duncan': 882063,\n",
       " '613': 543076,\n",
       " 'worried': 1182064,\n",
       " 'lr6': 987570,\n",
       " 'standalone': 1116961,\n",
       " 'programme': 1060493,\n",
       " 'lose': 985871,\n",
       " 'due': 881812,\n",
       " 'online': 1032822,\n",
       " 'versionis': 1164321,\n",
       " 'true': 1148932,\n",
       " 'fair': 901315,\n",
       " 'whoa': 1176407,\n",
       " 'along': 783650,\n",
       " 'ben': 814076,\n",
       " 'warde': 1170015,\n",
       " 'lowdown': 987287,\n",
       " '115780': 15143,\n",
       " 'lauren': 976534,\n",
       " 'changing': 836378,\n",
       " 'screen': 1093011,\n",
       " 'always': 784353,\n",
       " 'clear': 842723,\n",
       " 'cooky': 852278,\n",
       " '115781': 15145,\n",
       " 'jake': 961190,\n",
       " 'screenshots': 1093156,\n",
       " 'setting': 1098178,\n",
       " 'happening': 932522,\n",
       " 'example': 895534,\n",
       " 'unchanged': 1154836,\n",
       " 'default': 864418,\n",
       " 'jack': 960703,\n",
       " 'exporting': 897218,\n",
       " 'replicate': 1076516,\n",
       " 'conversation': 852021,\n",
       " 'solved': 1110847,\n",
       " 'indesign': 950710,\n",
       " '130': 32212,\n",
       " 'pdfs': 1044073,\n",
       " 'blurry': 819420,\n",
       " 'missing': 1003308,\n",
       " 'indd': 950623,\n",
       " 'jpg': 964936,\n",
       " '115782': 15147,\n",
       " 'responded': 1078630,\n",
       " 'airbnbhelp': 779731,\n",
       " 'reservation': 1077777,\n",
       " 'quand': 1064861,\n",
       " 'ton': 1143862,\n",
       " '115783': 15148,\n",
       " 'ne': 1014599,\n",
       " 'ressemble': 1079106,\n",
       " 'pa': 1038927,\n",
       " 'celui': 835088,\n",
       " 'que': 1064992,\n",
       " 'tu': 1149624,\n",
       " 'réservé': 1087056,\n",
       " 'quen': 1065141,\n",
       " 'dêtre': 883292,\n",
       " 'sale': 1088729,\n",
       " 'en': 888757,\n",
       " 'soussol': 1112922,\n",
       " 'te': 1129913,\n",
       " 'retrouves': 1079964,\n",
       " '10': 8674,\n",
       " 'dans': 860734,\n",
       " 'logement': 984455,\n",
       " '115784': 15163,\n",
       " 'misrepresentation': 1003172,\n",
       " 'host': 941725,\n",
       " 'asked': 799563,\n",
       " 'cancel': 830432,\n",
       " 'refund': 1073403,\n",
       " 'aud1700': 802260,\n",
       " 'strict': 1120783,\n",
       " 'policy': 1053303,\n",
       " '115785': 15164,\n",
       " 'reaching': 1069124,\n",
       " 'ja': 960609,\n",
       " 'keeping': 968078,\n",
       " 'lol': 984744,\n",
       " 'there': 1135302,\n",
       " '115786': 15165,\n",
       " 'shipped': 1100632,\n",
       " 'kinda': 969965,\n",
       " 'weird': 1173558,\n",
       " ...}"
      ]
     },
     "execution_count": 42,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "BOW.vocabulary_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [],
   "source": [
    "# parameter N-GRAM RANGE in CountVectorizer , it is used to specify the range of n-grams to be extracted\n",
    "\n",
    "# 1st will try Bi-GRAM = it will consider 2 words at a time\n",
    "\n",
    "bigram=CountVectorizer(ngram_range=(2,2))\n",
    "bigramvocab=bigram.fit_transform(data['text'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'115712 understand': 46142,\n",
       " 'understand would': 7052634,\n",
       " 'would like': 7420198,\n",
       " 'like assist': 4608783,\n",
       " 'assist would': 2141825,\n",
       " 'would need': 7420488,\n",
       " 'need get': 5063958,\n",
       " 'get private': 3818493,\n",
       " 'private secured': 5621733,\n",
       " 'secured link': 6151070,\n",
       " 'link assist': 4630566,\n",
       " 'sprintcare propose': 6477890,\n",
       " 'sprintcare sent': 6478058,\n",
       " 'sent several': 6196452,\n",
       " 'several private': 6233578,\n",
       " 'private message': 5621617,\n",
       " 'message one': 4886562,\n",
       " 'one responding': 5247102,\n",
       " 'responding usual': 5942234,\n",
       " '115712 please': 46141,\n",
       " 'please send': 5518225,\n",
       " 'send private': 6187442,\n",
       " 'message assist': 4884239,\n",
       " 'assist click': 2139012,\n",
       " 'click message': 2713098,\n",
       " 'message top': 4887856,\n",
       " 'top profile': 6898979,\n",
       " 'message gain': 4885430,\n",
       " 'gain detail': 3778298,\n",
       " 'detail account': 3133293,\n",
       " 'sprintcare worst': 6478526,\n",
       " 'worst customer': 7413551,\n",
       " 'customer service': 2971328,\n",
       " '115713 saddening': 46145,\n",
       " 'saddening hear': 6051526,\n",
       " 'hear please': 4024122,\n",
       " 'please shoot': 5518286,\n",
       " 'shoot dm': 6266335,\n",
       " 'dm look': 3224192,\n",
       " 'look kc': 4701683,\n",
       " 'sprintcare gon': 6477257,\n",
       " 'gon na': 3877677,\n",
       " 'na magically': 5033659,\n",
       " 'magically change': 4768668,\n",
       " 'change connectivity': 2606524,\n",
       " 'connectivity whole': 2840913,\n",
       " 'whole family': 7340299,\n",
       " 'family lyingface': 3559984,\n",
       " 'lyingface hundredpoints': 4752695,\n",
       " '115713 understand': 46146,\n",
       " 'understand concern': 7050364,\n",
       " 'concern wed': 2813158,\n",
       " 'wed like': 7293297,\n",
       " 'like please': 4614753,\n",
       " 'send direct': 6186045,\n",
       " 'direct message': 3175210,\n",
       " 'assist aa': 2138429,\n",
       " 'sprintcare since': 6478109,\n",
       " 'since signed': 6321782,\n",
       " 'signed yousince': 6308351,\n",
       " 'yousince day': 7495172,\n",
       " '115713 wed': 46147,\n",
       " 'wed definitely': 7293138,\n",
       " 'definitely like': 3060407,\n",
       " 'like work': 4618099,\n",
       " 'work long': 7393779,\n",
       " 'long experiencing': 4693423,\n",
       " 'experiencing issue': 3513082,\n",
       " 'issue aa': 4358855,\n",
       " '115714 all': 46486,\n",
       " 'all lie': 1885345,\n",
       " 'lie great': 4598227,\n",
       " 'great connection': 3908452,\n",
       " 'connection bar': 2837798,\n",
       " 'bar lte': 2264505,\n",
       " 'lte still': 4741035,\n",
       " 'still won': 6533595,\n",
       " 'won load': 7379939,\n",
       " 'load something': 4664926,\n",
       " 'something smh': 6394754,\n",
       " '115715 please': 48686,\n",
       " 'message send': 4887318,\n",
       " 'send link': 6186842,\n",
       " 'link access': 4630318,\n",
       " 'access account': 1746319,\n",
       " 'account fr': 1756766,\n",
       " '115714 whenever': 48542,\n",
       " 'whenever contact': 7332127,\n",
       " 'contact customer': 2854625,\n",
       " 'customer support': 2971986,\n",
       " 'support tell': 6620676,\n",
       " 'tell shortcode': 6721026,\n",
       " 'shortcode enabled': 6272664,\n",
       " 'enabled account': 3383433,\n",
       " 'account never': 1758250,\n",
       " 'never year': 5087190,\n",
       " 'year ive': 7465253,\n",
       " 'ive tried': 4387872,\n",
       " '115716 information': 48689,\n",
       " 'information incorrect': 4277974,\n",
       " 'incorrect jk': 4256278,\n",
       " 'askspectrum would': 2130938,\n",
       " 'like email': 4611014,\n",
       " 'email copy': 3364765,\n",
       " 'copy one': 2884568,\n",
       " 'one since': 5247650,\n",
       " 'since spectrum': 6321872,\n",
       " 'spectrum updating': 6450143,\n",
       " 'updating training': 7092738,\n",
       " '115716 department': 48688,\n",
       " 'department part': 3111039,\n",
       " 'part corporate': 5364638,\n",
       " 'corporate office': 2888138,\n",
       " 'office youre': 5212916,\n",
       " 'youre particular': 7493621,\n",
       " 'particular area': 5367640,\n",
       " 'area gone': 2073273,\n",
       " 'gone format': 3878724,\n",
       " 'format unawa': 3707476,\n",
       " 'askspectrum received': 2130082,\n",
       " 'received corporate': 5801570,\n",
       " 'office would': 5212898,\n",
       " 'like copy': 4610146,\n",
       " '115716 thank': 48690,\n",
       " 'thank jk': 6754722,\n",
       " 'askspectrum correct': 2128691,\n",
       " 'correct way': 2890618,\n",
       " 'way via': 7281949,\n",
       " 'via ocs': 7181495,\n",
       " 'ocs account': 5198438,\n",
       " 'account takeover': 1760104,\n",
       " 'takeover email': 6680469,\n",
       " 'email consent': 3364719,\n",
       " 'consent form': 2842869,\n",
       " 'form need': 3706028,\n",
       " 'need done': 5063257,\n",
       " 'done local': 3247617,\n",
       " 'local office': 4668881,\n",
       " 'askspectrum incorrect': 2129354,\n",
       " 'incorrect information': 4256258,\n",
       " 'information form': 4277633,\n",
       " 'form front': 3705632,\n",
       " 'front faxed': 3744652,\n",
       " 'faxed overmaybe': 3580993,\n",
       " 'overmaybe need': 5319024,\n",
       " 'need maintain': 5065140,\n",
       " 'maintain date': 4774953,\n",
       " 'date information': 3008119,\n",
       " 'information pertaining': 4278854,\n",
       " 'pertaining account': 5442318,\n",
       " 'account assumption': 1755074,\n",
       " 'assumption correct': 2148558,\n",
       " 'correct need': 2889824,\n",
       " 'local outlet': 4668903,\n",
       " 'outlet wit': 5310771,\n",
       " 'actually thats': 1779983,\n",
       " 'thats broken': 6773331,\n",
       " 'broken link': 2439012,\n",
       " 'link sent': 4633189,\n",
       " 'sent incorrect': 6195206,\n",
       " '115717 hello': 48693,\n",
       " 'hello apology': 4040626,\n",
       " 'apology frustration': 2026847,\n",
       " 'frustration inconvenience': 3751659,\n",
       " 'inconvenience happy': 4253326,\n",
       " 'happy look': 3992276,\n",
       " 'look mg': 4702206,\n",
       " 'yo askspectrum': 7485355,\n",
       " 'askspectrum customer': 2128738,\n",
       " 'service rep': 6219232,\n",
       " 'rep super': 5890088,\n",
       " 'super nice': 6610973,\n",
       " 'nice imma': 5104581,\n",
       " 'imma start': 4228928,\n",
       " 'start trippin': 6499140,\n",
       " 'trippin all': 6959368,\n",
       " 'all don': 1884961,\n",
       " 'don get': 3242347,\n",
       " 'get service': 3819768,\n",
       " 'service going': 6215347,\n",
       " '115718 apologize': 48695,\n",
       " 'apologize inconvenience': 2024432,\n",
       " 'inconvenience glad': 4253280,\n",
       " 'glad assist': 3847078,\n",
       " 'assist dm': 2139264,\n",
       " 'dm name': 3224551,\n",
       " 'name acct': 5038933,\n",
       " 'acct phone': 1762855,\n",
       " 'phone jb': 5454229,\n",
       " 'picture askspectrum': 5470716,\n",
       " 'askspectrum pretty': 2129985,\n",
       " 'pretty much': 5601925,\n",
       " 'much every': 5010666,\n",
       " 'every day': 3470525,\n",
       " 'day pay': 3020784,\n",
       " 'pay 171': 5395646,\n",
       " '171 per': 362868,\n",
       " 'per month': 5426149,\n",
       " '115719 help': 48705,\n",
       " 'help arrived': 4048896,\n",
       " 'arrived sorry': 2094520,\n",
       " 'sorry see': 6415910,\n",
       " 'see trouble': 6160411,\n",
       " 'trouble help': 6962971,\n",
       " 'help hsb': 4052329,\n",
       " 'verizonsupport finally': 7171188,\n",
       " 'finally got': 3617387,\n",
       " 'got someone': 3895903,\n",
       " 'someone helped': 6389833,\n",
       " 'helped thanks': 4059898,\n",
       " '115719 awesome': 48704,\n",
       " 'awesome ever': 2210079,\n",
       " 'ever need': 3468345,\n",
       " 'need tweet': 5068031,\n",
       " 'tweet away': 6997732,\n",
       " 'away hsb': 2207264,\n",
       " 'somebody verizonsupport': 6387500,\n",
       " 'verizonsupport please': 7171952,\n",
       " 'please help': 5516309,\n",
       " 'help meeeeee': 4053866,\n",
       " 'meeeeee wearyfacewearyfacewearyfacewearyface': 4862253,\n",
       " 'wearyfacewearyfacewearyfacewearyface im': 7286269,\n",
       " 'im worst': 4224934,\n",
       " 'worst luck': 7414113,\n",
       " 'luck customer': 4742439,\n",
       " '115720 friend': 48708,\n",
       " 'friend message': 3740394,\n",
       " 'message acm': 4883977,\n",
       " 'verizonsupport friend': 7171240,\n",
       " 'friend without': 3741550,\n",
       " 'without internet': 7370582,\n",
       " 'internet need': 4319974,\n",
       " 'need play': 5065949,\n",
       " 'play videogames': 5506167,\n",
       " 'videogames together': 7187867,\n",
       " 'together please': 6877261,\n",
       " 'please skill': 5518345,\n",
       " 'skill diminish': 6340405,\n",
       " 'diminish every': 3171300,\n",
       " 'every moment': 3471129,\n",
       " 'moment without': 4963917,\n",
       " 'without internetz': 7370585,\n",
       " '115721 please': 48711,\n",
       " 'please follow': 5516012,\n",
       " 'follow dm': 3686889,\n",
       " 'look order': 4702592,\n",
       " 'order hsb': 5285994,\n",
       " 'verizonsupport else': 7171065,\n",
       " 'else provide': 3360437,\n",
       " 'provide refuse': 5670696,\n",
       " 'refuse help': 5847545,\n",
       " 'help can': 4049574,\n",
       " 'can not': 2517246,\n",
       " 'not validate': 5143218,\n",
       " 'validate account': 7148646,\n",
       " '115721 would': 48714,\n",
       " 'would able': 7417958,\n",
       " 'able verify': 1734735,\n",
       " 'verify anything': 7167579,\n",
       " 'anything without': 2015502,\n",
       " 'without authenticating': 7369313,\n",
       " 'authenticating account': 2182007,\n",
       " 'account jay': 1757491,\n",
       " 'verizonsupport phone': 7171926,\n",
       " 'phone number': 5455133,\n",
       " 'number email': 5173550,\n",
       " 'email thats': 3368420,\n",
       " 'thats get': 6774150,\n",
       " 'get equipment': 3814063,\n",
       " 'equipment service': 3422295,\n",
       " 'service im': 6215995,\n",
       " 'im literally': 4222156,\n",
       " 'literally trying': 4646472,\n",
       " 'trying pay': 6978181,\n",
       " 'pay nobody': 5398209,\n",
       " 'nobody find': 5122271,\n",
       " '115721 use': 48713,\n",
       " 'use order': 7121523,\n",
       " 'order number': 5287263,\n",
       " 'number locate': 5174990,\n",
       " 'locate account': 4669809,\n",
       " 'account need': 1758227,\n",
       " 'need secure': 5067011,\n",
       " 'secure one': 6150780,\n",
       " 'one one': 5245994,\n",
       " 'one chat': 5241882,\n",
       " 'chat please': 2635136,\n",
       " 'dm hsb': 3223469,\n",
       " '115722 md': 49352,\n",
       " 'md sent': 4847973,\n",
       " 'sent wrong': 6197166,\n",
       " 'wrong address': 7430994,\n",
       " '115721 hello': 48710,\n",
       " 'hello duke': 4041924,\n",
       " 'duke copy': 3302042,\n",
       " 'copy bill': 2883975,\n",
       " 'bill state': 2334588,\n",
       " 'state service': 6505289,\n",
       " 'service located': 6216952,\n",
       " 'located nhp': 4671045,\n",
       " '115722 nobody': 49405,\n",
       " 'find account': 3619024,\n",
       " 'account number': 1758371,\n",
       " 'number walked': 5177678,\n",
       " 'walked store': 7241622,\n",
       " 'store ive': 6552127,\n",
       " 'ive explained': 4386299,\n",
       " 'explained find': 3518796,\n",
       " 'find acct': 3619027,\n",
       " 'acct via': 1763169,\n",
       " 'via device': 7180493,\n",
       " 'device serial': 3144785,\n",
       " '115721 referring': 48712,\n",
       " 'referring wireless': 5837915,\n",
       " 'wireless residential': 7363266,\n",
       " 'residential service': 5929961,\n",
       " 'service jay': 6216373,\n",
       " '115722 tried': 49751,\n",
       " 'tried pay': 6953543,\n",
       " 'pay bill': 5396593,\n",
       " 'bill 60': 2332628,\n",
       " '60 day': 1332562,\n",
       " 'day service': 3021895,\n",
       " 'service rude': 6219529,\n",
       " 'rude several': 6030810,\n",
       " 'several transfer': 6233799,\n",
       " 'transfer look': 6930777,\n",
       " 'look equipment': 4700411,\n",
       " 'equipment give': 3421960,\n",
       " 'give acct': 3838151,\n",
       " '115723 light': 49912,\n",
       " 'light top': 4605704,\n",
       " 'top red': 6899036,\n",
       " 'red jay': 5824522,\n",
       " 'verizonsupport don': 7171016,\n",
       " 'don know': 3242575,\n",
       " 'know router': 4495564,\n",
       " 'router downstairs': 6023010,\n",
       " 'downstairs it': 3268827,\n",
       " 'it wifi': 4375977,\n",
       " 'wifi nothing': 7348477,\n",
       " 'nothing connected': 5148094,\n",
       " 'connected ethernet': 2835457,\n",
       " 'light change': 4604737,\n",
       " 'change router': 2609022,\n",
       " 'router happened': 6023145,\n",
       " 'happened jay': 3983422,\n",
       " 'verizonsupport randomly': 7172047,\n",
       " 'randomly boot': 5748902,\n",
       " 'boot offline': 2388905,\n",
       " 'offline go': 5214806,\n",
       " '115723 fios': 49910,\n",
       " 'fios service': 3631633,\n",
       " 'service service': 6219802,\n",
       " 'service go': 6215332,\n",
       " 'go internet': 3861916,\n",
       " 'internet light': 4319738,\n",
       " 'light router': 4605487,\n",
       " 'router change': 6022881,\n",
       " 'change color': 2606462,\n",
       " 'color bcw': 2752991,\n",
       " 'verizonsupport yep': 7172839,\n",
       " '115723 service': 49914,\n",
       " 'service cutting': 6213590,\n",
       " 'cutting acm': 2977447,\n",
       " 'verizonsupport cut': 7170916,\n",
       " 'cut every': 2975272,\n",
       " 'every 20': 3470043,\n",
       " '20 minute': 456195,\n",
       " 'minute ridiculous': 4930139,\n",
       " '115723 make': 49913,\n",
       " 'make feel': 4780290,\n",
       " 'feel way': 3597102,\n",
       " 'way fix': 7278219,\n",
       " 'fix thing': 3645435,\n",
       " 'thing kmg': 6789892,\n",
       " '115722 worst': 49870,\n",
       " 'worst isp': 7414005,\n",
       " 'isp ve': 4357526,\n",
       " 've ever': 7156663,\n",
       " '115724 area': 49915,\n",
       " 'area located': 2073711,\n",
       " 'located service': 4671194,\n",
       " 'service time': 6221054,\n",
       " 'time hsb': 6840029,\n",
       " 'verizonsupport 115725': 7170011,\n",
       " '115725 115726': 49928,\n",
       " '115726 gtall': 51191,\n",
       " 'gtall verizon': 3929485,\n",
       " 'verizon downlt': 7169040,\n",
       " 'downlt expect': 3268532,\n",
       " 'expect fix': 3500279,\n",
       " '115727 app': 51202,\n",
       " 'app referring': 2033392,\n",
       " 'referring acm': 5836524,\n",
       " '115725 fix': 50370,\n",
       " 'fix app': 3641799,\n",
       " 'app wont': 2035024,\n",
       " 'wont even': 7384575,\n",
       " 'even open': 3459985,\n",
       " '115728 still': 51204,\n",
       " 'still think': 6532926,\n",
       " 'think look': 6794750,\n",
       " 'look great': 4700903,\n",
       " 'great becky': 3908067,\n",
       " 'chipotletweets chipotletweets': 2669886,\n",
       " 'chipotletweets becky': 2669609,\n",
       " 'becky nice': 2289610,\n",
       " 'chipotletweets 28': 2668803,\n",
       " '28 dont': 665261,\n",
       " 'dont fit': 3251932,\n",
       " 'fit veggie': 3640440,\n",
       " 'veggie burrito': 7161185,\n",
       " 'burrito costume': 2465621,\n",
       " 'costume halloween': 2898537,\n",
       " '115729 im': 51205,\n",
       " 'im sorry': 4223931,\n",
       " 'sorry please': 6415236,\n",
       " 'please tell': 5518656,\n",
       " 'tell help': 6719452,\n",
       " 'help becky': 4049206,\n",
       " 'chipotletweets messed': 2671257,\n",
       " 'messed today': 4890277,\n",
       " 'today didn': 6868250,\n",
       " 'didn give': 3155218,\n",
       " 'give burrito': 3838576,\n",
       " 'burrito although': 2465449,\n",
       " 'although dressed': 1912580,\n",
       " 'dressed loudlycryingface': 3275029,\n",
       " '115730 hopefully': 51206,\n",
       " 'hopefully well': 4140754,\n",
       " 'well get': 7311515,\n",
       " 'get point': 3818274,\n",
       " 'point becky': 5535125,\n",
       " 'hey chipotletweets': 4071595,\n",
       " 'chipotletweets wan': 2672645,\n",
       " 'wan na': 7245678,\n",
       " 'na come': 5032845,\n",
       " 'come mammoth': 2764503,\n",
       " 'mammoth ill': 4789603,\n",
       " 'ill least': 4216469,\n",
       " 'least eat': 4563396,\n",
       " 'eat week': 3326218,\n",
       " 'week promise': 7298914,\n",
       " '115731 guac': 51207,\n",
       " 'guac im': 3931043,\n",
       " 'im happy': 4221487,\n",
       " 'happy great': 3991843,\n",
       " 'great experience': 3908916,\n",
       " 'experience becky': 3507161,\n",
       " 'chipotletweets excellent': 2670346,\n",
       " 'excellent service': 3486437,\n",
       " 'service tonight': 6221139,\n",
       " 'tonight plenty': 6892509,\n",
       " 'plenty people': 5521281,\n",
       " 'people line': 5422320,\n",
       " 'line went': 4628935,\n",
       " 'went fast': 7317734,\n",
       " 'fast everyone': 3571718,\n",
       " 'everyone kind': 3474295,\n",
       " '115731 youre': 51208,\n",
       " 'youre smart': 7494204,\n",
       " 'smart tara': 6359473,\n",
       " 'youre one': 7493554,\n",
       " 'one costume': 5242318,\n",
       " 'costume boorito': 2898401,\n",
       " 'boorito chipotletweets': 2387450,\n",
       " '115732 thats': 51209,\n",
       " 'thats incredibly': 6774417,\n",
       " 'incredibly concerning': 4259063,\n",
       " 'concerning please': 2814462,\n",
       " 'tell becky': 6718232,\n",
       " 'chipotletweets diet': 2670178,\n",
       " 'diet coke': 3161433,\n",
       " 'coke literal': 2744089,\n",
       " 'literal bone': 4644739,\n",
       " 'bone boorito': 2376157,\n",
       " 'boorito extra': 2387467,\n",
       " 'extra spooky': 3528989,\n",
       " '115733 nope': 51210,\n",
       " 'nope still': 5134314,\n",
       " 'still becky': 6527846,\n",
       " 'chipotletweets get': 2670603,\n",
       " 'get queso': 3818671,\n",
       " 'queso quac': 5720485,\n",
       " 'quac youre': 5708800,\n",
       " 'youre bowl': 7491996,\n",
       " 'bowl extra': 2402711,\n",
       " 'stop costume': 6542563,\n",
       " 'costume 1031': 2898349,\n",
       " '1031 3pmclose': 25527,\n",
       " '3pmclose official': 947570,\n",
       " 'official rule': 5213924,\n",
       " '115734 mean': 51211,\n",
       " 'mean boorito': 4851726,\n",
       " 'boorito basically': 2387443,\n",
       " 'basically adult': 2271927,\n",
       " 'adult version': 1805195,\n",
       " 'version halloween': 7175423,\n",
       " 'halloween becky': 3966743,\n",
       " 'happy halloween': 3991887,\n",
       " 'halloween since': 3967381,\n",
       " 'since im': 6320463,\n",
       " 'im old': 4222711,\n",
       " 'old trick': 5232789,\n",
       " 'trick treat': 6951242,\n",
       " 'treat look': 6946120,\n",
       " 'look forward': 4700683,\n",
       " 'forward booritos': 3710873,\n",
       " 'booritos chipotletweets': 2387568,\n",
       " 'chipotletweets ghost': 2670609,\n",
       " 'ghost got': 3830487,\n",
       " 'got mine': 3894074,\n",
       " 'mine earlier': 4922855,\n",
       " '115735 im': 51212,\n",
       " 'im glad': 4221325,\n",
       " 'glad could': 3847297,\n",
       " 'could help': 2901294,\n",
       " 'help work': 4058405,\n",
       " 'work id': 7393196,\n",
       " 'id like': 4195543,\n",
       " 'like share': 4615995,\n",
       " 'share praise': 6243085,\n",
       " 'praise becky': 5581023,\n",
       " 'chipotletweets thank': 2672366,\n",
       " 'thank chipotletweets': 6753068,\n",
       " 'chipotletweets resolving': 2671823,\n",
       " 'resolving issue': 5936490,\n",
       " 'issue quickly': 4364519,\n",
       " 'quickly all': 5728904,\n",
       " 'all best': 1884700,\n",
       " 'best smilingface': 2314681,\n",
       " 'smilingface fanforlife': 6363160,\n",
       " 'frustrated chipotletweets': 3748174,\n",
       " 'chipotletweets enragedface': 2670314,\n",
       " 'enragedface ordered': 3404520,\n",
       " 'ordered dinner': 5291314,\n",
       " 'dinner saturday': 3172872,\n",
       " 'saturday using': 6088929,\n",
       " 'using app': 7133348,\n",
       " 'app order': 2032820,\n",
       " 'order wrong': 5289793,\n",
       " 'wrong charged': 7431444,\n",
       " 'charged credit': 2623702,\n",
       " 'credit card': 2936690,\n",
       " 'card twice': 2545256,\n",
       " '115736 location': 51214,\n",
       " 'location participating': 4673618,\n",
       " 'participating becky': 5367399,\n",
       " 'way chipotletweets': 7277190,\n",
       " 'chipotletweets giving': 2670622,\n",
       " 'giving burrito': 3845103,\n",
       " 'burrito dress': 2465676,\n",
       " 'dress halloween': 3274765,\n",
       " 'halloween jackolantern': 3967108,\n",
       " 'jackolantern call': 4391401,\n",
       " 'call chipotle': 2497908,\n",
       " 'chipotle make': 2667829,\n",
       " 'make sure': 4782866,\n",
       " 'sure they': 6631126,\n",
       " 'they re': 6783270,\n",
       " 're select': 5763991,\n",
       " 'select one': 6174388,\n",
       " '115737 apology': 51217,\n",
       " 'apology sent': 2028313,\n",
       " 'sent dm': 6194613,\n",
       " 'dm help': 3223375,\n",
       " 'chipotletweets tried': 2672467,\n",
       " 'tried didnt': 6952475,\n",
       " 'didnt work': 3157852,\n",
       " 'work rude': 7395258,\n",
       " '115737 give': 51218,\n",
       " 'give try': 3841631,\n",
       " 'try tara': 6975943,\n",
       " 'chipotletweets dress': 2670245,\n",
       " 'dress still': 3274906,\n",
       " 'still qualify': 6531602,\n",
       " 'qualify boorito': 5709629,\n",
       " '115738 thats': 51221,\n",
       " 'thats best': 6773249,\n",
       " 'best kind': 2313618,\n",
       " 'kind trickortreating': 4478743,\n",
       " 'trickortreating treat': 6951463,\n",
       " 'treat friend': 6945934,\n",
       " 'friend becky': 3739191,\n",
       " 'every year': 3471952,\n",
       " 'year trickortreating': 7467126,\n",
       " 'trickortreating routine': 6951461,\n",
       " 'routine walking': 6024133,\n",
       " 'walking chipotle': 7241888,\n",
       " 'chipotle spending': 2668170,\n",
       " 'spending dollar': 6455948,\n",
       " 'dollar walking': 3239524,\n",
       " 'walking back': 7241860,\n",
       " 'back home': 2230344,\n",
       " 'home chipotletweets': 4125968,\n",
       " '115739 thats': 51223,\n",
       " 'please provide': 5517684,\n",
       " 'provide detail': 5669523,\n",
       " 'detail investigate': 3135102,\n",
       " 'investigate becky': 4326800,\n",
       " 'chipotletweets nasty': 2671346,\n",
       " 'nasty used': 5046617,\n",
       " 'used napkin': 7126172,\n",
       " 'napkin someone': 5045002,\n",
       " 'someone food': 6389651,\n",
       " '115740 bummer': 51228,\n",
       " 'bummer im': 2460165,\n",
       " 'sorry far': 6412711,\n",
       " 'far away': 3564998,\n",
       " 'away closest': 2206456,\n",
       " 'closest location': 2722639,\n",
       " 'location becky': 4672010,\n",
       " 'burrito nowhere': 2465984,\n",
       " 'nowhere near': 5163476,\n",
       " 'near chipotletweets': 5056410,\n",
       " 'chipotletweets manfacepalmingmediumdarkskintone': 2671200,\n",
       " '115741 noted': 51230,\n",
       " 'noted smilingfacewithsmilingeyes': 5146703,\n",
       " 'smilingfacewithsmilingeyes becky': 6365117,\n",
       " 'chipotletweets also': 2669460,\n",
       " 'also got': 1906967,\n",
       " 'got onesie': 3894475,\n",
       " 'onesie target': 5250606,\n",
       " 'target cozy': 6693297,\n",
       " 'chipotletweets thanks': 2672368,\n",
       " 'thanks becky': 6760609,\n",
       " 'becky feeling': 2289522,\n",
       " 'feeling sorry': 3598021,\n",
       " 'sorry fiancé': 6412753,\n",
       " 'fiancé driving': 3603745,\n",
       " 'driving dc': 3285350,\n",
       " 'dc mississippi': 3025967,\n",
       " 'mississippi tonight': 4942173,\n",
       " '115741 wont': 51233,\n",
       " 'wont alone': 7384125,\n",
       " 'alone well': 1896936,\n",
       " 'well also': 7309910,\n",
       " 'also want': 1909899,\n",
       " 'want llama': 7249189,\n",
       " 'llama onesie': 4659182,\n",
       " 'onesie becky': 5250583,\n",
       " 'considering walking': 2845982,\n",
       " 'walking chipotletweets': 7241889,\n",
       " 'chipotletweets llama': 2671105,\n",
       " 'onesie alone': 5250578,\n",
       " 'alone happy': 1896472,\n",
       " 'halloween loudlycryingface': 3967167,\n",
       " '115742 love': 51235,\n",
       " 'love thanks': 4731916,\n",
       " 'thanks much': 6764577,\n",
       " 'much stopping': 5013057,\n",
       " 'stopping becky': 6546853,\n",
       " 'chipotletweets name': 2671343,\n",
       " 'name better': 5039322,\n",
       " 'better halloween': 2320324,\n",
       " 'halloween duo': 3966921,\n",
       " 'duo speedwaybrick': 3305214,\n",
       " 'speedwaybrick uttranscript': 6454010,\n",
       " '115743 info': 51237,\n",
       " 'info share': 4273409,\n",
       " 'share moment': 6242858,\n",
       " 'moment feel': 4962635,\n",
       " 'feel free': 3596009,\n",
       " 'free keep': 3727727,\n",
       " 'keep eye': 4454445,\n",
       " 'eye blog': 3530700,\n",
       " 'blog news': 2358909,\n",
       " 'news update': 5097891,\n",
       " 'askplaystation 115743': 2122199,\n",
       " '115743 get': 51236,\n",
       " 'get help': 3815309,\n",
       " 'help already': 4048606,\n",
       " 'askplaystation whats': 2125147,\n",
       " 'whats november': 7328962,\n",
       " 'november plus': 5161740,\n",
       " 'plus free': 5525777,\n",
       " 'free game': 3727406,\n",
       " '115745 glad': 51238,\n",
       " 'glad know': 3847744,\n",
       " 'know downloading': 4491762,\n",
       " 'downloading please': 3267864,\n",
       " 'please feel': 5515916,\n",
       " 'free contact': 3726887,\n",
       " 'contact concern': 2854532,\n",
       " 'askplaystation would': 2125193,\n",
       " 'would go': 7419628,\n",
       " 'go download': 3860716,\n",
       " 'download waited': 3266429,\n",
       " 'waited hour': 7234104,\n",
       " 'hour till': 4156720,\n",
       " 'till bought': 6832547,\n",
       " 'bought downloaded': 2397987,\n",
       " '115745 sorry': 51239,\n",
       " 'sorry inconvenience': 6413453,\n",
       " 'inconvenience see': 4254266,\n",
       " 'see data': 6155214,\n",
       " 'data corrupted': 3003195,\n",
       " 'corrupted message': 2894353,\n",
       " 'message try': 4887903,\n",
       " 'try open': 6974876,\n",
       " 'open game': 5262323,\n",
       " 'game download': 3781001,\n",
       " 'askplaystation bought': 2123140,\n",
       " 'bought lego': 2398753,\n",
       " 'lego star': 4577443,\n",
       " 'star war': 6495502,\n",
       " 'war playstation': 7254709,\n",
       " 'playstation store': 5512834,\n",
       " 'store wont': 6555530,\n",
       " 'wont let': 7384875,\n",
       " 'let download': 4582797,\n",
       " 'download data': 3265238,\n",
       " '115746 glad': 51241,\n",
       " 'glad help': 3847600,\n",
       " 'help please': 4055047,\n",
       " 'please share': 5518263,\n",
       " 'share detail': 6242227,\n",
       " 'detail issue': 3135129,\n",
       " 'issue community': 4360301,\n",
       " 'community forum': 2780420,\n",
       " 'forum investigation': 3710192,\n",
       " 'askplaystation block': 2123117,\n",
       " 'block community': 2356363,\n",
       " 'community sending': 2780740,\n",
       " 'sending invite': 6189656,\n",
       " 'invite something': 4330299,\n",
       " 'something dont': 6392966,\n",
       " 'dont want': 3254276,\n",
       " 'want join': 7248999,\n",
       " '115747 glad': 51242,\n",
       " 'glad fun': 3847520,\n",
       " 'fun sarah': 3766905,\n",
       " 'sarah heard': 6083711,\n",
       " 'heard count': 4026470,\n",
       " 'count collin': 2905325,\n",
       " 'collin really': 2752283,\n",
       " 'really suck': 5785964,\n",
       " 'suck life': 6593999,\n",
       " 'life party': 4602393,\n",
       " 'count colin': 2905322,\n",
       " 'colin yellowheart': 2746345,\n",
       " 'yellowheart marksandspencer': 7469386,\n",
       " 'marksandspencer xx': 4819909,\n",
       " '115748 weve': 51243,\n",
       " 'weve let': 7323467,\n",
       " 'let team': 4584855,\n",
       " 'team know': 6707532,\n",
       " 'know better': 4490499,\n",
       " 'better joel': 2320587,\n",
       " 'joel thanks': 4421086,\n",
       " 'thanks sharing': 6766178,\n",
       " 'ere marksandspencer': 3423929,\n",
       " 'marksandspencer never': 4818728,\n",
       " 'never mind': 5085803,\n",
       " 'mind avocado': 4920463,\n",
       " 'avocado avocado': 2199889,\n",
       " 'avocado how': 2199980,\n",
       " 'how ave': 4160910,\n",
       " 'ave word': 2197173,\n",
       " 'word really': 7388971,\n",
       " 'really necessary': 5785049,\n",
       " 'necessary pair': 5060141,\n",
       " 'pair em': 5347769,\n",
       " 'em suffocating': 3362918,\n",
       " '115749 obligated': 51245,\n",
       " 'obligated provide': 5191294,\n",
       " 'provide bag': 5669153,\n",
       " 'bag unpackaged': 2247693,\n",
       " 'unpackaged meat': 7072195,\n",
       " 'meat prepackaged': 4858434,\n",
       " 'prepackaged charge': 5593815,\n",
       " 'charge applied': 2619042,\n",
       " 'marksandspencer raw': 4819082,\n",
       " 'raw meat': 5759089,\n",
       " 'meat it': 4858286,\n",
       " 'it say': 4374727,\n",
       " 'say unwrapped': 6102790,\n",
       " 'unwrapped raw': 7081261,\n",
       " 'meat sainsbury': 4858490,\n",
       " 'sainsbury don': 6064783,\n",
       " 'don charge': 3241860,\n",
       " 'charge waitrose': 2622032,\n",
       " '115749 packaging': 51246,\n",
       " 'packaging sufficient': 5334697,\n",
       " 'sufficient extra': 6598539,\n",
       " 'extra wrapping': 3529371,\n",
       " 'wrapping bag': 7427754,\n",
       " 'bag require': 2246966,\n",
       " 'require extra': 5917580,\n",
       " 'extra 5p': 3527229,\n",
       " '5p charge': 1330956,\n",
       " 'charge per': 2620931,\n",
       " 'per legislation': 5426049,\n",
       " 'legislation thanks': 4576489,\n",
       " 'marksandspencer check': 4817466,\n",
       " 'check gov': 2643119,\n",
       " 'gov office': 3899125,\n",
       " 'office legal': 5211912,\n",
       " 'legal stated': 4575720,\n",
       " 'stated right': 6506232,\n",
       " 'right it': 5992363,\n",
       " 'it funny': 4372574,\n",
       " 'funny store': 3771671,\n",
       " 'store don': 6550897,\n",
       " 'don wonder': 3243745,\n",
       " 'wonder lidl': 7381009,\n",
       " 'lidl rest': 4597683,\n",
       " 'rest beating': 5948685,\n",
       " 'marksandspencer ou': 4818840,\n",
       " 'ou must': 5305056,\n",
       " 'must charge': 5023818,\n",
       " 'charge least': 2620474,\n",
       " 'least 5p': 4562863,\n",
       " '5p bag': 1330949,\n",
       " 'bag including': 2246049,\n",
       " 'including vat': 4250074,\n",
       " 'vat carrier': 7155036,\n",
       " 'carrier bag': 2557772,\n",
       " 'bag following': 2245728,\n",
       " 'following unused': 3691285,\n",
       " 'unused it': 7080022,\n",
       " 'it new': 4373737,\n",
       " 'new hasn': 5090522,\n",
       " 'hasn already': 4001025,\n",
       " 'already used': 1903600,\n",
       " 'used sold': 7126980,\n",
       " 'sold good': 6379748,\n",
       " 'good taken': 3884514,\n",
       " 'taken away': 6678516,\n",
       " 'away delivered': 2206653,\n",
       " 'delivered plastic': 3083636,\n",
       " 'plastic 70': 5499774,\n",
       " '70 micron': 1496701,\n",
       " 'micron thick': 4901953,\n",
       " 'thick le': 6786731,\n",
       " 'le handle': 4554433,\n",
       " 'handle opening': 3973191,\n",
       " 'opening isn': 5266211,\n",
       " 'isn sealed': 4353571,\n",
       " 'marksandspencer aren': 4817161,\n",
       " 'aren require': 2076052,\n",
       " 'require charge': 5917458,\n",
       " 'charge bag': 2619150,\n",
       " 'bag paper': 2246660,\n",
       " 'paper bag': 5353609,\n",
       " 'bag shop': 2247165,\n",
       " 'shop airport': 6267013,\n",
       " 'airport board': 1856177,\n",
       " 'board train': 2368075,\n",
       " 'train aeroplane': 6921843,\n",
       " 'aeroplane ship': 1815878,\n",
       " 'ship bag': 6254058,\n",
       " 'bag contain': 2245233,\n",
       " 'contain certain': 2861221,\n",
       " 'certain item': 2596771,\n",
       " 'item unwrapped': 4381089,\n",
       " 'unwrapped food': 7081252,\n",
       " 'food raw': 3694659,\n",
       " 'meat fish': 4858187,\n",
       " 'fish food': 3639100,\n",
       " 'food safety': 3694770,\n",
       " 'safety risk': 6059515,\n",
       " 'risk prescription': 5999738,\n",
       " 'prescription medicine': 5595886,\n",
       " 'medicine uncovered': 4860571,\n",
       " 'uncovered blade': 7047421,\n",
       " 'blade seed': 2350604,\n",
       " 'seed bulb': 6161118,\n",
       " 'bulb amp': 2457764,\n",
       " 'amp tulip': 1974614,\n",
       " 'marksandspencer charge': 4817460,\n",
       " 'charge meat': 2620620,\n",
       " 'meat bag': 4857995,\n",
       " 'bag collier': 2245181,\n",
       " 'collier wood': 2752257,\n",
       " 'wood branch': 7385951,\n",
       " 'branch buy': 2411153,\n",
       " 'buy meat': 2477458,\n",
       " 'meat required': 4858472,\n",
       " 'required supply': 5918991,\n",
       " 'supply customer': 6615831,\n",
       " 'customer free': 2968961,\n",
       " 'free bag': 3726489,\n",
       " 'bag poor': 2246766,\n",
       " 'poor service': 5546923,\n",
       " '115750 love': 51248,\n",
       " 'love aesthetic': 4727642,\n",
       " 'aesthetic colin': 1815967,\n",
       " 'colin creeperpillar': 2746160,\n",
       " 'creeperpillar someday': 2939717,\n",
       " 'someday bugbutterflyghost': 6387560,\n",
       " 'excellent halloweening': 3486183,\n",
       " 'halloweening marksandspencer': 3967632,\n",
       " 'marksandspencer okhandmediumlightskintone': 4818801,\n",
       " 'okhandmediumlightskintone countcolin': 5229181,\n",
       " 'countcolin halloween': 2906010,\n",
       " 'halloween food': 3966993,\n",
       " '115751 hello': 51251,\n",
       " 'hello josh': 4043180,\n",
       " 'josh get': 4429933,\n",
       " 'get better': 3811724,\n",
       " 'better assistance': 2319084,\n",
       " 'assistance support': 2144326,\n",
       " 'support suggest': 6620562,\n",
       " 'suggest post': 6600041,\n",
       " 'post tweet': 5566302,\n",
       " 'tweet dm': 6998197,\n",
       " 'dm friend': 3223094,\n",
       " 'friend xboxsupport': 3741581,\n",
       " 'microsofthelps xboxsupport': 4904724,\n",
       " 'xboxsupport brilliant': 7446084,\n",
       " 'brilliant thank': 2425066,\n",
       " 'microsofthelps hi': 4903667,\n",
       " 'hi trouble': 4096349,\n",
       " 'trouble making': 6963439,\n",
       " 'making purchase': 4785766,\n",
       " 'purchase xbox': 5694698,\n",
       " 'xbox one': 7443457,\n",
       " 'one store': 5248039,\n",
       " 'store fifa': 6551313,\n",
       " 'fifa point': 3605786,\n",
       " 'point help': 5536254,\n",
       " '115752 help': 51254,\n",
       " 'help assist': 4048965,\n",
       " 'assist recovering': 2140867,\n",
       " 'recovering account': 5821701,\n",
       " 'account recommend': 1759120,\n",
       " 'recommend contact': 5815676,\n",
       " 'contact answer': 2854016,\n",
       " 'answer desk': 2001320,\n",
       " 'desk team': 3126885,\n",
       " 'microsofthelps need': 4903949,\n",
       " 'need assistance': 5061832,\n",
       " 'assistance recovering': 2143952,\n",
       " 'recovering hotmail': 5821741,\n",
       " 'hotmail account': 4150983,\n",
       " 'account filled': 1756671,\n",
       " 'filled recovery': 3613144,\n",
       " 'recovery form': 5821973,\n",
       " 'form told': 3706585,\n",
       " 'told providing': 6882483,\n",
       " 'providing enough': 5675574,\n",
       " 'enough info': 3402194,\n",
       " '115753 appears': 51255,\n",
       " 'appears removed': 2041327,\n",
       " 'removed thanks': 5882611,\n",
       " 'thanks letting': 6763951,\n",
       " 'letting know': 4587478,\n",
       " 'know mb': 4493979,\n",
       " 'atviassist 115754': 2169160,\n",
       " '115754 umm': 51437,\n",
       " 'umm someone': 7036282,\n",
       " 'someone streaming': 6391231,\n",
       " 'streaming wwii': 6565450,\n",
       " 'wwii 500': 7439890,\n",
       " '500 viewer': 1162356,\n",
       " '115755 problem': 51459,\n",
       " 'problem let': 5630127,\n",
       " 'let know': 4583487,\n",
       " 'know come': 4491081,\n",
       " 'come across': 2762295,\n",
       " 'across issue': 1768419,\n",
       " 'issue question': 4364510,\n",
       " 'question future': 5722508,\n",
       " 'future happy': 3773918,\n",
       " 'happy help': 3991939,\n",
       " 'help rk': 4055991,\n",
       " 'atviassist 115755': 2169161,\n",
       " '115755 im': 51458,\n",
       " 'im trying': 4224514,\n",
       " 'trying buy': 6977017,\n",
       " 'buy digital': 2476520,\n",
       " 'digital deluxe': 3169399,\n",
       " 'deluxe edition': 3100996,\n",
       " 'edition store': 3336381,\n",
       " 'store keep': 6552229,\n",
       " 'keep receiving': 4455751,\n",
       " 'receiving error': 5804902,\n",
       " 'error message': 3428694,\n",
       " '115756 hello': 51461,\n",
       " 'hello sorry': 4045725,\n",
       " 'sorry late': 6414065,\n",
       " 'late response': 4537602,\n",
       " 'response checking': 5943461,\n",
       " 'checking still': 2651806,\n",
       " 'still need': 6530847,\n",
       " 'assistance please': 2143815,\n",
       " 'please let': 5516873,\n",
       " 'know rn': 4495522,\n",
       " 'atviassist thanks': 2173845,\n",
       " '115755 yes': 51460,\n",
       " 'yes pre': 7473964,\n",
       " 'pre order': 5582970,\n",
       " 'order game': 5285653,\n",
       " 'game console': 3780694,\n",
       " 'console store': 2848659,\n",
       " 'store information': 6552011,\n",
       " 'information please': 4278901,\n",
       " 'please contact': 5515260,\n",
       " ...}"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "bigram.vocabulary_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [],
   "source": [
    "# 2nd will try Tri-GRAM = it will consider 3 words at a time\n",
    "\n",
    "trigram=CountVectorizer(ngram_range=(3,3))\n",
    "trigramvocab=trigram.fit_transform(data['text'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'115712 understand would': 68742,\n",
       " 'understand would like': 14905422,\n",
       " 'would like assist': 15846173,\n",
       " 'like assist would': 9031110,\n",
       " 'assist would need': 3205982,\n",
       " 'would need get': 15850140,\n",
       " 'need get private': 10099577,\n",
       " 'get private secured': 6972843,\n",
       " 'private secured link': 11466877,\n",
       " 'secured link assist': 12592911,\n",
       " 'sprintcare sent several': 13416653,\n",
       " 'sent several private': 12734079,\n",
       " 'several private message': 12856149,\n",
       " 'private message one': 11466419,\n",
       " 'message one responding': 9708639,\n",
       " 'one responding usual': 10572912,\n",
       " '115712 please send': 68740,\n",
       " 'please send private': 11241505,\n",
       " 'send private message': 12706674,\n",
       " 'private message assist': 11466149,\n",
       " 'message assist click': 9699049,\n",
       " 'assist click message': 3197959,\n",
       " 'click message top': 4455941,\n",
       " 'message top profile': 9715079,\n",
       " 'private message gain': 11466281,\n",
       " 'message gain detail': 9704163,\n",
       " 'gain detail account': 6851677,\n",
       " 'sprintcare worst customer': 13418889,\n",
       " 'worst customer service': 15819258,\n",
       " '115713 saddening hear': 68745,\n",
       " 'saddening hear please': 12360572,\n",
       " 'hear please shoot': 7549750,\n",
       " 'please shoot dm': 11242292,\n",
       " 'shoot dm look': 12922203,\n",
       " 'dm look kc': 5608271,\n",
       " 'sprintcare gon na': 13413353,\n",
       " 'gon na magically': 7173138,\n",
       " 'na magically change': 10033094,\n",
       " 'magically change connectivity': 9449290,\n",
       " 'change connectivity whole': 4208043,\n",
       " 'connectivity whole family': 4722960,\n",
       " 'whole family lyingface': 15634296,\n",
       " 'family lyingface hundredpoints': 6361448,\n",
       " '115713 understand concern': 68746,\n",
       " 'understand concern wed': 14895609,\n",
       " 'concern wed like': 4664458,\n",
       " 'wed like please': 15506205,\n",
       " 'like please send': 9064665,\n",
       " 'please send direct': 11241243,\n",
       " 'send direct message': 12697551,\n",
       " 'direct message assist': 5516539,\n",
       " 'message assist aa': 9699008,\n",
       " 'sprintcare since signed': 13416903,\n",
       " 'since signed yousince': 13045470,\n",
       " 'signed yousince day': 13012497,\n",
       " '115713 wed definitely': 68747,\n",
       " 'wed definitely like': 15505257,\n",
       " 'definitely like work': 5217838,\n",
       " 'like work long': 9082916,\n",
       " 'work long experiencing': 15762230,\n",
       " 'long experiencing issue': 9263191,\n",
       " 'experiencing issue aa': 6278633,\n",
       " '115714 all lie': 69806,\n",
       " 'all lie great': 2464683,\n",
       " 'lie great connection': 9008951,\n",
       " 'great connection bar': 7271194,\n",
       " 'connection bar lte': 4714255,\n",
       " 'bar lte still': 3477162,\n",
       " 'lte still won': 9397078,\n",
       " 'still won load': 13560359,\n",
       " 'won load something': 15718283,\n",
       " 'load something smh': 9195694,\n",
       " '115715 please send': 78660,\n",
       " 'private message send': 11466511,\n",
       " 'message send link': 9712532,\n",
       " 'send link access': 12702665,\n",
       " 'link access account': 9110106,\n",
       " 'access account fr': 2149270,\n",
       " '115714 whenever contact': 78085,\n",
       " 'whenever contact customer': 15620366,\n",
       " 'contact customer support': 4747047,\n",
       " 'customer support tell': 5009929,\n",
       " 'support tell shortcode': 13751239,\n",
       " 'tell shortcode enabled': 13990284,\n",
       " 'shortcode enabled account': 12935312,\n",
       " 'enabled account never': 5994995,\n",
       " 'account never year': 2189219,\n",
       " 'never year ive': 10179355,\n",
       " 'year ive tried': 15966487,\n",
       " '115716 information incorrect': 78663,\n",
       " 'information incorrect jk': 8251673,\n",
       " 'askspectrum would like': 3181917,\n",
       " 'would like email': 15846443,\n",
       " 'like email copy': 9041208,\n",
       " 'email copy one': 5943636,\n",
       " 'copy one since': 4809519,\n",
       " 'one since spectrum': 10576233,\n",
       " 'since spectrum updating': 13045681,\n",
       " 'spectrum updating training': 13347469,\n",
       " '115716 department part': 78662,\n",
       " 'department part corporate': 5370997,\n",
       " 'part corporate office': 10851594,\n",
       " 'corporate office youre': 4814979,\n",
       " 'office youre particular': 10471059,\n",
       " 'youre particular area': 16058544,\n",
       " 'particular area gone': 10858229,\n",
       " 'area gone format': 3035549,\n",
       " 'gone format unawa': 7175909,\n",
       " 'askspectrum received corporate': 3177709,\n",
       " 'received corporate office': 11865979,\n",
       " 'corporate office would': 4814977,\n",
       " 'office would like': 10471012,\n",
       " 'would like copy': 15846354,\n",
       " '115716 thank jk': 78665,\n",
       " 'askspectrum correct way': 3170627,\n",
       " 'correct way via': 4821214,\n",
       " 'way via ocs': 15476108,\n",
       " 'via ocs account': 15215541,\n",
       " 'ocs account takeover': 10437541,\n",
       " 'account takeover email': 2201235,\n",
       " 'takeover email consent': 13896191,\n",
       " 'email consent form': 5943343,\n",
       " 'consent form need': 4725349,\n",
       " 'form need done': 6700524,\n",
       " 'need done local': 10095044,\n",
       " 'done local office': 5682940,\n",
       " 'askspectrum incorrect information': 3173714,\n",
       " 'incorrect information form': 8205211,\n",
       " 'information form front': 8249980,\n",
       " 'form front faxed': 6699559,\n",
       " 'front faxed overmaybe': 6784150,\n",
       " 'faxed overmaybe need': 6402058,\n",
       " 'overmaybe need maintain': 10757079,\n",
       " 'need maintain date': 10108116,\n",
       " 'maintain date information': 9461615,\n",
       " '115716 information pertaining': 78664,\n",
       " 'information pertaining account': 8254939,\n",
       " 'pertaining account assumption': 11028559,\n",
       " 'account assumption correct': 2170099,\n",
       " 'assumption correct need': 3217948,\n",
       " 'correct need done': 4818843,\n",
       " 'done local outlet': 5682941,\n",
       " 'local outlet wit': 9204144,\n",
       " 'actually thats broken': 2244220,\n",
       " 'thats broken link': 14158775,\n",
       " 'broken link sent': 3812028,\n",
       " 'link sent incorrect': 9122953,\n",
       " 'sent incorrect information': 12728549,\n",
       " '115717 hello apology': 78668,\n",
       " 'hello apology frustration': 7584613,\n",
       " 'apology frustration inconvenience': 2886066,\n",
       " 'frustration inconvenience happy': 6798628,\n",
       " 'inconvenience happy look': 8199286,\n",
       " 'happy look mg': 7467892,\n",
       " 'yo askspectrum customer': 16029693,\n",
       " 'askspectrum customer service': 3170802,\n",
       " 'customer service rep': 5006210,\n",
       " 'service rep super': 12812485,\n",
       " 'rep super nice': 12037415,\n",
       " 'super nice imma': 13724796,\n",
       " 'nice imma start': 10241935,\n",
       " 'imma start trippin': 8158692,\n",
       " 'start trippin all': 13460417,\n",
       " 'trippin all don': 14653159,\n",
       " 'all don get': 2463091,\n",
       " 'don get service': 5663087,\n",
       " 'get service going': 6983782,\n",
       " '115718 apologize inconvenience': 78672,\n",
       " 'apologize inconvenience glad': 2876875,\n",
       " 'inconvenience glad assist': 8199157,\n",
       " 'glad assist dm': 7074592,\n",
       " 'assist dm name': 3198795,\n",
       " 'dm name acct': 5609530,\n",
       " 'name acct phone': 10042969,\n",
       " 'acct phone jb': 2210316,\n",
       " 'picture askspectrum pretty': 11113392,\n",
       " 'askspectrum pretty much': 3177312,\n",
       " 'pretty much every': 11416996,\n",
       " 'much every day': 9979883,\n",
       " 'every day pay': 6179701,\n",
       " 'day pay 171': 5123719,\n",
       " 'pay 171 per': 10915927,\n",
       " '171 per month': 612780,\n",
       " '115719 help arrived': 78683,\n",
       " 'help arrived sorry': 7612522,\n",
       " 'arrived sorry see': 3082389,\n",
       " 'sorry see trouble': 13261074,\n",
       " 'see trouble help': 12636034,\n",
       " 'trouble help hsb': 14660240,\n",
       " 'verizonsupport finally got': 15186439,\n",
       " 'finally got someone': 6481039,\n",
       " 'got someone helped': 7246076,\n",
       " 'someone helped thanks': 13169850,\n",
       " '115719 awesome ever': 78682,\n",
       " 'awesome ever need': 3344868,\n",
       " 'ever need tweet': 6171718,\n",
       " 'need tweet away': 10125476,\n",
       " 'tweet away hsb': 14760302,\n",
       " 'somebody verizonsupport please': 13161130,\n",
       " 'verizonsupport please help': 15190296,\n",
       " 'please help meeeeee': 11226407,\n",
       " 'help meeeeee wearyfacewearyfacewearyfacewearyface': 7638459,\n",
       " 'meeeeee wearyfacewearyfacewearyfacewearyface im': 9660780,\n",
       " 'wearyfacewearyfacewearyfacewearyface im worst': 15484702,\n",
       " 'im worst luck': 8152474,\n",
       " 'worst luck customer': 15821176,\n",
       " 'luck customer service': 9398742,\n",
       " '115720 friend message': 78686,\n",
       " 'friend message acm': 6775787,\n",
       " 'verizonsupport friend without': 15186699,\n",
       " 'friend without internet': 6779166,\n",
       " 'without internet need': 15698839,\n",
       " 'internet need play': 8331572,\n",
       " 'need play videogames': 10112453,\n",
       " 'play videogames together': 11189409,\n",
       " 'videogames together please': 15229850,\n",
       " 'together please skill': 14458390,\n",
       " 'please skill diminish': 11242572,\n",
       " 'skill diminish every': 13087538,\n",
       " 'diminish every moment': 5509887,\n",
       " 'every moment without': 6182745,\n",
       " 'moment without internetz': 9873984,\n",
       " '115721 please follow': 78689,\n",
       " 'please follow dm': 11222933,\n",
       " 'follow dm look': 6660103,\n",
       " 'dm look order': 5608345,\n",
       " 'look order hsb': 9299922,\n",
       " 'verizonsupport else provide': 15186159,\n",
       " 'else provide refuse': 5930103,\n",
       " 'provide refuse help': 11576606,\n",
       " 'refuse help can': 11961190,\n",
       " 'help can not': 7615409,\n",
       " 'can not validate': 3983514,\n",
       " 'not validate account': 10315273,\n",
       " '115721 would able': 78692,\n",
       " 'would able verify': 15829029,\n",
       " 'able verify anything': 2127554,\n",
       " 'verify anything without': 15177549,\n",
       " 'anything without authenticating': 2860354,\n",
       " 'without authenticating account': 15694237,\n",
       " 'authenticating account jay': 3283709,\n",
       " 'verizonsupport phone number': 15190195,\n",
       " 'phone number email': 11067987,\n",
       " 'number email thats': 10378392,\n",
       " 'email thats get': 5964713,\n",
       " 'thats get equipment': 14162675,\n",
       " 'get equipment service': 6941188,\n",
       " 'equipment service im': 6064474,\n",
       " 'service im literally': 12792910,\n",
       " 'im literally trying': 8130184,\n",
       " 'literally trying pay': 9151142,\n",
       " 'trying pay nobody': 14712383,\n",
       " 'pay nobody find': 10926999,\n",
       " '115721 use order': 78691,\n",
       " 'use order number': 15068523,\n",
       " 'order number locate': 10687895,\n",
       " 'number locate account': 10384060,\n",
       " 'locate account need': 9207202,\n",
       " 'account need secure': 2188976,\n",
       " 'need secure one': 10118228,\n",
       " 'secure one one': 12592435,\n",
       " 'one one chat': 10565699,\n",
       " 'one chat please': 10542773,\n",
       " 'chat please follow': 4286345,\n",
       " 'follow dm hsb': 6660063,\n",
       " '115722 md sent': 80244,\n",
       " 'md sent wrong': 9631638,\n",
       " 'sent wrong address': 12736722,\n",
       " '115721 hello duke': 78688,\n",
       " 'hello duke copy': 7589164,\n",
       " 'duke copy bill': 5828340,\n",
       " 'copy bill state': 4808377,\n",
       " 'bill state service': 3606840,\n",
       " 'state service located': 13472996,\n",
       " 'service located nhp': 12798402,\n",
       " '115722 nobody find': 80373,\n",
       " 'nobody find account': 10275933,\n",
       " 'find account number': 6484847,\n",
       " 'account number walked': 2190302,\n",
       " 'number walked store': 10396876,\n",
       " 'walked store ive': 15353886,\n",
       " 'store ive explained': 13609029,\n",
       " 'ive explained find': 8548646,\n",
       " 'explained find acct': 6290722,\n",
       " 'find acct via': 6484889,\n",
       " 'acct via device': 2210993,\n",
       " 'via device serial': 15210351,\n",
       " '115721 referring wireless': 78690,\n",
       " 'referring wireless residential': 11936162,\n",
       " 'wireless residential service': 15680441,\n",
       " 'residential service jay': 12126707,\n",
       " '115722 tried pay': 81164,\n",
       " 'tried pay bill': 14634202,\n",
       " 'pay bill 60': 10919563,\n",
       " 'bill 60 day': 3600818,\n",
       " '60 day service': 1681466,\n",
       " 'day service rude': 5129835,\n",
       " 'service rude several': 12814529,\n",
       " 'rude several transfer': 12321544,\n",
       " 'several transfer look': 12857225,\n",
       " 'transfer look equipment': 14586587,\n",
       " 'look equipment give': 9288105,\n",
       " 'equipment give acct': 6063931,\n",
       " '115723 light top': 81648,\n",
       " 'light top red': 9023000,\n",
       " 'top red jay': 14512515,\n",
       " 'verizonsupport don know': 15185913,\n",
       " 'don know router': 5664873,\n",
       " 'know router downstairs': 8778421,\n",
       " 'router downstairs it': 12308628,\n",
       " 'downstairs it wifi': 5749337,\n",
       " 'it wifi nothing': 8513646,\n",
       " 'wifi nothing connected': 15653178,\n",
       " 'nothing connected ethernet': 10325196,\n",
       " '115723 light change': 81647,\n",
       " 'light change router': 9021043,\n",
       " 'change router happened': 4219158,\n",
       " 'router happened jay': 12308936,\n",
       " 'verizonsupport randomly boot': 15190613,\n",
       " 'randomly boot offline': 11731962,\n",
       " 'boot offline go': 3712001,\n",
       " '115723 fios service': 81645,\n",
       " 'fios service service': 6519575,\n",
       " 'service service go': 12816563,\n",
       " 'service go internet': 12788783,\n",
       " 'go internet light': 7117219,\n",
       " 'internet light router': 8330813,\n",
       " 'light router change': 9022546,\n",
       " 'router change color': 12308321,\n",
       " 'change color bcw': 4207823,\n",
       " '115723 service cutting': 81650,\n",
       " 'service cutting acm': 12778044,\n",
       " 'verizonsupport cut every': 15185591,\n",
       " 'cut every 20': 5017074,\n",
       " 'every 20 minute': 6177325,\n",
       " '20 minute ridiculous': 719167,\n",
       " '115723 make feel': 81649,\n",
       " 'make feel way': 9478226,\n",
       " 'feel way fix': 6443532,\n",
       " 'way fix thing': 15458746,\n",
       " 'fix thing kmg': 6559831,\n",
       " '115722 worst isp': 81529,\n",
       " 'worst isp ve': 15820915,\n",
       " 'isp ve ever': 8426763,\n",
       " '115724 area located': 81651,\n",
       " 'area located service': 3036750,\n",
       " 'located service time': 9209921,\n",
       " 'service time hsb': 12824730,\n",
       " 'verizonsupport 115725 115726': 15182933,\n",
       " '115725 115726 gtall': 81799,\n",
       " '115726 gtall verizon': 85278,\n",
       " 'gtall verizon downlt': 7318085,\n",
       " 'verizon downlt expect': 15180580,\n",
       " 'downlt expect fix': 5749052,\n",
       " '115727 app referring': 85288,\n",
       " 'app referring acm': 2915021,\n",
       " '115725 fix app': 82963,\n",
       " 'fix app wont': 6546044,\n",
       " 'app wont even': 2926608,\n",
       " 'wont even open': 15731479,\n",
       " '115728 still think': 85290,\n",
       " 'still think look': 13555154,\n",
       " 'think look great': 14226459,\n",
       " 'look great becky': 9290885,\n",
       " 'chipotletweets chipotletweets becky': 4370399,\n",
       " 'chipotletweets becky nice': 4369322,\n",
       " 'chipotletweets 28 dont': 4367700,\n",
       " '28 dont fit': 956238,\n",
       " 'dont fit veggie': 5699497,\n",
       " 'fit veggie burrito': 6543153,\n",
       " 'veggie burrito costume': 15167977,\n",
       " 'burrito costume halloween': 3853001,\n",
       " '115729 im sorry': 85291,\n",
       " 'im sorry please': 8142181,\n",
       " 'sorry please tell': 13256665,\n",
       " 'please tell help': 11245682,\n",
       " 'tell help becky': 13984006,\n",
       " 'chipotletweets messed today': 4375678,\n",
       " 'messed today didn': 9720626,\n",
       " 'today didn give': 14428249,\n",
       " 'didn give burrito': 5463113,\n",
       " 'give burrito although': 7046405,\n",
       " 'burrito although dressed': 3852388,\n",
       " 'although dressed loudlycryingface': 2548703,\n",
       " '115730 hopefully well': 85292,\n",
       " 'hopefully well get': 7928656,\n",
       " 'well get point': 15557445,\n",
       " 'get point becky': 6971669,\n",
       " 'hey chipotletweets wan': 7698019,\n",
       " 'chipotletweets wan na': 4380576,\n",
       " 'wan na come': 15360430,\n",
       " 'na come mammoth': 10029468,\n",
       " 'come mammoth ill': 4563583,\n",
       " 'mammoth ill least': 9509509,\n",
       " 'ill least eat': 8102762,\n",
       " 'least eat week': 8927778,\n",
       " 'eat week promise': 5870492,\n",
       " '115731 guac im': 85293,\n",
       " 'guac im happy': 7320020,\n",
       " 'im happy great': 8126335,\n",
       " 'happy great experience': 7463473,\n",
       " 'great experience becky': 7273805,\n",
       " 'chipotletweets excellent service': 4371899,\n",
       " 'excellent service tonight': 6221489,\n",
       " 'service tonight plenty': 12825993,\n",
       " 'tonight plenty people': 14497554,\n",
       " 'plenty people line': 11254618,\n",
       " 'people line went': 10983856,\n",
       " 'line went fast': 9107992,\n",
       " 'went fast everyone': 15581580,\n",
       " 'fast everyone kind': 6385369,\n",
       " '115731 youre smart': 85294,\n",
       " 'youre smart tara': 16062369,\n",
       " 'youre one costume': 16058256,\n",
       " 'one costume boorito': 10545200,\n",
       " 'costume boorito chipotletweets': 4834074,\n",
       " '115732 thats incredibly': 85295,\n",
       " 'thats incredibly concerning': 14164790,\n",
       " 'incredibly concerning please': 8209893,\n",
       " 'concerning please tell': 4667396,\n",
       " 'please tell becky': 11245354,\n",
       " 'chipotletweets diet coke': 4371219,\n",
       " 'diet coke literal': 5487303,\n",
       " 'coke literal bone': 4514633,\n",
       " 'literal bone boorito': 9146209,\n",
       " 'bone boorito extra': 3680005,\n",
       " 'boorito extra spooky': 3709851,\n",
       " '115733 nope still': 85296,\n",
       " 'nope still becky': 10294877,\n",
       " 'chipotletweets get queso': 4372658,\n",
       " 'get queso quac': 6973930,\n",
       " 'queso quac youre': 11678995,\n",
       " 'quac youre bowl': 11652141,\n",
       " 'youre bowl extra': 16048447,\n",
       " 'stop costume 1031': 13578588,\n",
       " 'costume 1031 3pmclose': 4834010,\n",
       " '1031 3pmclose official': 37675,\n",
       " '3pmclose official rule': 1265867,\n",
       " '115734 mean boorito': 85297,\n",
       " 'mean boorito basically': 9638344,\n",
       " 'boorito basically adult': 3709811,\n",
       " 'basically adult version': 3489494,\n",
       " 'adult version halloween': 2305419,\n",
       " 'version halloween becky': 15199575,\n",
       " 'happy halloween since': 7463687,\n",
       " 'halloween since im': 7410328,\n",
       " 'since im old': 13038651,\n",
       " 'im old trick': 8133484,\n",
       " 'old trick treat': 10522628,\n",
       " 'trick treat look': 14623542,\n",
       " 'treat look forward': 14615699,\n",
       " 'look forward booritos': 9289299,\n",
       " 'forward booritos chipotletweets': 6708702,\n",
       " 'booritos chipotletweets ghost': 3709960,\n",
       " 'chipotletweets ghost got': 4372719,\n",
       " 'ghost got mine': 7031864,\n",
       " 'got mine earlier': 7235406,\n",
       " '115735 im glad': 85298,\n",
       " 'im glad could': 8124333,\n",
       " 'glad could help': 7075605,\n",
       " 'could help work': 4846548,\n",
       " 'help work id': 7663964,\n",
       " 'work id like': 15759549,\n",
       " 'id like share': 8054877,\n",
       " 'like share praise': 9071889,\n",
       " 'share praise becky': 12874471,\n",
       " 'chipotletweets thank chipotletweets': 4379292,\n",
       " 'thank chipotletweets resolving': 14069416,\n",
       " 'chipotletweets resolving issue': 4377829,\n",
       " 'resolving issue quickly': 12141143,\n",
       " 'issue quickly all': 8461019,\n",
       " 'quickly all best': 11700213,\n",
       " 'all best smilingface': 2462276,\n",
       " 'best smilingface fanforlife': 3564067,\n",
       " 'frustrated chipotletweets enragedface': 6789978,\n",
       " 'chipotletweets enragedface ordered': 4371778,\n",
       " 'enragedface ordered dinner': 6035513,\n",
       " 'ordered dinner saturday': 10708299,\n",
       " 'dinner saturday using': 5512026,\n",
       " 'saturday using app': 12446930,\n",
       " 'using app order': 15101365,\n",
       " 'app order wrong': 2912673,\n",
       " 'order wrong charged': 10704123,\n",
       " 'wrong charged credit': 15884023,\n",
       " 'charged credit card': 4259153,\n",
       " 'credit card twice': 4925040,\n",
       " '115736 location participating': 85300,\n",
       " 'location participating becky': 9215583,\n",
       " 'way chipotletweets giving': 15454383,\n",
       " 'chipotletweets giving burrito': 4372777,\n",
       " 'giving burrito dress': 7069405,\n",
       " 'burrito dress halloween': 3853106,\n",
       " 'dress halloween jackolantern': 5757294,\n",
       " 'halloween jackolantern call': 7409892,\n",
       " 'jackolantern call chipotle': 8567369,\n",
       " 'call chipotle make': 3922851,\n",
       " 'chipotle make sure': 4366240,\n",
       " 'make sure they': 9493085,\n",
       " 'sure they re': 13785471,\n",
       " 'they re select': 14190094,\n",
       " 're select one': 11760050,\n",
       " '115737 apology sent': 85303,\n",
       " 'apology sent dm': 2891723,\n",
       " 'sent dm help': 12725476,\n",
       " 'dm help becky': 5603695,\n",
       " 'chipotletweets tried didnt': 4380059,\n",
       " 'tried didnt work': 14628638,\n",
       " 'didnt work rude': 5481174,\n",
       " '115737 give try': 85304,\n",
       " 'give try tara': 7060615,\n",
       " 'chipotletweets dress still': 4371572,\n",
       " 'dress still qualify': 5757469,\n",
       " 'still qualify boorito': 13545570,\n",
       " '115738 thats best': 85307,\n",
       " 'thats best kind': 14158457,\n",
       " 'best kind trickortreating': 3559753,\n",
       " 'kind trickortreating treat': 8721492,\n",
       " 'trickortreating treat friend': 14623814,\n",
       " 'treat friend becky': 14615312,\n",
       " 'every year trickortreating': 6189596,\n",
       " 'year trickortreating routine': 15973619,\n",
       " 'trickortreating routine walking': 14623812,\n",
       " 'routine walking chipotle': 12311125,\n",
       " 'walking chipotle spending': 15354321,\n",
       " 'chipotle spending dollar': 4366834,\n",
       " 'spending dollar walking': 13360374,\n",
       " 'dollar walking back': 5655291,\n",
       " 'walking back home': 15354269,\n",
       " 'back home chipotletweets': 3390386,\n",
       " '115739 thats incredibly': 85309,\n",
       " 'concerning please provide': 4667387,\n",
       " 'please provide detail': 11235096,\n",
       " 'provide detail investigate': 11571541,\n",
       " 'detail investigate becky': 5415369,\n",
       " 'chipotletweets nasty used': 4375915,\n",
       " 'nasty used napkin': 10057543,\n",
       " 'used napkin someone': 15084328,\n",
       " 'napkin someone food': 10055688,\n",
       " '115740 bummer im': 85314,\n",
       " 'bummer im sorry': 3844990,\n",
       " 'im sorry far': 8141218,\n",
       " 'sorry far away': 13236577,\n",
       " 'far away closest': 6371360,\n",
       " 'away closest location': 3336889,\n",
       " 'closest location becky': 4475344,\n",
       " 'burrito nowhere near': 3853642,\n",
       " 'nowhere near chipotletweets': 10360170,\n",
       " 'near chipotletweets manfacepalmingmediumdarkskintone': 10073442,\n",
       " '115741 noted smilingfacewithsmilingeyes': 85316,\n",
       " 'noted smilingfacewithsmilingeyes becky': 10322099,\n",
       " 'chipotletweets also got': 4368703,\n",
       " 'also got onesie': 2527171,\n",
       " 'got onesie target': 7238039,\n",
       " 'onesie target cozy': 10590221,\n",
       " 'chipotletweets thanks becky': 4379407,\n",
       " 'thanks becky feeling': 14100795,\n",
       " 'becky feeling sorry': 3519618,\n",
       " 'feeling sorry fiancé': 6446236,\n",
       " 'sorry fiancé driving': 13236801,\n",
       " 'fiancé driving dc': 6454112,\n",
       " 'driving dc mississippi': 5790287,\n",
       " 'dc mississippi tonight': 5143760,\n",
       " '115741 wont alone': 85319,\n",
       " 'wont alone well': 15729399,\n",
       " 'alone well also': 2488839,\n",
       " 'well also want': 15548074,\n",
       " 'also want llama': 2543260,\n",
       " 'want llama onesie': 15381350,\n",
       " 'llama onesie becky': 9184720,\n",
       " 'considering walking chipotletweets': 4730151,\n",
       " 'walking chipotletweets llama': 15354328,\n",
       " 'chipotletweets llama onesie': 4375004,\n",
       " 'llama onesie alone': 9184719,\n",
       " 'onesie alone happy': 10590193,\n",
       " 'alone happy halloween': 2488190,\n",
       " 'happy halloween loudlycryingface': 7463661,\n",
       " '115742 love thanks': 85321,\n",
       " 'love thanks much': 9379202,\n",
       " 'thanks much stopping': 14124702,\n",
       " 'much stopping becky': 9989778,\n",
       " 'chipotletweets name better': 4375909,\n",
       " 'name better halloween': 10044242,\n",
       " 'better halloween duo': 3576383,\n",
       " 'halloween duo speedwaybrick': 7409633,\n",
       " 'duo speedwaybrick uttranscript': 5832940,\n",
       " '115743 info share': 85323,\n",
       " 'info share moment': 8238042,\n",
       " 'share moment feel': 12873607,\n",
       " 'moment feel free': 9870686,\n",
       " 'feel free keep': 6438797,\n",
       " 'free keep eye': 6745090,\n",
       " 'keep eye blog': 8669857,\n",
       " 'eye blog news': 6313524,\n",
       " 'blog news update': 3648031,\n",
       " 'askplaystation 115743 get': 3151242,\n",
       " '115743 get help': 85322,\n",
       " 'get help already': 6949969,\n",
       " 'askplaystation whats november': 3163079,\n",
       " 'whats november plus': 15614198,\n",
       " 'november plus free': 10357872,\n",
       " 'plus free game': 11267048,\n",
       " '115745 glad know': 85324,\n",
       " 'glad know downloading': 7079906,\n",
       " 'know downloading please': 8753791,\n",
       " 'downloading please feel': 5748058,\n",
       " 'please feel free': 11221275,\n",
       " 'feel free contact': 6438721,\n",
       " 'free contact concern': 6741615,\n",
       " 'askplaystation would go': 3163308,\n",
       " 'would go download': 15841284,\n",
       " 'go download waited': 7112473,\n",
       " 'download waited hour': 5744753,\n",
       " 'waited hour till': 15333652,\n",
       " 'hour till bought': 7971565,\n",
       " 'till bought downloaded': 14308155,\n",
       " '115745 sorry inconvenience': 85325,\n",
       " 'sorry inconvenience see': 13246500,\n",
       " 'inconvenience see data': 8201453,\n",
       " 'see data corrupted': 12606993,\n",
       " 'data corrupted message': 5064442,\n",
       " 'corrupted message try': 4826630,\n",
       " 'message try open': 9715321,\n",
       " 'try open game': 14691190,\n",
       " 'open game download': 10620379,\n",
       " 'askplaystation bought lego': 3153356,\n",
       " 'bought lego star': 3728639,\n",
       " 'lego star war': 8960033,\n",
       " 'star war playstation': 13450373,\n",
       " 'war playstation store': 15406859,\n",
       " 'playstation store wont': 11203571,\n",
       " 'store wont let': 13627528,\n",
       " 'wont let download': 15733566,\n",
       " 'let download data': 8970287,\n",
       " 'download data corrupted': 5740871,\n",
       " '115746 glad help': 85327,\n",
       " 'glad help please': 7079238,\n",
       " 'help please share': 7644397,\n",
       " 'please share detail': 11241960,\n",
       " 'share detail issue': 12870324,\n",
       " 'detail issue community': 5415581,\n",
       " 'issue community forum': 8436588,\n",
       " 'community forum investigation': 4596023,\n",
       " 'askplaystation block community': 3153260,\n",
       " 'block community sending': 3643687,\n",
       " 'community sending invite': 4596584,\n",
       " 'sending invite something': 12714097,\n",
       " 'invite something dont': 8352074,\n",
       " 'something dont want': 13181327,\n",
       " 'dont want join': 5720657,\n",
       " '115747 glad fun': 85328,\n",
       " 'glad fun sarah': 7077010,\n",
       " 'fun sarah heard': 6834028,\n",
       " 'sarah heard count': 12438317,\n",
       " 'heard count collin': 7561089,\n",
       " 'count collin really': 4866180,\n",
       " 'collin really suck': 4530341,\n",
       " 'really suck life': 11824798,\n",
       " 'suck life party': 13695723,\n",
       " 'count colin yellowheart': 4866175,\n",
       " 'colin yellowheart marksandspencer': 4518161,\n",
       " 'yellowheart marksandspencer xx': 15977554,\n",
       " '115748 weve let': 85329,\n",
       " 'weve let team': 15596163,\n",
       " 'let team know': 8984696,\n",
       " 'team know better': 13950152,\n",
       " 'know better joel': 8746653,\n",
       " 'better joel thanks': 3577162,\n",
       " 'joel thanks sharing': 8615996,\n",
       " 'ere marksandspencer never': 6066709,\n",
       " 'marksandspencer never mind': 9569636,\n",
       " 'never mind avocado': 10170164,\n",
       " 'mind avocado avocado': 9784252,\n",
       " 'avocado avocado how': 3323847,\n",
       " 'avocado how ave': 3323968,\n",
       " 'how ave word': 7981610,\n",
       " 'ave word really': 3319610,\n",
       " 'word really necessary': 15744062,\n",
       " 'really necessary pair': 11818926,\n",
       " 'necessary pair em': 10080538,\n",
       " 'pair em suffocating': 10822435,\n",
       " '115749 obligated provide': 85331,\n",
       " 'obligated provide bag': 10428043,\n",
       " 'provide bag unpackaged': 11570051,\n",
       " 'bag unpackaged meat': 3446028,\n",
       " 'unpackaged meat prepackaged': 14939474,\n",
       " 'meat prepackaged charge': 9653716,\n",
       " 'prepackaged charge applied': 11403358,\n",
       " 'marksandspencer raw meat': 9570712,\n",
       " 'raw meat it': 11748771,\n",
       " 'meat it say': 9653483,\n",
       " 'it say unwrapped': 8507116,\n",
       " 'say unwrapped raw': 12489209,\n",
       " 'unwrapped raw meat': 14951979,\n",
       " 'raw meat sainsbury': 11748776,\n",
       " 'meat sainsbury don': 9653801,\n",
       " 'sainsbury don charge': 12398016,\n",
       " 'don charge waitrose': 5660433,\n",
       " '115749 packaging sufficient': 85332,\n",
       " 'packaging sufficient extra': 10792620,\n",
       " 'sufficient extra wrapping': 13703221,\n",
       " 'extra wrapping bag': 6310407,\n",
       " 'wrapping bag require': 15877091,\n",
       " 'bag require extra': 3443664,\n",
       " 'require extra 5p': 12101438,\n",
       " 'extra 5p charge': 6303558,\n",
       " '5p charge per': 1678938,\n",
       " 'charge per legislation': 4250793,\n",
       " 'per legislation thanks': 10997019,\n",
       " 'marksandspencer check gov': 9565744,\n",
       " 'check gov office': 4308632,\n",
       " 'gov office legal': 7257517,\n",
       " 'office legal stated': 10468643,\n",
       " 'legal stated right': 8957770,\n",
       " 'stated right it': 13474696,\n",
       " 'right it funny': 12258645,\n",
       " 'it funny store': 8495051,\n",
       " 'funny store don': 6841836,\n",
       " 'store don wonder': 13603551,\n",
       " 'don wonder lidl': 5673420,\n",
       " 'wonder lidl rest': 15722058,\n",
       " 'lidl rest beating': 9008015,\n",
       " 'marksandspencer ou must': 9570125,\n",
       " 'ou must charge': 10734615,\n",
       " 'must charge least': 10014519,\n",
       " 'charge least 5p': 4249173,\n",
       " 'least 5p bag': 8926510,\n",
       " '5p bag including': 1678905,\n",
       " 'bag including vat': 3440577,\n",
       " 'including vat carrier': 8193007,\n",
       " 'vat carrier bag': 15144977,\n",
       " 'carrier bag following': 4110679,\n",
       " 'bag following unused': 3439361,\n",
       " 'following unused it': 6672106,\n",
       " 'unused it new': 14950160,\n",
       " 'it new hasn': 8502226,\n",
       " 'new hasn already': 10192982,\n",
       " 'hasn already used': 7487240,\n",
       " 'already used sold': 2514358,\n",
       " 'used sold good': 15087045,\n",
       " 'sold good taken': 13147050,\n",
       " 'good taken away': 7202021,\n",
       " 'taken away delivered': 13890825,\n",
       " 'away delivered plastic': 3337251,\n",
       " 'delivered plastic 70': 5282881,\n",
       " 'plastic 70 micron': 11174040,\n",
       " '70 micron thick': 1852503,\n",
       " 'micron thick le': 9739234,\n",
       " 'thick le handle': 14199351,\n",
       " 'le handle opening': 8909812,\n",
       " 'handle opening isn': 7419551,\n",
       " 'opening isn sealed': 10630547,\n",
       " 'marksandspencer aren require': 9564970,\n",
       " 'aren require charge': 3042286,\n",
       " 'require charge bag': 12101226,\n",
       " 'charge bag paper': 4244551,\n",
       " 'bag paper bag': 3442724,\n",
       " 'paper bag shop': 10830173,\n",
       " 'bag shop airport': 3444254,\n",
       " 'shop airport board': 12923325,\n",
       " 'airport board train': 2406202,\n",
       " 'board train aeroplane': 3663683,\n",
       " 'train aeroplane ship': 14554570,\n",
       " 'aeroplane ship bag': 2324716,\n",
       " 'ship bag contain': 12893986,\n",
       " 'bag contain certain': 3437507,\n",
       " 'contain certain item': 4769468,\n",
       " 'certain item unwrapped': 4186290,\n",
       " 'item unwrapped food': 8534544,\n",
       " 'unwrapped food raw': 14951966,\n",
       " 'food raw meat': 6680246,\n",
       " 'raw meat fish': 11748770,\n",
       " 'meat fish food': 9653258,\n",
       " 'fish food safety': 6541062,\n",
       " 'food safety risk': 6680557,\n",
       " 'safety risk prescription': 12379357,\n",
       " 'risk prescription medicine': 12274397,\n",
       " 'prescription medicine uncovered': 11406711,\n",
       " 'medicine uncovered blade': 9657229,\n",
       " 'uncovered blade seed': 14889271,\n",
       " 'blade seed bulb': 3636386,\n",
       " 'seed bulb amp': 12640046,\n",
       " 'bulb amp tulip': 3841824,\n",
       " 'marksandspencer charge meat': 9565736,\n",
       " 'charge meat bag': 4249658,\n",
       " 'meat bag collier': 9652940,\n",
       " 'bag collier wood': 3437384,\n",
       " 'collier wood branch': 4530303,\n",
       " 'wood branch buy': 15739095,\n",
       " 'branch buy meat': 3754057,\n",
       " 'buy meat required': 3880689,\n",
       " 'meat required supply': 9653781,\n",
       " 'required supply customer': 12104094,\n",
       " 'supply customer free': 13732919,\n",
       " 'customer free bag': 4991849,\n",
       " 'free bag poor': 6739855,\n",
       " 'bag poor service': 3443153,\n",
       " '115750 love aesthetic': 85334,\n",
       " 'love aesthetic colin': 9361523,\n",
       " 'aesthetic colin creeperpillar': 2324818,\n",
       " 'colin creeperpillar someday': 4517878,\n",
       " 'creeperpillar someday bugbutterflyghost': 4932606,\n",
       " 'excellent halloweening marksandspencer': 6220775,\n",
       " 'halloweening marksandspencer okhandmediumlightskintone': 7410742,\n",
       " 'marksandspencer okhandmediumlightskintone countcolin': 9569918,\n",
       " 'okhandmediumlightskintone countcolin halloween': 10513549,\n",
       " 'countcolin halloween food': 4867308,\n",
       " '115751 hello josh': 85337,\n",
       " 'hello josh get': 7593902,\n",
       " 'josh get better': 8630502,\n",
       " 'get better assistance': 6924219,\n",
       " 'better assistance support': 3572767,\n",
       " 'assistance support suggest': 3211464,\n",
       " 'support suggest post': 13749688,\n",
       " 'suggest post tweet': 13706114,\n",
       " 'post tweet dm': 11353091,\n",
       " 'tweet dm friend': 14761647,\n",
       " 'dm friend xboxsupport': 5601931,\n",
       " 'microsofthelps xboxsupport brilliant': 9748261,\n",
       " 'xboxsupport brilliant thank': 15917535,\n",
       " 'microsofthelps hi trouble': 9743852,\n",
       " 'hi trouble making': 7831557,\n",
       " 'trouble making purchase': 14661714,\n",
       " 'making purchase xbox': 9503036,\n",
       " 'purchase xbox one': 11623902,\n",
       " 'xbox one store': 15910997,\n",
       " 'one store fifa': 10578383,\n",
       " 'store fifa point': 13605077,\n",
       " 'fifa point help': 6457116,\n",
       " '115752 help assist': 85340,\n",
       " 'help assist recovering': 7612836,\n",
       " 'assist recovering account': 3202827,\n",
       " 'recovering account recommend': 11911460,\n",
       " 'account recommend contact': 2194890,\n",
       " 'recommend contact answer': 11899908,\n",
       " 'contact answer desk': 4744439,\n",
       " 'answer desk team': 2824694,\n",
       " 'microsofthelps need assistance': 9744982,\n",
       " 'need assistance recovering': 10086426,\n",
       " 'assistance recovering hotmail': 3210574,\n",
       " 'recovering hotmail account': 11911513,\n",
       " 'hotmail account filled': 7947429,\n",
       " 'account filled recovery': 2179156,\n",
       " 'filled recovery form': 6473100,\n",
       " 'recovery form told': 11911840,\n",
       " 'form told providing': 6702090,\n",
       " 'told providing enough': 14474030,\n",
       " 'providing enough info': 11588981,\n",
       " '115753 appears removed': 85341,\n",
       " 'appears removed thanks': 2938949,\n",
       " 'removed thanks letting': 12024454,\n",
       " 'thanks letting know': 14120376,\n",
       " 'letting know mb': 8992507,\n",
       " 'atviassist 115754 umm': 3254654,\n",
       " '115754 umm someone': 85888,\n",
       " 'umm someone streaming': 14863217,\n",
       " 'someone streaming wwii': 13175263,\n",
       " 'streaming wwii 500': 13644914,\n",
       " 'wwii 500 viewer': 15903187,\n",
       " '115755 problem let': 85925,\n",
       " 'problem let know': 11488185,\n",
       " 'let know come': 8975089,\n",
       " 'know come across': 8749550,\n",
       " 'come across issue': 4555119,\n",
       " 'across issue question': 2218199,\n",
       " 'issue question future': 8460969,\n",
       " 'question future happy': 11683919,\n",
       " 'future happy help': 6845127,\n",
       " 'happy help rk': 7465875,\n",
       " 'atviassist 115755 im': 3254668,\n",
       " '115755 im trying': 85924,\n",
       " 'im trying buy': 8148750,\n",
       " 'trying buy digital': 14702284,\n",
       " 'buy digital deluxe': 3877945,\n",
       " 'digital deluxe edition': 5506996,\n",
       " 'deluxe edition store': 5355787,\n",
       " 'edition store keep': 5887160,\n",
       " 'store keep receiving': 13609210,\n",
       " 'keep receiving error': 8678823,\n",
       " 'receiving error message': 11879462,\n",
       " '115756 hello sorry': 85927,\n",
       " 'hello sorry late': 7602554,\n",
       " 'sorry late response': 13250128,\n",
       " 'late response checking': 8876317,\n",
       " 'response checking still': 12154930,\n",
       " 'checking still need': 4340717,\n",
       " 'still need assistance': 13539916,\n",
       " 'need assistance please': 10086374,\n",
       " 'assistance please let': 3210103,\n",
       " 'please let know': 11230087,\n",
       " 'let know rn': 8976793,\n",
       " '115755 yes pre': 85926,\n",
       " 'yes pre order': 15992468,\n",
       " 'pre order game': 11383038,\n",
       " 'order game console': 10678685,\n",
       " 'game console store': 6857282,\n",
       " 'console store information': 4735063,\n",
       " 'store information please': 13608328,\n",
       " 'information please contact': 8255100,\n",
       " 'please contact console': 11215132,\n",
       " 'contact console store': 4746710,\n",
       " 'console store rk': 4735071,\n",
       " 'atviassist still pre': 3268954,\n",
       " 'still pre oder': 13544441,\n",
       " 'pre oder ww2': 11382850,\n",
       " 'oder ww2 playstation': 10445509,\n",
       " 'ww2 playstation store': 15902273,\n",
       " '115757 good afternoon': 85929,\n",
       " 'good afternoon william': 7180694,\n",
       " 'afternoon william unfortunately': 2337532,\n",
       " 'william unfortunately app': 15659643,\n",
       " 'unfortunately app longer': 14914173,\n",
       " 'app longer supported': 2909922,\n",
       " 'longer supported sincerest': 9277894,\n",
       " 'supported sincerest apology': 13754708,\n",
       " 'sincerest apology jp': 13051682,\n",
       " '115758 atviassist yous': 86000,\n",
       " 'atviassist yous going': 3271351,\n",
       " 'yous going update': 16068656,\n",
       " 'going update cod': 7167125,\n",
       " 'update cod zombie': 14959806,\n",
       " 'cod zombie io': 4496056,\n",
       " 'zombie io io': 16089930,\n",
       " 'io io 11': 8362088,\n",
       " '115759 good afternoon': 86318,\n",
       " 'good afternoon jayden': 7180392,\n",
       " 'afternoon jayden sadly': 2336237,\n",
       " 'jayden sadly dont': 8581686,\n",
       " 'sadly dont information': 12361191,\n",
       " 'dont information sincerest': 5702983,\n",
       " 'information sincerest apology': 8258752,\n",
       " '115758 half gig': 86115,\n",
       " 'half gig update': 7404047,\n",
       " 'gig update world': 7038405,\n",
       " 'update world war': 14985419,\n",
       " '115760 awesome thank': 86319,\n",
       " 'awesome thank much': 3347935,\n",
       " 'thank much support': 14081337,\n",
       " 'much support love': 9989982,\n",
       " 'support love costume': 13744052,\n",
       " 'love costume tv': 9364963,\n",
       " '108162 115761 atviassist': 41739,\n",
       " '115761 atviassist tried': 86328,\n",
       " 'atviassist tried people': 3269714,\n",
       " 'tried people came': 14634313,\n",
       " 'people came back': 10976834,\n",
       " '115762 hey check': 86336,\n",
       " 'hey check link': 7697614,\n",
       " 'check link information': 4312001,\n",
       " 'link information regard': 9117010,\n",
       " 'information regard ko': 8256692,\n",
       " 'atviassist go get': 3264092,\n",
       " 'go get game': 7114858,\n",
       " 'get game friday': 6947194,\n",
       " 'game friday 2xp': 6859944,\n",
       " 'friday 2xp code': 6764641,\n",
       " '2xp code receipt': 1013828,\n",
       " '115762 gamestop give': 86334,\n",
       " 'gamestop give code': 6873918,\n",
       " 'give code pre': 7047637,\n",
       " 'code pre order': 4505300,\n",
       " 'pre order payment': 11383139,\n",
       " 'order payment needed': 10689906,\n",
       " 'payment needed redeem': 10946399,\n",
       " 'needed redeem ko': 10132090,\n",
       " 'atviassist yes beta': 3271134,\n",
       " 'yes beta code': 15981606,\n",
       " '115762 redeemed account': 86338,\n",
       " 'redeemed account even': 11919239,\n",
       " 'account even tho': 2178469,\n",
       " 'even tho say': 6151751,\n",
       " 'tho say beta': 14243218,\n",
       " 'say beta code': 12465684,\n",
       " 'beta code pre': 3569509,\n",
       " 'pre order bonus': 11382933,\n",
       " 'order bonus linked': 10668939,\n",
       " 'bonus linked ko': 3683799,\n",
       " 'atviassist yes code': 3271146,\n",
       " 'atviassist pre ordered': 3267528,\n",
       " 'pre ordered game': 11383390,\n",
       " 'ordered game game': 10709143,\n",
       " 'game game stop': 6860223,\n",
       " '115762 hello apologize': 86335,\n",
       " 'hello apologize delay': 7584475,\n",
       " 'apologize delay clarify': 2874517,\n",
       " 'delay clarify preordered': 5229413,\n",
       " 'clarify preordered game': 4429781,\n",
       " 'preordered game please': 11401644,\n",
       " 'game please sure': 6865304,\n",
       " 'please sure keep': 11244651,\n",
       " 'sure keep updated': 13776619,\n",
       " 'keep updated rn': 8684251,\n",
       " 'atviassist double xp': 3263042,\n",
       " 'pre ordered wwii': 11383517,\n",
       " 'ordered wwii get': 10715935,\n",
       " 'wwii get code': 15903414,\n",
       " '115763 please give': 86341,\n",
       " 'please give gamertag': 11224367,\n",
       " 'give gamertag platform': 7051295,\n",
       " 'gamertag platform youre': 6873376,\n",
       " 'platform youre playing': 11179812,\n",
       " ...}"
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "trigram.vocabulary_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [],
   "source": [
    "# 3rd will try quad-GRAM = it will consider 4 words at a time\n",
    "\n",
    "quadgram=CountVectorizer(ngram_range=(3,3))\n",
    "trigramvocab=quadgram.fit_transform(data['text'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'115712 understand would': 68742,\n",
       " 'understand would like': 14905422,\n",
       " 'would like assist': 15846173,\n",
       " 'like assist would': 9031110,\n",
       " 'assist would need': 3205982,\n",
       " 'would need get': 15850140,\n",
       " 'need get private': 10099577,\n",
       " 'get private secured': 6972843,\n",
       " 'private secured link': 11466877,\n",
       " 'secured link assist': 12592911,\n",
       " 'sprintcare sent several': 13416653,\n",
       " 'sent several private': 12734079,\n",
       " 'several private message': 12856149,\n",
       " 'private message one': 11466419,\n",
       " 'message one responding': 9708639,\n",
       " 'one responding usual': 10572912,\n",
       " '115712 please send': 68740,\n",
       " 'please send private': 11241505,\n",
       " 'send private message': 12706674,\n",
       " 'private message assist': 11466149,\n",
       " 'message assist click': 9699049,\n",
       " 'assist click message': 3197959,\n",
       " 'click message top': 4455941,\n",
       " 'message top profile': 9715079,\n",
       " 'private message gain': 11466281,\n",
       " 'message gain detail': 9704163,\n",
       " 'gain detail account': 6851677,\n",
       " 'sprintcare worst customer': 13418889,\n",
       " 'worst customer service': 15819258,\n",
       " '115713 saddening hear': 68745,\n",
       " 'saddening hear please': 12360572,\n",
       " 'hear please shoot': 7549750,\n",
       " 'please shoot dm': 11242292,\n",
       " 'shoot dm look': 12922203,\n",
       " 'dm look kc': 5608271,\n",
       " 'sprintcare gon na': 13413353,\n",
       " 'gon na magically': 7173138,\n",
       " 'na magically change': 10033094,\n",
       " 'magically change connectivity': 9449290,\n",
       " 'change connectivity whole': 4208043,\n",
       " 'connectivity whole family': 4722960,\n",
       " 'whole family lyingface': 15634296,\n",
       " 'family lyingface hundredpoints': 6361448,\n",
       " '115713 understand concern': 68746,\n",
       " 'understand concern wed': 14895609,\n",
       " 'concern wed like': 4664458,\n",
       " 'wed like please': 15506205,\n",
       " 'like please send': 9064665,\n",
       " 'please send direct': 11241243,\n",
       " 'send direct message': 12697551,\n",
       " 'direct message assist': 5516539,\n",
       " 'message assist aa': 9699008,\n",
       " 'sprintcare since signed': 13416903,\n",
       " 'since signed yousince': 13045470,\n",
       " 'signed yousince day': 13012497,\n",
       " '115713 wed definitely': 68747,\n",
       " 'wed definitely like': 15505257,\n",
       " 'definitely like work': 5217838,\n",
       " 'like work long': 9082916,\n",
       " 'work long experiencing': 15762230,\n",
       " 'long experiencing issue': 9263191,\n",
       " 'experiencing issue aa': 6278633,\n",
       " '115714 all lie': 69806,\n",
       " 'all lie great': 2464683,\n",
       " 'lie great connection': 9008951,\n",
       " 'great connection bar': 7271194,\n",
       " 'connection bar lte': 4714255,\n",
       " 'bar lte still': 3477162,\n",
       " 'lte still won': 9397078,\n",
       " 'still won load': 13560359,\n",
       " 'won load something': 15718283,\n",
       " 'load something smh': 9195694,\n",
       " '115715 please send': 78660,\n",
       " 'private message send': 11466511,\n",
       " 'message send link': 9712532,\n",
       " 'send link access': 12702665,\n",
       " 'link access account': 9110106,\n",
       " 'access account fr': 2149270,\n",
       " '115714 whenever contact': 78085,\n",
       " 'whenever contact customer': 15620366,\n",
       " 'contact customer support': 4747047,\n",
       " 'customer support tell': 5009929,\n",
       " 'support tell shortcode': 13751239,\n",
       " 'tell shortcode enabled': 13990284,\n",
       " 'shortcode enabled account': 12935312,\n",
       " 'enabled account never': 5994995,\n",
       " 'account never year': 2189219,\n",
       " 'never year ive': 10179355,\n",
       " 'year ive tried': 15966487,\n",
       " '115716 information incorrect': 78663,\n",
       " 'information incorrect jk': 8251673,\n",
       " 'askspectrum would like': 3181917,\n",
       " 'would like email': 15846443,\n",
       " 'like email copy': 9041208,\n",
       " 'email copy one': 5943636,\n",
       " 'copy one since': 4809519,\n",
       " 'one since spectrum': 10576233,\n",
       " 'since spectrum updating': 13045681,\n",
       " 'spectrum updating training': 13347469,\n",
       " '115716 department part': 78662,\n",
       " 'department part corporate': 5370997,\n",
       " 'part corporate office': 10851594,\n",
       " 'corporate office youre': 4814979,\n",
       " 'office youre particular': 10471059,\n",
       " 'youre particular area': 16058544,\n",
       " 'particular area gone': 10858229,\n",
       " 'area gone format': 3035549,\n",
       " 'gone format unawa': 7175909,\n",
       " 'askspectrum received corporate': 3177709,\n",
       " 'received corporate office': 11865979,\n",
       " 'corporate office would': 4814977,\n",
       " 'office would like': 10471012,\n",
       " 'would like copy': 15846354,\n",
       " '115716 thank jk': 78665,\n",
       " 'askspectrum correct way': 3170627,\n",
       " 'correct way via': 4821214,\n",
       " 'way via ocs': 15476108,\n",
       " 'via ocs account': 15215541,\n",
       " 'ocs account takeover': 10437541,\n",
       " 'account takeover email': 2201235,\n",
       " 'takeover email consent': 13896191,\n",
       " 'email consent form': 5943343,\n",
       " 'consent form need': 4725349,\n",
       " 'form need done': 6700524,\n",
       " 'need done local': 10095044,\n",
       " 'done local office': 5682940,\n",
       " 'askspectrum incorrect information': 3173714,\n",
       " 'incorrect information form': 8205211,\n",
       " 'information form front': 8249980,\n",
       " 'form front faxed': 6699559,\n",
       " 'front faxed overmaybe': 6784150,\n",
       " 'faxed overmaybe need': 6402058,\n",
       " 'overmaybe need maintain': 10757079,\n",
       " 'need maintain date': 10108116,\n",
       " 'maintain date information': 9461615,\n",
       " '115716 information pertaining': 78664,\n",
       " 'information pertaining account': 8254939,\n",
       " 'pertaining account assumption': 11028559,\n",
       " 'account assumption correct': 2170099,\n",
       " 'assumption correct need': 3217948,\n",
       " 'correct need done': 4818843,\n",
       " 'done local outlet': 5682941,\n",
       " 'local outlet wit': 9204144,\n",
       " 'actually thats broken': 2244220,\n",
       " 'thats broken link': 14158775,\n",
       " 'broken link sent': 3812028,\n",
       " 'link sent incorrect': 9122953,\n",
       " 'sent incorrect information': 12728549,\n",
       " '115717 hello apology': 78668,\n",
       " 'hello apology frustration': 7584613,\n",
       " 'apology frustration inconvenience': 2886066,\n",
       " 'frustration inconvenience happy': 6798628,\n",
       " 'inconvenience happy look': 8199286,\n",
       " 'happy look mg': 7467892,\n",
       " 'yo askspectrum customer': 16029693,\n",
       " 'askspectrum customer service': 3170802,\n",
       " 'customer service rep': 5006210,\n",
       " 'service rep super': 12812485,\n",
       " 'rep super nice': 12037415,\n",
       " 'super nice imma': 13724796,\n",
       " 'nice imma start': 10241935,\n",
       " 'imma start trippin': 8158692,\n",
       " 'start trippin all': 13460417,\n",
       " 'trippin all don': 14653159,\n",
       " 'all don get': 2463091,\n",
       " 'don get service': 5663087,\n",
       " 'get service going': 6983782,\n",
       " '115718 apologize inconvenience': 78672,\n",
       " 'apologize inconvenience glad': 2876875,\n",
       " 'inconvenience glad assist': 8199157,\n",
       " 'glad assist dm': 7074592,\n",
       " 'assist dm name': 3198795,\n",
       " 'dm name acct': 5609530,\n",
       " 'name acct phone': 10042969,\n",
       " 'acct phone jb': 2210316,\n",
       " 'picture askspectrum pretty': 11113392,\n",
       " 'askspectrum pretty much': 3177312,\n",
       " 'pretty much every': 11416996,\n",
       " 'much every day': 9979883,\n",
       " 'every day pay': 6179701,\n",
       " 'day pay 171': 5123719,\n",
       " 'pay 171 per': 10915927,\n",
       " '171 per month': 612780,\n",
       " '115719 help arrived': 78683,\n",
       " 'help arrived sorry': 7612522,\n",
       " 'arrived sorry see': 3082389,\n",
       " 'sorry see trouble': 13261074,\n",
       " 'see trouble help': 12636034,\n",
       " 'trouble help hsb': 14660240,\n",
       " 'verizonsupport finally got': 15186439,\n",
       " 'finally got someone': 6481039,\n",
       " 'got someone helped': 7246076,\n",
       " 'someone helped thanks': 13169850,\n",
       " '115719 awesome ever': 78682,\n",
       " 'awesome ever need': 3344868,\n",
       " 'ever need tweet': 6171718,\n",
       " 'need tweet away': 10125476,\n",
       " 'tweet away hsb': 14760302,\n",
       " 'somebody verizonsupport please': 13161130,\n",
       " 'verizonsupport please help': 15190296,\n",
       " 'please help meeeeee': 11226407,\n",
       " 'help meeeeee wearyfacewearyfacewearyfacewearyface': 7638459,\n",
       " 'meeeeee wearyfacewearyfacewearyfacewearyface im': 9660780,\n",
       " 'wearyfacewearyfacewearyfacewearyface im worst': 15484702,\n",
       " 'im worst luck': 8152474,\n",
       " 'worst luck customer': 15821176,\n",
       " 'luck customer service': 9398742,\n",
       " '115720 friend message': 78686,\n",
       " 'friend message acm': 6775787,\n",
       " 'verizonsupport friend without': 15186699,\n",
       " 'friend without internet': 6779166,\n",
       " 'without internet need': 15698839,\n",
       " 'internet need play': 8331572,\n",
       " 'need play videogames': 10112453,\n",
       " 'play videogames together': 11189409,\n",
       " 'videogames together please': 15229850,\n",
       " 'together please skill': 14458390,\n",
       " 'please skill diminish': 11242572,\n",
       " 'skill diminish every': 13087538,\n",
       " 'diminish every moment': 5509887,\n",
       " 'every moment without': 6182745,\n",
       " 'moment without internetz': 9873984,\n",
       " '115721 please follow': 78689,\n",
       " 'please follow dm': 11222933,\n",
       " 'follow dm look': 6660103,\n",
       " 'dm look order': 5608345,\n",
       " 'look order hsb': 9299922,\n",
       " 'verizonsupport else provide': 15186159,\n",
       " 'else provide refuse': 5930103,\n",
       " 'provide refuse help': 11576606,\n",
       " 'refuse help can': 11961190,\n",
       " 'help can not': 7615409,\n",
       " 'can not validate': 3983514,\n",
       " 'not validate account': 10315273,\n",
       " '115721 would able': 78692,\n",
       " 'would able verify': 15829029,\n",
       " 'able verify anything': 2127554,\n",
       " 'verify anything without': 15177549,\n",
       " 'anything without authenticating': 2860354,\n",
       " 'without authenticating account': 15694237,\n",
       " 'authenticating account jay': 3283709,\n",
       " 'verizonsupport phone number': 15190195,\n",
       " 'phone number email': 11067987,\n",
       " 'number email thats': 10378392,\n",
       " 'email thats get': 5964713,\n",
       " 'thats get equipment': 14162675,\n",
       " 'get equipment service': 6941188,\n",
       " 'equipment service im': 6064474,\n",
       " 'service im literally': 12792910,\n",
       " 'im literally trying': 8130184,\n",
       " 'literally trying pay': 9151142,\n",
       " 'trying pay nobody': 14712383,\n",
       " 'pay nobody find': 10926999,\n",
       " '115721 use order': 78691,\n",
       " 'use order number': 15068523,\n",
       " 'order number locate': 10687895,\n",
       " 'number locate account': 10384060,\n",
       " 'locate account need': 9207202,\n",
       " 'account need secure': 2188976,\n",
       " 'need secure one': 10118228,\n",
       " 'secure one one': 12592435,\n",
       " 'one one chat': 10565699,\n",
       " 'one chat please': 10542773,\n",
       " 'chat please follow': 4286345,\n",
       " 'follow dm hsb': 6660063,\n",
       " '115722 md sent': 80244,\n",
       " 'md sent wrong': 9631638,\n",
       " 'sent wrong address': 12736722,\n",
       " '115721 hello duke': 78688,\n",
       " 'hello duke copy': 7589164,\n",
       " 'duke copy bill': 5828340,\n",
       " 'copy bill state': 4808377,\n",
       " 'bill state service': 3606840,\n",
       " 'state service located': 13472996,\n",
       " 'service located nhp': 12798402,\n",
       " '115722 nobody find': 80373,\n",
       " 'nobody find account': 10275933,\n",
       " 'find account number': 6484847,\n",
       " 'account number walked': 2190302,\n",
       " 'number walked store': 10396876,\n",
       " 'walked store ive': 15353886,\n",
       " 'store ive explained': 13609029,\n",
       " 'ive explained find': 8548646,\n",
       " 'explained find acct': 6290722,\n",
       " 'find acct via': 6484889,\n",
       " 'acct via device': 2210993,\n",
       " 'via device serial': 15210351,\n",
       " '115721 referring wireless': 78690,\n",
       " 'referring wireless residential': 11936162,\n",
       " 'wireless residential service': 15680441,\n",
       " 'residential service jay': 12126707,\n",
       " '115722 tried pay': 81164,\n",
       " 'tried pay bill': 14634202,\n",
       " 'pay bill 60': 10919563,\n",
       " 'bill 60 day': 3600818,\n",
       " '60 day service': 1681466,\n",
       " 'day service rude': 5129835,\n",
       " 'service rude several': 12814529,\n",
       " 'rude several transfer': 12321544,\n",
       " 'several transfer look': 12857225,\n",
       " 'transfer look equipment': 14586587,\n",
       " 'look equipment give': 9288105,\n",
       " 'equipment give acct': 6063931,\n",
       " '115723 light top': 81648,\n",
       " 'light top red': 9023000,\n",
       " 'top red jay': 14512515,\n",
       " 'verizonsupport don know': 15185913,\n",
       " 'don know router': 5664873,\n",
       " 'know router downstairs': 8778421,\n",
       " 'router downstairs it': 12308628,\n",
       " 'downstairs it wifi': 5749337,\n",
       " 'it wifi nothing': 8513646,\n",
       " 'wifi nothing connected': 15653178,\n",
       " 'nothing connected ethernet': 10325196,\n",
       " '115723 light change': 81647,\n",
       " 'light change router': 9021043,\n",
       " 'change router happened': 4219158,\n",
       " 'router happened jay': 12308936,\n",
       " 'verizonsupport randomly boot': 15190613,\n",
       " 'randomly boot offline': 11731962,\n",
       " 'boot offline go': 3712001,\n",
       " '115723 fios service': 81645,\n",
       " 'fios service service': 6519575,\n",
       " 'service service go': 12816563,\n",
       " 'service go internet': 12788783,\n",
       " 'go internet light': 7117219,\n",
       " 'internet light router': 8330813,\n",
       " 'light router change': 9022546,\n",
       " 'router change color': 12308321,\n",
       " 'change color bcw': 4207823,\n",
       " '115723 service cutting': 81650,\n",
       " 'service cutting acm': 12778044,\n",
       " 'verizonsupport cut every': 15185591,\n",
       " 'cut every 20': 5017074,\n",
       " 'every 20 minute': 6177325,\n",
       " '20 minute ridiculous': 719167,\n",
       " '115723 make feel': 81649,\n",
       " 'make feel way': 9478226,\n",
       " 'feel way fix': 6443532,\n",
       " 'way fix thing': 15458746,\n",
       " 'fix thing kmg': 6559831,\n",
       " '115722 worst isp': 81529,\n",
       " 'worst isp ve': 15820915,\n",
       " 'isp ve ever': 8426763,\n",
       " '115724 area located': 81651,\n",
       " 'area located service': 3036750,\n",
       " 'located service time': 9209921,\n",
       " 'service time hsb': 12824730,\n",
       " 'verizonsupport 115725 115726': 15182933,\n",
       " '115725 115726 gtall': 81799,\n",
       " '115726 gtall verizon': 85278,\n",
       " 'gtall verizon downlt': 7318085,\n",
       " 'verizon downlt expect': 15180580,\n",
       " 'downlt expect fix': 5749052,\n",
       " '115727 app referring': 85288,\n",
       " 'app referring acm': 2915021,\n",
       " '115725 fix app': 82963,\n",
       " 'fix app wont': 6546044,\n",
       " 'app wont even': 2926608,\n",
       " 'wont even open': 15731479,\n",
       " '115728 still think': 85290,\n",
       " 'still think look': 13555154,\n",
       " 'think look great': 14226459,\n",
       " 'look great becky': 9290885,\n",
       " 'chipotletweets chipotletweets becky': 4370399,\n",
       " 'chipotletweets becky nice': 4369322,\n",
       " 'chipotletweets 28 dont': 4367700,\n",
       " '28 dont fit': 956238,\n",
       " 'dont fit veggie': 5699497,\n",
       " 'fit veggie burrito': 6543153,\n",
       " 'veggie burrito costume': 15167977,\n",
       " 'burrito costume halloween': 3853001,\n",
       " '115729 im sorry': 85291,\n",
       " 'im sorry please': 8142181,\n",
       " 'sorry please tell': 13256665,\n",
       " 'please tell help': 11245682,\n",
       " 'tell help becky': 13984006,\n",
       " 'chipotletweets messed today': 4375678,\n",
       " 'messed today didn': 9720626,\n",
       " 'today didn give': 14428249,\n",
       " 'didn give burrito': 5463113,\n",
       " 'give burrito although': 7046405,\n",
       " 'burrito although dressed': 3852388,\n",
       " 'although dressed loudlycryingface': 2548703,\n",
       " '115730 hopefully well': 85292,\n",
       " 'hopefully well get': 7928656,\n",
       " 'well get point': 15557445,\n",
       " 'get point becky': 6971669,\n",
       " 'hey chipotletweets wan': 7698019,\n",
       " 'chipotletweets wan na': 4380576,\n",
       " 'wan na come': 15360430,\n",
       " 'na come mammoth': 10029468,\n",
       " 'come mammoth ill': 4563583,\n",
       " 'mammoth ill least': 9509509,\n",
       " 'ill least eat': 8102762,\n",
       " 'least eat week': 8927778,\n",
       " 'eat week promise': 5870492,\n",
       " '115731 guac im': 85293,\n",
       " 'guac im happy': 7320020,\n",
       " 'im happy great': 8126335,\n",
       " 'happy great experience': 7463473,\n",
       " 'great experience becky': 7273805,\n",
       " 'chipotletweets excellent service': 4371899,\n",
       " 'excellent service tonight': 6221489,\n",
       " 'service tonight plenty': 12825993,\n",
       " 'tonight plenty people': 14497554,\n",
       " 'plenty people line': 11254618,\n",
       " 'people line went': 10983856,\n",
       " 'line went fast': 9107992,\n",
       " 'went fast everyone': 15581580,\n",
       " 'fast everyone kind': 6385369,\n",
       " '115731 youre smart': 85294,\n",
       " 'youre smart tara': 16062369,\n",
       " 'youre one costume': 16058256,\n",
       " 'one costume boorito': 10545200,\n",
       " 'costume boorito chipotletweets': 4834074,\n",
       " '115732 thats incredibly': 85295,\n",
       " 'thats incredibly concerning': 14164790,\n",
       " 'incredibly concerning please': 8209893,\n",
       " 'concerning please tell': 4667396,\n",
       " 'please tell becky': 11245354,\n",
       " 'chipotletweets diet coke': 4371219,\n",
       " 'diet coke literal': 5487303,\n",
       " 'coke literal bone': 4514633,\n",
       " 'literal bone boorito': 9146209,\n",
       " 'bone boorito extra': 3680005,\n",
       " 'boorito extra spooky': 3709851,\n",
       " '115733 nope still': 85296,\n",
       " 'nope still becky': 10294877,\n",
       " 'chipotletweets get queso': 4372658,\n",
       " 'get queso quac': 6973930,\n",
       " 'queso quac youre': 11678995,\n",
       " 'quac youre bowl': 11652141,\n",
       " 'youre bowl extra': 16048447,\n",
       " 'stop costume 1031': 13578588,\n",
       " 'costume 1031 3pmclose': 4834010,\n",
       " '1031 3pmclose official': 37675,\n",
       " '3pmclose official rule': 1265867,\n",
       " '115734 mean boorito': 85297,\n",
       " 'mean boorito basically': 9638344,\n",
       " 'boorito basically adult': 3709811,\n",
       " 'basically adult version': 3489494,\n",
       " 'adult version halloween': 2305419,\n",
       " 'version halloween becky': 15199575,\n",
       " 'happy halloween since': 7463687,\n",
       " 'halloween since im': 7410328,\n",
       " 'since im old': 13038651,\n",
       " 'im old trick': 8133484,\n",
       " 'old trick treat': 10522628,\n",
       " 'trick treat look': 14623542,\n",
       " 'treat look forward': 14615699,\n",
       " 'look forward booritos': 9289299,\n",
       " 'forward booritos chipotletweets': 6708702,\n",
       " 'booritos chipotletweets ghost': 3709960,\n",
       " 'chipotletweets ghost got': 4372719,\n",
       " 'ghost got mine': 7031864,\n",
       " 'got mine earlier': 7235406,\n",
       " '115735 im glad': 85298,\n",
       " 'im glad could': 8124333,\n",
       " 'glad could help': 7075605,\n",
       " 'could help work': 4846548,\n",
       " 'help work id': 7663964,\n",
       " 'work id like': 15759549,\n",
       " 'id like share': 8054877,\n",
       " 'like share praise': 9071889,\n",
       " 'share praise becky': 12874471,\n",
       " 'chipotletweets thank chipotletweets': 4379292,\n",
       " 'thank chipotletweets resolving': 14069416,\n",
       " 'chipotletweets resolving issue': 4377829,\n",
       " 'resolving issue quickly': 12141143,\n",
       " 'issue quickly all': 8461019,\n",
       " 'quickly all best': 11700213,\n",
       " 'all best smilingface': 2462276,\n",
       " 'best smilingface fanforlife': 3564067,\n",
       " 'frustrated chipotletweets enragedface': 6789978,\n",
       " 'chipotletweets enragedface ordered': 4371778,\n",
       " 'enragedface ordered dinner': 6035513,\n",
       " 'ordered dinner saturday': 10708299,\n",
       " 'dinner saturday using': 5512026,\n",
       " 'saturday using app': 12446930,\n",
       " 'using app order': 15101365,\n",
       " 'app order wrong': 2912673,\n",
       " 'order wrong charged': 10704123,\n",
       " 'wrong charged credit': 15884023,\n",
       " 'charged credit card': 4259153,\n",
       " 'credit card twice': 4925040,\n",
       " '115736 location participating': 85300,\n",
       " 'location participating becky': 9215583,\n",
       " 'way chipotletweets giving': 15454383,\n",
       " 'chipotletweets giving burrito': 4372777,\n",
       " 'giving burrito dress': 7069405,\n",
       " 'burrito dress halloween': 3853106,\n",
       " 'dress halloween jackolantern': 5757294,\n",
       " 'halloween jackolantern call': 7409892,\n",
       " 'jackolantern call chipotle': 8567369,\n",
       " 'call chipotle make': 3922851,\n",
       " 'chipotle make sure': 4366240,\n",
       " 'make sure they': 9493085,\n",
       " 'sure they re': 13785471,\n",
       " 'they re select': 14190094,\n",
       " 're select one': 11760050,\n",
       " '115737 apology sent': 85303,\n",
       " 'apology sent dm': 2891723,\n",
       " 'sent dm help': 12725476,\n",
       " 'dm help becky': 5603695,\n",
       " 'chipotletweets tried didnt': 4380059,\n",
       " 'tried didnt work': 14628638,\n",
       " 'didnt work rude': 5481174,\n",
       " '115737 give try': 85304,\n",
       " 'give try tara': 7060615,\n",
       " 'chipotletweets dress still': 4371572,\n",
       " 'dress still qualify': 5757469,\n",
       " 'still qualify boorito': 13545570,\n",
       " '115738 thats best': 85307,\n",
       " 'thats best kind': 14158457,\n",
       " 'best kind trickortreating': 3559753,\n",
       " 'kind trickortreating treat': 8721492,\n",
       " 'trickortreating treat friend': 14623814,\n",
       " 'treat friend becky': 14615312,\n",
       " 'every year trickortreating': 6189596,\n",
       " 'year trickortreating routine': 15973619,\n",
       " 'trickortreating routine walking': 14623812,\n",
       " 'routine walking chipotle': 12311125,\n",
       " 'walking chipotle spending': 15354321,\n",
       " 'chipotle spending dollar': 4366834,\n",
       " 'spending dollar walking': 13360374,\n",
       " 'dollar walking back': 5655291,\n",
       " 'walking back home': 15354269,\n",
       " 'back home chipotletweets': 3390386,\n",
       " '115739 thats incredibly': 85309,\n",
       " 'concerning please provide': 4667387,\n",
       " 'please provide detail': 11235096,\n",
       " 'provide detail investigate': 11571541,\n",
       " 'detail investigate becky': 5415369,\n",
       " 'chipotletweets nasty used': 4375915,\n",
       " 'nasty used napkin': 10057543,\n",
       " 'used napkin someone': 15084328,\n",
       " 'napkin someone food': 10055688,\n",
       " '115740 bummer im': 85314,\n",
       " 'bummer im sorry': 3844990,\n",
       " 'im sorry far': 8141218,\n",
       " 'sorry far away': 13236577,\n",
       " 'far away closest': 6371360,\n",
       " 'away closest location': 3336889,\n",
       " 'closest location becky': 4475344,\n",
       " 'burrito nowhere near': 3853642,\n",
       " 'nowhere near chipotletweets': 10360170,\n",
       " 'near chipotletweets manfacepalmingmediumdarkskintone': 10073442,\n",
       " '115741 noted smilingfacewithsmilingeyes': 85316,\n",
       " 'noted smilingfacewithsmilingeyes becky': 10322099,\n",
       " 'chipotletweets also got': 4368703,\n",
       " 'also got onesie': 2527171,\n",
       " 'got onesie target': 7238039,\n",
       " 'onesie target cozy': 10590221,\n",
       " 'chipotletweets thanks becky': 4379407,\n",
       " 'thanks becky feeling': 14100795,\n",
       " 'becky feeling sorry': 3519618,\n",
       " 'feeling sorry fiancé': 6446236,\n",
       " 'sorry fiancé driving': 13236801,\n",
       " 'fiancé driving dc': 6454112,\n",
       " 'driving dc mississippi': 5790287,\n",
       " 'dc mississippi tonight': 5143760,\n",
       " '115741 wont alone': 85319,\n",
       " 'wont alone well': 15729399,\n",
       " 'alone well also': 2488839,\n",
       " 'well also want': 15548074,\n",
       " 'also want llama': 2543260,\n",
       " 'want llama onesie': 15381350,\n",
       " 'llama onesie becky': 9184720,\n",
       " 'considering walking chipotletweets': 4730151,\n",
       " 'walking chipotletweets llama': 15354328,\n",
       " 'chipotletweets llama onesie': 4375004,\n",
       " 'llama onesie alone': 9184719,\n",
       " 'onesie alone happy': 10590193,\n",
       " 'alone happy halloween': 2488190,\n",
       " 'happy halloween loudlycryingface': 7463661,\n",
       " '115742 love thanks': 85321,\n",
       " 'love thanks much': 9379202,\n",
       " 'thanks much stopping': 14124702,\n",
       " 'much stopping becky': 9989778,\n",
       " 'chipotletweets name better': 4375909,\n",
       " 'name better halloween': 10044242,\n",
       " 'better halloween duo': 3576383,\n",
       " 'halloween duo speedwaybrick': 7409633,\n",
       " 'duo speedwaybrick uttranscript': 5832940,\n",
       " '115743 info share': 85323,\n",
       " 'info share moment': 8238042,\n",
       " 'share moment feel': 12873607,\n",
       " 'moment feel free': 9870686,\n",
       " 'feel free keep': 6438797,\n",
       " 'free keep eye': 6745090,\n",
       " 'keep eye blog': 8669857,\n",
       " 'eye blog news': 6313524,\n",
       " 'blog news update': 3648031,\n",
       " 'askplaystation 115743 get': 3151242,\n",
       " '115743 get help': 85322,\n",
       " 'get help already': 6949969,\n",
       " 'askplaystation whats november': 3163079,\n",
       " 'whats november plus': 15614198,\n",
       " 'november plus free': 10357872,\n",
       " 'plus free game': 11267048,\n",
       " '115745 glad know': 85324,\n",
       " 'glad know downloading': 7079906,\n",
       " 'know downloading please': 8753791,\n",
       " 'downloading please feel': 5748058,\n",
       " 'please feel free': 11221275,\n",
       " 'feel free contact': 6438721,\n",
       " 'free contact concern': 6741615,\n",
       " 'askplaystation would go': 3163308,\n",
       " 'would go download': 15841284,\n",
       " 'go download waited': 7112473,\n",
       " 'download waited hour': 5744753,\n",
       " 'waited hour till': 15333652,\n",
       " 'hour till bought': 7971565,\n",
       " 'till bought downloaded': 14308155,\n",
       " '115745 sorry inconvenience': 85325,\n",
       " 'sorry inconvenience see': 13246500,\n",
       " 'inconvenience see data': 8201453,\n",
       " 'see data corrupted': 12606993,\n",
       " 'data corrupted message': 5064442,\n",
       " 'corrupted message try': 4826630,\n",
       " 'message try open': 9715321,\n",
       " 'try open game': 14691190,\n",
       " 'open game download': 10620379,\n",
       " 'askplaystation bought lego': 3153356,\n",
       " 'bought lego star': 3728639,\n",
       " 'lego star war': 8960033,\n",
       " 'star war playstation': 13450373,\n",
       " 'war playstation store': 15406859,\n",
       " 'playstation store wont': 11203571,\n",
       " 'store wont let': 13627528,\n",
       " 'wont let download': 15733566,\n",
       " 'let download data': 8970287,\n",
       " 'download data corrupted': 5740871,\n",
       " '115746 glad help': 85327,\n",
       " 'glad help please': 7079238,\n",
       " 'help please share': 7644397,\n",
       " 'please share detail': 11241960,\n",
       " 'share detail issue': 12870324,\n",
       " 'detail issue community': 5415581,\n",
       " 'issue community forum': 8436588,\n",
       " 'community forum investigation': 4596023,\n",
       " 'askplaystation block community': 3153260,\n",
       " 'block community sending': 3643687,\n",
       " 'community sending invite': 4596584,\n",
       " 'sending invite something': 12714097,\n",
       " 'invite something dont': 8352074,\n",
       " 'something dont want': 13181327,\n",
       " 'dont want join': 5720657,\n",
       " '115747 glad fun': 85328,\n",
       " 'glad fun sarah': 7077010,\n",
       " 'fun sarah heard': 6834028,\n",
       " 'sarah heard count': 12438317,\n",
       " 'heard count collin': 7561089,\n",
       " 'count collin really': 4866180,\n",
       " 'collin really suck': 4530341,\n",
       " 'really suck life': 11824798,\n",
       " 'suck life party': 13695723,\n",
       " 'count colin yellowheart': 4866175,\n",
       " 'colin yellowheart marksandspencer': 4518161,\n",
       " 'yellowheart marksandspencer xx': 15977554,\n",
       " '115748 weve let': 85329,\n",
       " 'weve let team': 15596163,\n",
       " 'let team know': 8984696,\n",
       " 'team know better': 13950152,\n",
       " 'know better joel': 8746653,\n",
       " 'better joel thanks': 3577162,\n",
       " 'joel thanks sharing': 8615996,\n",
       " 'ere marksandspencer never': 6066709,\n",
       " 'marksandspencer never mind': 9569636,\n",
       " 'never mind avocado': 10170164,\n",
       " 'mind avocado avocado': 9784252,\n",
       " 'avocado avocado how': 3323847,\n",
       " 'avocado how ave': 3323968,\n",
       " 'how ave word': 7981610,\n",
       " 'ave word really': 3319610,\n",
       " 'word really necessary': 15744062,\n",
       " 'really necessary pair': 11818926,\n",
       " 'necessary pair em': 10080538,\n",
       " 'pair em suffocating': 10822435,\n",
       " '115749 obligated provide': 85331,\n",
       " 'obligated provide bag': 10428043,\n",
       " 'provide bag unpackaged': 11570051,\n",
       " 'bag unpackaged meat': 3446028,\n",
       " 'unpackaged meat prepackaged': 14939474,\n",
       " 'meat prepackaged charge': 9653716,\n",
       " 'prepackaged charge applied': 11403358,\n",
       " 'marksandspencer raw meat': 9570712,\n",
       " 'raw meat it': 11748771,\n",
       " 'meat it say': 9653483,\n",
       " 'it say unwrapped': 8507116,\n",
       " 'say unwrapped raw': 12489209,\n",
       " 'unwrapped raw meat': 14951979,\n",
       " 'raw meat sainsbury': 11748776,\n",
       " 'meat sainsbury don': 9653801,\n",
       " 'sainsbury don charge': 12398016,\n",
       " 'don charge waitrose': 5660433,\n",
       " '115749 packaging sufficient': 85332,\n",
       " 'packaging sufficient extra': 10792620,\n",
       " 'sufficient extra wrapping': 13703221,\n",
       " 'extra wrapping bag': 6310407,\n",
       " 'wrapping bag require': 15877091,\n",
       " 'bag require extra': 3443664,\n",
       " 'require extra 5p': 12101438,\n",
       " 'extra 5p charge': 6303558,\n",
       " '5p charge per': 1678938,\n",
       " 'charge per legislation': 4250793,\n",
       " 'per legislation thanks': 10997019,\n",
       " 'marksandspencer check gov': 9565744,\n",
       " 'check gov office': 4308632,\n",
       " 'gov office legal': 7257517,\n",
       " 'office legal stated': 10468643,\n",
       " 'legal stated right': 8957770,\n",
       " 'stated right it': 13474696,\n",
       " 'right it funny': 12258645,\n",
       " 'it funny store': 8495051,\n",
       " 'funny store don': 6841836,\n",
       " 'store don wonder': 13603551,\n",
       " 'don wonder lidl': 5673420,\n",
       " 'wonder lidl rest': 15722058,\n",
       " 'lidl rest beating': 9008015,\n",
       " 'marksandspencer ou must': 9570125,\n",
       " 'ou must charge': 10734615,\n",
       " 'must charge least': 10014519,\n",
       " 'charge least 5p': 4249173,\n",
       " 'least 5p bag': 8926510,\n",
       " '5p bag including': 1678905,\n",
       " 'bag including vat': 3440577,\n",
       " 'including vat carrier': 8193007,\n",
       " 'vat carrier bag': 15144977,\n",
       " 'carrier bag following': 4110679,\n",
       " 'bag following unused': 3439361,\n",
       " 'following unused it': 6672106,\n",
       " 'unused it new': 14950160,\n",
       " 'it new hasn': 8502226,\n",
       " 'new hasn already': 10192982,\n",
       " 'hasn already used': 7487240,\n",
       " 'already used sold': 2514358,\n",
       " 'used sold good': 15087045,\n",
       " 'sold good taken': 13147050,\n",
       " 'good taken away': 7202021,\n",
       " 'taken away delivered': 13890825,\n",
       " 'away delivered plastic': 3337251,\n",
       " 'delivered plastic 70': 5282881,\n",
       " 'plastic 70 micron': 11174040,\n",
       " '70 micron thick': 1852503,\n",
       " 'micron thick le': 9739234,\n",
       " 'thick le handle': 14199351,\n",
       " 'le handle opening': 8909812,\n",
       " 'handle opening isn': 7419551,\n",
       " 'opening isn sealed': 10630547,\n",
       " 'marksandspencer aren require': 9564970,\n",
       " 'aren require charge': 3042286,\n",
       " 'require charge bag': 12101226,\n",
       " 'charge bag paper': 4244551,\n",
       " 'bag paper bag': 3442724,\n",
       " 'paper bag shop': 10830173,\n",
       " 'bag shop airport': 3444254,\n",
       " 'shop airport board': 12923325,\n",
       " 'airport board train': 2406202,\n",
       " 'board train aeroplane': 3663683,\n",
       " 'train aeroplane ship': 14554570,\n",
       " 'aeroplane ship bag': 2324716,\n",
       " 'ship bag contain': 12893986,\n",
       " 'bag contain certain': 3437507,\n",
       " 'contain certain item': 4769468,\n",
       " 'certain item unwrapped': 4186290,\n",
       " 'item unwrapped food': 8534544,\n",
       " 'unwrapped food raw': 14951966,\n",
       " 'food raw meat': 6680246,\n",
       " 'raw meat fish': 11748770,\n",
       " 'meat fish food': 9653258,\n",
       " 'fish food safety': 6541062,\n",
       " 'food safety risk': 6680557,\n",
       " 'safety risk prescription': 12379357,\n",
       " 'risk prescription medicine': 12274397,\n",
       " 'prescription medicine uncovered': 11406711,\n",
       " 'medicine uncovered blade': 9657229,\n",
       " 'uncovered blade seed': 14889271,\n",
       " 'blade seed bulb': 3636386,\n",
       " 'seed bulb amp': 12640046,\n",
       " 'bulb amp tulip': 3841824,\n",
       " 'marksandspencer charge meat': 9565736,\n",
       " 'charge meat bag': 4249658,\n",
       " 'meat bag collier': 9652940,\n",
       " 'bag collier wood': 3437384,\n",
       " 'collier wood branch': 4530303,\n",
       " 'wood branch buy': 15739095,\n",
       " 'branch buy meat': 3754057,\n",
       " 'buy meat required': 3880689,\n",
       " 'meat required supply': 9653781,\n",
       " 'required supply customer': 12104094,\n",
       " 'supply customer free': 13732919,\n",
       " 'customer free bag': 4991849,\n",
       " 'free bag poor': 6739855,\n",
       " 'bag poor service': 3443153,\n",
       " '115750 love aesthetic': 85334,\n",
       " 'love aesthetic colin': 9361523,\n",
       " 'aesthetic colin creeperpillar': 2324818,\n",
       " 'colin creeperpillar someday': 4517878,\n",
       " 'creeperpillar someday bugbutterflyghost': 4932606,\n",
       " 'excellent halloweening marksandspencer': 6220775,\n",
       " 'halloweening marksandspencer okhandmediumlightskintone': 7410742,\n",
       " 'marksandspencer okhandmediumlightskintone countcolin': 9569918,\n",
       " 'okhandmediumlightskintone countcolin halloween': 10513549,\n",
       " 'countcolin halloween food': 4867308,\n",
       " '115751 hello josh': 85337,\n",
       " 'hello josh get': 7593902,\n",
       " 'josh get better': 8630502,\n",
       " 'get better assistance': 6924219,\n",
       " 'better assistance support': 3572767,\n",
       " 'assistance support suggest': 3211464,\n",
       " 'support suggest post': 13749688,\n",
       " 'suggest post tweet': 13706114,\n",
       " 'post tweet dm': 11353091,\n",
       " 'tweet dm friend': 14761647,\n",
       " 'dm friend xboxsupport': 5601931,\n",
       " 'microsofthelps xboxsupport brilliant': 9748261,\n",
       " 'xboxsupport brilliant thank': 15917535,\n",
       " 'microsofthelps hi trouble': 9743852,\n",
       " 'hi trouble making': 7831557,\n",
       " 'trouble making purchase': 14661714,\n",
       " 'making purchase xbox': 9503036,\n",
       " 'purchase xbox one': 11623902,\n",
       " 'xbox one store': 15910997,\n",
       " 'one store fifa': 10578383,\n",
       " 'store fifa point': 13605077,\n",
       " 'fifa point help': 6457116,\n",
       " '115752 help assist': 85340,\n",
       " 'help assist recovering': 7612836,\n",
       " 'assist recovering account': 3202827,\n",
       " 'recovering account recommend': 11911460,\n",
       " 'account recommend contact': 2194890,\n",
       " 'recommend contact answer': 11899908,\n",
       " 'contact answer desk': 4744439,\n",
       " 'answer desk team': 2824694,\n",
       " 'microsofthelps need assistance': 9744982,\n",
       " 'need assistance recovering': 10086426,\n",
       " 'assistance recovering hotmail': 3210574,\n",
       " 'recovering hotmail account': 11911513,\n",
       " 'hotmail account filled': 7947429,\n",
       " 'account filled recovery': 2179156,\n",
       " 'filled recovery form': 6473100,\n",
       " 'recovery form told': 11911840,\n",
       " 'form told providing': 6702090,\n",
       " 'told providing enough': 14474030,\n",
       " 'providing enough info': 11588981,\n",
       " '115753 appears removed': 85341,\n",
       " 'appears removed thanks': 2938949,\n",
       " 'removed thanks letting': 12024454,\n",
       " 'thanks letting know': 14120376,\n",
       " 'letting know mb': 8992507,\n",
       " 'atviassist 115754 umm': 3254654,\n",
       " '115754 umm someone': 85888,\n",
       " 'umm someone streaming': 14863217,\n",
       " 'someone streaming wwii': 13175263,\n",
       " 'streaming wwii 500': 13644914,\n",
       " 'wwii 500 viewer': 15903187,\n",
       " '115755 problem let': 85925,\n",
       " 'problem let know': 11488185,\n",
       " 'let know come': 8975089,\n",
       " 'know come across': 8749550,\n",
       " 'come across issue': 4555119,\n",
       " 'across issue question': 2218199,\n",
       " 'issue question future': 8460969,\n",
       " 'question future happy': 11683919,\n",
       " 'future happy help': 6845127,\n",
       " 'happy help rk': 7465875,\n",
       " 'atviassist 115755 im': 3254668,\n",
       " '115755 im trying': 85924,\n",
       " 'im trying buy': 8148750,\n",
       " 'trying buy digital': 14702284,\n",
       " 'buy digital deluxe': 3877945,\n",
       " 'digital deluxe edition': 5506996,\n",
       " 'deluxe edition store': 5355787,\n",
       " 'edition store keep': 5887160,\n",
       " 'store keep receiving': 13609210,\n",
       " 'keep receiving error': 8678823,\n",
       " 'receiving error message': 11879462,\n",
       " '115756 hello sorry': 85927,\n",
       " 'hello sorry late': 7602554,\n",
       " 'sorry late response': 13250128,\n",
       " 'late response checking': 8876317,\n",
       " 'response checking still': 12154930,\n",
       " 'checking still need': 4340717,\n",
       " 'still need assistance': 13539916,\n",
       " 'need assistance please': 10086374,\n",
       " 'assistance please let': 3210103,\n",
       " 'please let know': 11230087,\n",
       " 'let know rn': 8976793,\n",
       " '115755 yes pre': 85926,\n",
       " 'yes pre order': 15992468,\n",
       " 'pre order game': 11383038,\n",
       " 'order game console': 10678685,\n",
       " 'game console store': 6857282,\n",
       " 'console store information': 4735063,\n",
       " 'store information please': 13608328,\n",
       " 'information please contact': 8255100,\n",
       " 'please contact console': 11215132,\n",
       " 'contact console store': 4746710,\n",
       " 'console store rk': 4735071,\n",
       " 'atviassist still pre': 3268954,\n",
       " 'still pre oder': 13544441,\n",
       " 'pre oder ww2': 11382850,\n",
       " 'oder ww2 playstation': 10445509,\n",
       " 'ww2 playstation store': 15902273,\n",
       " '115757 good afternoon': 85929,\n",
       " 'good afternoon william': 7180694,\n",
       " 'afternoon william unfortunately': 2337532,\n",
       " 'william unfortunately app': 15659643,\n",
       " 'unfortunately app longer': 14914173,\n",
       " 'app longer supported': 2909922,\n",
       " 'longer supported sincerest': 9277894,\n",
       " 'supported sincerest apology': 13754708,\n",
       " 'sincerest apology jp': 13051682,\n",
       " '115758 atviassist yous': 86000,\n",
       " 'atviassist yous going': 3271351,\n",
       " 'yous going update': 16068656,\n",
       " 'going update cod': 7167125,\n",
       " 'update cod zombie': 14959806,\n",
       " 'cod zombie io': 4496056,\n",
       " 'zombie io io': 16089930,\n",
       " 'io io 11': 8362088,\n",
       " '115759 good afternoon': 86318,\n",
       " 'good afternoon jayden': 7180392,\n",
       " 'afternoon jayden sadly': 2336237,\n",
       " 'jayden sadly dont': 8581686,\n",
       " 'sadly dont information': 12361191,\n",
       " 'dont information sincerest': 5702983,\n",
       " 'information sincerest apology': 8258752,\n",
       " '115758 half gig': 86115,\n",
       " 'half gig update': 7404047,\n",
       " 'gig update world': 7038405,\n",
       " 'update world war': 14985419,\n",
       " '115760 awesome thank': 86319,\n",
       " 'awesome thank much': 3347935,\n",
       " 'thank much support': 14081337,\n",
       " 'much support love': 9989982,\n",
       " 'support love costume': 13744052,\n",
       " 'love costume tv': 9364963,\n",
       " '108162 115761 atviassist': 41739,\n",
       " '115761 atviassist tried': 86328,\n",
       " 'atviassist tried people': 3269714,\n",
       " 'tried people came': 14634313,\n",
       " 'people came back': 10976834,\n",
       " '115762 hey check': 86336,\n",
       " 'hey check link': 7697614,\n",
       " 'check link information': 4312001,\n",
       " 'link information regard': 9117010,\n",
       " 'information regard ko': 8256692,\n",
       " 'atviassist go get': 3264092,\n",
       " 'go get game': 7114858,\n",
       " 'get game friday': 6947194,\n",
       " 'game friday 2xp': 6859944,\n",
       " 'friday 2xp code': 6764641,\n",
       " '2xp code receipt': 1013828,\n",
       " '115762 gamestop give': 86334,\n",
       " 'gamestop give code': 6873918,\n",
       " 'give code pre': 7047637,\n",
       " 'code pre order': 4505300,\n",
       " 'pre order payment': 11383139,\n",
       " 'order payment needed': 10689906,\n",
       " 'payment needed redeem': 10946399,\n",
       " 'needed redeem ko': 10132090,\n",
       " 'atviassist yes beta': 3271134,\n",
       " 'yes beta code': 15981606,\n",
       " '115762 redeemed account': 86338,\n",
       " 'redeemed account even': 11919239,\n",
       " 'account even tho': 2178469,\n",
       " 'even tho say': 6151751,\n",
       " 'tho say beta': 14243218,\n",
       " 'say beta code': 12465684,\n",
       " 'beta code pre': 3569509,\n",
       " 'pre order bonus': 11382933,\n",
       " 'order bonus linked': 10668939,\n",
       " 'bonus linked ko': 3683799,\n",
       " 'atviassist yes code': 3271146,\n",
       " 'atviassist pre ordered': 3267528,\n",
       " 'pre ordered game': 11383390,\n",
       " 'ordered game game': 10709143,\n",
       " 'game game stop': 6860223,\n",
       " '115762 hello apologize': 86335,\n",
       " 'hello apologize delay': 7584475,\n",
       " 'apologize delay clarify': 2874517,\n",
       " 'delay clarify preordered': 5229413,\n",
       " 'clarify preordered game': 4429781,\n",
       " 'preordered game please': 11401644,\n",
       " 'game please sure': 6865304,\n",
       " 'please sure keep': 11244651,\n",
       " 'sure keep updated': 13776619,\n",
       " 'keep updated rn': 8684251,\n",
       " 'atviassist double xp': 3263042,\n",
       " 'pre ordered wwii': 11383517,\n",
       " 'ordered wwii get': 10715935,\n",
       " 'wwii get code': 15903414,\n",
       " '115763 please give': 86341,\n",
       " 'please give gamertag': 11224367,\n",
       " 'give gamertag platform': 7051295,\n",
       " 'gamertag platform youre': 6873376,\n",
       " 'platform youre playing': 11179812,\n",
       " ...}"
      ]
     },
     "execution_count": 48,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "quadgram.vocabulary_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# TF-IDF (Term Frequency-Inverse Document Frequency)\n",
    "# it is used to convert the document matrix into a normalized form"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.feature_extraction.text import TfidfVectorizer\n",
    "tfidf=TfidfVectorizer()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "ename": "MemoryError",
     "evalue": "Unable to allocate 25.3 TiB for an array with shape (2811774, 1236949) and data type float64",
     "output_type": "error",
     "traceback": [
      "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[1;31mMemoryError\u001b[0m                               Traceback (most recent call last)",
      "Cell \u001b[1;32mIn[50], line 1\u001b[0m\n\u001b[1;32m----> 1\u001b[0m tfidf\u001b[38;5;241m.\u001b[39mfit_transform(data[\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mtext\u001b[39m\u001b[38;5;124m'\u001b[39m])\u001b[38;5;241m.\u001b[39mtoarray()\n",
      "File \u001b[1;32mc:\\Users\\harsh\\anaconda3\\Lib\\site-packages\\scipy\\sparse\\_compressed.py:1050\u001b[0m, in \u001b[0;36m_cs_matrix.toarray\u001b[1;34m(self, order, out)\u001b[0m\n\u001b[0;32m   1048\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m out \u001b[38;5;129;01mis\u001b[39;00m \u001b[38;5;28;01mNone\u001b[39;00m \u001b[38;5;129;01mand\u001b[39;00m order \u001b[38;5;129;01mis\u001b[39;00m \u001b[38;5;28;01mNone\u001b[39;00m:\n\u001b[0;32m   1049\u001b[0m     order \u001b[38;5;241m=\u001b[39m \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39m_swap(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mcf\u001b[39m\u001b[38;5;124m'\u001b[39m)[\u001b[38;5;241m0\u001b[39m]\n\u001b[1;32m-> 1050\u001b[0m out \u001b[38;5;241m=\u001b[39m \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39m_process_toarray_args(order, out)\n\u001b[0;32m   1051\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;129;01mnot\u001b[39;00m (out\u001b[38;5;241m.\u001b[39mflags\u001b[38;5;241m.\u001b[39mc_contiguous \u001b[38;5;129;01mor\u001b[39;00m out\u001b[38;5;241m.\u001b[39mflags\u001b[38;5;241m.\u001b[39mf_contiguous):\n\u001b[0;32m   1052\u001b[0m     \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mValueError\u001b[39;00m(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mOutput array must be C or F contiguous\u001b[39m\u001b[38;5;124m'\u001b[39m)\n",
      "File \u001b[1;32mc:\\Users\\harsh\\anaconda3\\Lib\\site-packages\\scipy\\sparse\\_base.py:1267\u001b[0m, in \u001b[0;36m_spbase._process_toarray_args\u001b[1;34m(self, order, out)\u001b[0m\n\u001b[0;32m   1265\u001b[0m     \u001b[38;5;28;01mreturn\u001b[39;00m out\n\u001b[0;32m   1266\u001b[0m \u001b[38;5;28;01melse\u001b[39;00m:\n\u001b[1;32m-> 1267\u001b[0m     \u001b[38;5;28;01mreturn\u001b[39;00m np\u001b[38;5;241m.\u001b[39mzeros(\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mshape, dtype\u001b[38;5;241m=\u001b[39m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mdtype, order\u001b[38;5;241m=\u001b[39morder)\n",
      "\u001b[1;31mMemoryError\u001b[0m: Unable to allocate 25.3 TiB for an array with shape (2811774, 1236949) and data type float64"
     ]
    }
   ],
   "source": [
    "tfidf.fit_transform(data['text']).toarray()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [],
   "source": [
    "# due to memory issue on local machine we are not able to run the code for TF-IDF. Hence we are limiting the Vocabulary Size \n",
    "\n",
    "tfidf = TfidfVectorizer(max_features=500)  # Adjust the number based on available memory\n",
    "tfidf_matrix = tfidf.fit_transform(data['text']).toarray()\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['10', '11', '115714', '115817', '115821', '115850', '115858',\n",
       "       '115873', '115888', '115911', '115913', '116062', '12', '20', '22',\n",
       "       '30', 'able', 'access', 'account', 'actually', 'add', 'address',\n",
       "       'advise', 'agent', 'ago', 'airasiasupport', 'airport', 'aldiuk',\n",
       "       'along', 'already', 'also', 'always', 'amazon', 'amazonhelp',\n",
       "       'americanair', 'amp', 'another', 'answer', 'anyone', 'anything',\n",
       "       'apologize', 'apology', 'app', 'apple', 'applesupport',\n",
       "       'appreciate', 'apps', 'area', 'argoshelpers', 'around', 'ask',\n",
       "       'askpaypal', 'askplaystation', 'askspectrum', 'assist',\n",
       "       'assistance', 'atviassist', 'available', 'away', 'back', 'bad',\n",
       "       'bag', 'bank', 'battery', 'best', 'better', 'bill', 'book',\n",
       "       'booking', 'bought', 'box', 'britishairways', 'business', 'buy',\n",
       "       'call', 'called', 'can', 'cancel', 'cancelled', 'cant', 'car',\n",
       "       'card', 'care', 'case', 'caused', 'chance', 'change', 'charge',\n",
       "       'charged', 'chat', 'check', 'checked', 'chipotletweets', 'claim',\n",
       "       'click', 'closer', 'code', 'comcastcares', 'come', 'company',\n",
       "       'complaint', 'concern', 'confirm', 'confirmation', 'connect',\n",
       "       'connection', 'contact', 'continue', 'could', 'credit',\n",
       "       'currently', 'customer', 'data', 'date', 'day', 'de', 'deal',\n",
       "       'definitely', 'delay', 'delayed', 'deliver', 'delivered',\n",
       "       'delivery', 'delta', 'detail', 'device', 'didn', 'didnt',\n",
       "       'different', 'direct', 'directly', 'disappointed', 'dm', 'doesn',\n",
       "       'doesnt', 'don', 'done', 'dont', 'driver', 'due', 'earlier', 'el',\n",
       "       'else', 'email', 'en', 'end', 'enjoy', 'error', 'even', 'ever',\n",
       "       'every', 'everything', 'experience', 'experiencing', 'extra',\n",
       "       'family', 'fee', 'feedback', 'feel', 'find', 'fine', 'first',\n",
       "       'fix', 'fixed', 'flight', 'flying', 'follow', 'following', 'food',\n",
       "       'forward', 'found', 'free', 'friend', 'frustration', 'full',\n",
       "       'future', 'game', 'gate', 'get', 'getting', 'give', 'given',\n",
       "       'glad', 'go', 'going', 'good', 'got', 'great', 'gt', 'guy',\n",
       "       'gwrhelp', 'happen', 'happened', 'happening', 'happy', 'hard',\n",
       "       'havent', 'hear', 'hello', 'help', 'here', 'hey', 'hi', 'hold',\n",
       "       'home', 'hope', 'hour', 'however', 'hulusupport', 'id', 'idea',\n",
       "       'ideacares', 'ill', 'im', 'inconvenience', 'info', 'information',\n",
       "       'instead', 'internet', 'io', 'iphone', 'isnt', 'issue', 'it',\n",
       "       'item', 'ive', 'je', 'jetblue', 'keep', 'kind', 'kindly', 'know',\n",
       "       'la', 'last', 'late', 'later', 'le', 'leave', 'left', 'let',\n",
       "       'life', 'like', 'line', 'link', 'little', 'live', 'll', 'local',\n",
       "       'location', 'log', 'london', 'long', 'longer', 'look', 'looking',\n",
       "       'lost', 'lot', 'love', 'made', 'make', 'making', 'manager', 'many',\n",
       "       'marksandspencer', 'may', 'mean', 'meet', 'member', 'message',\n",
       "       'microsofthelps', 'min', 'mind', 'minute', 'mobile', 'moment',\n",
       "       'money', 'month', 'morning', 'morrison', 'much', 'music', 'na',\n",
       "       'name', 'need', 'network', 'never', 'new', 'next', 'nice', 'night',\n",
       "       'not', 'note', 'nothing', 'number', 'o2', 'offer', 'oh', 'ok',\n",
       "       'okay', 'old', 'one', 'online', 'open', 'option', 'order',\n",
       "       'ordered', 'pa', 'package', 'page', 'paid', 'pas', 'patience',\n",
       "       'pay', 'payment', 'people', 'personal', 'phone', 'place', 'plan',\n",
       "       'plane', 'play', 'please', 'pls', 'plus', 'point', 'poor', 'por',\n",
       "       'possible', 'post', 'price', 'prime', 'problem', 'product',\n",
       "       'provide', 'provided', 'purchase', 'put', 'que', 'question', 're',\n",
       "       'reach', 'reaching', 'really', 'reason', 'receive', 'received',\n",
       "       'refund', 'regard', 'regarding', 'reply', 'report', 'request',\n",
       "       'reset', 'resolve', 'resolved', 'response', 'return', 'review',\n",
       "       'ride', 'right', 'run', 'running', 'safaricomcare', 'said',\n",
       "       'sainsburys', 'say', 'saying', 'screen', 'seat', 'see', 'seeing',\n",
       "       'seems', 'send', 'sent', 'service', 'set', 'setting', 'share',\n",
       "       'sharing', 'shipping', 'shit', 'show', 'showing', 'sign', 'since',\n",
       "       'site', 'software', 'someone', 'something', 'soon', 'sorry',\n",
       "       'sound', 'southwestair', 'speak', 'speed', 'spotify',\n",
       "       'spotifycares', 'sprintcare', 'staff', 'start', 'started',\n",
       "       'status', 'stay', 'step', 'still', 'stock', 'stop', 'store',\n",
       "       'support', 'sure', 'swhelp', 'system', 'take', 'taking', 'team',\n",
       "       'tell', 'tesco', 'thank', 'thanks', 'that', 'thats', 'there',\n",
       "       'thing', 'think', 'though', 'ticket', 'time', 'tmobilehelp',\n",
       "       'today', 'together', 'told', 'tomorrow', 'touch', 'tracking',\n",
       "       'train', 'travel', 'tried', 'trip', 'trouble', 'try', 'trying',\n",
       "       'turn', 'tv', 'tweet', 'twitter', 'two', 'ty', 'type', 'uber',\n",
       "       'ubersupport', 'un', 'unable', 'understand', 'update', 'updated',\n",
       "       'upgrade', 'upshelp', 'ur', 'use', 'used', 'using', 've',\n",
       "       'verizonsupport', 'version', 'via', 'virgintrains', 'visit',\n",
       "       'wait', 'waiting', 'want', 'watch', 'way', 'we', 'website', 'wed',\n",
       "       'week', 'welcome', 'well', 'went', 'weve', 'whats', 'wifi',\n",
       "       'window', 'within', 'without', 'wont', 'work', 'working', 'worst',\n",
       "       'would', 'wrong', 'xbox', 'xboxsupport', 'year', 'yes',\n",
       "       'yesterday', 'yet', 'you', 'youre', 'youve'], dtype=object)"
      ]
     },
     "execution_count": 53,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tfidf.get_feature_names_out()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'understand': 452,\n",
       " 'would': 489,\n",
       " 'like': 241,\n",
       " 'assist': 54,\n",
       " 'need': 283,\n",
       " 'get': 178,\n",
       " 'link': 243,\n",
       " 'sprintcare': 397,\n",
       " 'sent': 373,\n",
       " 'message': 268,\n",
       " 'one': 300,\n",
       " 'please': 321,\n",
       " 'send': 372,\n",
       " 'click': 94,\n",
       " 'detail': 124,\n",
       " 'account': 18,\n",
       " 'worst': 488,\n",
       " 'customer': 111,\n",
       " 'service': 374,\n",
       " 'hear': 197,\n",
       " 'dm': 132,\n",
       " 'look': 253,\n",
       " 'na': 281,\n",
       " 'change': 86,\n",
       " 'family': 155,\n",
       " 'concern': 101,\n",
       " 'wed': 474,\n",
       " 'direct': 129,\n",
       " 'since': 384,\n",
       " 'day': 114,\n",
       " 'definitely': 117,\n",
       " 'work': 486,\n",
       " 'long': 251,\n",
       " 'experiencing': 153,\n",
       " 'issue': 222,\n",
       " '115714': 2,\n",
       " 'great': 187,\n",
       " 'connection': 105,\n",
       " 'still': 404,\n",
       " 'something': 388,\n",
       " 'access': 17,\n",
       " 'contact': 106,\n",
       " 'support': 408,\n",
       " 'tell': 415,\n",
       " 'never': 285,\n",
       " 'year': 493,\n",
       " 'ive': 225,\n",
       " 'tried': 436,\n",
       " 'information': 216,\n",
       " 'askspectrum': 53,\n",
       " 'email': 143,\n",
       " 'youre': 498,\n",
       " 'area': 47,\n",
       " 'received': 345,\n",
       " 'thank': 417,\n",
       " 'way': 471,\n",
       " 'via': 464,\n",
       " 'done': 136,\n",
       " 'local': 247,\n",
       " 'date': 113,\n",
       " 'actually': 19,\n",
       " 'thats': 420,\n",
       " 'hello': 198,\n",
       " 'apology': 41,\n",
       " 'frustration': 173,\n",
       " 'inconvenience': 214,\n",
       " 'happy': 194,\n",
       " 'nice': 288,\n",
       " 'start': 399,\n",
       " 'don': 135,\n",
       " 'going': 184,\n",
       " 'apologize': 40,\n",
       " 'glad': 182,\n",
       " 'name': 282,\n",
       " 'phone': 316,\n",
       " 'much': 279,\n",
       " 'every': 150,\n",
       " 'pay': 312,\n",
       " 'month': 276,\n",
       " 'help': 199,\n",
       " 'sorry': 390,\n",
       " 'see': 369,\n",
       " 'trouble': 438,\n",
       " 'verizonsupport': 462,\n",
       " 'got': 186,\n",
       " 'someone': 387,\n",
       " 'thanks': 418,\n",
       " 'ever': 149,\n",
       " 'tweet': 443,\n",
       " 'away': 58,\n",
       " 'im': 213,\n",
       " 'friend': 172,\n",
       " 'without': 484,\n",
       " 'internet': 218,\n",
       " 'play': 320,\n",
       " 'together': 429,\n",
       " 'moment': 274,\n",
       " 'follow': 166,\n",
       " 'order': 304,\n",
       " 'else': 142,\n",
       " 'provide': 333,\n",
       " 'can': 76,\n",
       " 'not': 290,\n",
       " 'able': 16,\n",
       " 'anything': 39,\n",
       " 'number': 293,\n",
       " 'trying': 440,\n",
       " 'find': 159,\n",
       " 'use': 458,\n",
       " 'chat': 89,\n",
       " 'wrong': 490,\n",
       " 'address': 21,\n",
       " 'bill': 66,\n",
       " 'store': 407,\n",
       " 'device': 125,\n",
       " 'give': 180,\n",
       " 'know': 231,\n",
       " 'it': 223,\n",
       " 'wifi': 481,\n",
       " 'nothing': 292,\n",
       " 'happened': 192,\n",
       " 'go': 183,\n",
       " '20': 13,\n",
       " 'minute': 272,\n",
       " 'make': 259,\n",
       " 'feel': 158,\n",
       " 'fix': 162,\n",
       " 'thing': 422,\n",
       " 've': 461,\n",
       " 'time': 426,\n",
       " 'app': 42,\n",
       " 'wont': 485,\n",
       " 'even': 148,\n",
       " 'open': 302,\n",
       " 'think': 423,\n",
       " 'chipotletweets': 92,\n",
       " 'dont': 137,\n",
       " 'today': 428,\n",
       " 'didn': 126,\n",
       " 'well': 477,\n",
       " 'point': 324,\n",
       " 'hey': 201,\n",
       " 'come': 98,\n",
       " 'ill': 212,\n",
       " 'week': 475,\n",
       " 'experience': 152,\n",
       " 'people': 314,\n",
       " 'line': 242,\n",
       " 'went': 478,\n",
       " 'kind': 229,\n",
       " 'extra': 154,\n",
       " 'stop': 406,\n",
       " 'mean': 265,\n",
       " 'version': 463,\n",
       " 'old': 299,\n",
       " 'forward': 169,\n",
       " 'earlier': 140,\n",
       " 'could': 108,\n",
       " 'id': 209,\n",
       " 'share': 377,\n",
       " 'best': 64,\n",
       " 'ordered': 305,\n",
       " 'using': 460,\n",
       " 'charged': 88,\n",
       " 'credit': 109,\n",
       " 'card': 81,\n",
       " 'location': 248,\n",
       " 'call': 74,\n",
       " 'sure': 409,\n",
       " 're': 339,\n",
       " 'didnt': 127,\n",
       " 'try': 439,\n",
       " 'back': 59,\n",
       " 'home': 204,\n",
       " 'used': 459,\n",
       " 'food': 168,\n",
       " 'also': 30,\n",
       " 'want': 469,\n",
       " 'love': 257,\n",
       " 'better': 65,\n",
       " 'info': 215,\n",
       " 'free': 171,\n",
       " 'keep': 228,\n",
       " 'update': 453,\n",
       " 'askplaystation': 52,\n",
       " 'already': 29,\n",
       " 'whats': 480,\n",
       " 'plus': 323,\n",
       " 'game': 176,\n",
       " 'hour': 206,\n",
       " 'bought': 69,\n",
       " 'data': 112,\n",
       " 'let': 239,\n",
       " 'really': 342,\n",
       " 'life': 240,\n",
       " 'marksandspencer': 263,\n",
       " 'weve': 479,\n",
       " 'team': 414,\n",
       " 'sharing': 378,\n",
       " 'mind': 271,\n",
       " 'bag': 61,\n",
       " 'charge': 87,\n",
       " 'say': 365,\n",
       " 'check': 90,\n",
       " 'right': 359,\n",
       " 'following': 167,\n",
       " 'new': 286,\n",
       " 'good': 185,\n",
       " 'delivered': 121,\n",
       " 'le': 236,\n",
       " 'airport': 26,\n",
       " 'train': 434,\n",
       " 'item': 224,\n",
       " 'amp': 35,\n",
       " 'buy': 73,\n",
       " 'poor': 325,\n",
       " 'assistance': 55,\n",
       " 'post': 328,\n",
       " 'xboxsupport': 492,\n",
       " 'microsofthelps': 269,\n",
       " 'hi': 202,\n",
       " 'making': 260,\n",
       " 'purchase': 335,\n",
       " 'xbox': 491,\n",
       " 'answer': 37,\n",
       " 'told': 430,\n",
       " 'atviassist': 56,\n",
       " 'problem': 331,\n",
       " 'question': 338,\n",
       " 'future': 175,\n",
       " 'error': 147,\n",
       " 'late': 234,\n",
       " 'response': 355,\n",
       " 'yes': 494,\n",
       " 'longer': 252,\n",
       " 'io': 219,\n",
       " '11': 1,\n",
       " 'tv': 442,\n",
       " 'regard': 347,\n",
       " 'code': 96,\n",
       " 'payment': 313,\n",
       " 'delay': 118,\n",
       " 'updated': 454,\n",
       " 'reset': 352,\n",
       " 'stay': 402,\n",
       " 'pas': 310,\n",
       " 'isnt': 221,\n",
       " 'step': 403,\n",
       " 'another': 36,\n",
       " 'product': 332,\n",
       " 'ask': 50,\n",
       " '22': 14,\n",
       " 'reply': 349,\n",
       " 'soon': 389,\n",
       " 'available': 57,\n",
       " 'ok': 297,\n",
       " 'request': 351,\n",
       " 'possible': 327,\n",
       " 'getting': 179,\n",
       " 'return': 356,\n",
       " 'working': 487,\n",
       " 'wait': 467,\n",
       " 'next': 287,\n",
       " 'patience': 311,\n",
       " 'review': 357,\n",
       " 'log': 249,\n",
       " 'everything': 151,\n",
       " 'guy': 189,\n",
       " 'saying': 366,\n",
       " 'unable': 451,\n",
       " 'disappointed': 131,\n",
       " 'amazonhelp': 33,\n",
       " 'live': 245,\n",
       " 'currently': 110,\n",
       " 'may': 264,\n",
       " 'plan': 318,\n",
       " 'add': 20,\n",
       " 'take': 412,\n",
       " 'many': 262,\n",
       " 'option': 303,\n",
       " 'end': 145,\n",
       " 'seems': 371,\n",
       " 'cant': 79,\n",
       " 'due': 139,\n",
       " 'online': 301,\n",
       " 'along': 28,\n",
       " 'screen': 367,\n",
       " 'always': 31,\n",
       " 'setting': 376,\n",
       " 'happening': 193,\n",
       " 'pa': 306,\n",
       " 'que': 337,\n",
       " 'en': 144,\n",
       " '10': 0,\n",
       " 'cancel': 77,\n",
       " 'refund': 346,\n",
       " 'reaching': 341,\n",
       " 'there': 421,\n",
       " 'reach': 340,\n",
       " 'bank': 62,\n",
       " 'around': 49,\n",
       " 'money': 275,\n",
       " 'anyone': 38,\n",
       " 'havent': 196,\n",
       " 'show': 381,\n",
       " 'last': 233,\n",
       " 'booking': 68,\n",
       " 'airasiasupport': 25,\n",
       " 'member': 267,\n",
       " 'flight': 164,\n",
       " 'kindly': 230,\n",
       " 'ticket': 425,\n",
       " 'ur': 457,\n",
       " 'checked': 91,\n",
       " 'made': 258,\n",
       " 'lost': 255,\n",
       " 'case': 83,\n",
       " 'provided': 334,\n",
       " 'enjoy': 146,\n",
       " 'trip': 437,\n",
       " 'offer': 295,\n",
       " 'morrison': 278,\n",
       " 'yet': 496,\n",
       " 'speak': 393,\n",
       " 'staff': 398,\n",
       " 'youve': 499,\n",
       " 'leave': 237,\n",
       " 'stock': 405,\n",
       " 'place': 317,\n",
       " 'care': 82,\n",
       " 'welcome': 476,\n",
       " 'run': 360,\n",
       " '12': 12,\n",
       " 'continue': 107,\n",
       " 'pls': 322,\n",
       " 'personal': 315,\n",
       " 'bad': 60,\n",
       " 'll': 246,\n",
       " 'you': 497,\n",
       " 'connect': 104,\n",
       " 'tomorrow': 431,\n",
       " 'ride': 358,\n",
       " 'tracking': 433,\n",
       " 'amazon': 32,\n",
       " 'shit': 380,\n",
       " '115817': 3,\n",
       " 'confirmation': 103,\n",
       " 'delta': 123,\n",
       " 'different': 128,\n",
       " 'given': 181,\n",
       " '115821': 4,\n",
       " 'twitter': 444,\n",
       " 'feedback': 157,\n",
       " 'okay': 298,\n",
       " 'prime': 330,\n",
       " 'receive': 344,\n",
       " 'delivery': 122,\n",
       " 'we': 472,\n",
       " 'shipping': 379,\n",
       " 'first': 161,\n",
       " 'package': 307,\n",
       " 'driver': 138,\n",
       " 'closer': 95,\n",
       " 'oh': 296,\n",
       " 'page': 308,\n",
       " 'chance': 85,\n",
       " 'doesn': 133,\n",
       " 'ago': 24,\n",
       " 'started': 400,\n",
       " 'book': 67,\n",
       " 'box': 70,\n",
       " 'por': 326,\n",
       " 'la': 232,\n",
       " 'paid': 309,\n",
       " 'night': 289,\n",
       " 'idea': 210,\n",
       " 'said': 363,\n",
       " 'looking': 254,\n",
       " 'waiting': 468,\n",
       " 'company': 99,\n",
       " 'within': 483,\n",
       " 'caused': 84,\n",
       " 'status': 401,\n",
       " 'report': 350,\n",
       " '115850': 5,\n",
       " 'deliver': 120,\n",
       " 'running': 361,\n",
       " 'gt': 188,\n",
       " 'applesupport': 44,\n",
       " 'yesterday': 495,\n",
       " 'showing': 382,\n",
       " 'iphone': 220,\n",
       " 'meet': 266,\n",
       " 'put': 336,\n",
       " '115858': 6,\n",
       " 'type': 447,\n",
       " 'software': 386,\n",
       " 'battery': 63,\n",
       " 'de': 115,\n",
       " 'apple': 43,\n",
       " 'fine': 160,\n",
       " 'sound': 391,\n",
       " 'here': 200,\n",
       " 'confirm': 102,\n",
       " 'spotify': 395,\n",
       " 'ubersupport': 449,\n",
       " '115873': 7,\n",
       " 'note': 291,\n",
       " 'touch': 432,\n",
       " 'travel': 435,\n",
       " 'instead': 217,\n",
       " 'seat': 368,\n",
       " 'manager': 261,\n",
       " 'tesco': 416,\n",
       " 'appreciate': 45,\n",
       " 'full': 174,\n",
       " 'fixed': 163,\n",
       " 'website': 473,\n",
       " 'flying': 165,\n",
       " 'delayed': 119,\n",
       " 'agent': 23,\n",
       " 'though': 424,\n",
       " 'complaint': 100,\n",
       " 'reason': 343,\n",
       " 'spotifycares': 396,\n",
       " 'turn': 441,\n",
       " 'system': 411,\n",
       " '115888': 8,\n",
       " 'window': 482,\n",
       " 'doesnt': 134,\n",
       " 'music': 280,\n",
       " 'upgrade': 455,\n",
       " 'however': 207,\n",
       " 'britishairways': 71,\n",
       " 'car': 80,\n",
       " 'cancelled': 78,\n",
       " 'london': 250,\n",
       " 'two': 445,\n",
       " 'little': 244,\n",
       " 'comcastcares': 97,\n",
       " 'set': 375,\n",
       " 'network': 284,\n",
       " 'watch': 470,\n",
       " 'americanair': 34,\n",
       " 'ty': 446,\n",
       " 'gate': 177,\n",
       " '115911': 9,\n",
       " '115913': 10,\n",
       " 'hope': 205,\n",
       " 'fee': 156,\n",
       " 'called': 75,\n",
       " 'tmobilehelp': 427,\n",
       " 'deal': 116,\n",
       " 'virgintrains': 465,\n",
       " 'price': 329,\n",
       " 'lot': 256,\n",
       " 'southwestair': 392,\n",
       " 'advise': 22,\n",
       " 'seeing': 370,\n",
       " 'claim': 93,\n",
       " 'directly': 130,\n",
       " 'hulusupport': 208,\n",
       " 'gwrhelp': 190,\n",
       " 'sign': 383,\n",
       " 'regarding': 348,\n",
       " 'sainsburys': 364,\n",
       " 'speed': 394,\n",
       " 'askpaypal': 51,\n",
       " 'hard': 195,\n",
       " 'morning': 277,\n",
       " 'el': 141,\n",
       " 'site': 385,\n",
       " 'business': 72,\n",
       " 'resolved': 354,\n",
       " 'taking': 413,\n",
       " 'left': 238,\n",
       " 'un': 450,\n",
       " 'happen': 191,\n",
       " 'argoshelpers': 48,\n",
       " '116062': 11,\n",
       " 'hold': 203,\n",
       " 'min': 270,\n",
       " 'upshelp': 456,\n",
       " 'mobile': 273,\n",
       " 'that': 419,\n",
       " 'found': 170,\n",
       " 'apps': 46,\n",
       " '30': 15,\n",
       " 'uber': 448,\n",
       " 'resolve': 353,\n",
       " 'visit': 466,\n",
       " 'swhelp': 410,\n",
       " 'later': 235,\n",
       " 'ideacares': 211,\n",
       " 'plane': 319,\n",
       " 'safaricomcare': 362,\n",
       " 'o2': 294,\n",
       " 'jetblue': 227,\n",
       " 'aldiuk': 27,\n",
       " 'je': 226}"
      ]
     },
     "execution_count": 54,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tfidf.vocabulary_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([6.01894743, 6.46394099, 6.25114204, 6.4851498 , 5.8219855 ,\n",
       "       5.91095456, 5.25271678, 5.88846668, 6.20954413, 5.92986719,\n",
       "       5.78355006, 6.60255779, 5.18774709, 6.62419606, 5.34362904,\n",
       "       6.53084948, 4.93563903, 6.07094877, 4.12447215, 6.4352293 ,\n",
       "       6.29468747, 4.42581167, 6.57001994, 6.50559226, 6.21280379,\n",
       "       6.37800745, 6.38643914, 6.56899377, 6.55620872, 5.43059312,\n",
       "       5.17413479, 5.52122504, 5.40040903, 4.03571885, 5.04040697,\n",
       "       4.6387231 , 5.67177419, 6.25522146, 6.51385241, 5.40307872,\n",
       "       5.63872198, 5.29949517, 4.91030848, 5.9707466 , 4.36013038,\n",
       "       5.64788483, 6.54449448, 6.21502645, 6.52218136, 6.00034795,\n",
       "       6.23933792, 6.61409843, 5.83434231, 5.77609619, 4.67241939,\n",
       "       5.30588161, 5.73302861, 5.31621748, 6.13639432, 4.38418472,\n",
       "       6.23933792, 6.20137658, 6.48910169, 6.26288119, 5.48708588,\n",
       "       5.61491782, 6.56035982, 6.49004903, 6.1262224 , 6.20383279,\n",
       "       6.25202451, 5.51230483, 6.37393319, 6.1442899 , 4.86751442,\n",
       "       6.28299143, 5.32354352, 6.25385981, 6.16126239, 5.00014478,\n",
       "       6.54031797, 5.31653721, 5.83564017, 6.02932927, 6.4389884 ,\n",
       "       6.54914544, 5.41638787, 6.00013677, 6.20015073, 5.85741608,\n",
       "       4.47407817, 6.39863155, 5.86342983, 6.47237062, 6.10465886,\n",
       "       6.36636695, 5.5511989 , 5.7914883 , 5.66235318, 6.34251778,\n",
       "       6.57011328, 5.45263774, 6.19314714, 6.11041884, 5.73659152,\n",
       "       6.24404286, 4.8542345 , 6.08045666, 4.7268544 , 6.1840327 ,\n",
       "       5.80991044, 4.48320876, 6.19065313, 5.61258619, 4.50476053,\n",
       "       5.5911059 , 6.40249211, 6.32410241, 5.27383881, 5.86670436,\n",
       "       6.67658417, 5.94443994, 5.06213341, 5.06343599, 4.46507568,\n",
       "       5.3044852 , 6.4439129 , 5.86099243, 6.24242724, 5.86085464,\n",
       "       6.50113908, 6.55381813, 3.10934278, 6.47499829, 5.82119066,\n",
       "       5.63479443, 5.6564209 , 4.70936509, 5.49117108, 5.73371591,\n",
       "       6.63250718, 6.51987066, 5.98791174, 4.21377642, 6.29199796,\n",
       "       6.23398781, 6.53561761, 5.545822  , 5.22471189, 5.85380688,\n",
       "       5.64695734, 6.25699439, 5.16871835, 6.25549402, 6.56035982,\n",
       "       6.64681672, 6.46663075, 5.30812521, 5.6356007 , 5.41709484,\n",
       "       6.55152487, 5.65784444, 5.20576049, 6.04383775, 4.61437044,\n",
       "       6.56955337, 5.26484028, 6.17211241, 6.4224242 , 6.17223781,\n",
       "       6.38916171, 5.46458634, 6.41832567, 6.51871731, 5.20714497,\n",
       "       6.06063272, 5.6776838 , 6.68293803, 3.65588835, 5.1282642 ,\n",
       "       5.3510491 , 6.64249228, 5.46941846, 4.86788867, 4.90397341,\n",
       "       5.02575543, 4.75978067, 5.08364545, 6.4855786 , 5.31228256,\n",
       "       5.63806019, 6.50227232, 5.86790617, 6.12484602, 4.65049555,\n",
       "       6.57432263, 6.29157397, 4.48071032, 4.85021447, 3.33426295,\n",
       "       6.45966909, 4.42374703, 3.52742385, 6.42371349, 5.76739993,\n",
       "       5.42820656, 5.16207441, 6.39556949, 6.01862473, 5.42674759,\n",
       "       5.82818927, 6.17368103, 5.5757938 , 4.10209602, 5.78070595,\n",
       "       5.05589221, 5.0587505 , 6.55134163, 5.47909063, 5.24143043,\n",
       "       5.05634405, 6.07111878, 3.95354972, 5.00432893, 5.55935282,\n",
       "       5.3272537 , 6.69365354, 6.63111718, 5.05103748, 6.51447027,\n",
       "       5.67539207, 3.97221637, 6.06919374, 5.34026695, 5.98535972,\n",
       "       6.59000552, 6.12802053, 6.58411924, 6.22251516, 4.00570259,\n",
       "       6.61001003, 3.97571018, 5.82494964, 4.87992206, 6.62616864,\n",
       "       6.16867006, 6.07640333, 6.59774823, 6.10395583, 6.50000712,\n",
       "       6.66769431, 5.89900309, 6.64671594, 3.9338669 , 5.92319723,\n",
       "       6.28657026, 6.53480632, 5.16282823, 5.85613538, 4.78914646,\n",
       "       6.41464331, 6.4979207 , 6.07276366, 6.29937598, 5.29078313,\n",
       "       6.3017285 , 6.5825113 , 6.26638864, 4.88510163, 6.57883222,\n",
       "       6.31806274, 6.48232433, 5.73849964, 6.21869811, 6.57488522,\n",
       "       5.7960406 , 5.69046058, 5.75654179, 6.48592177, 5.53711251,\n",
       "       6.40162415, 6.30874758, 5.16665171, 4.26242594, 6.04521741,\n",
       "       5.37096869, 4.84836065, 5.58858419, 6.51694552, 6.24809336,\n",
       "       6.51747673, 5.81078373, 5.85057424, 4.16166654, 5.91579484,\n",
       "       5.73898741, 5.52453331, 5.96313773, 6.58962471, 6.48335085,\n",
       "       4.51248212, 5.66503046, 6.15612799, 5.42764058, 4.48240996,\n",
       "       6.24458198, 6.67668801, 5.64758794, 5.95907619, 6.28544611,\n",
       "       5.87846073, 6.44968897, 5.61276535, 6.29575111, 5.67272499,\n",
       "       6.41528275, 4.2233224 , 6.37339632, 6.14276667, 6.62488602,\n",
       "       6.38117067, 2.96202999, 5.94608899, 6.59468222, 6.02829708,\n",
       "       6.52066992, 6.78193315, 5.4033112 , 6.58222781, 6.19423622,\n",
       "       6.0913851 , 5.16913219, 5.84794122, 5.28811173, 6.25549402,\n",
       "       6.3353323 , 6.24021002, 6.03998482, 5.48888891, 5.88446168,\n",
       "       5.25414283, 5.64107856, 5.21265409, 6.20266857, 6.18950415,\n",
       "       5.49798509, 5.47159434, 6.45159413, 6.3432615 , 5.65746963,\n",
       "       6.28642967, 5.81012869, 6.68670688, 6.39863155, 6.22304279,\n",
       "       5.49686747, 6.1176361 , 6.05008898, 6.43629023, 5.21039887,\n",
       "       6.40676393, 5.99334994, 6.09660371, 5.86241735, 5.77960444,\n",
       "       5.18936493, 6.32585565, 6.21817276, 5.92672284, 4.44772375,\n",
       "       6.38055267, 6.25597116, 4.01584771, 5.28248111, 3.95020031,\n",
       "       6.52049225, 6.39706009, 5.56507647, 6.55308371, 6.71349419,\n",
       "       6.34975527, 5.75035442, 6.57949157, 6.62765063, 5.42217609,\n",
       "       6.37025756, 6.42921156, 5.78312505, 5.73845901, 5.05772139,\n",
       "       3.68577001, 6.32644074, 5.38590894, 6.45541537, 6.57826741,\n",
       "       6.28285134, 5.49747402, 6.30623511, 6.2135877 , 6.06085707,\n",
       "       6.20869835, 6.62390051, 6.61010718, 5.8754737 , 4.42737664,\n",
       "       6.55528858, 6.06501672, 4.78020686, 5.08284353, 5.03617011,\n",
       "       6.17562956, 6.05437117, 4.49955548, 6.52084761, 4.33224968,\n",
       "       5.39818009, 5.36790624, 4.27677457, 3.63057953, 6.55851276,\n",
       "       5.32424149, 6.0297642 , 5.60161116, 5.81375862, 6.22073644,\n",
       "       5.61718291, 4.13279104, 5.85098343, 4.89089995, 6.18651023,\n",
       "       5.85075608, 6.2243631 , 5.77411503, 5.98900746, 5.35594341,\n",
       "       6.1950057 , 5.48642243, 6.3229353 , 5.58938904, 5.08592812,\n",
       "       5.37494416, 6.48266639, 6.09869881, 6.04212962, 5.80507752,\n",
       "       5.94399067, 6.53642955, 6.33201628, 6.2400758 , 5.10102275,\n",
       "       6.50673056, 6.2883997 , 5.67230653, 4.65076939, 6.11556024,\n",
       "       6.3967461 , 6.25747226, 6.46511687, 5.10052879, 6.22628064,\n",
       "       5.11691603, 5.60459243, 6.05409255, 5.62683992, 4.77018847,\n",
       "       5.31720364, 6.35170415, 5.64063628, 5.78372011, 4.56122101,\n",
       "       6.29766852, 4.99987293, 5.8329568 , 5.81762166, 4.83932464,\n",
       "       5.48459231, 6.12826052, 4.03912267, 6.34504868, 5.77542131,\n",
       "       5.43101136, 6.10871089, 6.67357759, 6.526372  , 5.90873587,\n",
       "       6.09893187, 4.7442941 , 5.06604625, 6.28215121, 4.36744806,\n",
       "       6.00129882, 6.29355416, 5.57645018, 5.73703777, 5.48999765,\n",
       "       6.24992146, 5.59107083, 6.18492136, 4.81057336, 6.16281408])"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tfidf.idf_"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Summarizing 5 advantages and disadvantages of One-Hot Encoding (OHE), Bag-of-Words (BOW), N-Grams, and TF-IDF:\n",
    "\n",
    "### One-Hot Encoding (OHE)\n",
    "\n",
    "**Advantages:**\n",
    "1. Simple and intuitive representation.\n",
    "2. Preserves information about distinct categories.\n",
    "3. Works well with algorithms that expect numerical input.\n",
    "4. No assumptions about relationships between categories.\n",
    "5. Straightforward interpretation and implementation.\n",
    "\n",
    "**Disadvantages:**\n",
    "1. High dimensionality for large categorical spaces.\n",
    "2. Not suitable for high cardinality categorical data.\n",
    "3. Can result in a sparse matrix with many zeros.\n",
    "4. May lead to multicollinearity issues in certain models.\n",
    "5. Increases the complexity of the dataset.\n",
    "\n",
    "### Bag-of-Words (BOW)\n",
    "\n",
    "**Advantages:**\n",
    "1. Simple and efficient representation of text data.\n",
    "2. Works well for document classification tasks.\n",
    "3. Scalable and easy to implement.\n",
    "4. Can be used with various machine learning algorithms.\n",
    "5. Good for tasks where word frequency matters.\n",
    "\n",
    "**Disadvantages:**\n",
    "1. Ignores word order and context.\n",
    "2. Loses information about word relationships.\n",
    "3. Treats all words as independent entities.\n",
    "4. Doesn't capture semantics or word meanings.\n",
    "5. Vocabulary size can be large and impact memory.\n",
    "\n",
    "### N-Grams\n",
    "\n",
    "**Advantages:**\n",
    "1. Captures local word patterns and context.\n",
    "2. Retains some sequential information.\n",
    "3. Can improve performance for certain tasks.\n",
    "4. Useful for tasks like machine translation.\n",
    "5. Adjustability to task-specific contexts.\n",
    "\n",
    "**Disadvantages:**\n",
    "1. Increased dimensionality with higher N-grams.\n",
    "2. Sensitivity to word order in training data.\n",
    "3. Limited understanding of global context.\n",
    "4. Sparse representation for higher N-grams.\n",
    "5. Limited capturing of long-term dependencies.\n",
    "\n",
    "### TF-IDF (Term Frequency-Inverse Document Frequency)\n",
    "\n",
    "**Advantages:**\n",
    "1. Considers word importance in a document collection.\n",
    "2. Helps down-weight common words and emphasize rare ones.\n",
    "3. Effective in information retrieval and search tasks.\n",
    "4. Can be combined with various machine learning models.\n",
    "5. Reduces the impact of stop words in the analysis.\n",
    "\n",
    "**Disadvantages:**\n",
    "1. Complexity increases with larger document collections.\n",
    "2. May not work well for short documents.\n",
    "3. Requires a corpus for meaningful IDF calculations.\n",
    "4. Ignores word order and semantics.\n",
    "5. Loss of some context information.\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "base",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.11.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}