TUD-MMC_mathias.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Evaluation of Results of \"TUD-MMC at MediaEval 2016: Context of Experience task\" by Wang & Liem"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Necessary imports"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "import os.path\n",
    "import xml.etree.ElementTree as ET\n",
    "\n",
    "train_path = \"res/coe_dataset_icpr/dev_set/\"\n",
    "test_path = \"res/coe_dataset_icpr/test_set/\"\n",
    "\n",
    "audio_folder = \"audio_descriptors/\"\n",
    "text_folder = \"text_descriptors/\"\n",
    "vis_folder = \"vis_descriptors/\"\n",
    "metadata_folder = \"XML/\"\n",
    "\n",
    "train_entries_path = \"res/CoeTraining.csv\"\n",
    "test_entries_path = \"res/CoeTestLabels.csv\"\n",
    "testtrain_entries_path = \"res/CoeTrainingTest.csv\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Datasets\n",
    "\n",
    "Features are built in the manner described in the paper of Wang & Liem or \"Right Inflight? A Dataset for Exploring the Automatic\n",
    "Prediction of Movies Suitable for a Watching Situation\" (https://mmsys2016.itec.aau.at/papers/MMSYS/a45-riegler.pdf), if Wang & Liem do not provide any information.\n",
    "\n",
    "This leads to following set-up:\n",
    "\n",
    "Metadata: (language, year published, genre, country, runtime and age rating) - from XML -- 1-Hot Encoding for all categorical values<br>\n",
    "Text: as is td-idf <br>\n",
    "Audio: Averaged of all Frames (NaN to 0) - Mel-Frequency Cepstral Coefficients<br>\n",
    "Visual: as is - Histogram of Oriented Gradients (HOG) gray, Color Moments, local binary patterns (LBP) and Gray Level Run Length Matrix\n",
    "\n",
    "NOTE: Training data - invalid entry (2_states, also in test set), (Moulin_Rouge!.mp4, should be Moulin_Rouge! --> fixed)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>movie_name</th>\n",
       "      <th>file_name</th>\n",
       "      <th>goodforairplanes</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>A Fish Called Wanda</td>\n",
       "      <td>A_Fish_Called_Wanda</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>A Goofy Movie</td>\n",
       "      <td>A_Goofy_Movie</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>A Million Ways to Die in the West</td>\n",
       "      <td>A_Million_Ways_to_Die_in_the_West</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>A Single Man</td>\n",
       "      <td>A_Single_Man</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>American Gangster</td>\n",
       "      <td>American_Gangster</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                          movie_name                          file_name  \\\n",
       "0                A Fish Called Wanda                A_Fish_Called_Wanda   \n",
       "1                      A Goofy Movie                      A_Goofy_Movie   \n",
       "2  A Million Ways to Die in the West  A_Million_Ways_to_Die_in_the_West   \n",
       "3                       A Single Man                       A_Single_Man   \n",
       "4                  American Gangster                  American_Gangster   \n",
       "\n",
       "  goodforairplanes  \n",
       "0                1  \n",
       "1                0  \n",
       "2                1  \n",
       "3                1  \n",
       "4                1  "
      ]
     },
     "execution_count": 59,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_base_train = pd.read_csv(train_entries_path)\n",
    "df_base_train = df_base_train[df_base_train['file_name'] != '2_States'] # remove invalid entry\n",
    "df_base_train.sort_values(by='file_name', inplace=True)\n",
    "df_base_train.reset_index(inplace=True, drop=True)\n",
    "df_targets_train = df_base_train['goodforairplanes'].astype(int)\n",
    "df_base_train.head(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>movie_name</th>\n",
       "      <th>file_name</th>\n",
       "      <th>goodforairplanes</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>10.000 Km</td>\n",
       "      <td>10.000_Km</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>12 Years a Slave</td>\n",
       "      <td>12_Years_a_Slave</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>21 Jump Street</td>\n",
       "      <td>21_Jump_Street</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>A Bug's Life</td>\n",
       "      <td>A_Bug's_Life</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>A_Fish_Called_Wanda</td>\n",
       "      <td>A_Fish_Called_Wanda</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>A Little Chaos</td>\n",
       "      <td>A_Little_Chaos</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>A Most Wanted Man</td>\n",
       "      <td>A_Most_Wanted_Man</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>A Simple Life</td>\n",
       "      <td>A_Simple_Life</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Aanmodderfakker</td>\n",
       "      <td>Aanmodderfakker</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Alexander</td>\n",
       "      <td>Alexander</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Alexander and the Terrible Horrible No Good Ve...</td>\n",
       "      <td>Alexander_and_the_Terrible_Horrible_No_Good_Ve...</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Alice in Wonderland</td>\n",
       "      <td>Alice_in_Wonderland</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>American Sniper</td>\n",
       "      <td>American_Sniper</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Anastasia</td>\n",
       "      <td>Anastasia</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>And So It Goes</td>\n",
       "      <td>And_So_It_Goes</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Antz</td>\n",
       "      <td>Antz</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Avatar</td>\n",
       "      <td>Avatar</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Bad News Bears</td>\n",
       "      <td>Bad_News_Bears</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Banklady</td>\n",
       "      <td>Banklady</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Beetlejuice</td>\n",
       "      <td>Beetlejuice</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Begin Again</td>\n",
       "      <td>Begin_Again</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Belle de Jour</td>\n",
       "      <td>Belle_de_Jour</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Bewakoofiyaan</td>\n",
       "      <td>Bewakoofiyaan</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Bhoothnath</td>\n",
       "      <td>Bhoothnath</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Big Game</td>\n",
       "      <td>Big_Game</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Billy Elliot</td>\n",
       "      <td>Billy_Elliot</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Birdman Or (The Unexpected Virtue of Ignorance)</td>\n",
       "      <td>Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Blended</td>\n",
       "      <td>Blended</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Blow Out</td>\n",
       "      <td>Blow_Out</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Bride Flight</td>\n",
       "      <td>Bride_Flight</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>The Talented Mr. Ripley</td>\n",
       "      <td>The_Talented_Mr._Ripley</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>194</th>\n",
       "      <td>The Trip to Italy</td>\n",
       "      <td>The_Trip_to_Italy</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>195</th>\n",
       "      <td>The Voices</td>\n",
       "      <td>The_Voices</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>196</th>\n",
       "      <td>The Water Diviner</td>\n",
       "      <td>The_Water_Diviner</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>197</th>\n",
       "      <td>The White Haired Witch of Lunar Kingdom</td>\n",
       "      <td>The_White_Haired_Witch_of_Lunar_Kingdom</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>The Wolf of Wall Street</td>\n",
       "      <td>The_Wolf_of_Wall_Street</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>Thelma Louise</td>\n",
       "      <td>Thelma___Louise</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>There Will Be Blood</td>\n",
       "      <td>There_Will_Be_Blood</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>201</th>\n",
       "      <td>Thor The Dark World</td>\n",
       "      <td>Thor__The_Dark_World</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>202</th>\n",
       "      <td>Titanic</td>\n",
       "      <td>Titanic</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>203</th>\n",
       "      <td>Tommy Boy</td>\n",
       "      <td>Tommy_Boy</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>204</th>\n",
       "      <td>Trainspotting</td>\n",
       "      <td>Trainspotting</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>205</th>\n",
       "      <td>Trash</td>\n",
       "      <td>Trash</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>206</th>\n",
       "      <td>Unbroken</td>\n",
       "      <td>Unbroken</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>207</th>\n",
       "      <td>Valkyrie</td>\n",
       "      <td>Valkyrie</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>Verliefd op Ibiza</td>\n",
       "      <td>Verliefd_op_Ibiza</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>209</th>\n",
       "      <td>Walk the Line</td>\n",
       "      <td>Walk_the_Line</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>210</th>\n",
       "      <td>Warrior</td>\n",
       "      <td>Warrior</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>211</th>\n",
       "      <td>Wassup Rockers</td>\n",
       "      <td>Wassup_Rockers</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>212</th>\n",
       "      <td>Watchmen</td>\n",
       "      <td>Watchmen</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>213</th>\n",
       "      <td>Wet Hot American Summer</td>\n",
       "      <td>Wet_Hot_American_Summer</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>214</th>\n",
       "      <td>What We Do in the Shadows</td>\n",
       "      <td>What_We_Do_in_the_Shadows</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>215</th>\n",
       "      <td>Whiplash</td>\n",
       "      <td>Whiplash</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>216</th>\n",
       "      <td>Who Framed Roger Rabbit</td>\n",
       "      <td>Who_Framed_Roger_Rabbit</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>217</th>\n",
       "      <td>Wish I Was Here</td>\n",
       "      <td>Wish_I_Was_Here</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>218</th>\n",
       "      <td>X-Men Days of Future Past</td>\n",
       "      <td>X-Men__Days_of_Future_Past</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>219</th>\n",
       "      <td>X-Men First Class</td>\n",
       "      <td>X-Men__First_Class</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>220</th>\n",
       "      <td>Yentl</td>\n",
       "      <td>Yentl</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>221</th>\n",
       "      <td>Yves Saint Laurent</td>\n",
       "      <td>Yves_Saint_Laurent</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>222</th>\n",
       "      <td>Zombieland</td>\n",
       "      <td>Zombieland</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>223 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                            movie_name  \\\n",
       "0                                            10.000 Km   \n",
       "1                                     12 Years a Slave   \n",
       "2                                       21 Jump Street   \n",
       "3                                         A Bug's Life   \n",
       "4                                  A_Fish_Called_Wanda   \n",
       "5                                       A Little Chaos   \n",
       "6                                    A Most Wanted Man   \n",
       "7                                        A Simple Life   \n",
       "8                                      Aanmodderfakker   \n",
       "9                                            Alexander   \n",
       "10   Alexander and the Terrible Horrible No Good Ve...   \n",
       "11                                 Alice in Wonderland   \n",
       "12                                     American Sniper   \n",
       "13                                           Anastasia   \n",
       "14                                      And So It Goes   \n",
       "15                                                Antz   \n",
       "16                                              Avatar   \n",
       "17                                      Bad News Bears   \n",
       "18                                            Banklady   \n",
       "19                                         Beetlejuice   \n",
       "20                                         Begin Again   \n",
       "21                                       Belle de Jour   \n",
       "22                                       Bewakoofiyaan   \n",
       "23                                          Bhoothnath   \n",
       "24                                            Big Game   \n",
       "25                                        Billy Elliot   \n",
       "26     Birdman Or (The Unexpected Virtue of Ignorance)   \n",
       "27                                             Blended   \n",
       "28                                            Blow Out   \n",
       "29                                        Bride Flight   \n",
       "..                                                 ...   \n",
       "193                            The Talented Mr. Ripley   \n",
       "194                                  The Trip to Italy   \n",
       "195                                         The Voices   \n",
       "196                                  The Water Diviner   \n",
       "197            The White Haired Witch of Lunar Kingdom   \n",
       "198                            The Wolf of Wall Street   \n",
       "199                                      Thelma Louise   \n",
       "200                                There Will Be Blood   \n",
       "201                                Thor The Dark World   \n",
       "202                                            Titanic   \n",
       "203                                          Tommy Boy   \n",
       "204                                      Trainspotting   \n",
       "205                                              Trash   \n",
       "206                                           Unbroken   \n",
       "207                                           Valkyrie   \n",
       "208                                  Verliefd op Ibiza   \n",
       "209                                      Walk the Line   \n",
       "210                                            Warrior   \n",
       "211                                     Wassup Rockers   \n",
       "212                                           Watchmen   \n",
       "213                            Wet Hot American Summer   \n",
       "214                          What We Do in the Shadows   \n",
       "215                                           Whiplash   \n",
       "216                            Who Framed Roger Rabbit   \n",
       "217                                    Wish I Was Here   \n",
       "218                          X-Men Days of Future Past   \n",
       "219                                  X-Men First Class   \n",
       "220                                              Yentl   \n",
       "221                                 Yves Saint Laurent   \n",
       "222                                         Zombieland   \n",
       "\n",
       "                                             file_name  goodforairplanes  \n",
       "0                                            10.000_Km                 1  \n",
       "1                                     12_Years_a_Slave                 1  \n",
       "2                                       21_Jump_Street                 1  \n",
       "3                                         A_Bug's_Life                 1  \n",
       "4                                  A_Fish_Called_Wanda                 1  \n",
       "5                                       A_Little_Chaos                 0  \n",
       "6                                    A_Most_Wanted_Man                 1  \n",
       "7                                        A_Simple_Life                 1  \n",
       "8                                      Aanmodderfakker                 1  \n",
       "9                                            Alexander                 1  \n",
       "10   Alexander_and_the_Terrible_Horrible_No_Good_Ve...                 1  \n",
       "11                                 Alice_in_Wonderland                 0  \n",
       "12                                     American_Sniper                 0  \n",
       "13                                           Anastasia                 1  \n",
       "14                                      And_So_It_Goes                 1  \n",
       "15                                                Antz                 1  \n",
       "16                                              Avatar                 0  \n",
       "17                                      Bad_News_Bears                 1  \n",
       "18                                            Banklady                 1  \n",
       "19                                         Beetlejuice                 1  \n",
       "20                                         Begin_Again                 1  \n",
       "21                                       Belle_de_Jour                 1  \n",
       "22                                       Bewakoofiyaan                 1  \n",
       "23                                          Bhoothnath                 0  \n",
       "24                                            Big_Game                 0  \n",
       "25                                        Billy_Elliot                 1  \n",
       "26    Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)                 1  \n",
       "27                                             Blended                 1  \n",
       "28                                            Blow_Out                 0  \n",
       "29                                        Bride_Flight                 1  \n",
       "..                                                 ...               ...  \n",
       "193                            The_Talented_Mr._Ripley                 1  \n",
       "194                                  The_Trip_to_Italy                 1  \n",
       "195                                         The_Voices                 0  \n",
       "196                                  The_Water_Diviner                 0  \n",
       "197            The_White_Haired_Witch_of_Lunar_Kingdom                 1  \n",
       "198                            The_Wolf_of_Wall_Street                 1  \n",
       "199                                    Thelma___Louise                 0  \n",
       "200                                There_Will_Be_Blood                 0  \n",
       "201                               Thor__The_Dark_World                 0  \n",
       "202                                            Titanic                 0  \n",
       "203                                          Tommy_Boy                 1  \n",
       "204                                      Trainspotting                 0  \n",
       "205                                              Trash                 1  \n",
       "206                                           Unbroken                 0  \n",
       "207                                           Valkyrie                 0  \n",
       "208                                  Verliefd_op_Ibiza                 0  \n",
       "209                                      Walk_the_Line                 1  \n",
       "210                                            Warrior                 0  \n",
       "211                                     Wassup_Rockers                 0  \n",
       "212                                           Watchmen                 0  \n",
       "213                            Wet_Hot_American_Summer                 1  \n",
       "214                          What_We_Do_in_the_Shadows                 1  \n",
       "215                                           Whiplash                 0  \n",
       "216                            Who_Framed_Roger_Rabbit                 0  \n",
       "217                                    Wish_I_Was_Here                 1  \n",
       "218                         X-Men__Days_of_Future_Past                 0  \n",
       "219                                 X-Men__First_Class                 0  \n",
       "220                                              Yentl                 1  \n",
       "221                                 Yves_Saint_Laurent                 0  \n",
       "222                                         Zombieland                 0  \n",
       "\n",
       "[223 rows x 3 columns]"
      ]
     },
     "execution_count": 91,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_base_train = pd.read_csv(test_entries_path)\n",
    "df_base_train = df_base_train[df_base_train['file_name'] != '2_States'] # remove invalid entry\n",
    "\n",
    "#df_base_train.reset_index(inplace=True, drop=True)\n",
    "df_base_testtrain = pd.read_csv(testtrain_entries_path)\n",
    "#df_base_testtrain.sort_values(by='file_name', inplace=True)\n",
    "df_base_testtrain.reset_index(inplace=True, drop=True)\n",
    "\n",
    "df_base_train=pd.concat([df_base_train,df_base_testtrain])\n",
    "\n",
    "\n",
    "df_base_train.sort_values(by='file_name', inplace=True)\n",
    "df_base_train.reset_index(inplace=True, drop=True)\n",
    "df_targets_train = df_base_train['goodforairplanes'].astype(int)\n",
    "df_base_train\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Feature extractors\n",
    "As the dataset was built in a manner that would have been considered dirty already in 2002 a lot of feature extraction is done"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 165,
   "metadata": {},
   "outputs": [],
   "source": [
    "def get_audio_features(file_name, use_train=True):\n",
    "    \"\"\"\n",
    "        returns 1x14 dataframe, with averaged Mel-Frequency Cepstral Coefficients + file_name\n",
    "    \"\"\"\n",
    "    base_path = train_path if use_train else test_path\n",
    "    file_path = os.path.join(base_path, audio_folder, file_name + \".csv\")\n",
    "    if not os.path.isfile(file_path):\n",
    "        print(file_name, \" does not exist!\")\n",
    "        return pd.DataFrame(columns=[str(x) for x in range(13)] + ['file_name'])\n",
    "    df_audio = pd.read_csv(file_path, header=None).T # transpose (columns are rows)\n",
    "    df_audio = df_audio.fillna(0) # nan values are treated as 0\n",
    "    df_audio = pd.DataFrame(df_audio.mean(axis=0)).T # average accross columns\n",
    "    df_audio['file_name'] = file_name\n",
    "    return df_audio\n",
    "\n",
    "def get_all_audio_features(df, use_train=True):\n",
    "    \"\"\"\n",
    "        returns nx14 dataframe, containing audio features for all movies\n",
    "    \"\"\"\n",
    "    dfs = []\n",
    "    for file_name in df['file_name']:\n",
    "        dfs.append(get_audio_features(file_name, use_train))\n",
    "    \n",
    "    return pd.concat(dfs).reset_index(drop=True)\n",
    "\n",
    "def get_all_text_features(df, use_train=True):\n",
    "    \"\"\"\n",
    "        returns nx3284 dataframe, containing tf-idf features for all movies\n",
    "        the dataset creators messed up - contains several terms multiple times\n",
    "        ordered alphabetically (?) - Live_Nude_Girls and Transformers__Age_of_Extinction where switched (detected perchance)\n",
    "    \"\"\"\n",
    "    base_path = train_path if use_train else test_path\n",
    "    file_path = os.path.join(base_path, text_folder, \"tdf_idf_test.csv\")\n",
    "    df_txt = pd.read_csv(file_path)\n",
    "    # the creators of the dataset missed how csv-files work - so we transpose and drop empty rows to get the correct format\n",
    "    cols = df_txt.columns \n",
    "    df_txt = df_txt.T.dropna()\n",
    "    df_txt.columns = cols\n",
    "    df_txt.reset_index(inplace=True, drop=True)\n",
    "    df_txt['file_name'] = sorted(df['file_name']) # we assume the info to be order alphabetically, as we do not have more info\n",
    "    return df_txt.reset_index(drop=True)\n",
    "\n",
    "\n",
    "def get_vis_features(file_name, use_train=True):\n",
    "    \"\"\"\n",
    "        returns 1x1653 dataframe, with unspecified visual features + file_name\n",
    "        we assume that every single value in the csv is one feature\n",
    "        this may be wrong, as there are two rows and no documentation (again)\n",
    "    \"\"\"\n",
    "    base_path = train_path if use_train else test_path\n",
    "    file_path = os.path.join(base_path, vis_folder, file_name + \".csv\")\n",
    "    if not os.path.isfile(file_path):\n",
    "        print(file_name, \" does not exist!\")\n",
    "        return pd.DataFrame(columns=[str(x) for x in range(1652)] + ['file_name'])\n",
    "    df_vis = pd.read_csv(file_path, header=None)\n",
    "    df_vis = pd.DataFrame(pd.concat([df_vis.loc[0,:], df_vis.loc[1,:]])).reset_index(drop=True).T # treat each value as single feature (-> no aggregation)\n",
    "    df_vis['file_name'] = file_name\n",
    "    return df_vis\n",
    "\n",
    "def get_all_vis_features(df, use_train=True):\n",
    "    \"\"\"\n",
    "        returns nx1653 dataframe, containing visual features for all movies\n",
    "    \"\"\"\n",
    "    dfs = []\n",
    "    for file_name in df['file_name']:\n",
    "        dfs.append(get_vis_features(file_name, use_train))\n",
    "    \n",
    "    return pd.concat(dfs).reset_index(drop=True)\n",
    "\n",
    "def get_meta_features(file_name, use_train=True):\n",
    "    \"\"\"\n",
    "        returns 1x7 dataframe, with metadata features + file_name\n",
    "        One Hot Encoding is not applied here, this should happen later\n",
    "    \"\"\"\n",
    "    base_path = train_path if use_train else test_path\n",
    "    file_path = os.path.join(base_path, metadata_folder, file_name + \".xml\")\n",
    "    if not os.path.isfile(file_path):\n",
    "        print(file_name, \" does not exist!\")\n",
    "        return pd.DataFrame(columns=['country', 'genre', 'language', 'rated', 'runtime', 'year', 'file_name'])\n",
    "    etree = ET.parse(file_path)\n",
    "    movie = etree.getroot().find('movie')\n",
    "    mv = {}\n",
    "    mv['language'] = [movie.get('language')]\n",
    "    mv['year'] = [int(movie.get('year'))]\n",
    "    mv['genre'] = [movie.get('genre')]\n",
    "    mv['country'] = [movie.get('country')]\n",
    "    mv['runtime'] = [0 if movie.get('runtime')=='N/A'  else int(movie.get('runtime')[:-4])]\n",
    "    mv['rated'] = [movie.get('rated')]\n",
    "    \n",
    "    df_meta = pd.DataFrame.from_dict(mv)\n",
    "    df_meta['file_name'] = file_name\n",
    "    \n",
    "    return df_meta\n",
    "\n",
    "def get_meta_features_withrating(file_name, use_train=True):\n",
    "    \"\"\"\n",
    "        returns 1x7 dataframe, with metadata features + file_name\n",
    "        One Hot Encoding is not applied here, this should happen later\n",
    "    \"\"\"\n",
    "    base_path = train_path if use_train else test_path\n",
    "    file_path = os.path.join(base_path, metadata_folder, file_name + \".xml\")\n",
    "    if not os.path.isfile(file_path):\n",
    "        print(file_name, \" does not exist!\")\n",
    "        return pd.DataFrame(columns=['country', 'genre', 'language', 'rated', 'runtime', 'year', 'tomatoUserRating','imdbRating','file_name'])\n",
    "    etree = ET.parse(file_path)\n",
    "    movie = etree.getroot().find('movie')\n",
    "    mv = {}\n",
    "    mv['language'] = [movie.get('language')]\n",
    "    mv['year'] = [int(movie.get('year'))]\n",
    "    mv['genre'] = [movie.get('genre')]\n",
    "    mv['country'] = [movie.get('country')]\n",
    "    mv['runtime'] = [int(movie.get('runtime')[:-4])]\n",
    "    mv['rated'] = [movie.get('rated')]\n",
    "    mv['tomatoUserRating']=  [\"NaN\" if movie.get('tomatoUserRating')=='N/A'  else movie.get('tomatoUserRating')]\n",
    "    mv['imdbRating']= [float(movie.get('imdbRating'))]\n",
    "    df_meta = pd.DataFrame.from_dict(mv)\n",
    "    df_meta['file_name'] = file_name\n",
    "    \n",
    "    return df_meta\n",
    "\n",
    "\n",
    "def get_all_meta_features(df, use_train=True):\n",
    "    \"\"\"\n",
    "        returns nx7 dataframe, containing metadata features for all movies\n",
    "    \"\"\"\n",
    "    dfs = []\n",
    "    for file_name in df['file_name']:\n",
    "        dfs.append(get_meta_features(file_name, use_train))\n",
    "    \n",
    "    df_meta = pd.concat(dfs)\n",
    "    \n",
    "    df_country = df_meta.country.str.replace(' ','').str.get_dummies(sep=',')\n",
    "    df_country.columns = ['country_' + x for x in df_country.columns]\n",
    "\n",
    "    df_genre = df_meta.genre.str.replace(' ','').str.get_dummies(sep=',')\n",
    "    df_genre.columns = ['genre_' + x for x in df_genre.columns]\n",
    "\n",
    "    df_language = df_meta.language.str.replace(' ','').str.get_dummies(sep=',')\n",
    "    df_language.columns = ['language_' + x for x in df_language.columns]\n",
    "\n",
    "    df_rated = df_meta.rated.str.get_dummies(sep=',')\n",
    "    df_rated.columns = ['rated_' + x for x in df_rated.columns]\n",
    "    \n",
    "    return pd.concat([df_country, df_genre, df_language, df_rated, df_meta[['runtime', 'year', 'file_name']]], axis=1).reset_index(drop=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 179,
   "metadata": {},
   "outputs": [
    {
     "ename": "ValueError",
     "evalue": "Length of values does not match length of index",
     "output_type": "error",
     "traceback": [
      "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[1;31mValueError\u001b[0m                                Traceback (most recent call last)",
      "\u001b[1;32m<ipython-input-179-98f0aa34c64d>\u001b[0m in \u001b[0;36m<module>\u001b[1;34m\u001b[0m\n\u001b[1;32m----> 1\u001b[1;33m \u001b[0mdf_txt_train\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mget_all_text_features\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mdf_base_train\u001b[0m\u001b[1;33m,\u001b[0m\u001b[0muse_train\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mFalse\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m      2\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      3\u001b[0m \u001b[0mdf_txt_train\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mdf_txt_train\u001b[0m\u001b[1;33m[\u001b[0m\u001b[0mdf_txt_train\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'file_name'\u001b[0m\u001b[1;33m]\u001b[0m \u001b[1;33m!=\u001b[0m \u001b[1;34m'A_Fish_Called_Wanda'\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      4\u001b[0m \u001b[0mdf_txt_train\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mdf_txt_train\u001b[0m\u001b[1;33m[\u001b[0m\u001b[0mdf_txt_train\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'file_name'\u001b[0m\u001b[1;33m]\u001b[0m \u001b[1;33m!=\u001b[0m \u001b[1;34m'Alexander_and_the_Terrible_Horrible_No_Good_Very_Bad_Day'\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      5\u001b[0m \u001b[0mdf_txt_train\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mdf_txt_train\u001b[0m\u001b[1;33m[\u001b[0m\u001b[0mdf_txt_train\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'file_name'\u001b[0m\u001b[1;33m]\u001b[0m \u001b[1;33m!=\u001b[0m \u001b[1;34m'Good_Morning_Vietnam'\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32m<ipython-input-165-85eee77d36b6>\u001b[0m in \u001b[0;36mget_all_text_features\u001b[1;34m(df, use_train)\u001b[0m\n\u001b[0;32m     38\u001b[0m     \u001b[0mdf_txt\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mcolumns\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mcols\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m     39\u001b[0m     \u001b[0mdf_txt\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mreset_index\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0minplace\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdrop\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m---> 40\u001b[1;33m     \u001b[0mdf_txt\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'file_name'\u001b[0m\u001b[1;33m]\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0msorted\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mdf\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'file_name'\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m)\u001b[0m \u001b[1;31m# we assume the info to be order alphabetically, as we do not have more info\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m     41\u001b[0m     \u001b[1;32mreturn\u001b[0m \u001b[0mdf_txt\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mreset_index\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mdrop\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m     42\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\Anaconda3\\lib\\site-packages\\pandas\\core\\frame.py\u001b[0m in \u001b[0;36m__setitem__\u001b[1;34m(self, key, value)\u001b[0m\n\u001b[0;32m   3117\u001b[0m         \u001b[1;32melse\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   3118\u001b[0m             \u001b[1;31m# set column\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 3119\u001b[1;33m             \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_set_item\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mvalue\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   3120\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   3121\u001b[0m     \u001b[1;32mdef\u001b[0m \u001b[0m_setitem_slice\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mkey\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mvalue\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\Anaconda3\\lib\\site-packages\\pandas\\core\\frame.py\u001b[0m in \u001b[0;36m_set_item\u001b[1;34m(self, key, value)\u001b[0m\n\u001b[0;32m   3192\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   3193\u001b[0m         \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_ensure_valid_index\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mvalue\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 3194\u001b[1;33m         \u001b[0mvalue\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_sanitize_column\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mvalue\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   3195\u001b[0m         \u001b[0mNDFrame\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_set_item\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mkey\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mvalue\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   3196\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\Anaconda3\\lib\\site-packages\\pandas\\core\\frame.py\u001b[0m in \u001b[0;36m_sanitize_column\u001b[1;34m(self, key, value, broadcast)\u001b[0m\n\u001b[0;32m   3389\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   3390\u001b[0m             \u001b[1;31m# turn me into an ndarray\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 3391\u001b[1;33m             \u001b[0mvalue\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0m_sanitize_index\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mvalue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mindex\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mcopy\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mFalse\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   3392\u001b[0m             \u001b[1;32mif\u001b[0m \u001b[1;32mnot\u001b[0m \u001b[0misinstance\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mvalue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[1;33m(\u001b[0m\u001b[0mnp\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mndarray\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mIndex\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   3393\u001b[0m                 \u001b[1;32mif\u001b[0m \u001b[0misinstance\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mvalue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mlist\u001b[0m\u001b[1;33m)\u001b[0m \u001b[1;32mand\u001b[0m \u001b[0mlen\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mvalue\u001b[0m\u001b[1;33m)\u001b[0m \u001b[1;33m>\u001b[0m \u001b[1;36m0\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\Anaconda3\\lib\\site-packages\\pandas\\core\\series.py\u001b[0m in \u001b[0;36m_sanitize_index\u001b[1;34m(data, index, copy)\u001b[0m\n\u001b[0;32m   3999\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   4000\u001b[0m     \u001b[1;32mif\u001b[0m \u001b[0mlen\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mdata\u001b[0m\u001b[1;33m)\u001b[0m \u001b[1;33m!=\u001b[0m \u001b[0mlen\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mindex\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 4001\u001b[1;33m         \u001b[1;32mraise\u001b[0m \u001b[0mValueError\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;34m'Length of values does not match length of '\u001b[0m \u001b[1;34m'index'\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   4002\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   4003\u001b[0m     \u001b[1;32mif\u001b[0m \u001b[0misinstance\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mdata\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mABCIndexClass\u001b[0m\u001b[1;33m)\u001b[0m \u001b[1;32mand\u001b[0m \u001b[1;32mnot\u001b[0m \u001b[0mcopy\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;31mValueError\u001b[0m: Length of values does not match length of index"
     ]
    }
   ],
   "source": [
    "df_txt_train = get_all_text_features(df_base_train,use_train=False)\n",
    "\n",
    "df_txt_train = df_txt_train[df_txt_train['file_name'] != 'A_Fish_Called_Wanda']\n",
    "df_txt_train = df_txt_train[df_txt_train['file_name'] != 'Alexander_and_the_Terrible_Horrible_No_Good_Very_Bad_Day']\n",
    "df_txt_train = df_txt_train[df_txt_train['file_name'] != 'Good_Morning_Vietnam']\n",
    "df_txt_train = df_txt_train[df_txt_train['file_name'] != 'Love_Rosie']\n",
    "df_txt_train = df_txt_train[df_txt_train['file_name'] != 'The_Good_the_Bad_and_the_Ugly']\n",
    "df_txt_train.reset_index(inplace=True, drop=True)\n",
    "\n",
    "df_base_train = df_base_train[df_base_train['file_name'] != 'A_Fish_Called_Wanda']\n",
    "df_base_train = df_base_train[df_base_train['file_name'] != 'Alexander_and_the_Terrible_Horrible_No_Good_Very_Bad_Day']\n",
    "df_base_train = df_base_train[df_base_train['file_name'] != 'Good_Morning_Vietnam']\n",
    "df_base_train = df_base_train[df_base_train['file_name'] != 'Love_Rosie']\n",
    "df_base_train = df_base_train[df_base_train['file_name'] != 'The_Good_the_Bad_and_the_Ugly']\n",
    "df_base_train.reset_index(inplace=True, drop=True)\n",
    "df_targets_train = df_base_train['goodforairplanes'].astype(int)\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>10</th>\n",
       "      <th>11</th>\n",
       "      <th>12</th>\n",
       "      <th>file_name</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>-2.526758</td>\n",
       "      <td>-4.041369</td>\n",
       "      <td>1.993339</td>\n",
       "      <td>0.186229</td>\n",
       "      <td>0.439292</td>\n",
       "      <td>-1.073407</td>\n",
       "      <td>-1.204877</td>\n",
       "      <td>-0.040134</td>\n",
       "      <td>0.180450</td>\n",
       "      <td>-2.916251</td>\n",
       "      <td>-0.829277</td>\n",
       "      <td>-0.455054</td>\n",
       "      <td>0.208318</td>\n",
       "      <td>10.000_Km</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>65.069285</td>\n",
       "      <td>-2.643378</td>\n",
       "      <td>0.614012</td>\n",
       "      <td>-0.269641</td>\n",
       "      <td>-0.290764</td>\n",
       "      <td>0.306304</td>\n",
       "      <td>-0.611462</td>\n",
       "      <td>-0.173489</td>\n",
       "      <td>0.961753</td>\n",
       "      <td>-1.172046</td>\n",
       "      <td>-0.519489</td>\n",
       "      <td>-1.271658</td>\n",
       "      <td>-0.179605</td>\n",
       "      <td>12_Years_a_Slave</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>65.721634</td>\n",
       "      <td>-4.928884</td>\n",
       "      <td>0.814478</td>\n",
       "      <td>-0.145326</td>\n",
       "      <td>0.265794</td>\n",
       "      <td>-0.428410</td>\n",
       "      <td>0.121390</td>\n",
       "      <td>-0.313247</td>\n",
       "      <td>0.381455</td>\n",
       "      <td>-0.924582</td>\n",
       "      <td>0.192938</td>\n",
       "      <td>-0.167529</td>\n",
       "      <td>-0.026522</td>\n",
       "      <td>21_Jump_Street</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>60.218722</td>\n",
       "      <td>-7.358705</td>\n",
       "      <td>-0.310818</td>\n",
       "      <td>-1.095195</td>\n",
       "      <td>-0.596027</td>\n",
       "      <td>-0.824320</td>\n",
       "      <td>0.196180</td>\n",
       "      <td>-0.086074</td>\n",
       "      <td>0.384909</td>\n",
       "      <td>-0.763167</td>\n",
       "      <td>-1.051928</td>\n",
       "      <td>-1.290511</td>\n",
       "      <td>-1.151264</td>\n",
       "      <td>A_Bug's_Life</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>64.730372</td>\n",
       "      <td>-2.603121</td>\n",
       "      <td>0.734011</td>\n",
       "      <td>1.156563</td>\n",
       "      <td>-0.798081</td>\n",
       "      <td>-0.453259</td>\n",
       "      <td>-1.149437</td>\n",
       "      <td>0.286334</td>\n",
       "      <td>-1.379145</td>\n",
       "      <td>-0.181773</td>\n",
       "      <td>-1.572061</td>\n",
       "      <td>-1.267311</td>\n",
       "      <td>-0.090285</td>\n",
       "      <td>A_Little_Chaos</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>60.658010</td>\n",
       "      <td>-2.266060</td>\n",
       "      <td>1.657855</td>\n",
       "      <td>1.028910</td>\n",
       "      <td>0.607900</td>\n",
       "      <td>1.251477</td>\n",
       "      <td>-0.105159</td>\n",
       "      <td>-0.173230</td>\n",
       "      <td>-0.261850</td>\n",
       "      <td>-0.321715</td>\n",
       "      <td>0.321455</td>\n",
       "      <td>0.058193</td>\n",
       "      <td>-0.246221</td>\n",
       "      <td>A_Most_Wanted_Man</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>67.085961</td>\n",
       "      <td>1.781262</td>\n",
       "      <td>0.305900</td>\n",
       "      <td>0.746188</td>\n",
       "      <td>-0.257237</td>\n",
       "      <td>-0.200025</td>\n",
       "      <td>0.370250</td>\n",
       "      <td>-0.345818</td>\n",
       "      <td>-2.137183</td>\n",
       "      <td>-1.707853</td>\n",
       "      <td>0.097651</td>\n",
       "      <td>-1.478550</td>\n",
       "      <td>-1.164362</td>\n",
       "      <td>A_Simple_Life</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>65.985640</td>\n",
       "      <td>-2.875637</td>\n",
       "      <td>0.472032</td>\n",
       "      <td>-1.601717</td>\n",
       "      <td>2.256657</td>\n",
       "      <td>0.956259</td>\n",
       "      <td>0.950898</td>\n",
       "      <td>0.492875</td>\n",
       "      <td>0.547208</td>\n",
       "      <td>0.012388</td>\n",
       "      <td>0.721714</td>\n",
       "      <td>-1.461903</td>\n",
       "      <td>1.804050</td>\n",
       "      <td>Aanmodderfakker</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>66.469278</td>\n",
       "      <td>-3.822306</td>\n",
       "      <td>0.180833</td>\n",
       "      <td>-0.654696</td>\n",
       "      <td>-0.329590</td>\n",
       "      <td>-0.805191</td>\n",
       "      <td>-1.568045</td>\n",
       "      <td>-1.727193</td>\n",
       "      <td>-0.556033</td>\n",
       "      <td>-0.790086</td>\n",
       "      <td>0.822247</td>\n",
       "      <td>0.794421</td>\n",
       "      <td>0.353131</td>\n",
       "      <td>Alexander</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>62.779312</td>\n",
       "      <td>-5.516617</td>\n",
       "      <td>-0.241958</td>\n",
       "      <td>-1.305328</td>\n",
       "      <td>-0.184150</td>\n",
       "      <td>0.587740</td>\n",
       "      <td>-0.029263</td>\n",
       "      <td>0.106667</td>\n",
       "      <td>-0.041566</td>\n",
       "      <td>0.198214</td>\n",
       "      <td>-0.302957</td>\n",
       "      <td>0.667275</td>\n",
       "      <td>0.894902</td>\n",
       "      <td>Alice_in_Wonderland</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>60.799455</td>\n",
       "      <td>-0.662386</td>\n",
       "      <td>-1.633315</td>\n",
       "      <td>0.097911</td>\n",
       "      <td>-0.294735</td>\n",
       "      <td>-0.404839</td>\n",
       "      <td>-0.093575</td>\n",
       "      <td>-1.302294</td>\n",
       "      <td>-0.963811</td>\n",
       "      <td>-0.792142</td>\n",
       "      <td>-1.125511</td>\n",
       "      <td>-1.179247</td>\n",
       "      <td>-0.599368</td>\n",
       "      <td>American_Sniper</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>66.932388</td>\n",
       "      <td>-4.411218</td>\n",
       "      <td>-0.131530</td>\n",
       "      <td>-1.150421</td>\n",
       "      <td>0.277227</td>\n",
       "      <td>0.278146</td>\n",
       "      <td>-0.009089</td>\n",
       "      <td>-0.106300</td>\n",
       "      <td>0.273896</td>\n",
       "      <td>-0.169695</td>\n",
       "      <td>0.030711</td>\n",
       "      <td>-0.263055</td>\n",
       "      <td>0.386448</td>\n",
       "      <td>Anastasia</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>62.546272</td>\n",
       "      <td>-4.431310</td>\n",
       "      <td>0.305822</td>\n",
       "      <td>0.739121</td>\n",
       "      <td>-0.120685</td>\n",
       "      <td>0.235183</td>\n",
       "      <td>-0.245644</td>\n",
       "      <td>0.044114</td>\n",
       "      <td>0.109714</td>\n",
       "      <td>-0.504728</td>\n",
       "      <td>0.496991</td>\n",
       "      <td>-0.949683</td>\n",
       "      <td>0.082011</td>\n",
       "      <td>And_So_It_Goes</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>4.353247</td>\n",
       "      <td>-5.740150</td>\n",
       "      <td>-0.680029</td>\n",
       "      <td>-0.365659</td>\n",
       "      <td>0.754221</td>\n",
       "      <td>-0.136739</td>\n",
       "      <td>0.142539</td>\n",
       "      <td>0.163932</td>\n",
       "      <td>-0.043930</td>\n",
       "      <td>-0.187867</td>\n",
       "      <td>0.411240</td>\n",
       "      <td>-0.468032</td>\n",
       "      <td>-0.025394</td>\n",
       "      <td>Antz</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>64.914344</td>\n",
       "      <td>-4.607564</td>\n",
       "      <td>0.866000</td>\n",
       "      <td>0.519994</td>\n",
       "      <td>0.231213</td>\n",
       "      <td>-0.490675</td>\n",
       "      <td>-0.244872</td>\n",
       "      <td>-0.699138</td>\n",
       "      <td>0.783867</td>\n",
       "      <td>-0.463542</td>\n",
       "      <td>-0.337444</td>\n",
       "      <td>-0.564925</td>\n",
       "      <td>0.399956</td>\n",
       "      <td>Avatar</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>63.247656</td>\n",
       "      <td>-5.784616</td>\n",
       "      <td>-0.415322</td>\n",
       "      <td>-1.442116</td>\n",
       "      <td>-0.705312</td>\n",
       "      <td>-0.579245</td>\n",
       "      <td>-1.076865</td>\n",
       "      <td>-1.462926</td>\n",
       "      <td>-0.121808</td>\n",
       "      <td>-1.019984</td>\n",
       "      <td>0.100998</td>\n",
       "      <td>-0.611633</td>\n",
       "      <td>-0.290393</td>\n",
       "      <td>Bad_News_Bears</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>1.235957</td>\n",
       "      <td>-3.927059</td>\n",
       "      <td>-1.525705</td>\n",
       "      <td>0.104882</td>\n",
       "      <td>0.154692</td>\n",
       "      <td>-0.333045</td>\n",
       "      <td>-1.531798</td>\n",
       "      <td>0.801804</td>\n",
       "      <td>1.010630</td>\n",
       "      <td>0.666461</td>\n",
       "      <td>-0.290212</td>\n",
       "      <td>-0.276354</td>\n",
       "      <td>0.844872</td>\n",
       "      <td>Banklady</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>69.356517</td>\n",
       "      <td>-6.664503</td>\n",
       "      <td>1.357936</td>\n",
       "      <td>-1.283372</td>\n",
       "      <td>1.738132</td>\n",
       "      <td>0.542746</td>\n",
       "      <td>-0.823760</td>\n",
       "      <td>-0.004039</td>\n",
       "      <td>0.055227</td>\n",
       "      <td>0.446140</td>\n",
       "      <td>-0.125184</td>\n",
       "      <td>-0.306798</td>\n",
       "      <td>0.528909</td>\n",
       "      <td>Beetlejuice</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>63.540171</td>\n",
       "      <td>-4.444205</td>\n",
       "      <td>-0.973474</td>\n",
       "      <td>-1.112058</td>\n",
       "      <td>-0.870865</td>\n",
       "      <td>-0.913776</td>\n",
       "      <td>-0.434824</td>\n",
       "      <td>-1.095242</td>\n",
       "      <td>-0.418789</td>\n",
       "      <td>-1.246752</td>\n",
       "      <td>-0.599711</td>\n",
       "      <td>-0.311434</td>\n",
       "      <td>1.737507</td>\n",
       "      <td>Begin_Again</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>57.690224</td>\n",
       "      <td>-8.103223</td>\n",
       "      <td>0.651748</td>\n",
       "      <td>-2.379234</td>\n",
       "      <td>-0.154854</td>\n",
       "      <td>-1.828355</td>\n",
       "      <td>0.228078</td>\n",
       "      <td>-0.999688</td>\n",
       "      <td>-0.425112</td>\n",
       "      <td>-0.773685</td>\n",
       "      <td>-0.035393</td>\n",
       "      <td>-0.525491</td>\n",
       "      <td>0.163840</td>\n",
       "      <td>Belle_de_Jour</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>70.183975</td>\n",
       "      <td>-4.797058</td>\n",
       "      <td>-0.604536</td>\n",
       "      <td>0.773867</td>\n",
       "      <td>-0.381193</td>\n",
       "      <td>-0.636714</td>\n",
       "      <td>-0.932308</td>\n",
       "      <td>-0.095296</td>\n",
       "      <td>-0.733545</td>\n",
       "      <td>-0.450018</td>\n",
       "      <td>-0.387670</td>\n",
       "      <td>-1.025458</td>\n",
       "      <td>0.530404</td>\n",
       "      <td>Bewakoofiyaan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>63.677679</td>\n",
       "      <td>-1.344287</td>\n",
       "      <td>0.646610</td>\n",
       "      <td>-0.932991</td>\n",
       "      <td>0.517206</td>\n",
       "      <td>1.261401</td>\n",
       "      <td>0.373893</td>\n",
       "      <td>-0.515453</td>\n",
       "      <td>-0.367190</td>\n",
       "      <td>-0.529120</td>\n",
       "      <td>-0.342890</td>\n",
       "      <td>0.200841</td>\n",
       "      <td>0.606574</td>\n",
       "      <td>Bhoothnath</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>59.430683</td>\n",
       "      <td>-4.234552</td>\n",
       "      <td>0.231837</td>\n",
       "      <td>-0.824707</td>\n",
       "      <td>-1.133522</td>\n",
       "      <td>-1.028014</td>\n",
       "      <td>-0.289735</td>\n",
       "      <td>-0.424867</td>\n",
       "      <td>0.753868</td>\n",
       "      <td>-0.459766</td>\n",
       "      <td>0.269023</td>\n",
       "      <td>-1.028823</td>\n",
       "      <td>-0.279974</td>\n",
       "      <td>Big_Game</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>1.653598</td>\n",
       "      <td>-7.259786</td>\n",
       "      <td>0.398771</td>\n",
       "      <td>-1.059177</td>\n",
       "      <td>-0.064047</td>\n",
       "      <td>0.405019</td>\n",
       "      <td>-0.500505</td>\n",
       "      <td>0.931563</td>\n",
       "      <td>1.808189</td>\n",
       "      <td>-2.289274</td>\n",
       "      <td>0.378564</td>\n",
       "      <td>-0.009454</td>\n",
       "      <td>-1.190644</td>\n",
       "      <td>Billy_Elliot</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>65.951088</td>\n",
       "      <td>-3.109060</td>\n",
       "      <td>-0.160809</td>\n",
       "      <td>0.731511</td>\n",
       "      <td>0.064454</td>\n",
       "      <td>-0.848364</td>\n",
       "      <td>0.126554</td>\n",
       "      <td>-0.599923</td>\n",
       "      <td>0.339361</td>\n",
       "      <td>-1.256192</td>\n",
       "      <td>0.124059</td>\n",
       "      <td>-0.569407</td>\n",
       "      <td>0.019782</td>\n",
       "      <td>Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>61.614508</td>\n",
       "      <td>-4.801353</td>\n",
       "      <td>-0.878212</td>\n",
       "      <td>-0.875922</td>\n",
       "      <td>-1.059308</td>\n",
       "      <td>-1.418208</td>\n",
       "      <td>-0.306124</td>\n",
       "      <td>-1.493840</td>\n",
       "      <td>-0.930916</td>\n",
       "      <td>-1.288355</td>\n",
       "      <td>0.678025</td>\n",
       "      <td>0.386360</td>\n",
       "      <td>0.153531</td>\n",
       "      <td>Blended</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>67.555194</td>\n",
       "      <td>-4.096890</td>\n",
       "      <td>-0.928682</td>\n",
       "      <td>-0.006808</td>\n",
       "      <td>-0.548435</td>\n",
       "      <td>0.317124</td>\n",
       "      <td>1.389815</td>\n",
       "      <td>0.758213</td>\n",
       "      <td>2.272988</td>\n",
       "      <td>1.168899</td>\n",
       "      <td>0.330289</td>\n",
       "      <td>0.336959</td>\n",
       "      <td>-1.454317</td>\n",
       "      <td>Blow_Out</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>64.766022</td>\n",
       "      <td>-1.658432</td>\n",
       "      <td>1.283690</td>\n",
       "      <td>1.881826</td>\n",
       "      <td>0.974925</td>\n",
       "      <td>0.419500</td>\n",
       "      <td>-1.265323</td>\n",
       "      <td>0.431151</td>\n",
       "      <td>1.622440</td>\n",
       "      <td>2.015594</td>\n",
       "      <td>-0.304145</td>\n",
       "      <td>0.030298</td>\n",
       "      <td>0.733001</td>\n",
       "      <td>Bride_Flight</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>4.039247</td>\n",
       "      <td>-1.076041</td>\n",
       "      <td>-0.651398</td>\n",
       "      <td>-0.345512</td>\n",
       "      <td>-1.855686</td>\n",
       "      <td>-2.221668</td>\n",
       "      <td>-1.643940</td>\n",
       "      <td>0.985800</td>\n",
       "      <td>-0.969197</td>\n",
       "      <td>0.281265</td>\n",
       "      <td>-0.142620</td>\n",
       "      <td>0.948808</td>\n",
       "      <td>-0.289194</td>\n",
       "      <td>Bridges_of_Sarajevo</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>63.328124</td>\n",
       "      <td>-5.348965</td>\n",
       "      <td>-0.931210</td>\n",
       "      <td>-1.923488</td>\n",
       "      <td>-0.404019</td>\n",
       "      <td>-1.760123</td>\n",
       "      <td>0.793195</td>\n",
       "      <td>-0.752133</td>\n",
       "      <td>-1.332891</td>\n",
       "      <td>-0.447351</td>\n",
       "      <td>-0.828482</td>\n",
       "      <td>0.399213</td>\n",
       "      <td>-0.369465</td>\n",
       "      <td>Burlesque</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>188</th>\n",
       "      <td>62.546066</td>\n",
       "      <td>-0.535224</td>\n",
       "      <td>0.398454</td>\n",
       "      <td>0.495747</td>\n",
       "      <td>0.698858</td>\n",
       "      <td>-0.647333</td>\n",
       "      <td>-0.318680</td>\n",
       "      <td>-0.890591</td>\n",
       "      <td>-0.687026</td>\n",
       "      <td>-1.304344</td>\n",
       "      <td>-0.606383</td>\n",
       "      <td>-1.559487</td>\n",
       "      <td>0.852263</td>\n",
       "      <td>The_Talented_Mr._Ripley</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>189</th>\n",
       "      <td>68.450024</td>\n",
       "      <td>-4.337801</td>\n",
       "      <td>-0.038506</td>\n",
       "      <td>-1.440840</td>\n",
       "      <td>-0.169587</td>\n",
       "      <td>-1.297177</td>\n",
       "      <td>-2.710199</td>\n",
       "      <td>-0.471302</td>\n",
       "      <td>0.925725</td>\n",
       "      <td>-0.411755</td>\n",
       "      <td>0.231597</td>\n",
       "      <td>-1.582602</td>\n",
       "      <td>-1.966300</td>\n",
       "      <td>The_Trip_to_Italy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>190</th>\n",
       "      <td>58.668567</td>\n",
       "      <td>-3.015846</td>\n",
       "      <td>0.337451</td>\n",
       "      <td>1.273479</td>\n",
       "      <td>0.718874</td>\n",
       "      <td>-1.352611</td>\n",
       "      <td>-0.603458</td>\n",
       "      <td>0.028086</td>\n",
       "      <td>0.452069</td>\n",
       "      <td>-1.038480</td>\n",
       "      <td>0.254052</td>\n",
       "      <td>-0.269128</td>\n",
       "      <td>-0.256780</td>\n",
       "      <td>The_Voices</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>191</th>\n",
       "      <td>63.412375</td>\n",
       "      <td>-0.975941</td>\n",
       "      <td>0.535475</td>\n",
       "      <td>-1.009827</td>\n",
       "      <td>-1.032184</td>\n",
       "      <td>-1.640965</td>\n",
       "      <td>-1.313181</td>\n",
       "      <td>-1.021741</td>\n",
       "      <td>0.419164</td>\n",
       "      <td>0.344653</td>\n",
       "      <td>0.972602</td>\n",
       "      <td>0.814311</td>\n",
       "      <td>0.655868</td>\n",
       "      <td>The_Water_Diviner</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>192</th>\n",
       "      <td>67.964552</td>\n",
       "      <td>-4.183669</td>\n",
       "      <td>0.438747</td>\n",
       "      <td>-1.903738</td>\n",
       "      <td>0.685046</td>\n",
       "      <td>0.923594</td>\n",
       "      <td>0.848129</td>\n",
       "      <td>-1.254255</td>\n",
       "      <td>-0.057255</td>\n",
       "      <td>-0.405060</td>\n",
       "      <td>-0.225751</td>\n",
       "      <td>0.037156</td>\n",
       "      <td>-0.639873</td>\n",
       "      <td>The_White_Haired_Witch_of_Lunar_Kingdom</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>60.907936</td>\n",
       "      <td>-5.592318</td>\n",
       "      <td>0.539552</td>\n",
       "      <td>-1.115131</td>\n",
       "      <td>-0.056683</td>\n",
       "      <td>-0.466904</td>\n",
       "      <td>-0.159973</td>\n",
       "      <td>0.003431</td>\n",
       "      <td>0.702777</td>\n",
       "      <td>0.139241</td>\n",
       "      <td>0.635809</td>\n",
       "      <td>-0.550585</td>\n",
       "      <td>-0.473238</td>\n",
       "      <td>The_Wolf_of_Wall_Street</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>194</th>\n",
       "      <td>6.646471</td>\n",
       "      <td>-7.386393</td>\n",
       "      <td>0.139800</td>\n",
       "      <td>-1.655487</td>\n",
       "      <td>0.033531</td>\n",
       "      <td>-0.262377</td>\n",
       "      <td>-0.682926</td>\n",
       "      <td>1.393152</td>\n",
       "      <td>0.173529</td>\n",
       "      <td>-2.680552</td>\n",
       "      <td>0.892051</td>\n",
       "      <td>0.246102</td>\n",
       "      <td>0.419439</td>\n",
       "      <td>Thelma___Louise</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>195</th>\n",
       "      <td>1.528570</td>\n",
       "      <td>-3.875501</td>\n",
       "      <td>2.043072</td>\n",
       "      <td>-0.736872</td>\n",
       "      <td>0.621951</td>\n",
       "      <td>-0.413168</td>\n",
       "      <td>-0.278974</td>\n",
       "      <td>-1.889314</td>\n",
       "      <td>-1.042588</td>\n",
       "      <td>-2.610210</td>\n",
       "      <td>0.550404</td>\n",
       "      <td>-0.698804</td>\n",
       "      <td>-0.409648</td>\n",
       "      <td>There_Will_Be_Blood</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>196</th>\n",
       "      <td>66.922937</td>\n",
       "      <td>-5.824156</td>\n",
       "      <td>0.522241</td>\n",
       "      <td>-0.474348</td>\n",
       "      <td>0.202372</td>\n",
       "      <td>-0.115749</td>\n",
       "      <td>-0.052676</td>\n",
       "      <td>-0.118774</td>\n",
       "      <td>0.222147</td>\n",
       "      <td>-0.129649</td>\n",
       "      <td>-0.008700</td>\n",
       "      <td>0.368996</td>\n",
       "      <td>0.125681</td>\n",
       "      <td>Thor__The_Dark_World</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>197</th>\n",
       "      <td>62.078033</td>\n",
       "      <td>-1.854257</td>\n",
       "      <td>-0.240834</td>\n",
       "      <td>-1.753175</td>\n",
       "      <td>-0.364458</td>\n",
       "      <td>0.390055</td>\n",
       "      <td>-1.616275</td>\n",
       "      <td>-3.071639</td>\n",
       "      <td>-0.236372</td>\n",
       "      <td>1.100317</td>\n",
       "      <td>-1.072721</td>\n",
       "      <td>1.509009</td>\n",
       "      <td>-0.859411</td>\n",
       "      <td>Titanic</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>61.489602</td>\n",
       "      <td>-5.385404</td>\n",
       "      <td>0.324601</td>\n",
       "      <td>-1.347758</td>\n",
       "      <td>-1.709938</td>\n",
       "      <td>-1.517166</td>\n",
       "      <td>0.177519</td>\n",
       "      <td>0.109133</td>\n",
       "      <td>-0.045923</td>\n",
       "      <td>-1.393425</td>\n",
       "      <td>-0.451694</td>\n",
       "      <td>-0.981295</td>\n",
       "      <td>0.068757</td>\n",
       "      <td>Tommy_Boy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>65.042952</td>\n",
       "      <td>-5.680611</td>\n",
       "      <td>0.460374</td>\n",
       "      <td>-0.370140</td>\n",
       "      <td>-0.304695</td>\n",
       "      <td>0.104790</td>\n",
       "      <td>-1.082162</td>\n",
       "      <td>0.493590</td>\n",
       "      <td>0.785276</td>\n",
       "      <td>-1.305781</td>\n",
       "      <td>0.848198</td>\n",
       "      <td>-0.773040</td>\n",
       "      <td>0.252448</td>\n",
       "      <td>Trainspotting</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>59.511905</td>\n",
       "      <td>-4.309526</td>\n",
       "      <td>-0.728330</td>\n",
       "      <td>-2.602980</td>\n",
       "      <td>0.150200</td>\n",
       "      <td>-0.210795</td>\n",
       "      <td>-0.315625</td>\n",
       "      <td>0.037404</td>\n",
       "      <td>-0.298176</td>\n",
       "      <td>0.943956</td>\n",
       "      <td>0.579414</td>\n",
       "      <td>0.388942</td>\n",
       "      <td>-0.008194</td>\n",
       "      <td>Trash</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>201</th>\n",
       "      <td>63.559539</td>\n",
       "      <td>-3.565613</td>\n",
       "      <td>0.831247</td>\n",
       "      <td>-0.274866</td>\n",
       "      <td>-0.425399</td>\n",
       "      <td>-1.748246</td>\n",
       "      <td>0.500452</td>\n",
       "      <td>-0.283688</td>\n",
       "      <td>0.974784</td>\n",
       "      <td>0.521954</td>\n",
       "      <td>0.443222</td>\n",
       "      <td>-0.411838</td>\n",
       "      <td>0.259322</td>\n",
       "      <td>Unbroken</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>202</th>\n",
       "      <td>68.279066</td>\n",
       "      <td>-4.390411</td>\n",
       "      <td>1.178664</td>\n",
       "      <td>0.743035</td>\n",
       "      <td>0.159671</td>\n",
       "      <td>-0.111799</td>\n",
       "      <td>0.614183</td>\n",
       "      <td>-0.679050</td>\n",
       "      <td>0.823877</td>\n",
       "      <td>-1.201035</td>\n",
       "      <td>0.631561</td>\n",
       "      <td>-0.859654</td>\n",
       "      <td>-0.102381</td>\n",
       "      <td>Valkyrie</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>203</th>\n",
       "      <td>69.243301</td>\n",
       "      <td>-5.877979</td>\n",
       "      <td>0.673428</td>\n",
       "      <td>-1.697120</td>\n",
       "      <td>0.740326</td>\n",
       "      <td>0.125345</td>\n",
       "      <td>0.217559</td>\n",
       "      <td>-0.240339</td>\n",
       "      <td>-0.096364</td>\n",
       "      <td>-0.067281</td>\n",
       "      <td>-0.899868</td>\n",
       "      <td>-1.158325</td>\n",
       "      <td>-0.338628</td>\n",
       "      <td>Verliefd_op_Ibiza</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>204</th>\n",
       "      <td>63.813987</td>\n",
       "      <td>-4.067109</td>\n",
       "      <td>-0.484448</td>\n",
       "      <td>-1.212508</td>\n",
       "      <td>-0.499303</td>\n",
       "      <td>0.029433</td>\n",
       "      <td>-1.650626</td>\n",
       "      <td>-0.403020</td>\n",
       "      <td>-0.295284</td>\n",
       "      <td>-0.075770</td>\n",
       "      <td>0.869204</td>\n",
       "      <td>0.141045</td>\n",
       "      <td>-0.597827</td>\n",
       "      <td>Walk_the_Line</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>205</th>\n",
       "      <td>66.895057</td>\n",
       "      <td>-4.354692</td>\n",
       "      <td>-0.330156</td>\n",
       "      <td>-0.975275</td>\n",
       "      <td>-0.637346</td>\n",
       "      <td>-1.064908</td>\n",
       "      <td>-0.364699</td>\n",
       "      <td>0.087310</td>\n",
       "      <td>0.461851</td>\n",
       "      <td>0.094161</td>\n",
       "      <td>0.384287</td>\n",
       "      <td>1.239551</td>\n",
       "      <td>-0.070643</td>\n",
       "      <td>Warrior</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>206</th>\n",
       "      <td>-0.472871</td>\n",
       "      <td>-6.112898</td>\n",
       "      <td>0.974750</td>\n",
       "      <td>-0.241602</td>\n",
       "      <td>-0.724095</td>\n",
       "      <td>-1.403937</td>\n",
       "      <td>0.445222</td>\n",
       "      <td>-2.412163</td>\n",
       "      <td>-0.780196</td>\n",
       "      <td>0.829588</td>\n",
       "      <td>0.464152</td>\n",
       "      <td>-0.062364</td>\n",
       "      <td>0.044569</td>\n",
       "      <td>Wassup_Rockers</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>207</th>\n",
       "      <td>2.852496</td>\n",
       "      <td>-2.899815</td>\n",
       "      <td>0.500835</td>\n",
       "      <td>-1.304353</td>\n",
       "      <td>0.184263</td>\n",
       "      <td>0.067547</td>\n",
       "      <td>0.034258</td>\n",
       "      <td>0.641412</td>\n",
       "      <td>-0.247031</td>\n",
       "      <td>-0.088565</td>\n",
       "      <td>-0.110451</td>\n",
       "      <td>-1.353592</td>\n",
       "      <td>1.631554</td>\n",
       "      <td>Watchmen</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>67.943940</td>\n",
       "      <td>-5.703620</td>\n",
       "      <td>0.191065</td>\n",
       "      <td>0.344958</td>\n",
       "      <td>-1.836191</td>\n",
       "      <td>-0.467043</td>\n",
       "      <td>0.160743</td>\n",
       "      <td>0.456691</td>\n",
       "      <td>-0.210429</td>\n",
       "      <td>-0.974890</td>\n",
       "      <td>0.464000</td>\n",
       "      <td>-0.250216</td>\n",
       "      <td>-0.200747</td>\n",
       "      <td>Wet_Hot_American_Summer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>209</th>\n",
       "      <td>66.156327</td>\n",
       "      <td>-4.753366</td>\n",
       "      <td>0.570812</td>\n",
       "      <td>-0.297508</td>\n",
       "      <td>-0.031952</td>\n",
       "      <td>0.237761</td>\n",
       "      <td>-0.296249</td>\n",
       "      <td>0.741167</td>\n",
       "      <td>1.440949</td>\n",
       "      <td>-0.472363</td>\n",
       "      <td>0.219085</td>\n",
       "      <td>-1.170579</td>\n",
       "      <td>0.403457</td>\n",
       "      <td>What_We_Do_in_the_Shadows</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>210</th>\n",
       "      <td>58.629760</td>\n",
       "      <td>-1.751487</td>\n",
       "      <td>1.137864</td>\n",
       "      <td>-0.129651</td>\n",
       "      <td>0.353535</td>\n",
       "      <td>0.136651</td>\n",
       "      <td>-0.162704</td>\n",
       "      <td>-0.498704</td>\n",
       "      <td>0.312203</td>\n",
       "      <td>0.341762</td>\n",
       "      <td>-0.431968</td>\n",
       "      <td>0.251901</td>\n",
       "      <td>-1.037215</td>\n",
       "      <td>Whiplash</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>211</th>\n",
       "      <td>66.018906</td>\n",
       "      <td>-7.372850</td>\n",
       "      <td>0.068729</td>\n",
       "      <td>-0.956286</td>\n",
       "      <td>0.101014</td>\n",
       "      <td>0.269000</td>\n",
       "      <td>0.248208</td>\n",
       "      <td>-1.403964</td>\n",
       "      <td>0.227380</td>\n",
       "      <td>0.181136</td>\n",
       "      <td>-0.216362</td>\n",
       "      <td>-0.612747</td>\n",
       "      <td>0.127347</td>\n",
       "      <td>Who_Framed_Roger_Rabbit</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>212</th>\n",
       "      <td>63.573946</td>\n",
       "      <td>-3.473597</td>\n",
       "      <td>0.035900</td>\n",
       "      <td>-0.940283</td>\n",
       "      <td>-0.244776</td>\n",
       "      <td>-0.233596</td>\n",
       "      <td>1.218827</td>\n",
       "      <td>1.251947</td>\n",
       "      <td>0.832160</td>\n",
       "      <td>-1.083029</td>\n",
       "      <td>-0.013228</td>\n",
       "      <td>-1.693744</td>\n",
       "      <td>0.313248</td>\n",
       "      <td>Wish_I_Was_Here</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>213</th>\n",
       "      <td>67.450605</td>\n",
       "      <td>-5.350624</td>\n",
       "      <td>-0.166274</td>\n",
       "      <td>0.302811</td>\n",
       "      <td>-0.207895</td>\n",
       "      <td>-0.010656</td>\n",
       "      <td>-1.223716</td>\n",
       "      <td>-1.169657</td>\n",
       "      <td>0.704279</td>\n",
       "      <td>-1.849729</td>\n",
       "      <td>1.097474</td>\n",
       "      <td>-0.968166</td>\n",
       "      <td>-0.586068</td>\n",
       "      <td>X-Men__Days_of_Future_Past</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>214</th>\n",
       "      <td>60.541139</td>\n",
       "      <td>-3.812291</td>\n",
       "      <td>1.018012</td>\n",
       "      <td>-1.319166</td>\n",
       "      <td>-0.061933</td>\n",
       "      <td>-0.996868</td>\n",
       "      <td>0.311122</td>\n",
       "      <td>0.643464</td>\n",
       "      <td>0.631968</td>\n",
       "      <td>-0.143521</td>\n",
       "      <td>1.278076</td>\n",
       "      <td>0.148111</td>\n",
       "      <td>-0.110976</td>\n",
       "      <td>X-Men__First_Class</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>215</th>\n",
       "      <td>69.081321</td>\n",
       "      <td>-5.029392</td>\n",
       "      <td>4.084043</td>\n",
       "      <td>-1.495126</td>\n",
       "      <td>1.627803</td>\n",
       "      <td>0.909621</td>\n",
       "      <td>1.422748</td>\n",
       "      <td>1.062166</td>\n",
       "      <td>-0.268165</td>\n",
       "      <td>-0.238752</td>\n",
       "      <td>-0.677100</td>\n",
       "      <td>-0.660449</td>\n",
       "      <td>-0.826689</td>\n",
       "      <td>Yentl</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>216</th>\n",
       "      <td>63.551348</td>\n",
       "      <td>-3.343067</td>\n",
       "      <td>1.355899</td>\n",
       "      <td>-0.184400</td>\n",
       "      <td>0.055924</td>\n",
       "      <td>-1.272055</td>\n",
       "      <td>-0.079103</td>\n",
       "      <td>-0.000659</td>\n",
       "      <td>0.554970</td>\n",
       "      <td>0.693429</td>\n",
       "      <td>-0.828130</td>\n",
       "      <td>-1.128304</td>\n",
       "      <td>-0.082842</td>\n",
       "      <td>Yves_Saint_Laurent</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>217</th>\n",
       "      <td>61.875096</td>\n",
       "      <td>-2.894059</td>\n",
       "      <td>0.882380</td>\n",
       "      <td>0.463451</td>\n",
       "      <td>-1.162797</td>\n",
       "      <td>-0.323171</td>\n",
       "      <td>-0.647866</td>\n",
       "      <td>0.228511</td>\n",
       "      <td>-0.208020</td>\n",
       "      <td>-0.171043</td>\n",
       "      <td>0.150682</td>\n",
       "      <td>-0.779983</td>\n",
       "      <td>0.237937</td>\n",
       "      <td>Zombieland</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>218 rows × 14 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "             0         1         2         3         4         5         6  \\\n",
       "0    -2.526758 -4.041369  1.993339  0.186229  0.439292 -1.073407 -1.204877   \n",
       "1    65.069285 -2.643378  0.614012 -0.269641 -0.290764  0.306304 -0.611462   \n",
       "2    65.721634 -4.928884  0.814478 -0.145326  0.265794 -0.428410  0.121390   \n",
       "3    60.218722 -7.358705 -0.310818 -1.095195 -0.596027 -0.824320  0.196180   \n",
       "4    64.730372 -2.603121  0.734011  1.156563 -0.798081 -0.453259 -1.149437   \n",
       "5    60.658010 -2.266060  1.657855  1.028910  0.607900  1.251477 -0.105159   \n",
       "6    67.085961  1.781262  0.305900  0.746188 -0.257237 -0.200025  0.370250   \n",
       "7    65.985640 -2.875637  0.472032 -1.601717  2.256657  0.956259  0.950898   \n",
       "8    66.469278 -3.822306  0.180833 -0.654696 -0.329590 -0.805191 -1.568045   \n",
       "9    62.779312 -5.516617 -0.241958 -1.305328 -0.184150  0.587740 -0.029263   \n",
       "10   60.799455 -0.662386 -1.633315  0.097911 -0.294735 -0.404839 -0.093575   \n",
       "11   66.932388 -4.411218 -0.131530 -1.150421  0.277227  0.278146 -0.009089   \n",
       "12   62.546272 -4.431310  0.305822  0.739121 -0.120685  0.235183 -0.245644   \n",
       "13    4.353247 -5.740150 -0.680029 -0.365659  0.754221 -0.136739  0.142539   \n",
       "14   64.914344 -4.607564  0.866000  0.519994  0.231213 -0.490675 -0.244872   \n",
       "15   63.247656 -5.784616 -0.415322 -1.442116 -0.705312 -0.579245 -1.076865   \n",
       "16    1.235957 -3.927059 -1.525705  0.104882  0.154692 -0.333045 -1.531798   \n",
       "17   69.356517 -6.664503  1.357936 -1.283372  1.738132  0.542746 -0.823760   \n",
       "18   63.540171 -4.444205 -0.973474 -1.112058 -0.870865 -0.913776 -0.434824   \n",
       "19   57.690224 -8.103223  0.651748 -2.379234 -0.154854 -1.828355  0.228078   \n",
       "20   70.183975 -4.797058 -0.604536  0.773867 -0.381193 -0.636714 -0.932308   \n",
       "21   63.677679 -1.344287  0.646610 -0.932991  0.517206  1.261401  0.373893   \n",
       "22   59.430683 -4.234552  0.231837 -0.824707 -1.133522 -1.028014 -0.289735   \n",
       "23    1.653598 -7.259786  0.398771 -1.059177 -0.064047  0.405019 -0.500505   \n",
       "24   65.951088 -3.109060 -0.160809  0.731511  0.064454 -0.848364  0.126554   \n",
       "25   61.614508 -4.801353 -0.878212 -0.875922 -1.059308 -1.418208 -0.306124   \n",
       "26   67.555194 -4.096890 -0.928682 -0.006808 -0.548435  0.317124  1.389815   \n",
       "27   64.766022 -1.658432  1.283690  1.881826  0.974925  0.419500 -1.265323   \n",
       "28    4.039247 -1.076041 -0.651398 -0.345512 -1.855686 -2.221668 -1.643940   \n",
       "29   63.328124 -5.348965 -0.931210 -1.923488 -0.404019 -1.760123  0.793195   \n",
       "..         ...       ...       ...       ...       ...       ...       ...   \n",
       "188  62.546066 -0.535224  0.398454  0.495747  0.698858 -0.647333 -0.318680   \n",
       "189  68.450024 -4.337801 -0.038506 -1.440840 -0.169587 -1.297177 -2.710199   \n",
       "190  58.668567 -3.015846  0.337451  1.273479  0.718874 -1.352611 -0.603458   \n",
       "191  63.412375 -0.975941  0.535475 -1.009827 -1.032184 -1.640965 -1.313181   \n",
       "192  67.964552 -4.183669  0.438747 -1.903738  0.685046  0.923594  0.848129   \n",
       "193  60.907936 -5.592318  0.539552 -1.115131 -0.056683 -0.466904 -0.159973   \n",
       "194   6.646471 -7.386393  0.139800 -1.655487  0.033531 -0.262377 -0.682926   \n",
       "195   1.528570 -3.875501  2.043072 -0.736872  0.621951 -0.413168 -0.278974   \n",
       "196  66.922937 -5.824156  0.522241 -0.474348  0.202372 -0.115749 -0.052676   \n",
       "197  62.078033 -1.854257 -0.240834 -1.753175 -0.364458  0.390055 -1.616275   \n",
       "198  61.489602 -5.385404  0.324601 -1.347758 -1.709938 -1.517166  0.177519   \n",
       "199  65.042952 -5.680611  0.460374 -0.370140 -0.304695  0.104790 -1.082162   \n",
       "200  59.511905 -4.309526 -0.728330 -2.602980  0.150200 -0.210795 -0.315625   \n",
       "201  63.559539 -3.565613  0.831247 -0.274866 -0.425399 -1.748246  0.500452   \n",
       "202  68.279066 -4.390411  1.178664  0.743035  0.159671 -0.111799  0.614183   \n",
       "203  69.243301 -5.877979  0.673428 -1.697120  0.740326  0.125345  0.217559   \n",
       "204  63.813987 -4.067109 -0.484448 -1.212508 -0.499303  0.029433 -1.650626   \n",
       "205  66.895057 -4.354692 -0.330156 -0.975275 -0.637346 -1.064908 -0.364699   \n",
       "206  -0.472871 -6.112898  0.974750 -0.241602 -0.724095 -1.403937  0.445222   \n",
       "207   2.852496 -2.899815  0.500835 -1.304353  0.184263  0.067547  0.034258   \n",
       "208  67.943940 -5.703620  0.191065  0.344958 -1.836191 -0.467043  0.160743   \n",
       "209  66.156327 -4.753366  0.570812 -0.297508 -0.031952  0.237761 -0.296249   \n",
       "210  58.629760 -1.751487  1.137864 -0.129651  0.353535  0.136651 -0.162704   \n",
       "211  66.018906 -7.372850  0.068729 -0.956286  0.101014  0.269000  0.248208   \n",
       "212  63.573946 -3.473597  0.035900 -0.940283 -0.244776 -0.233596  1.218827   \n",
       "213  67.450605 -5.350624 -0.166274  0.302811 -0.207895 -0.010656 -1.223716   \n",
       "214  60.541139 -3.812291  1.018012 -1.319166 -0.061933 -0.996868  0.311122   \n",
       "215  69.081321 -5.029392  4.084043 -1.495126  1.627803  0.909621  1.422748   \n",
       "216  63.551348 -3.343067  1.355899 -0.184400  0.055924 -1.272055 -0.079103   \n",
       "217  61.875096 -2.894059  0.882380  0.463451 -1.162797 -0.323171 -0.647866   \n",
       "\n",
       "            7         8         9        10        11        12  \\\n",
       "0   -0.040134  0.180450 -2.916251 -0.829277 -0.455054  0.208318   \n",
       "1   -0.173489  0.961753 -1.172046 -0.519489 -1.271658 -0.179605   \n",
       "2   -0.313247  0.381455 -0.924582  0.192938 -0.167529 -0.026522   \n",
       "3   -0.086074  0.384909 -0.763167 -1.051928 -1.290511 -1.151264   \n",
       "4    0.286334 -1.379145 -0.181773 -1.572061 -1.267311 -0.090285   \n",
       "5   -0.173230 -0.261850 -0.321715  0.321455  0.058193 -0.246221   \n",
       "6   -0.345818 -2.137183 -1.707853  0.097651 -1.478550 -1.164362   \n",
       "7    0.492875  0.547208  0.012388  0.721714 -1.461903  1.804050   \n",
       "8   -1.727193 -0.556033 -0.790086  0.822247  0.794421  0.353131   \n",
       "9    0.106667 -0.041566  0.198214 -0.302957  0.667275  0.894902   \n",
       "10  -1.302294 -0.963811 -0.792142 -1.125511 -1.179247 -0.599368   \n",
       "11  -0.106300  0.273896 -0.169695  0.030711 -0.263055  0.386448   \n",
       "12   0.044114  0.109714 -0.504728  0.496991 -0.949683  0.082011   \n",
       "13   0.163932 -0.043930 -0.187867  0.411240 -0.468032 -0.025394   \n",
       "14  -0.699138  0.783867 -0.463542 -0.337444 -0.564925  0.399956   \n",
       "15  -1.462926 -0.121808 -1.019984  0.100998 -0.611633 -0.290393   \n",
       "16   0.801804  1.010630  0.666461 -0.290212 -0.276354  0.844872   \n",
       "17  -0.004039  0.055227  0.446140 -0.125184 -0.306798  0.528909   \n",
       "18  -1.095242 -0.418789 -1.246752 -0.599711 -0.311434  1.737507   \n",
       "19  -0.999688 -0.425112 -0.773685 -0.035393 -0.525491  0.163840   \n",
       "20  -0.095296 -0.733545 -0.450018 -0.387670 -1.025458  0.530404   \n",
       "21  -0.515453 -0.367190 -0.529120 -0.342890  0.200841  0.606574   \n",
       "22  -0.424867  0.753868 -0.459766  0.269023 -1.028823 -0.279974   \n",
       "23   0.931563  1.808189 -2.289274  0.378564 -0.009454 -1.190644   \n",
       "24  -0.599923  0.339361 -1.256192  0.124059 -0.569407  0.019782   \n",
       "25  -1.493840 -0.930916 -1.288355  0.678025  0.386360  0.153531   \n",
       "26   0.758213  2.272988  1.168899  0.330289  0.336959 -1.454317   \n",
       "27   0.431151  1.622440  2.015594 -0.304145  0.030298  0.733001   \n",
       "28   0.985800 -0.969197  0.281265 -0.142620  0.948808 -0.289194   \n",
       "29  -0.752133 -1.332891 -0.447351 -0.828482  0.399213 -0.369465   \n",
       "..        ...       ...       ...       ...       ...       ...   \n",
       "188 -0.890591 -0.687026 -1.304344 -0.606383 -1.559487  0.852263   \n",
       "189 -0.471302  0.925725 -0.411755  0.231597 -1.582602 -1.966300   \n",
       "190  0.028086  0.452069 -1.038480  0.254052 -0.269128 -0.256780   \n",
       "191 -1.021741  0.419164  0.344653  0.972602  0.814311  0.655868   \n",
       "192 -1.254255 -0.057255 -0.405060 -0.225751  0.037156 -0.639873   \n",
       "193  0.003431  0.702777  0.139241  0.635809 -0.550585 -0.473238   \n",
       "194  1.393152  0.173529 -2.680552  0.892051  0.246102  0.419439   \n",
       "195 -1.889314 -1.042588 -2.610210  0.550404 -0.698804 -0.409648   \n",
       "196 -0.118774  0.222147 -0.129649 -0.008700  0.368996  0.125681   \n",
       "197 -3.071639 -0.236372  1.100317 -1.072721  1.509009 -0.859411   \n",
       "198  0.109133 -0.045923 -1.393425 -0.451694 -0.981295  0.068757   \n",
       "199  0.493590  0.785276 -1.305781  0.848198 -0.773040  0.252448   \n",
       "200  0.037404 -0.298176  0.943956  0.579414  0.388942 -0.008194   \n",
       "201 -0.283688  0.974784  0.521954  0.443222 -0.411838  0.259322   \n",
       "202 -0.679050  0.823877 -1.201035  0.631561 -0.859654 -0.102381   \n",
       "203 -0.240339 -0.096364 -0.067281 -0.899868 -1.158325 -0.338628   \n",
       "204 -0.403020 -0.295284 -0.075770  0.869204  0.141045 -0.597827   \n",
       "205  0.087310  0.461851  0.094161  0.384287  1.239551 -0.070643   \n",
       "206 -2.412163 -0.780196  0.829588  0.464152 -0.062364  0.044569   \n",
       "207  0.641412 -0.247031 -0.088565 -0.110451 -1.353592  1.631554   \n",
       "208  0.456691 -0.210429 -0.974890  0.464000 -0.250216 -0.200747   \n",
       "209  0.741167  1.440949 -0.472363  0.219085 -1.170579  0.403457   \n",
       "210 -0.498704  0.312203  0.341762 -0.431968  0.251901 -1.037215   \n",
       "211 -1.403964  0.227380  0.181136 -0.216362 -0.612747  0.127347   \n",
       "212  1.251947  0.832160 -1.083029 -0.013228 -1.693744  0.313248   \n",
       "213 -1.169657  0.704279 -1.849729  1.097474 -0.968166 -0.586068   \n",
       "214  0.643464  0.631968 -0.143521  1.278076  0.148111 -0.110976   \n",
       "215  1.062166 -0.268165 -0.238752 -0.677100 -0.660449 -0.826689   \n",
       "216 -0.000659  0.554970  0.693429 -0.828130 -1.128304 -0.082842   \n",
       "217  0.228511 -0.208020 -0.171043  0.150682 -0.779983  0.237937   \n",
       "\n",
       "                                            file_name  \n",
       "0                                           10.000_Km  \n",
       "1                                    12_Years_a_Slave  \n",
       "2                                      21_Jump_Street  \n",
       "3                                        A_Bug's_Life  \n",
       "4                                      A_Little_Chaos  \n",
       "5                                   A_Most_Wanted_Man  \n",
       "6                                       A_Simple_Life  \n",
       "7                                     Aanmodderfakker  \n",
       "8                                           Alexander  \n",
       "9                                 Alice_in_Wonderland  \n",
       "10                                    American_Sniper  \n",
       "11                                          Anastasia  \n",
       "12                                     And_So_It_Goes  \n",
       "13                                               Antz  \n",
       "14                                             Avatar  \n",
       "15                                     Bad_News_Bears  \n",
       "16                                           Banklady  \n",
       "17                                        Beetlejuice  \n",
       "18                                        Begin_Again  \n",
       "19                                      Belle_de_Jour  \n",
       "20                                      Bewakoofiyaan  \n",
       "21                                         Bhoothnath  \n",
       "22                                           Big_Game  \n",
       "23                                       Billy_Elliot  \n",
       "24   Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)  \n",
       "25                                            Blended  \n",
       "26                                           Blow_Out  \n",
       "27                                       Bride_Flight  \n",
       "28                                Bridges_of_Sarajevo  \n",
       "29                                          Burlesque  \n",
       "..                                                ...  \n",
       "188                           The_Talented_Mr._Ripley  \n",
       "189                                 The_Trip_to_Italy  \n",
       "190                                        The_Voices  \n",
       "191                                 The_Water_Diviner  \n",
       "192           The_White_Haired_Witch_of_Lunar_Kingdom  \n",
       "193                           The_Wolf_of_Wall_Street  \n",
       "194                                   Thelma___Louise  \n",
       "195                               There_Will_Be_Blood  \n",
       "196                              Thor__The_Dark_World  \n",
       "197                                           Titanic  \n",
       "198                                         Tommy_Boy  \n",
       "199                                     Trainspotting  \n",
       "200                                             Trash  \n",
       "201                                          Unbroken  \n",
       "202                                          Valkyrie  \n",
       "203                                 Verliefd_op_Ibiza  \n",
       "204                                     Walk_the_Line  \n",
       "205                                           Warrior  \n",
       "206                                    Wassup_Rockers  \n",
       "207                                          Watchmen  \n",
       "208                           Wet_Hot_American_Summer  \n",
       "209                         What_We_Do_in_the_Shadows  \n",
       "210                                          Whiplash  \n",
       "211                           Who_Framed_Roger_Rabbit  \n",
       "212                                   Wish_I_Was_Here  \n",
       "213                        X-Men__Days_of_Future_Past  \n",
       "214                                X-Men__First_Class  \n",
       "215                                             Yentl  \n",
       "216                                Yves_Saint_Laurent  \n",
       "217                                        Zombieland  \n",
       "\n",
       "[218 rows x 14 columns]"
      ]
     },
     "execution_count": 94,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_audio_train = get_all_audio_features(df_base_train,use_train=False)\n",
    "df_audio_train"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>...</th>\n",
       "      <th>1643</th>\n",
       "      <th>1644</th>\n",
       "      <th>1645</th>\n",
       "      <th>1646</th>\n",
       "      <th>1647</th>\n",
       "      <th>1648</th>\n",
       "      <th>1649</th>\n",
       "      <th>1650</th>\n",
       "      <th>1651</th>\n",
       "      <th>file_name</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>269700.0000</td>\n",
       "      <td>6.103500e-07</td>\n",
       "      <td>0.001645</td>\n",
       "      <td>0.000002</td>\n",
       "      <td>0.001645</td>\n",
       "      <td>1638400.0</td>\n",
       "      <td>269700.00</td>\n",
       "      <td>518400.0</td>\n",
       "      <td>269700.00</td>\n",
       "      <td>10.000_Km</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.193000</td>\n",
       "      <td>0.192990</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.271100</td>\n",
       "      <td>0.271100</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.270240</td>\n",
       "      <td>...</td>\n",
       "      <td>15454.0000</td>\n",
       "      <td>1.529400e+01</td>\n",
       "      <td>13.422000</td>\n",
       "      <td>13.418000</td>\n",
       "      <td>13.307000</td>\n",
       "      <td>71633.0</td>\n",
       "      <td>21855.00</td>\n",
       "      <td>48314.0</td>\n",
       "      <td>24434.00</td>\n",
       "      <td>12_Years_a_Slave</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119790.0000</td>\n",
       "      <td>1.377600e-06</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>725900.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>21_Jump_Street</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>43.2690</td>\n",
       "      <td>2.964500e+00</td>\n",
       "      <td>3.737800</td>\n",
       "      <td>2.463500</td>\n",
       "      <td>3.952600</td>\n",
       "      <td>4444.8</td>\n",
       "      <td>2405.40</td>\n",
       "      <td>5602.6</td>\n",
       "      <td>2611.10</td>\n",
       "      <td>A_Bug's_Life</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0.272800</td>\n",
       "      <td>0.260960</td>\n",
       "      <td>0.270090</td>\n",
       "      <td>0.318910</td>\n",
       "      <td>0.296170</td>\n",
       "      <td>0.277970</td>\n",
       "      <td>0.304250</td>\n",
       "      <td>0.357020</td>\n",
       "      <td>0.270390</td>\n",
       "      <td>0.302700</td>\n",
       "      <td>...</td>\n",
       "      <td>60.5890</td>\n",
       "      <td>7.630400e+00</td>\n",
       "      <td>8.487600</td>\n",
       "      <td>7.460300</td>\n",
       "      <td>8.475200</td>\n",
       "      <td>5797.3</td>\n",
       "      <td>460.95</td>\n",
       "      <td>1206.1</td>\n",
       "      <td>458.15</td>\n",
       "      <td>A_Little_Chaos</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000161</td>\n",
       "      <td>0.000162</td>\n",
       "      <td>0.313130</td>\n",
       "      <td>0.344490</td>\n",
       "      <td>0.341150</td>\n",
       "      <td>0.321080</td>\n",
       "      <td>0.308520</td>\n",
       "      <td>0.339390</td>\n",
       "      <td>...</td>\n",
       "      <td>854.0200</td>\n",
       "      <td>2.176400e+01</td>\n",
       "      <td>16.822000</td>\n",
       "      <td>14.428000</td>\n",
       "      <td>16.660000</td>\n",
       "      <td>259450.0</td>\n",
       "      <td>32323.00</td>\n",
       "      <td>57982.0</td>\n",
       "      <td>32463.00</td>\n",
       "      <td>A_Most_Wanted_Man</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.339790</td>\n",
       "      <td>0.161840</td>\n",
       "      <td>0.141070</td>\n",
       "      <td>0.224330</td>\n",
       "      <td>0.239770</td>\n",
       "      <td>0.166240</td>\n",
       "      <td>...</td>\n",
       "      <td>7772.2000</td>\n",
       "      <td>1.239100e+01</td>\n",
       "      <td>12.498000</td>\n",
       "      <td>12.388000</td>\n",
       "      <td>12.783000</td>\n",
       "      <td>36773.0</td>\n",
       "      <td>7978.00</td>\n",
       "      <td>13848.0</td>\n",
       "      <td>7937.10</td>\n",
       "      <td>A_Simple_Life</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>0.271970</td>\n",
       "      <td>0.334210</td>\n",
       "      <td>0.316890</td>\n",
       "      <td>0.307720</td>\n",
       "      <td>0.265150</td>\n",
       "      <td>0.276710</td>\n",
       "      <td>0.265630</td>\n",
       "      <td>0.275900</td>\n",
       "      <td>0.240060</td>\n",
       "      <td>0.145130</td>\n",
       "      <td>...</td>\n",
       "      <td>86.8600</td>\n",
       "      <td>6.819900e+00</td>\n",
       "      <td>7.184600</td>\n",
       "      <td>6.196700</td>\n",
       "      <td>7.160700</td>\n",
       "      <td>5318.3</td>\n",
       "      <td>1022.90</td>\n",
       "      <td>3030.9</td>\n",
       "      <td>1012.10</td>\n",
       "      <td>Aanmodderfakker</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>51.9700</td>\n",
       "      <td>7.853800e+00</td>\n",
       "      <td>8.116700</td>\n",
       "      <td>6.557600</td>\n",
       "      <td>7.814300</td>\n",
       "      <td>8186.6</td>\n",
       "      <td>1578.00</td>\n",
       "      <td>2474.1</td>\n",
       "      <td>1736.40</td>\n",
       "      <td>Alexander</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>112920.0000</td>\n",
       "      <td>1.371100e-06</td>\n",
       "      <td>0.002504</td>\n",
       "      <td>0.000005</td>\n",
       "      <td>0.002504</td>\n",
       "      <td>729320.0</td>\n",
       "      <td>112920.00</td>\n",
       "      <td>211600.0</td>\n",
       "      <td>112920.00</td>\n",
       "      <td>Alice_in_Wonderland</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119790.0000</td>\n",
       "      <td>1.377600e-06</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>725900.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>American_Sniper</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>384.9700</td>\n",
       "      <td>1.608600e+01</td>\n",
       "      <td>12.814000</td>\n",
       "      <td>10.922000</td>\n",
       "      <td>12.903000</td>\n",
       "      <td>80685.0</td>\n",
       "      <td>10556.00</td>\n",
       "      <td>18197.0</td>\n",
       "      <td>10486.00</td>\n",
       "      <td>Anastasia</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119950.0000</td>\n",
       "      <td>1.371100e-06</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>729320.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>And_So_It_Goes</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>0.434330</td>\n",
       "      <td>0.447210</td>\n",
       "      <td>0.027070</td>\n",
       "      <td>0.245120</td>\n",
       "      <td>0.364930</td>\n",
       "      <td>0.478110</td>\n",
       "      <td>0.392060</td>\n",
       "      <td>0.388810</td>\n",
       "      <td>0.230150</td>\n",
       "      <td>0.347980</td>\n",
       "      <td>...</td>\n",
       "      <td>446.5300</td>\n",
       "      <td>5.308700e+00</td>\n",
       "      <td>5.614600</td>\n",
       "      <td>4.623000</td>\n",
       "      <td>5.461100</td>\n",
       "      <td>10250.0</td>\n",
       "      <td>2212.80</td>\n",
       "      <td>4488.6</td>\n",
       "      <td>2270.10</td>\n",
       "      <td>Antz</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>0.134080</td>\n",
       "      <td>0.203490</td>\n",
       "      <td>0.215750</td>\n",
       "      <td>0.186110</td>\n",
       "      <td>0.246650</td>\n",
       "      <td>0.273480</td>\n",
       "      <td>0.272380</td>\n",
       "      <td>0.261680</td>\n",
       "      <td>0.262910</td>\n",
       "      <td>0.290560</td>\n",
       "      <td>...</td>\n",
       "      <td>106.8300</td>\n",
       "      <td>2.061200e+01</td>\n",
       "      <td>18.973000</td>\n",
       "      <td>16.409000</td>\n",
       "      <td>19.020000</td>\n",
       "      <td>61284.0</td>\n",
       "      <td>8706.80</td>\n",
       "      <td>16447.0</td>\n",
       "      <td>8680.80</td>\n",
       "      <td>Avatar</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>37959.0000</td>\n",
       "      <td>4.340300e-06</td>\n",
       "      <td>0.004386</td>\n",
       "      <td>0.000014</td>\n",
       "      <td>0.004386</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>37959.00</td>\n",
       "      <td>72900.0</td>\n",
       "      <td>37959.00</td>\n",
       "      <td>Bad_News_Bears</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>0.053247</td>\n",
       "      <td>0.145600</td>\n",
       "      <td>0.122740</td>\n",
       "      <td>0.035300</td>\n",
       "      <td>0.315080</td>\n",
       "      <td>0.266740</td>\n",
       "      <td>0.230370</td>\n",
       "      <td>0.265030</td>\n",
       "      <td>0.291750</td>\n",
       "      <td>0.282430</td>\n",
       "      <td>...</td>\n",
       "      <td>592.4700</td>\n",
       "      <td>7.296200e+00</td>\n",
       "      <td>8.108000</td>\n",
       "      <td>8.592300</td>\n",
       "      <td>7.547800</td>\n",
       "      <td>927510.0</td>\n",
       "      <td>302830.00</td>\n",
       "      <td>465010.0</td>\n",
       "      <td>316520.00</td>\n",
       "      <td>Banklady</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>55609.0000</td>\n",
       "      <td>4.340300e-06</td>\n",
       "      <td>0.003916</td>\n",
       "      <td>0.000008</td>\n",
       "      <td>0.003916</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>55609.00</td>\n",
       "      <td>129600.0</td>\n",
       "      <td>55609.00</td>\n",
       "      <td>Beetlejuice</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>0.290990</td>\n",
       "      <td>0.326400</td>\n",
       "      <td>0.318940</td>\n",
       "      <td>0.311370</td>\n",
       "      <td>0.298140</td>\n",
       "      <td>0.306560</td>\n",
       "      <td>0.297380</td>\n",
       "      <td>0.314740</td>\n",
       "      <td>0.175290</td>\n",
       "      <td>0.198100</td>\n",
       "      <td>...</td>\n",
       "      <td>178.9500</td>\n",
       "      <td>1.961800e+01</td>\n",
       "      <td>19.591000</td>\n",
       "      <td>18.443000</td>\n",
       "      <td>19.614000</td>\n",
       "      <td>99528.0</td>\n",
       "      <td>14192.00</td>\n",
       "      <td>35310.0</td>\n",
       "      <td>14256.00</td>\n",
       "      <td>Begin_Again</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>0.005963</td>\n",
       "      <td>0.023951</td>\n",
       "      <td>0.028510</td>\n",
       "      <td>0.061558</td>\n",
       "      <td>0.044613</td>\n",
       "      <td>0.049806</td>\n",
       "      <td>0.032554</td>\n",
       "      <td>0.070085</td>\n",
       "      <td>0.040795</td>\n",
       "      <td>0.046450</td>\n",
       "      <td>...</td>\n",
       "      <td>121.6700</td>\n",
       "      <td>2.113700e+00</td>\n",
       "      <td>1.993900</td>\n",
       "      <td>1.016400</td>\n",
       "      <td>2.126400</td>\n",
       "      <td>6797.7</td>\n",
       "      <td>2722.40</td>\n",
       "      <td>8510.8</td>\n",
       "      <td>2390.50</td>\n",
       "      <td>Belle_de_Jour</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>8698.1000</td>\n",
       "      <td>4.319500e+00</td>\n",
       "      <td>3.472700</td>\n",
       "      <td>0.912420</td>\n",
       "      <td>3.445200</td>\n",
       "      <td>29166.0</td>\n",
       "      <td>10501.00</td>\n",
       "      <td>36679.0</td>\n",
       "      <td>9308.10</td>\n",
       "      <td>Bewakoofiyaan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>0.363190</td>\n",
       "      <td>0.409210</td>\n",
       "      <td>0.268550</td>\n",
       "      <td>0.156270</td>\n",
       "      <td>0.272130</td>\n",
       "      <td>0.336440</td>\n",
       "      <td>0.348700</td>\n",
       "      <td>0.315240</td>\n",
       "      <td>0.217470</td>\n",
       "      <td>0.308260</td>\n",
       "      <td>...</td>\n",
       "      <td>1299.1000</td>\n",
       "      <td>5.268900e+00</td>\n",
       "      <td>5.720600</td>\n",
       "      <td>4.040200</td>\n",
       "      <td>5.609500</td>\n",
       "      <td>6047.1</td>\n",
       "      <td>3228.70</td>\n",
       "      <td>7958.9</td>\n",
       "      <td>3300.00</td>\n",
       "      <td>Bhoothnath</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>269700.0000</td>\n",
       "      <td>6.103500e-07</td>\n",
       "      <td>0.001645</td>\n",
       "      <td>0.000002</td>\n",
       "      <td>0.001645</td>\n",
       "      <td>1638400.0</td>\n",
       "      <td>269700.00</td>\n",
       "      <td>518400.0</td>\n",
       "      <td>269700.00</td>\n",
       "      <td>Big_Game</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>0.002460</td>\n",
       "      <td>0.003696</td>\n",
       "      <td>0.003812</td>\n",
       "      <td>0.027867</td>\n",
       "      <td>0.006516</td>\n",
       "      <td>0.013417</td>\n",
       "      <td>0.012003</td>\n",
       "      <td>0.066500</td>\n",
       "      <td>0.003371</td>\n",
       "      <td>0.003234</td>\n",
       "      <td>...</td>\n",
       "      <td>184.6100</td>\n",
       "      <td>3.494100e-02</td>\n",
       "      <td>0.202970</td>\n",
       "      <td>0.097011</td>\n",
       "      <td>0.202050</td>\n",
       "      <td>29575.0</td>\n",
       "      <td>2124.70</td>\n",
       "      <td>3583.7</td>\n",
       "      <td>2158.80</td>\n",
       "      <td>Billy_Elliot</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119950.0000</td>\n",
       "      <td>1.371100e-06</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>729320.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119950.0000</td>\n",
       "      <td>1.371100e-06</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>729320.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>Blended</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>1974.7000</td>\n",
       "      <td>5.947800e-01</td>\n",
       "      <td>0.757800</td>\n",
       "      <td>0.507530</td>\n",
       "      <td>0.707840</td>\n",
       "      <td>8599.4</td>\n",
       "      <td>3114.90</td>\n",
       "      <td>7767.2</td>\n",
       "      <td>3580.80</td>\n",
       "      <td>Blow_Out</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>0.209470</td>\n",
       "      <td>0.246400</td>\n",
       "      <td>0.240960</td>\n",
       "      <td>0.222420</td>\n",
       "      <td>0.267430</td>\n",
       "      <td>0.286790</td>\n",
       "      <td>0.289760</td>\n",
       "      <td>0.295070</td>\n",
       "      <td>0.278350</td>\n",
       "      <td>0.295640</td>\n",
       "      <td>...</td>\n",
       "      <td>261.8200</td>\n",
       "      <td>1.566100e+01</td>\n",
       "      <td>16.005000</td>\n",
       "      <td>13.684000</td>\n",
       "      <td>15.575000</td>\n",
       "      <td>212900.0</td>\n",
       "      <td>22254.00</td>\n",
       "      <td>46058.0</td>\n",
       "      <td>22567.00</td>\n",
       "      <td>Bride_Flight</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>0.235150</td>\n",
       "      <td>0.277040</td>\n",
       "      <td>0.270530</td>\n",
       "      <td>0.245830</td>\n",
       "      <td>0.230190</td>\n",
       "      <td>0.259910</td>\n",
       "      <td>0.268810</td>\n",
       "      <td>0.258780</td>\n",
       "      <td>0.210050</td>\n",
       "      <td>0.243930</td>\n",
       "      <td>...</td>\n",
       "      <td>2375.3000</td>\n",
       "      <td>9.098500e+00</td>\n",
       "      <td>8.987400</td>\n",
       "      <td>8.742600</td>\n",
       "      <td>9.073900</td>\n",
       "      <td>9156.9</td>\n",
       "      <td>2404.40</td>\n",
       "      <td>4628.7</td>\n",
       "      <td>2555.10</td>\n",
       "      <td>Bridges_of_Sarajevo</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119950.0000</td>\n",
       "      <td>1.371100e-06</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>729320.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>Burlesque</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>188</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>55609.0000</td>\n",
       "      <td>4.340300e-06</td>\n",
       "      <td>0.003916</td>\n",
       "      <td>0.000008</td>\n",
       "      <td>0.003916</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>55609.00</td>\n",
       "      <td>129600.0</td>\n",
       "      <td>55609.00</td>\n",
       "      <td>The_Talented_Mr._Ripley</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>189</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119950.0000</td>\n",
       "      <td>1.371100e-06</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>729320.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>The_Trip_to_Italy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>190</th>\n",
       "      <td>0.297000</td>\n",
       "      <td>0.320510</td>\n",
       "      <td>0.308620</td>\n",
       "      <td>0.297130</td>\n",
       "      <td>0.297940</td>\n",
       "      <td>0.302130</td>\n",
       "      <td>0.292430</td>\n",
       "      <td>0.303390</td>\n",
       "      <td>0.162950</td>\n",
       "      <td>0.228300</td>\n",
       "      <td>...</td>\n",
       "      <td>265.2500</td>\n",
       "      <td>2.200600e+01</td>\n",
       "      <td>20.788000</td>\n",
       "      <td>18.185000</td>\n",
       "      <td>20.605000</td>\n",
       "      <td>62373.0</td>\n",
       "      <td>8412.20</td>\n",
       "      <td>19073.0</td>\n",
       "      <td>8520.60</td>\n",
       "      <td>The_Voices</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>191</th>\n",
       "      <td>0.280960</td>\n",
       "      <td>0.333330</td>\n",
       "      <td>0.336400</td>\n",
       "      <td>0.305370</td>\n",
       "      <td>0.338090</td>\n",
       "      <td>0.356980</td>\n",
       "      <td>0.349490</td>\n",
       "      <td>0.330910</td>\n",
       "      <td>0.340260</td>\n",
       "      <td>0.359490</td>\n",
       "      <td>...</td>\n",
       "      <td>343.1300</td>\n",
       "      <td>2.112200e+01</td>\n",
       "      <td>21.524000</td>\n",
       "      <td>19.339000</td>\n",
       "      <td>21.286000</td>\n",
       "      <td>176660.0</td>\n",
       "      <td>27540.00</td>\n",
       "      <td>56619.0</td>\n",
       "      <td>27869.00</td>\n",
       "      <td>The_Water_Diviner</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>192</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.266250</td>\n",
       "      <td>0.266250</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.306710</td>\n",
       "      <td>0.306710</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.421810</td>\n",
       "      <td>0.355100</td>\n",
       "      <td>...</td>\n",
       "      <td>20369.0000</td>\n",
       "      <td>1.243800e+01</td>\n",
       "      <td>12.447000</td>\n",
       "      <td>11.873000</td>\n",
       "      <td>12.425000</td>\n",
       "      <td>64079.0</td>\n",
       "      <td>20369.00</td>\n",
       "      <td>40388.0</td>\n",
       "      <td>20865.00</td>\n",
       "      <td>The_White_Haired_Witch_of_Lunar_Kingdom</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119790.0000</td>\n",
       "      <td>1.377600e-06</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>725900.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>The_Wolf_of_Wall_Street</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>194</th>\n",
       "      <td>0.000503</td>\n",
       "      <td>0.000936</td>\n",
       "      <td>0.000674</td>\n",
       "      <td>0.011439</td>\n",
       "      <td>0.002610</td>\n",
       "      <td>0.003995</td>\n",
       "      <td>0.003767</td>\n",
       "      <td>0.066450</td>\n",
       "      <td>0.002711</td>\n",
       "      <td>0.004708</td>\n",
       "      <td>...</td>\n",
       "      <td>2243.6000</td>\n",
       "      <td>5.319300e-01</td>\n",
       "      <td>0.710540</td>\n",
       "      <td>0.507170</td>\n",
       "      <td>0.741290</td>\n",
       "      <td>8616.0</td>\n",
       "      <td>2226.70</td>\n",
       "      <td>6476.7</td>\n",
       "      <td>2353.00</td>\n",
       "      <td>Thelma___Louise</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>195</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>92.2130</td>\n",
       "      <td>1.261300e+01</td>\n",
       "      <td>11.315000</td>\n",
       "      <td>9.588900</td>\n",
       "      <td>11.194000</td>\n",
       "      <td>30389.0</td>\n",
       "      <td>3410.50</td>\n",
       "      <td>7320.8</td>\n",
       "      <td>3404.60</td>\n",
       "      <td>There_Will_Be_Blood</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>196</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>455.4100</td>\n",
       "      <td>8.044600e+00</td>\n",
       "      <td>9.408400</td>\n",
       "      <td>7.057300</td>\n",
       "      <td>8.555500</td>\n",
       "      <td>26140.0</td>\n",
       "      <td>5433.60</td>\n",
       "      <td>13783.0</td>\n",
       "      <td>9447.60</td>\n",
       "      <td>Thor__The_Dark_World</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>197</th>\n",
       "      <td>0.247200</td>\n",
       "      <td>0.268550</td>\n",
       "      <td>0.260970</td>\n",
       "      <td>0.243260</td>\n",
       "      <td>0.266650</td>\n",
       "      <td>0.261520</td>\n",
       "      <td>0.263370</td>\n",
       "      <td>0.280910</td>\n",
       "      <td>0.214230</td>\n",
       "      <td>0.213900</td>\n",
       "      <td>...</td>\n",
       "      <td>67.1210</td>\n",
       "      <td>1.729300e+01</td>\n",
       "      <td>18.944000</td>\n",
       "      <td>17.139000</td>\n",
       "      <td>18.654000</td>\n",
       "      <td>85704.0</td>\n",
       "      <td>17313.00</td>\n",
       "      <td>33871.0</td>\n",
       "      <td>17173.00</td>\n",
       "      <td>Titanic</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>55609.0000</td>\n",
       "      <td>4.340300e-06</td>\n",
       "      <td>0.003916</td>\n",
       "      <td>0.000008</td>\n",
       "      <td>0.003916</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>55609.00</td>\n",
       "      <td>129600.0</td>\n",
       "      <td>55609.00</td>\n",
       "      <td>Tommy_Boy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>14.5870</td>\n",
       "      <td>2.066700e+01</td>\n",
       "      <td>21.193000</td>\n",
       "      <td>18.366000</td>\n",
       "      <td>21.123000</td>\n",
       "      <td>31826.0</td>\n",
       "      <td>3774.50</td>\n",
       "      <td>10586.0</td>\n",
       "      <td>3767.80</td>\n",
       "      <td>Trainspotting</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>0.238580</td>\n",
       "      <td>0.249240</td>\n",
       "      <td>0.342330</td>\n",
       "      <td>0.325370</td>\n",
       "      <td>0.284380</td>\n",
       "      <td>0.316750</td>\n",
       "      <td>0.405560</td>\n",
       "      <td>0.378410</td>\n",
       "      <td>0.267780</td>\n",
       "      <td>0.345280</td>\n",
       "      <td>...</td>\n",
       "      <td>7.0926</td>\n",
       "      <td>1.122600e+01</td>\n",
       "      <td>11.593000</td>\n",
       "      <td>9.857100</td>\n",
       "      <td>11.627000</td>\n",
       "      <td>36342.0</td>\n",
       "      <td>11420.00</td>\n",
       "      <td>23160.0</td>\n",
       "      <td>11730.00</td>\n",
       "      <td>Trash</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>201</th>\n",
       "      <td>0.287890</td>\n",
       "      <td>0.320650</td>\n",
       "      <td>0.317640</td>\n",
       "      <td>0.289620</td>\n",
       "      <td>0.309020</td>\n",
       "      <td>0.316080</td>\n",
       "      <td>0.315140</td>\n",
       "      <td>0.320340</td>\n",
       "      <td>0.245220</td>\n",
       "      <td>0.228330</td>\n",
       "      <td>...</td>\n",
       "      <td>359.6100</td>\n",
       "      <td>2.293100e+01</td>\n",
       "      <td>21.043000</td>\n",
       "      <td>18.369000</td>\n",
       "      <td>20.910000</td>\n",
       "      <td>87356.0</td>\n",
       "      <td>12388.00</td>\n",
       "      <td>24422.0</td>\n",
       "      <td>12314.00</td>\n",
       "      <td>Unbroken</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>202</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119950.0000</td>\n",
       "      <td>1.371100e-06</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002466</td>\n",
       "      <td>729320.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119950.00</td>\n",
       "      <td>Valkyrie</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>203</th>\n",
       "      <td>0.137650</td>\n",
       "      <td>0.276900</td>\n",
       "      <td>0.278090</td>\n",
       "      <td>0.005579</td>\n",
       "      <td>0.098563</td>\n",
       "      <td>0.248180</td>\n",
       "      <td>0.270330</td>\n",
       "      <td>0.275280</td>\n",
       "      <td>0.286550</td>\n",
       "      <td>0.278150</td>\n",
       "      <td>...</td>\n",
       "      <td>28388.0000</td>\n",
       "      <td>1.172900e+01</td>\n",
       "      <td>10.587000</td>\n",
       "      <td>8.380000</td>\n",
       "      <td>10.439000</td>\n",
       "      <td>104230.0</td>\n",
       "      <td>31198.00</td>\n",
       "      <td>120160.0</td>\n",
       "      <td>31935.00</td>\n",
       "      <td>Verliefd_op_Ibiza</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>204</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>158.8800</td>\n",
       "      <td>5.333300e-01</td>\n",
       "      <td>0.574830</td>\n",
       "      <td>0.403320</td>\n",
       "      <td>0.597660</td>\n",
       "      <td>3036.1</td>\n",
       "      <td>674.78</td>\n",
       "      <td>1484.9</td>\n",
       "      <td>601.38</td>\n",
       "      <td>Walk_the_Line</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>205</th>\n",
       "      <td>0.275500</td>\n",
       "      <td>0.286510</td>\n",
       "      <td>0.282350</td>\n",
       "      <td>0.271590</td>\n",
       "      <td>0.244740</td>\n",
       "      <td>0.257250</td>\n",
       "      <td>0.261990</td>\n",
       "      <td>0.261850</td>\n",
       "      <td>0.219630</td>\n",
       "      <td>0.231560</td>\n",
       "      <td>...</td>\n",
       "      <td>236.7600</td>\n",
       "      <td>1.593800e+01</td>\n",
       "      <td>14.916000</td>\n",
       "      <td>12.558000</td>\n",
       "      <td>14.437000</td>\n",
       "      <td>60114.0</td>\n",
       "      <td>7629.80</td>\n",
       "      <td>15487.0</td>\n",
       "      <td>7513.00</td>\n",
       "      <td>Warrior</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>206</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>37959.0000</td>\n",
       "      <td>4.340300e-06</td>\n",
       "      <td>0.004386</td>\n",
       "      <td>0.000014</td>\n",
       "      <td>0.004386</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>37959.00</td>\n",
       "      <td>72900.0</td>\n",
       "      <td>37959.00</td>\n",
       "      <td>Wassup_Rockers</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>207</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>25104.0000</td>\n",
       "      <td>4.340300e-06</td>\n",
       "      <td>0.004812</td>\n",
       "      <td>0.000024</td>\n",
       "      <td>0.004812</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>25104.00</td>\n",
       "      <td>41616.0</td>\n",
       "      <td>25104.00</td>\n",
       "      <td>Watchmen</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>0.008526</td>\n",
       "      <td>0.005164</td>\n",
       "      <td>0.001745</td>\n",
       "      <td>0.002335</td>\n",
       "      <td>0.012249</td>\n",
       "      <td>0.010098</td>\n",
       "      <td>0.004991</td>\n",
       "      <td>0.003161</td>\n",
       "      <td>0.019266</td>\n",
       "      <td>0.010823</td>\n",
       "      <td>...</td>\n",
       "      <td>65.1620</td>\n",
       "      <td>2.070300e+01</td>\n",
       "      <td>19.196000</td>\n",
       "      <td>16.620000</td>\n",
       "      <td>19.183000</td>\n",
       "      <td>35967.0</td>\n",
       "      <td>5644.50</td>\n",
       "      <td>10165.0</td>\n",
       "      <td>5831.60</td>\n",
       "      <td>Wet_Hot_American_Summer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>209</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.199080</td>\n",
       "      <td>0.277980</td>\n",
       "      <td>0.316510</td>\n",
       "      <td>0.307570</td>\n",
       "      <td>0.199080</td>\n",
       "      <td>0.277980</td>\n",
       "      <td>...</td>\n",
       "      <td>18110.0000</td>\n",
       "      <td>1.204400e+01</td>\n",
       "      <td>12.081000</td>\n",
       "      <td>13.335000</td>\n",
       "      <td>12.137000</td>\n",
       "      <td>79233.0</td>\n",
       "      <td>18418.00</td>\n",
       "      <td>31255.0</td>\n",
       "      <td>18263.00</td>\n",
       "      <td>What_We_Do_in_the_Shadows</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>210</th>\n",
       "      <td>0.292970</td>\n",
       "      <td>0.324030</td>\n",
       "      <td>0.338840</td>\n",
       "      <td>0.333360</td>\n",
       "      <td>0.288340</td>\n",
       "      <td>0.300330</td>\n",
       "      <td>0.310330</td>\n",
       "      <td>0.334610</td>\n",
       "      <td>0.109390</td>\n",
       "      <td>0.177980</td>\n",
       "      <td>...</td>\n",
       "      <td>453.0100</td>\n",
       "      <td>2.038500e+01</td>\n",
       "      <td>20.693000</td>\n",
       "      <td>18.948000</td>\n",
       "      <td>20.541000</td>\n",
       "      <td>42792.0</td>\n",
       "      <td>7356.20</td>\n",
       "      <td>14528.0</td>\n",
       "      <td>7332.50</td>\n",
       "      <td>Whiplash</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>211</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>8.1797</td>\n",
       "      <td>1.976500e+01</td>\n",
       "      <td>22.132000</td>\n",
       "      <td>19.341000</td>\n",
       "      <td>21.789000</td>\n",
       "      <td>49730.0</td>\n",
       "      <td>5041.20</td>\n",
       "      <td>12907.0</td>\n",
       "      <td>5079.70</td>\n",
       "      <td>Who_Framed_Roger_Rabbit</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>212</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>119790.0000</td>\n",
       "      <td>1.377600e-06</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>0.002470</td>\n",
       "      <td>725900.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>230400.0</td>\n",
       "      <td>119790.00</td>\n",
       "      <td>Wish_I_Was_Here</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>213</th>\n",
       "      <td>0.223640</td>\n",
       "      <td>0.277110</td>\n",
       "      <td>0.289560</td>\n",
       "      <td>0.258550</td>\n",
       "      <td>0.313380</td>\n",
       "      <td>0.341870</td>\n",
       "      <td>0.340690</td>\n",
       "      <td>0.325240</td>\n",
       "      <td>0.307790</td>\n",
       "      <td>0.345820</td>\n",
       "      <td>...</td>\n",
       "      <td>594.1700</td>\n",
       "      <td>2.318900e+01</td>\n",
       "      <td>19.177000</td>\n",
       "      <td>16.266000</td>\n",
       "      <td>18.939000</td>\n",
       "      <td>190970.0</td>\n",
       "      <td>23218.00</td>\n",
       "      <td>45267.0</td>\n",
       "      <td>23389.00</td>\n",
       "      <td>X-Men__Days_of_Future_Past</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>214</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>504.6700</td>\n",
       "      <td>1.066600e+01</td>\n",
       "      <td>10.704000</td>\n",
       "      <td>8.930900</td>\n",
       "      <td>10.311000</td>\n",
       "      <td>141960.0</td>\n",
       "      <td>16442.00</td>\n",
       "      <td>35903.0</td>\n",
       "      <td>16546.00</td>\n",
       "      <td>X-Men__First_Class</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>215</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.002633</td>\n",
       "      <td>0.002075</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.007275</td>\n",
       "      <td>0.006686</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.004481</td>\n",
       "      <td>...</td>\n",
       "      <td>25645.0000</td>\n",
       "      <td>8.857700e-06</td>\n",
       "      <td>0.005710</td>\n",
       "      <td>0.000017</td>\n",
       "      <td>0.005710</td>\n",
       "      <td>112900.0</td>\n",
       "      <td>25645.00</td>\n",
       "      <td>57600.0</td>\n",
       "      <td>25645.00</td>\n",
       "      <td>Yentl</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>216</th>\n",
       "      <td>0.063072</td>\n",
       "      <td>0.120370</td>\n",
       "      <td>0.150470</td>\n",
       "      <td>0.105100</td>\n",
       "      <td>0.302760</td>\n",
       "      <td>0.331970</td>\n",
       "      <td>0.326790</td>\n",
       "      <td>0.317470</td>\n",
       "      <td>0.304080</td>\n",
       "      <td>0.329360</td>\n",
       "      <td>...</td>\n",
       "      <td>534.7900</td>\n",
       "      <td>2.215900e+01</td>\n",
       "      <td>19.363000</td>\n",
       "      <td>16.777000</td>\n",
       "      <td>19.220000</td>\n",
       "      <td>370890.0</td>\n",
       "      <td>40598.00</td>\n",
       "      <td>81681.0</td>\n",
       "      <td>41165.00</td>\n",
       "      <td>Yves_Saint_Laurent</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>217</th>\n",
       "      <td>0.010121</td>\n",
       "      <td>0.004294</td>\n",
       "      <td>0.001727</td>\n",
       "      <td>0.084350</td>\n",
       "      <td>0.028502</td>\n",
       "      <td>0.039242</td>\n",
       "      <td>0.046928</td>\n",
       "      <td>0.556250</td>\n",
       "      <td>0.036940</td>\n",
       "      <td>0.101910</td>\n",
       "      <td>...</td>\n",
       "      <td>721.3200</td>\n",
       "      <td>5.893600e+00</td>\n",
       "      <td>5.977900</td>\n",
       "      <td>4.584800</td>\n",
       "      <td>5.697700</td>\n",
       "      <td>10086.0</td>\n",
       "      <td>2498.40</td>\n",
       "      <td>4378.6</td>\n",
       "      <td>2334.20</td>\n",
       "      <td>Zombieland</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>218 rows × 1653 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "            0         1         2         3         4         5         6  \\\n",
       "0    0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "1    0.000000  0.193000  0.192990  0.000000  0.000000  0.271100  0.271100   \n",
       "2    0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "3    0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "4    0.272800  0.260960  0.270090  0.318910  0.296170  0.277970  0.304250   \n",
       "5    0.000000  0.000000  0.000161  0.000162  0.313130  0.344490  0.341150   \n",
       "6    0.000000  0.000000  0.000000  0.000000  0.339790  0.161840  0.141070   \n",
       "7    0.271970  0.334210  0.316890  0.307720  0.265150  0.276710  0.265630   \n",
       "8    0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "9    0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "10   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "11   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "12   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "13   0.434330  0.447210  0.027070  0.245120  0.364930  0.478110  0.392060   \n",
       "14   0.134080  0.203490  0.215750  0.186110  0.246650  0.273480  0.272380   \n",
       "15   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "16   0.053247  0.145600  0.122740  0.035300  0.315080  0.266740  0.230370   \n",
       "17   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "18   0.290990  0.326400  0.318940  0.311370  0.298140  0.306560  0.297380   \n",
       "19   0.005963  0.023951  0.028510  0.061558  0.044613  0.049806  0.032554   \n",
       "20   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "21   0.363190  0.409210  0.268550  0.156270  0.272130  0.336440  0.348700   \n",
       "22   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "23   0.002460  0.003696  0.003812  0.027867  0.006516  0.013417  0.012003   \n",
       "24   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "25   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "26   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "27   0.209470  0.246400  0.240960  0.222420  0.267430  0.286790  0.289760   \n",
       "28   0.235150  0.277040  0.270530  0.245830  0.230190  0.259910  0.268810   \n",
       "29   0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "..        ...       ...       ...       ...       ...       ...       ...   \n",
       "188  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "189  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "190  0.297000  0.320510  0.308620  0.297130  0.297940  0.302130  0.292430   \n",
       "191  0.280960  0.333330  0.336400  0.305370  0.338090  0.356980  0.349490   \n",
       "192  0.000000  0.266250  0.266250  0.000000  0.000000  0.306710  0.306710   \n",
       "193  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "194  0.000503  0.000936  0.000674  0.011439  0.002610  0.003995  0.003767   \n",
       "195  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "196  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "197  0.247200  0.268550  0.260970  0.243260  0.266650  0.261520  0.263370   \n",
       "198  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "199  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "200  0.238580  0.249240  0.342330  0.325370  0.284380  0.316750  0.405560   \n",
       "201  0.287890  0.320650  0.317640  0.289620  0.309020  0.316080  0.315140   \n",
       "202  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "203  0.137650  0.276900  0.278090  0.005579  0.098563  0.248180  0.270330   \n",
       "204  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "205  0.275500  0.286510  0.282350  0.271590  0.244740  0.257250  0.261990   \n",
       "206  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "207  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "208  0.008526  0.005164  0.001745  0.002335  0.012249  0.010098  0.004991   \n",
       "209  0.000000  0.000000  0.000000  0.000000  0.199080  0.277980  0.316510   \n",
       "210  0.292970  0.324030  0.338840  0.333360  0.288340  0.300330  0.310330   \n",
       "211  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "212  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "213  0.223640  0.277110  0.289560  0.258550  0.313380  0.341870  0.340690   \n",
       "214  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000  0.000000   \n",
       "215  0.000000  0.002633  0.002075  0.000000  0.000000  0.007275  0.006686   \n",
       "216  0.063072  0.120370  0.150470  0.105100  0.302760  0.331970  0.326790   \n",
       "217  0.010121  0.004294  0.001727  0.084350  0.028502  0.039242  0.046928   \n",
       "\n",
       "            7         8         9  \\\n",
       "0    0.000000  0.000000  0.000000   \n",
       "1    0.000000  0.000000  0.270240   \n",
       "2    0.000000  0.000000  0.000000   \n",
       "3    0.000000  0.000000  0.000000   \n",
       "4    0.357020  0.270390  0.302700   \n",
       "5    0.321080  0.308520  0.339390   \n",
       "6    0.224330  0.239770  0.166240   \n",
       "7    0.275900  0.240060  0.145130   \n",
       "8    0.000000  0.000000  0.000000   \n",
       "9    0.000000  0.000000  0.000000   \n",
       "10   0.000000  0.000000  0.000000   \n",
       "11   0.000000  0.000000  0.000000   \n",
       "12   0.000000  0.000000  0.000000   \n",
       "13   0.388810  0.230150  0.347980   \n",
       "14   0.261680  0.262910  0.290560   \n",
       "15   0.000000  0.000000  0.000000   \n",
       "16   0.265030  0.291750  0.282430   \n",
       "17   0.000000  0.000000  0.000000   \n",
       "18   0.314740  0.175290  0.198100   \n",
       "19   0.070085  0.040795  0.046450   \n",
       "20   0.000000  0.000000  0.000000   \n",
       "21   0.315240  0.217470  0.308260   \n",
       "22   0.000000  0.000000  0.000000   \n",
       "23   0.066500  0.003371  0.003234   \n",
       "24   0.000000  0.000000  0.000000   \n",
       "25   0.000000  0.000000  0.000000   \n",
       "26   0.000000  0.000000  0.000000   \n",
       "27   0.295070  0.278350  0.295640   \n",
       "28   0.258780  0.210050  0.243930   \n",
       "29   0.000000  0.000000  0.000000   \n",
       "..        ...       ...       ...   \n",
       "188  0.000000  0.000000  0.000000   \n",
       "189  0.000000  0.000000  0.000000   \n",
       "190  0.303390  0.162950  0.228300   \n",
       "191  0.330910  0.340260  0.359490   \n",
       "192  0.000000  0.421810  0.355100   \n",
       "193  0.000000  0.000000  0.000000   \n",
       "194  0.066450  0.002711  0.004708   \n",
       "195  0.000000  0.000000  0.000000   \n",
       "196  0.000000  0.000000  0.000000   \n",
       "197  0.280910  0.214230  0.213900   \n",
       "198  0.000000  0.000000  0.000000   \n",
       "199  0.000000  0.000000  0.000000   \n",
       "200  0.378410  0.267780  0.345280   \n",
       "201  0.320340  0.245220  0.228330   \n",
       "202  0.000000  0.000000  0.000000   \n",
       "203  0.275280  0.286550  0.278150   \n",
       "204  0.000000  0.000000  0.000000   \n",
       "205  0.261850  0.219630  0.231560   \n",
       "206  0.000000  0.000000  0.000000   \n",
       "207  0.000000  0.000000  0.000000   \n",
       "208  0.003161  0.019266  0.010823   \n",
       "209  0.307570  0.199080  0.277980   \n",
       "210  0.334610  0.109390  0.177980   \n",
       "211  0.000000  0.000000  0.000000   \n",
       "212  0.000000  0.000000  0.000000   \n",
       "213  0.325240  0.307790  0.345820   \n",
       "214  0.000000  0.000000  0.000000   \n",
       "215  0.000000  0.000000  0.004481   \n",
       "216  0.317470  0.304080  0.329360   \n",
       "217  0.556250  0.036940  0.101910   \n",
       "\n",
       "                           ...                                1643  \\\n",
       "0                          ...                         269700.0000   \n",
       "1                          ...                          15454.0000   \n",
       "2                          ...                         119790.0000   \n",
       "3                          ...                             43.2690   \n",
       "4                          ...                             60.5890   \n",
       "5                          ...                            854.0200   \n",
       "6                          ...                           7772.2000   \n",
       "7                          ...                             86.8600   \n",
       "8                          ...                             51.9700   \n",
       "9                          ...                         112920.0000   \n",
       "10                         ...                         119790.0000   \n",
       "11                         ...                            384.9700   \n",
       "12                         ...                         119950.0000   \n",
       "13                         ...                            446.5300   \n",
       "14                         ...                            106.8300   \n",
       "15                         ...                          37959.0000   \n",
       "16                         ...                            592.4700   \n",
       "17                         ...                          55609.0000   \n",
       "18                         ...                            178.9500   \n",
       "19                         ...                            121.6700   \n",
       "20                         ...                           8698.1000   \n",
       "21                         ...                           1299.1000   \n",
       "22                         ...                         269700.0000   \n",
       "23                         ...                            184.6100   \n",
       "24                         ...                         119950.0000   \n",
       "25                         ...                         119950.0000   \n",
       "26                         ...                           1974.7000   \n",
       "27                         ...                            261.8200   \n",
       "28                         ...                           2375.3000   \n",
       "29                         ...                         119950.0000   \n",
       "..                         ...                                 ...   \n",
       "188                        ...                          55609.0000   \n",
       "189                        ...                         119950.0000   \n",
       "190                        ...                            265.2500   \n",
       "191                        ...                            343.1300   \n",
       "192                        ...                          20369.0000   \n",
       "193                        ...                         119790.0000   \n",
       "194                        ...                           2243.6000   \n",
       "195                        ...                             92.2130   \n",
       "196                        ...                            455.4100   \n",
       "197                        ...                             67.1210   \n",
       "198                        ...                          55609.0000   \n",
       "199                        ...                             14.5870   \n",
       "200                        ...                              7.0926   \n",
       "201                        ...                            359.6100   \n",
       "202                        ...                         119950.0000   \n",
       "203                        ...                          28388.0000   \n",
       "204                        ...                            158.8800   \n",
       "205                        ...                            236.7600   \n",
       "206                        ...                          37959.0000   \n",
       "207                        ...                          25104.0000   \n",
       "208                        ...                             65.1620   \n",
       "209                        ...                          18110.0000   \n",
       "210                        ...                            453.0100   \n",
       "211                        ...                              8.1797   \n",
       "212                        ...                         119790.0000   \n",
       "213                        ...                            594.1700   \n",
       "214                        ...                            504.6700   \n",
       "215                        ...                          25645.0000   \n",
       "216                        ...                            534.7900   \n",
       "217                        ...                            721.3200   \n",
       "\n",
       "             1644       1645       1646       1647       1648       1649  \\\n",
       "0    6.103500e-07   0.001645   0.000002   0.001645  1638400.0  269700.00   \n",
       "1    1.529400e+01  13.422000  13.418000  13.307000    71633.0   21855.00   \n",
       "2    1.377600e-06   0.002470   0.000004   0.002470   725900.0  119790.00   \n",
       "3    2.964500e+00   3.737800   2.463500   3.952600     4444.8    2405.40   \n",
       "4    7.630400e+00   8.487600   7.460300   8.475200     5797.3     460.95   \n",
       "5    2.176400e+01  16.822000  14.428000  16.660000   259450.0   32323.00   \n",
       "6    1.239100e+01  12.498000  12.388000  12.783000    36773.0    7978.00   \n",
       "7    6.819900e+00   7.184600   6.196700   7.160700     5318.3    1022.90   \n",
       "8    7.853800e+00   8.116700   6.557600   7.814300     8186.6    1578.00   \n",
       "9    1.371100e-06   0.002504   0.000005   0.002504   729320.0  112920.00   \n",
       "10   1.377600e-06   0.002470   0.000004   0.002470   725900.0  119790.00   \n",
       "11   1.608600e+01  12.814000  10.922000  12.903000    80685.0   10556.00   \n",
       "12   1.371100e-06   0.002466   0.000004   0.002466   729320.0  119950.00   \n",
       "13   5.308700e+00   5.614600   4.623000   5.461100    10250.0    2212.80   \n",
       "14   2.061200e+01  18.973000  16.409000  19.020000    61284.0    8706.80   \n",
       "15   4.340300e-06   0.004386   0.000014   0.004386   230400.0   37959.00   \n",
       "16   7.296200e+00   8.108000   8.592300   7.547800   927510.0  302830.00   \n",
       "17   4.340300e-06   0.003916   0.000008   0.003916   230400.0   55609.00   \n",
       "18   1.961800e+01  19.591000  18.443000  19.614000    99528.0   14192.00   \n",
       "19   2.113700e+00   1.993900   1.016400   2.126400     6797.7    2722.40   \n",
       "20   4.319500e+00   3.472700   0.912420   3.445200    29166.0   10501.00   \n",
       "21   5.268900e+00   5.720600   4.040200   5.609500     6047.1    3228.70   \n",
       "22   6.103500e-07   0.001645   0.000002   0.001645  1638400.0  269700.00   \n",
       "23   3.494100e-02   0.202970   0.097011   0.202050    29575.0    2124.70   \n",
       "24   1.371100e-06   0.002466   0.000004   0.002466   729320.0  119950.00   \n",
       "25   1.371100e-06   0.002466   0.000004   0.002466   729320.0  119950.00   \n",
       "26   5.947800e-01   0.757800   0.507530   0.707840     8599.4    3114.90   \n",
       "27   1.566100e+01  16.005000  13.684000  15.575000   212900.0   22254.00   \n",
       "28   9.098500e+00   8.987400   8.742600   9.073900     9156.9    2404.40   \n",
       "29   1.371100e-06   0.002466   0.000004   0.002466   729320.0  119950.00   \n",
       "..            ...        ...        ...        ...        ...        ...   \n",
       "188  4.340300e-06   0.003916   0.000008   0.003916   230400.0   55609.00   \n",
       "189  1.371100e-06   0.002466   0.000004   0.002466   729320.0  119950.00   \n",
       "190  2.200600e+01  20.788000  18.185000  20.605000    62373.0    8412.20   \n",
       "191  2.112200e+01  21.524000  19.339000  21.286000   176660.0   27540.00   \n",
       "192  1.243800e+01  12.447000  11.873000  12.425000    64079.0   20369.00   \n",
       "193  1.377600e-06   0.002470   0.000004   0.002470   725900.0  119790.00   \n",
       "194  5.319300e-01   0.710540   0.507170   0.741290     8616.0    2226.70   \n",
       "195  1.261300e+01  11.315000   9.588900  11.194000    30389.0    3410.50   \n",
       "196  8.044600e+00   9.408400   7.057300   8.555500    26140.0    5433.60   \n",
       "197  1.729300e+01  18.944000  17.139000  18.654000    85704.0   17313.00   \n",
       "198  4.340300e-06   0.003916   0.000008   0.003916   230400.0   55609.00   \n",
       "199  2.066700e+01  21.193000  18.366000  21.123000    31826.0    3774.50   \n",
       "200  1.122600e+01  11.593000   9.857100  11.627000    36342.0   11420.00   \n",
       "201  2.293100e+01  21.043000  18.369000  20.910000    87356.0   12388.00   \n",
       "202  1.371100e-06   0.002466   0.000004   0.002466   729320.0  119950.00   \n",
       "203  1.172900e+01  10.587000   8.380000  10.439000   104230.0   31198.00   \n",
       "204  5.333300e-01   0.574830   0.403320   0.597660     3036.1     674.78   \n",
       "205  1.593800e+01  14.916000  12.558000  14.437000    60114.0    7629.80   \n",
       "206  4.340300e-06   0.004386   0.000014   0.004386   230400.0   37959.00   \n",
       "207  4.340300e-06   0.004812   0.000024   0.004812   230400.0   25104.00   \n",
       "208  2.070300e+01  19.196000  16.620000  19.183000    35967.0    5644.50   \n",
       "209  1.204400e+01  12.081000  13.335000  12.137000    79233.0   18418.00   \n",
       "210  2.038500e+01  20.693000  18.948000  20.541000    42792.0    7356.20   \n",
       "211  1.976500e+01  22.132000  19.341000  21.789000    49730.0    5041.20   \n",
       "212  1.377600e-06   0.002470   0.000004   0.002470   725900.0  119790.00   \n",
       "213  2.318900e+01  19.177000  16.266000  18.939000   190970.0   23218.00   \n",
       "214  1.066600e+01  10.704000   8.930900  10.311000   141960.0   16442.00   \n",
       "215  8.857700e-06   0.005710   0.000017   0.005710   112900.0   25645.00   \n",
       "216  2.215900e+01  19.363000  16.777000  19.220000   370890.0   40598.00   \n",
       "217  5.893600e+00   5.977900   4.584800   5.697700    10086.0    2498.40   \n",
       "\n",
       "         1650       1651                                         file_name  \n",
       "0    518400.0  269700.00                                         10.000_Km  \n",
       "1     48314.0   24434.00                                  12_Years_a_Slave  \n",
       "2    230400.0  119790.00                                    21_Jump_Street  \n",
       "3      5602.6    2611.10                                      A_Bug's_Life  \n",
       "4      1206.1     458.15                                    A_Little_Chaos  \n",
       "5     57982.0   32463.00                                 A_Most_Wanted_Man  \n",
       "6     13848.0    7937.10                                     A_Simple_Life  \n",
       "7      3030.9    1012.10                                   Aanmodderfakker  \n",
       "8      2474.1    1736.40                                         Alexander  \n",
       "9    211600.0  112920.00                               Alice_in_Wonderland  \n",
       "10   230400.0  119790.00                                   American_Sniper  \n",
       "11    18197.0   10486.00                                         Anastasia  \n",
       "12   230400.0  119950.00                                    And_So_It_Goes  \n",
       "13     4488.6    2270.10                                              Antz  \n",
       "14    16447.0    8680.80                                            Avatar  \n",
       "15    72900.0   37959.00                                    Bad_News_Bears  \n",
       "16   465010.0  316520.00                                          Banklady  \n",
       "17   129600.0   55609.00                                       Beetlejuice  \n",
       "18    35310.0   14256.00                                       Begin_Again  \n",
       "19     8510.8    2390.50                                     Belle_de_Jour  \n",
       "20    36679.0    9308.10                                     Bewakoofiyaan  \n",
       "21     7958.9    3300.00                                        Bhoothnath  \n",
       "22   518400.0  269700.00                                          Big_Game  \n",
       "23     3583.7    2158.80                                      Billy_Elliot  \n",
       "24   230400.0  119950.00  Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)  \n",
       "25   230400.0  119950.00                                           Blended  \n",
       "26     7767.2    3580.80                                          Blow_Out  \n",
       "27    46058.0   22567.00                                      Bride_Flight  \n",
       "28     4628.7    2555.10                               Bridges_of_Sarajevo  \n",
       "29   230400.0  119950.00                                         Burlesque  \n",
       "..        ...        ...                                               ...  \n",
       "188  129600.0   55609.00                           The_Talented_Mr._Ripley  \n",
       "189  230400.0  119950.00                                 The_Trip_to_Italy  \n",
       "190   19073.0    8520.60                                        The_Voices  \n",
       "191   56619.0   27869.00                                 The_Water_Diviner  \n",
       "192   40388.0   20865.00           The_White_Haired_Witch_of_Lunar_Kingdom  \n",
       "193  230400.0  119790.00                           The_Wolf_of_Wall_Street  \n",
       "194    6476.7    2353.00                                   Thelma___Louise  \n",
       "195    7320.8    3404.60                               There_Will_Be_Blood  \n",
       "196   13783.0    9447.60                              Thor__The_Dark_World  \n",
       "197   33871.0   17173.00                                           Titanic  \n",
       "198  129600.0   55609.00                                         Tommy_Boy  \n",
       "199   10586.0    3767.80                                     Trainspotting  \n",
       "200   23160.0   11730.00                                             Trash  \n",
       "201   24422.0   12314.00                                          Unbroken  \n",
       "202  230400.0  119950.00                                          Valkyrie  \n",
       "203  120160.0   31935.00                                 Verliefd_op_Ibiza  \n",
       "204    1484.9     601.38                                     Walk_the_Line  \n",
       "205   15487.0    7513.00                                           Warrior  \n",
       "206   72900.0   37959.00                                    Wassup_Rockers  \n",
       "207   41616.0   25104.00                                          Watchmen  \n",
       "208   10165.0    5831.60                           Wet_Hot_American_Summer  \n",
       "209   31255.0   18263.00                         What_We_Do_in_the_Shadows  \n",
       "210   14528.0    7332.50                                          Whiplash  \n",
       "211   12907.0    5079.70                           Who_Framed_Roger_Rabbit  \n",
       "212  230400.0  119790.00                                   Wish_I_Was_Here  \n",
       "213   45267.0   23389.00                        X-Men__Days_of_Future_Past  \n",
       "214   35903.0   16546.00                                X-Men__First_Class  \n",
       "215   57600.0   25645.00                                             Yentl  \n",
       "216   81681.0   41165.00                                Yves_Saint_Laurent  \n",
       "217    4378.6    2334.20                                        Zombieland  \n",
       "\n",
       "[218 rows x 1653 columns]"
      ]
     },
     "execution_count": 101,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_vis_train = get_all_vis_features(df_base_train,use_train=False)\n",
    "df_vis_train"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 168,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>country_Australia</th>\n",
       "      <th>country_Belgium</th>\n",
       "      <th>country_BosniaandHerzegovina</th>\n",
       "      <th>country_Brazil</th>\n",
       "      <th>country_Bulgaria</th>\n",
       "      <th>country_Canada</th>\n",
       "      <th>country_China</th>\n",
       "      <th>country_CzechRepublic</th>\n",
       "      <th>country_Denmark</th>\n",
       "      <th>country_Finland</th>\n",
       "      <th>...</th>\n",
       "      <th>rated_N/A</th>\n",
       "      <th>rated_NOT RATED</th>\n",
       "      <th>rated_PG</th>\n",
       "      <th>rated_PG-13</th>\n",
       "      <th>rated_R</th>\n",
       "      <th>rated_TV-MA</th>\n",
       "      <th>rated_UNRATED</th>\n",
       "      <th>runtime</th>\n",
       "      <th>year</th>\n",
       "      <th>file_name</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>99</td>\n",
       "      <td>2014</td>\n",
       "      <td>10.000_Km</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>134</td>\n",
       "      <td>2013</td>\n",
       "      <td>12_Years_a_Slave</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>109</td>\n",
       "      <td>2012</td>\n",
       "      <td>21_Jump_Street</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>95</td>\n",
       "      <td>1998</td>\n",
       "      <td>A_Bug's_Life</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>117</td>\n",
       "      <td>2014</td>\n",
       "      <td>A_Little_Chaos</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>122</td>\n",
       "      <td>2014</td>\n",
       "      <td>A_Most_Wanted_Man</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>118</td>\n",
       "      <td>2011</td>\n",
       "      <td>A_Simple_Life</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>100</td>\n",
       "      <td>2014</td>\n",
       "      <td>Aanmodderfakker</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>175</td>\n",
       "      <td>2004</td>\n",
       "      <td>Alexander</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>108</td>\n",
       "      <td>2010</td>\n",
       "      <td>Alice_in_Wonderland</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>132</td>\n",
       "      <td>2014</td>\n",
       "      <td>American_Sniper</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>94</td>\n",
       "      <td>1997</td>\n",
       "      <td>Anastasia</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>94</td>\n",
       "      <td>2014</td>\n",
       "      <td>And_So_It_Goes</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>83</td>\n",
       "      <td>1998</td>\n",
       "      <td>Antz</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>162</td>\n",
       "      <td>2009</td>\n",
       "      <td>Avatar</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>113</td>\n",
       "      <td>2005</td>\n",
       "      <td>Bad_News_Bears</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>118</td>\n",
       "      <td>2013</td>\n",
       "      <td>Banklady</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>92</td>\n",
       "      <td>1988</td>\n",
       "      <td>Beetlejuice</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>104</td>\n",
       "      <td>2013</td>\n",
       "      <td>Begin_Again</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>101</td>\n",
       "      <td>1967</td>\n",
       "      <td>Belle_de_Jour</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>119</td>\n",
       "      <td>2014</td>\n",
       "      <td>Bewakoofiyaan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>150</td>\n",
       "      <td>2008</td>\n",
       "      <td>Bhoothnath</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>110</td>\n",
       "      <td>2014</td>\n",
       "      <td>Big_Game</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>110</td>\n",
       "      <td>2000</td>\n",
       "      <td>Billy_Elliot</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>119</td>\n",
       "      <td>2014</td>\n",
       "      <td>Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>117</td>\n",
       "      <td>2014</td>\n",
       "      <td>Blended</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>107</td>\n",
       "      <td>1981</td>\n",
       "      <td>Blow_Out</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>130</td>\n",
       "      <td>2008</td>\n",
       "      <td>Bride_Flight</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>114</td>\n",
       "      <td>2014</td>\n",
       "      <td>Bridges_of_Sarajevo</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>119</td>\n",
       "      <td>2010</td>\n",
       "      <td>Burlesque</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>188</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>139</td>\n",
       "      <td>1999</td>\n",
       "      <td>The_Talented_Mr._Ripley</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>189</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>108</td>\n",
       "      <td>2014</td>\n",
       "      <td>The_Trip_to_Italy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>190</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>103</td>\n",
       "      <td>2014</td>\n",
       "      <td>The_Voices</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>191</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>111</td>\n",
       "      <td>2014</td>\n",
       "      <td>The_Water_Diviner</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>192</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>104</td>\n",
       "      <td>2014</td>\n",
       "      <td>The_White_Haired_Witch_of_Lunar_Kingdom</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>180</td>\n",
       "      <td>2013</td>\n",
       "      <td>The_Wolf_of_Wall_Street</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>194</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>130</td>\n",
       "      <td>1991</td>\n",
       "      <td>Thelma___Louise</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>195</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>158</td>\n",
       "      <td>2007</td>\n",
       "      <td>There_Will_Be_Blood</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>196</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>112</td>\n",
       "      <td>2013</td>\n",
       "      <td>Thor__The_Dark_World</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>197</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>194</td>\n",
       "      <td>1997</td>\n",
       "      <td>Titanic</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>97</td>\n",
       "      <td>1995</td>\n",
       "      <td>Tommy_Boy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>94</td>\n",
       "      <td>1996</td>\n",
       "      <td>Trainspotting</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>114</td>\n",
       "      <td>2014</td>\n",
       "      <td>Trash</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>201</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>137</td>\n",
       "      <td>2014</td>\n",
       "      <td>Unbroken</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>202</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>121</td>\n",
       "      <td>2008</td>\n",
       "      <td>Valkyrie</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>203</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>112</td>\n",
       "      <td>2013</td>\n",
       "      <td>Verliefd_op_Ibiza</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>204</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>136</td>\n",
       "      <td>2005</td>\n",
       "      <td>Walk_the_Line</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>205</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>140</td>\n",
       "      <td>2011</td>\n",
       "      <td>Warrior</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>206</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>111</td>\n",
       "      <td>2005</td>\n",
       "      <td>Wassup_Rockers</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>207</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>162</td>\n",
       "      <td>2009</td>\n",
       "      <td>Watchmen</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>97</td>\n",
       "      <td>2001</td>\n",
       "      <td>Wet_Hot_American_Summer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>209</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>86</td>\n",
       "      <td>2014</td>\n",
       "      <td>What_We_Do_in_the_Shadows</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>210</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>107</td>\n",
       "      <td>2014</td>\n",
       "      <td>Whiplash</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>211</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>104</td>\n",
       "      <td>1988</td>\n",
       "      <td>Who_Framed_Roger_Rabbit</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>212</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>106</td>\n",
       "      <td>2014</td>\n",
       "      <td>Wish_I_Was_Here</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>213</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>131</td>\n",
       "      <td>2014</td>\n",
       "      <td>X-Men__Days_of_Future_Past</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>214</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>132</td>\n",
       "      <td>2011</td>\n",
       "      <td>X-Men__First_Class</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>215</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>132</td>\n",
       "      <td>1983</td>\n",
       "      <td>Yentl</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>216</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>106</td>\n",
       "      <td>2014</td>\n",
       "      <td>Yves_Saint_Laurent</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>217</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>88</td>\n",
       "      <td>2009</td>\n",
       "      <td>Zombieland</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>218 rows × 108 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     country_Australia  country_Belgium  country_BosniaandHerzegovina  \\\n",
       "0                    0                0                             0   \n",
       "1                    0                0                             0   \n",
       "2                    0                0                             0   \n",
       "3                    0                0                             0   \n",
       "4                    0                0                             0   \n",
       "5                    0                0                             0   \n",
       "6                    0                0                             0   \n",
       "7                    0                0                             0   \n",
       "8                    0                0                             0   \n",
       "9                    0                0                             0   \n",
       "10                   0                0                             0   \n",
       "11                   0                0                             0   \n",
       "12                   0                0                             0   \n",
       "13                   0                0                             0   \n",
       "14                   0                0                             0   \n",
       "15                   0                0                             0   \n",
       "16                   0                0                             0   \n",
       "17                   0                0                             0   \n",
       "18                   0                0                             0   \n",
       "19                   0                0                             0   \n",
       "20                   0                0                             0   \n",
       "21                   0                0                             0   \n",
       "22                   0                0                             0   \n",
       "23                   0                0                             0   \n",
       "24                   0                0                             0   \n",
       "25                   0                0                             0   \n",
       "26                   0                0                             0   \n",
       "27                   0                0                             0   \n",
       "28                   0                0                             1   \n",
       "29                   0                0                             0   \n",
       "..                 ...              ...                           ...   \n",
       "188                  0                0                             0   \n",
       "189                  0                0                             0   \n",
       "190                  0                0                             0   \n",
       "191                  1                0                             0   \n",
       "192                  0                0                             0   \n",
       "193                  0                0                             0   \n",
       "194                  0                0                             0   \n",
       "195                  0                0                             0   \n",
       "196                  0                0                             0   \n",
       "197                  0                0                             0   \n",
       "198                  0                0                             0   \n",
       "199                  0                0                             0   \n",
       "200                  0                0                             0   \n",
       "201                  0                0                             0   \n",
       "202                  0                0                             0   \n",
       "203                  0                0                             0   \n",
       "204                  0                0                             0   \n",
       "205                  0                0                             0   \n",
       "206                  0                0                             0   \n",
       "207                  0                0                             0   \n",
       "208                  0                0                             0   \n",
       "209                  0                0                             0   \n",
       "210                  0                0                             0   \n",
       "211                  0                0                             0   \n",
       "212                  0                0                             0   \n",
       "213                  0                0                             0   \n",
       "214                  0                0                             0   \n",
       "215                  0                0                             0   \n",
       "216                  0                1                             0   \n",
       "217                  0                0                             0   \n",
       "\n",
       "     country_Brazil  country_Bulgaria  country_Canada  country_China  \\\n",
       "0                 0                 0               0              0   \n",
       "1                 0                 0               0              0   \n",
       "2                 0                 0               0              0   \n",
       "3                 0                 0               0              0   \n",
       "4                 0                 0               0              0   \n",
       "5                 0                 0               0              0   \n",
       "6                 0                 0               0              0   \n",
       "7                 0                 0               0              0   \n",
       "8                 0                 0               0              0   \n",
       "9                 0                 0               0              0   \n",
       "10                0                 0               0              0   \n",
       "11                0                 0               1              0   \n",
       "12                0                 0               0              0   \n",
       "13                0                 0               0              0   \n",
       "14                0                 0               0              0   \n",
       "15                0                 0               0              0   \n",
       "16                0                 0               0              0   \n",
       "17                0                 0               0              0   \n",
       "18                0                 0               0              0   \n",
       "19                0                 0               0              0   \n",
       "20                0                 0               0              0   \n",
       "21                0                 0               0              0   \n",
       "22                0                 0               0              0   \n",
       "23                0                 0               0              0   \n",
       "24                0                 0               0              0   \n",
       "25                0                 0               0              0   \n",
       "26                0                 0               0              0   \n",
       "27                0                 0               0              0   \n",
       "28                0                 1               0              0   \n",
       "29                0                 0               0              0   \n",
       "..              ...               ...             ...            ...   \n",
       "188               0                 0               0              0   \n",
       "189               0                 0               0              0   \n",
       "190               0                 0               0              0   \n",
       "191               0                 0               0              0   \n",
       "192               0                 0               0              1   \n",
       "193               0                 0               0              0   \n",
       "194               0                 0               0              0   \n",
       "195               0                 0               0              0   \n",
       "196               0                 0               0              0   \n",
       "197               0                 0               0              0   \n",
       "198               0                 0               0              0   \n",
       "199               0                 0               0              0   \n",
       "200               1                 0               0              0   \n",
       "201               0                 0               0              0   \n",
       "202               0                 0               0              0   \n",
       "203               0                 0               0              0   \n",
       "204               0                 0               0              0   \n",
       "205               0                 0               0              0   \n",
       "206               0                 0               0              0   \n",
       "207               0                 0               0              0   \n",
       "208               0                 0               0              0   \n",
       "209               0                 0               0              0   \n",
       "210               0                 0               0              0   \n",
       "211               0                 0               0              0   \n",
       "212               0                 0               0              0   \n",
       "213               0                 0               0              0   \n",
       "214               0                 0               0              0   \n",
       "215               0                 0               0              0   \n",
       "216               0                 0               0              0   \n",
       "217               0                 0               0              0   \n",
       "\n",
       "     country_CzechRepublic  country_Denmark  country_Finland  \\\n",
       "0                        0                0                0   \n",
       "1                        0                0                0   \n",
       "2                        0                0                0   \n",
       "3                        0                0                0   \n",
       "4                        0                0                0   \n",
       "5                        0                0                0   \n",
       "6                        0                0                0   \n",
       "7                        0                0                0   \n",
       "8                        0                0                0   \n",
       "9                        0                0                0   \n",
       "10                       0                0                0   \n",
       "11                       0                0                0   \n",
       "12                       0                0                0   \n",
       "13                       0                0                0   \n",
       "14                       0                0                0   \n",
       "15                       0                0                0   \n",
       "16                       0                0                0   \n",
       "17                       0                0                0   \n",
       "18                       0                0                0   \n",
       "19                       0                0                0   \n",
       "20                       0                0                0   \n",
       "21                       0                0                0   \n",
       "22                       0                0                1   \n",
       "23                       0                0                0   \n",
       "24                       0                0                0   \n",
       "25                       0                0                0   \n",
       "26                       0                0                0   \n",
       "27                       0                0                0   \n",
       "28                       0                0                0   \n",
       "29                       0                0                0   \n",
       "..                     ...              ...              ...   \n",
       "188                      0                0                0   \n",
       "189                      0                0                0   \n",
       "190                      0                0                0   \n",
       "191                      0                0                0   \n",
       "192                      0                0                0   \n",
       "193                      0                0                0   \n",
       "194                      0                0                0   \n",
       "195                      0                0                0   \n",
       "196                      0                0                0   \n",
       "197                      0                0                0   \n",
       "198                      0                0                0   \n",
       "199                      0                0                0   \n",
       "200                      0                0                0   \n",
       "201                      0                0                0   \n",
       "202                      0                0                0   \n",
       "203                      0                0                0   \n",
       "204                      0                0                0   \n",
       "205                      0                0                0   \n",
       "206                      0                0                0   \n",
       "207                      0                0                0   \n",
       "208                      0                0                0   \n",
       "209                      0                0                0   \n",
       "210                      0                0                0   \n",
       "211                      0                0                0   \n",
       "212                      0                0                0   \n",
       "213                      0                0                0   \n",
       "214                      0                0                0   \n",
       "215                      0                0                0   \n",
       "216                      0                0                0   \n",
       "217                      0                0                0   \n",
       "\n",
       "                           ...                         rated_N/A  \\\n",
       "0                          ...                                 0   \n",
       "1                          ...                                 0   \n",
       "2                          ...                                 0   \n",
       "3                          ...                                 0   \n",
       "4                          ...                                 0   \n",
       "5                          ...                                 0   \n",
       "6                          ...                                 0   \n",
       "7                          ...                                 1   \n",
       "8                          ...                                 0   \n",
       "9                          ...                                 0   \n",
       "10                         ...                                 0   \n",
       "11                         ...                                 0   \n",
       "12                         ...                                 0   \n",
       "13                         ...                                 0   \n",
       "14                         ...                                 0   \n",
       "15                         ...                                 0   \n",
       "16                         ...                                 1   \n",
       "17                         ...                                 0   \n",
       "18                         ...                                 0   \n",
       "19                         ...                                 0   \n",
       "20                         ...                                 1   \n",
       "21                         ...                                 1   \n",
       "22                         ...                                 0   \n",
       "23                         ...                                 0   \n",
       "24                         ...                                 0   \n",
       "25                         ...                                 0   \n",
       "26                         ...                                 0   \n",
       "27                         ...                                 0   \n",
       "28                         ...                                 1   \n",
       "29                         ...                                 0   \n",
       "..                         ...                               ...   \n",
       "188                        ...                                 0   \n",
       "189                        ...                                 0   \n",
       "190                        ...                                 0   \n",
       "191                        ...                                 0   \n",
       "192                        ...                                 1   \n",
       "193                        ...                                 0   \n",
       "194                        ...                                 0   \n",
       "195                        ...                                 0   \n",
       "196                        ...                                 0   \n",
       "197                        ...                                 0   \n",
       "198                        ...                                 0   \n",
       "199                        ...                                 0   \n",
       "200                        ...                                 0   \n",
       "201                        ...                                 0   \n",
       "202                        ...                                 0   \n",
       "203                        ...                                 1   \n",
       "204                        ...                                 0   \n",
       "205                        ...                                 0   \n",
       "206                        ...                                 0   \n",
       "207                        ...                                 0   \n",
       "208                        ...                                 0   \n",
       "209                        ...                                 0   \n",
       "210                        ...                                 0   \n",
       "211                        ...                                 0   \n",
       "212                        ...                                 0   \n",
       "213                        ...                                 0   \n",
       "214                        ...                                 0   \n",
       "215                        ...                                 0   \n",
       "216                        ...                                 0   \n",
       "217                        ...                                 0   \n",
       "\n",
       "     rated_NOT RATED  rated_PG  rated_PG-13  rated_R  rated_TV-MA  \\\n",
       "0                  0         0            0        1            0   \n",
       "1                  0         0            0        1            0   \n",
       "2                  0         0            0        1            0   \n",
       "3                  0         0            0        0            0   \n",
       "4                  0         0            0        1            0   \n",
       "5                  0         0            0        1            0   \n",
       "6                  1         0            0        0            0   \n",
       "7                  0         0            0        0            0   \n",
       "8                  0         0            0        1            0   \n",
       "9                  0         1            0        0            0   \n",
       "10                 0         0            0        1            0   \n",
       "11                 0         0            0        0            0   \n",
       "12                 0         0            1        0            0   \n",
       "13                 0         1            0        0            0   \n",
       "14                 0         0            1        0            0   \n",
       "15                 0         0            1        0            0   \n",
       "16                 0         0            0        0            0   \n",
       "17                 0         1            0        0            0   \n",
       "18                 0         0            0        1            0   \n",
       "19                 0         0            0        0            0   \n",
       "20                 0         0            0        0            0   \n",
       "21                 0         0            0        0            0   \n",
       "22                 0         0            1        0            0   \n",
       "23                 0         0            1        0            0   \n",
       "24                 0         0            0        1            0   \n",
       "25                 0         0            1        0            0   \n",
       "26                 0         0            0        1            0   \n",
       "27                 0         0            0        1            0   \n",
       "28                 0         0            0        0            0   \n",
       "29                 0         0            1        0            0   \n",
       "..               ...       ...          ...      ...          ...   \n",
       "188                0         0            0        1            0   \n",
       "189                1         0            0        0            0   \n",
       "190                0         0            0        1            0   \n",
       "191                0         0            0        1            0   \n",
       "192                0         0            0        0            0   \n",
       "193                0         0            0        1            0   \n",
       "194                0         0            0        1            0   \n",
       "195                0         0            0        1            0   \n",
       "196                0         0            1        0            0   \n",
       "197                0         0            1        0            0   \n",
       "198                0         0            1        0            0   \n",
       "199                0         0            0        1            0   \n",
       "200                0         0            0        1            0   \n",
       "201                0         0            1        0            0   \n",
       "202                0         0            1        0            0   \n",
       "203                0         0            0        0            0   \n",
       "204                0         0            1        0            0   \n",
       "205                0         0            1        0            0   \n",
       "206                0         0            0        1            0   \n",
       "207                0         0            0        1            0   \n",
       "208                0         0            0        1            0   \n",
       "209                0         0            0        1            0   \n",
       "210                0         0            0        1            0   \n",
       "211                0         1            0        0            0   \n",
       "212                0         0            0        1            0   \n",
       "213                0         0            1        0            0   \n",
       "214                0         0            1        0            0   \n",
       "215                0         1            0        0            0   \n",
       "216                0         0            0        1            0   \n",
       "217                0         0            0        1            0   \n",
       "\n",
       "     rated_UNRATED  runtime  year  \\\n",
       "0                0       99  2014   \n",
       "1                0      134  2013   \n",
       "2                0      109  2012   \n",
       "3                0       95  1998   \n",
       "4                0      117  2014   \n",
       "5                0      122  2014   \n",
       "6                0      118  2011   \n",
       "7                0      100  2014   \n",
       "8                0      175  2004   \n",
       "9                0      108  2010   \n",
       "10               0      132  2014   \n",
       "11               0       94  1997   \n",
       "12               0       94  2014   \n",
       "13               0       83  1998   \n",
       "14               0      162  2009   \n",
       "15               0      113  2005   \n",
       "16               0      118  2013   \n",
       "17               0       92  1988   \n",
       "18               0      104  2013   \n",
       "19               0      101  1967   \n",
       "20               0      119  2014   \n",
       "21               0      150  2008   \n",
       "22               0      110  2014   \n",
       "23               0      110  2000   \n",
       "24               0      119  2014   \n",
       "25               0      117  2014   \n",
       "26               0      107  1981   \n",
       "27               0      130  2008   \n",
       "28               0      114  2014   \n",
       "29               0      119  2010   \n",
       "..             ...      ...   ...   \n",
       "188              0      139  1999   \n",
       "189              0      108  2014   \n",
       "190              0      103  2014   \n",
       "191              0      111  2014   \n",
       "192              0      104  2014   \n",
       "193              0      180  2013   \n",
       "194              0      130  1991   \n",
       "195              0      158  2007   \n",
       "196              0      112  2013   \n",
       "197              0      194  1997   \n",
       "198              0       97  1995   \n",
       "199              0       94  1996   \n",
       "200              0      114  2014   \n",
       "201              0      137  2014   \n",
       "202              0      121  2008   \n",
       "203              0      112  2013   \n",
       "204              0      136  2005   \n",
       "205              0      140  2011   \n",
       "206              0      111  2005   \n",
       "207              0      162  2009   \n",
       "208              0       97  2001   \n",
       "209              0       86  2014   \n",
       "210              0      107  2014   \n",
       "211              0      104  1988   \n",
       "212              0      106  2014   \n",
       "213              0      131  2014   \n",
       "214              0      132  2011   \n",
       "215              0      132  1983   \n",
       "216              0      106  2014   \n",
       "217              0       88  2009   \n",
       "\n",
       "                                            file_name  \n",
       "0                                           10.000_Km  \n",
       "1                                    12_Years_a_Slave  \n",
       "2                                      21_Jump_Street  \n",
       "3                                        A_Bug's_Life  \n",
       "4                                      A_Little_Chaos  \n",
       "5                                   A_Most_Wanted_Man  \n",
       "6                                       A_Simple_Life  \n",
       "7                                     Aanmodderfakker  \n",
       "8                                           Alexander  \n",
       "9                                 Alice_in_Wonderland  \n",
       "10                                    American_Sniper  \n",
       "11                                          Anastasia  \n",
       "12                                     And_So_It_Goes  \n",
       "13                                               Antz  \n",
       "14                                             Avatar  \n",
       "15                                     Bad_News_Bears  \n",
       "16                                           Banklady  \n",
       "17                                        Beetlejuice  \n",
       "18                                        Begin_Again  \n",
       "19                                      Belle_de_Jour  \n",
       "20                                      Bewakoofiyaan  \n",
       "21                                         Bhoothnath  \n",
       "22                                           Big_Game  \n",
       "23                                       Billy_Elliot  \n",
       "24   Birdman__Or_(The_Unexpected_Virtue_of_Ignorance)  \n",
       "25                                            Blended  \n",
       "26                                           Blow_Out  \n",
       "27                                       Bride_Flight  \n",
       "28                                Bridges_of_Sarajevo  \n",
       "29                                          Burlesque  \n",
       "..                                                ...  \n",
       "188                           The_Talented_Mr._Ripley  \n",
       "189                                 The_Trip_to_Italy  \n",
       "190                                        The_Voices  \n",
       "191                                 The_Water_Diviner  \n",
       "192           The_White_Haired_Witch_of_Lunar_Kingdom  \n",
       "193                           The_Wolf_of_Wall_Street  \n",
       "194                                   Thelma___Louise  \n",
       "195                               There_Will_Be_Blood  \n",
       "196                              Thor__The_Dark_World  \n",
       "197                                           Titanic  \n",
       "198                                         Tommy_Boy  \n",
       "199                                     Trainspotting  \n",
       "200                                             Trash  \n",
       "201                                          Unbroken  \n",
       "202                                          Valkyrie  \n",
       "203                                 Verliefd_op_Ibiza  \n",
       "204                                     Walk_the_Line  \n",
       "205                                           Warrior  \n",
       "206                                    Wassup_Rockers  \n",
       "207                                          Watchmen  \n",
       "208                           Wet_Hot_American_Summer  \n",
       "209                         What_We_Do_in_the_Shadows  \n",
       "210                                          Whiplash  \n",
       "211                           Who_Framed_Roger_Rabbit  \n",
       "212                                   Wish_I_Was_Here  \n",
       "213                        X-Men__Days_of_Future_Past  \n",
       "214                                X-Men__First_Class  \n",
       "215                                             Yentl  \n",
       "216                                Yves_Saint_Laurent  \n",
       "217                                        Zombieland  \n",
       "\n",
       "[218 rows x 108 columns]"
      ]
     },
     "execution_count": 168,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_meta_train = get_all_meta_features(df_base_train,use_train=False)\n",
    "\n",
    "df_meta_train\n",
    "#df_combined=pd.merge(df_meta_train, df_base_train, left_index=True, right_index=True)\n",
    "#df_combined=df_combined.drop(['file_name_x'],axis = 1)\n",
    "#df_combined=df_combined.drop(['file_name_y'],axis = 1)\n",
    "#df_combined=df_combined.drop(['movie_name'],axis = 1)\n",
    "\n",
    "#df_combined=df_combined.loc[:,['tomatoUserRating', 'goodforairplanes']]\n",
    "#df_combined.to_csv('ratingTomatoes.csv')\n",
    "#df_combined=pd.merge(df_vis_train, df_combined, left_index=True, right_index=True)\n",
    "#df_combined=df_combined.drop(['file_name'],axis = 1)\n",
    "#"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Implementation fun"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 169,
   "metadata": {},
   "outputs": [],
   "source": [
    "import random\n",
    "def sample_gen(n, forbid):\n",
    "    state = dict()\n",
    "    track = dict()\n",
    "    for (i, o) in enumerate(forbid):\n",
    "        x = track.get(o, o)\n",
    "        t = state.get(n-i-1, n-i-1)\n",
    "        state[x] = t\n",
    "        track[t] = x\n",
    "        state.pop(n-i-1, None)\n",
    "        track.pop(o, None)\n",
    "    del track\n",
    "    for remaining in range(n-len(forbid), 0, -1):\n",
    "        i = random.randrange(remaining)\n",
    "        yield state.get(i, i)\n",
    "        state[i] = state.get(remaining - 1, remaining - 1)\n",
    "        state.pop(remaining - 1, None)\n",
    "\n",
    "def randomSet(S,n=0):\n",
    "    Set = []\n",
    "    if (n==0):\n",
    "        n = len(S)\n",
    "    rand = random.randint(1,n)\n",
    "    return np.random.choice(S, rand ,replace=False)\n",
    "\n",
    "def InconCheck(S,D,T):\n",
    "    incon_value = 0\n",
    "    data = D[S]\n",
    "    data['target'] = T\n",
    "    # create dataframe\n",
    "    data_no = data.loc[data['target']==0]\n",
    "    data_no = data_no.drop('target',axis=1)\n",
    "    data_yes = data.loc[data['target']==1]\n",
    "    data_yes = data_yes.drop('target',axis=1)\n",
    "    no_df = pd.DataFrame(data_no.groupby(data_no.columns.tolist(),as_index=False).size().reset_index(name='target_no'))\n",
    "    yes_df = pd.DataFrame(data_yes.groupby(data_yes.columns.tolist(),as_index=False).size().reset_index(name='target_yes'))\n",
    "\n",
    "    result_df = pd.merge(no_df, yes_df, how='outer', on=S)\n",
    "    result_df = result_df.fillna(0)\n",
    "    result_df['inc'] = result_df['target_no']\n",
    "\n",
    "    for index, row in result_df.iterrows():\n",
    "        if (row['target_yes']>row['target_no']):\n",
    "            result_df.iloc[index,result_df.columns=='inc'] = row['target_no']\n",
    "        else:\n",
    "            result_df.iloc[index,result_df.columns=='inc'] = row['target_yes']\n",
    "    \n",
    "    incon_value = result_df['inc'].sum()\n",
    "    incon_value/len(D)\n",
    "\n",
    "    return incon_value\n",
    "\n",
    "def lvf(MAX_TRIES, D, TARGET_COLUMN, gamma):\n",
    "    C_best = len(D)\n",
    "    S_best = D.columns.values\n",
    "    M_sets=[]\n",
    "    \n",
    "    for i in range(1,MAX_TRIES):\n",
    "        S = sorted(randomSet(D.columns.values,C_best))\n",
    "        C = len(S)\n",
    "        if (C<C_best):\n",
    "            if(InconCheck(S,D,TARGET_COLUMN)<gamma):\n",
    "                M_sets=[]\n",
    "                S_best = S\n",
    "                C_best = C\n",
    "                M_sets.append(S_best)\n",
    "                print(\"\")\n",
    "                print(\"current best\", S_best)\n",
    "        elif ((C==C_best) and (InconCheck(S,D,TARGET_COLUMN)<gamma)) :\n",
    "            M_sets.append(S)\n",
    "            print(\"also current best\", S)\n",
    "    return M_sets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 170,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.neighbors import KNeighborsClassifier\n",
    "from sklearn.neighbors import NearestCentroid\n",
    "from sklearn.tree import DecisionTreeClassifier\n",
    "from sklearn.linear_model import LogisticRegression\n",
    "from sklearn.svm import SVC\n",
    "from sklearn.ensemble import BaggingClassifier\n",
    "from sklearn.ensemble import RandomForestClassifier\n",
    "from sklearn.ensemble import AdaBoostClassifier\n",
    "from sklearn.ensemble import GradientBoostingClassifier\n",
    "from sklearn.naive_bayes import GaussianNB # put NOTE into paper - not sure if correct bayes\n",
    "from sklearn.model_selection import StratifiedKFold # put NOTE into paper - better as common kfold sampling\n",
    "from sklearn.base import clone\n",
    "from sklearn.metrics import precision_score\n",
    "from sklearn.metrics import recall_score\n",
    "from sklearn.metrics import f1_score\n",
    "from functools import reduce\n",
    "\n",
    "CI_95_FACTOR = 1.96\n",
    "\n",
    "class BaseClassifier:\n",
    "    \n",
    "    def __init__(self, clf, clf_name, modality):\n",
    "        self.clf = clf\n",
    "        self.clf_name = clf_name\n",
    "        self.modality = modality\n",
    "        \n",
    "    def fit(self, df_features, df_targets, verbose=True):\n",
    "        self.clf = clone(self.clf) # reset any previously trained model\n",
    "        np.random.seed(32143421)\n",
    "        if verbose:\n",
    "            print(f\"Starting training for classifier {self.clf_name} and modality {self.modality}\")\n",
    "        self.clf.fit(df_features, df_targets)\n",
    "        \n",
    "    def predict(self, df_features, verbose=True):\n",
    "        if verbose:\n",
    "            print(f\"Starting prediction for classifier {self.clf_name} and modality {self.modality}\")\n",
    "        return self.clf.predict(df_features)    \n",
    "        \n",
    "class ClassifierFactory:\n",
    "    \n",
    "    @staticmethod\n",
    "    def get_metadata_classifiers():\n",
    "        return [BaseClassifier(KNeighborsClassifier(), 'k-Nearest neighbors', 'Metadata'),\n",
    "                BaseClassifier(NearestCentroid(), 'Nearest mean classifier', 'Metadata'),\n",
    "                BaseClassifier(DecisionTreeClassifier(), 'Decision tree', 'Metadata'),\n",
    "                BaseClassifier(LogisticRegression(), 'Logistic regression', 'Metadata'),\n",
    "                BaseClassifier(SVC(gamma='auto'), 'SVM (Gaussian Kernel)', 'Metadata'),\n",
    "                BaseClassifier(BaggingClassifier(),'Bagging', 'Metadata'),\n",
    "                BaseClassifier(RandomForestClassifier(n_estimators=10),'Random Forest', 'Metadata'),\n",
    "                BaseClassifier(AdaBoostClassifier(), 'AdaBoost', 'Metadata'),\n",
    "                BaseClassifier(GradientBoostingClassifier(), 'Gradient Boosting Tree', 'Metadata')]\n",
    "    \n",
    "    @staticmethod\n",
    "    def get_text_classifiers():\n",
    "        return [BaseClassifier(GaussianNB(), 'Naive Bayes', 'Textual'),\n",
    "                BaseClassifier(KNeighborsClassifier(), 'k-Nearest neighbors', 'Textual'),\n",
    "                BaseClassifier(SVC(gamma='auto'), 'SVM (Gaussian Kernel)', 'Textual')]\n",
    "    \n",
    "    @staticmethod\n",
    "    def get_visual_classifiers():\n",
    "        return [BaseClassifier(KNeighborsClassifier(), 'k-Nearest neighbors', 'Visual'),\n",
    "                BaseClassifier(DecisionTreeClassifier(), 'Decision tree', 'Visual'),\n",
    "                BaseClassifier(LogisticRegression(), 'Logistic regression', 'Visual'),\n",
    "                BaseClassifier(SVC(gamma='auto'), 'SVM (Gaussian Kernel)', 'Visual'),\n",
    "                BaseClassifier(RandomForestClassifier(n_estimators=10), 'Random Forest', 'Visual'),\n",
    "                BaseClassifier(AdaBoostClassifier(), 'AdaBoost', 'Visual'),\n",
    "                BaseClassifier(GradientBoostingClassifier(), 'Gradient Boosting Tree', 'Visual')]\n",
    "    \n",
    "    @staticmethod\n",
    "    def get_audio_classifiers():\n",
    "        return [BaseClassifier(LogisticRegression(), 'Logistic regression', 'Audio'),\n",
    "                BaseClassifier(GradientBoostingClassifier(), 'Gradient Boosting Tree', 'Audio')]                \n",
    "                \n",
    "class DataWrapper:\n",
    "    \n",
    "    def __init__(self, df_audio, df_vis, df_txt, df_meta, df_targets):\n",
    "        self.df_audio = df_audio\n",
    "        self.df_vis = df_vis\n",
    "        self.df_txt = df_txt\n",
    "        self.df_meta = df_meta\n",
    "        self.df_targets = df_targets\n",
    "        \n",
    "    def generate_subspace(self):\n",
    "        # TODO insert LVW functionality\n",
    "        # N = len(df_meta)\n",
    "        # MAX_TRIES = 77*N^5\n",
    "        # print(lvf(MAX_TRIES,df_meta, df_targets_train,5))\n",
    "        \n",
    "        self.df_audio = self.df_audio.drop('file_name', axis=1)\n",
    "        self.df_vis = self.df_vis.drop('file_name', axis=1)\n",
    "        self.df_txt = self.df_txt.drop('file_name', axis=1)\n",
    "        self.df_meta = self.df_meta.drop('file_name', axis=1)\n",
    "        \n",
    "        \n",
    "class OutputWrapper:\n",
    "    \n",
    "    def __init__(self, df_res_test, df_score_test, df_score_stats, df_res_all):\n",
    "        self.df_res_test = df_res_test\n",
    "        self.df_score_test = df_score_test\n",
    "        self.df_score_stats = df_score_stats\n",
    "        self.df_res_all = df_res_all\n",
    "        \n",
    "class Evaluator:\n",
    "    # TODO add clf stacking method\n",
    "    \n",
    "    def __init__(self, data_wrapper, use_audio=True, use_visual=True, use_text=True, use_meta=True):\n",
    "        self.data_wrapper = data_wrapper\n",
    "        self.use_audio = use_audio\n",
    "        self.use_visual = use_visual\n",
    "        self.use_text = use_text\n",
    "        self.use_meta = use_meta            \n",
    "            \n",
    "    def cv_modality(self, df_features, df_targets, clfs, cv=10, verbose=True, predict_all = False):\n",
    "        kf = StratifiedKFold(n_splits=cv, random_state=9832432)\n",
    "        df_cvs = []\n",
    "        df_all_cvs = []\n",
    "        i=1\n",
    "        for train_index, test_index in kf.split(df_features, df_targets):\n",
    "            if verbose:\n",
    "                print(f\"Performing CV fold {i}..\")\n",
    "            i += 1\n",
    "            X_train, X_test = df_features.iloc[train_index,:], df_features.iloc[test_index,:]\n",
    "            y_train, y_test = df_targets[train_index], df_targets[test_index]\n",
    "            \n",
    "            df_res = pd.DataFrame(y_test)\n",
    "            df_res.columns = ['TARGET']\n",
    "            \n",
    "            # init df for prediction of all entries\n",
    "            df_res_all = pd.DataFrame(df_targets)\n",
    "            df_res_all.columns = ['TARGET']\n",
    "            \n",
    "            for clf in clfs:\n",
    "                clf.fit(X_train, y_train, verbose)\n",
    "                y_pred = clf.predict(X_test, verbose)\n",
    "                df_res[clf.clf_name+\"_\"+clf.modality] = y_pred\n",
    "                \n",
    "                if predict_all:\n",
    "                    y_pred_all = clf.predict(df_features, verbose)\n",
    "                    df_res_all[clf.clf_name+\"_\"+clf.modality] = y_pred_all\n",
    "                \n",
    "            df_cvs.append(df_res)\n",
    "            df_all_cvs.append(df_res_all)\n",
    "        return df_cvs, df_all_cvs\n",
    "            \n",
    "    def cv(self, cv=10, verbose=True, predict_all=False):\n",
    "        \"\"\"\n",
    "            set predict_all to True to also include predictions for all data\n",
    "        \"\"\"\n",
    "        df_cvs = []\n",
    "        df_all_cvs = []\n",
    "        df_targets = self.data_wrapper.df_targets\n",
    "        if (self.use_audio):\n",
    "            df_test, df_all = self.cv_modality(\n",
    "                self.data_wrapper.df_audio,\n",
    "                df_targets,\n",
    "                ClassifierFactory.get_audio_classifiers(),\n",
    "                cv,\n",
    "                verbose,\n",
    "                predict_all)\n",
    "            df_cvs.append(df_test)\n",
    "            df_all_cvs.append(df_all)\n",
    "        if (self.use_visual):\n",
    "            df_test, df_all = self.cv_modality(\n",
    "                self.data_wrapper.df_vis,\n",
    "                df_targets,\n",
    "                ClassifierFactory.get_visual_classifiers(),\n",
    "                cv,\n",
    "                verbose,\n",
    "                predict_all)\n",
    "            df_cvs.append(df_test)\n",
    "            df_all_cvs.append(df_all)\n",
    "        if (self.use_text):\n",
    "            df_test, df_all = self.cv_modality(\n",
    "                self.data_wrapper.df_txt,\n",
    "                df_targets,\n",
    "                ClassifierFactory.get_text_classifiers(),\n",
    "                cv,\n",
    "                verbose,\n",
    "                predict_all)\n",
    "            df_cvs.append(df_test)\n",
    "            df_all_cvs.append(df_all)\n",
    "        if (self.use_meta):\n",
    "            df_test, df_all = self.cv_modality(\n",
    "                self.data_wrapper.df_meta,\n",
    "                df_targets,\n",
    "                ClassifierFactory.get_metadata_classifiers(),\n",
    "                cv,\n",
    "                verbose,\n",
    "                predict_all)\n",
    "            df_cvs.append(df_test)\n",
    "            df_all_cvs.append(df_all)\n",
    "            \n",
    "        df_c = []\n",
    "        for i in range(len(df_cvs[0])):\n",
    "            df_i = pd.concat([df_cvs[x][i] for x in range(len(df_cvs))], axis=1)\n",
    "            df_i = df_i.loc[:,~df_i.columns.duplicated()]\n",
    "            df_c.append(df_i)\n",
    "            \n",
    "        df_all_c = []\n",
    "        if predict_all:\n",
    "            for i in range(len(df_all_cvs[0])):\n",
    "                df_i = pd.concat([df_all_cvs[x][i] for x in range(len(df_all_cvs))], axis=1)\n",
    "                df_i = df_i.loc[:,~df_i.columns.duplicated()]\n",
    "                df_all_c.append(df_i)\n",
    "            \n",
    "        df_res = self.evaluate(df_c)\n",
    "        \n",
    "        return OutputWrapper(df_c, df_res, self.overall_eval(df_res), df_all_c)\n",
    "\n",
    "    def evaluate(self, df_res):\n",
    "        \"\"\"\n",
    "        returns precision, recall and F1 in a DF\n",
    "        returns list of DFs if df_res is list of DFs\n",
    "        \"\"\"\n",
    "        if type(df_res) == type([]):\n",
    "            return [self.evaluate_single(df_x) for df_x in df_res]\n",
    "        else:\n",
    "            return self.evaluate_single(df_res)\n",
    "\n",
    "    def evaluate_single(self, df_res):\n",
    "        cols = list(df_res.columns)\n",
    "        cols.remove('TARGET')\n",
    "        df_ev = pd.DataFrame(columns=['clf', 'precision', 'recall', 'f1'])\n",
    "        for col in cols:\n",
    "            prec = precision_score(df_res['TARGET'], df_res[col])\n",
    "            recall = recall_score(df_res['TARGET'], df_res[col])\n",
    "            f1 = f1_score(df_res['TARGET'], df_res[col])\n",
    "            df_ev = df_ev.append({'clf':col, 'precision': prec, 'recall':recall, 'f1':f1}, ignore_index=True)\n",
    "        return df_ev\n",
    "    \n",
    "    def overall_eval(self, df_results):\n",
    "        df_score = pd.DataFrame(columns =['clf', 'mean_precision', 'mean_recall', 'mean_f1', 'var_precision', 'var_recall', 'var_f1', 'std_precision', 'std_recall', 'std_f1'])\n",
    "        df_score['clf'] = df_results[0]['clf']\n",
    "        # mean \n",
    "        df_res = reduce(lambda x, y: x.add(y, fill_value=0), df_results)\n",
    "        df_score[['mean_precision', 'mean_recall', 'mean_f1']] = df_res[['precision', 'recall', 'f1']].div(len(df_results))\n",
    "\n",
    "        # var\n",
    "        df_mean = df_score[['mean_precision', 'mean_recall', 'mean_f1']]\n",
    "        df_mean.columns = ['precision', 'recall', 'f1']\n",
    "        df_dev = []\n",
    "        for df in df_results:\n",
    "            df_dev.append(np.square(df[['precision', 'recall', 'f1']].subtract(df_mean)))\n",
    "        df_dev = reduce(lambda x, y: x.add(y, fill_value=0), df_dev)\n",
    "        df_score[['var_precision', 'var_recall', 'var_f1']] = df_dev[['precision', 'recall', 'f1']].div(len(df_results))\n",
    "\n",
    "        # std \n",
    "        df_score[['std_precision', 'std_recall', 'std_f1']] = np.power(df_score[['var_precision', 'var_recall', 'var_f1']], 0.5)\n",
    "        \n",
    "        # 95-ci\n",
    "        for metric in ['precision', 'recall', 'f1']:\n",
    "            l_ci = df_score['mean_'+metric] - df_score['std_'+metric]*CI_95_FACTOR/len(df_results)\n",
    "            u_ci = df_score['mean_'+metric] + df_score['std_'+metric]*CI_95_FACTOR/len(df_results)\n",
    "            df_score['l_95ci_'+metric] = l_ci\n",
    "            df_score['u_95ci_'+metric] = u_ci\n",
    "\n",
    "        return df_score"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Call Example"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 171,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\svm\\base.py:922: ConvergenceWarning: Liblinear failed to converge, increase the number of iterations.\n",
      "  \"the number of iterations.\", ConvergenceWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n",
      "D:\\Anaconda3\\lib\\site-packages\\sklearn\\linear_model\\logistic.py:433: FutureWarning: Default solver will be changed to 'lbfgs' in 0.22. Specify a solver to silence this warning.\n",
      "  FutureWarning)\n"
     ]
    }
   ],
   "source": [
    "dw = DataWrapper(df_audio_train, df_vis_train, df_txt_train, df_meta_train, df_targets_train)\n",
    "dw.generate_subspace()\n",
    "ev = Evaluator(dw) # TODO preprocessing for meta needs to be done\n",
    "ow = ev.cv(verbose=False, predict_all=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 175,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>TARGET</th>\n",
       "      <th>Logistic regression_Audio</th>\n",
       "      <th>Gradient Boosting Tree_Audio</th>\n",
       "      <th>k-Nearest neighbors_Visual</th>\n",
       "      <th>Decision tree_Visual</th>\n",
       "      <th>Logistic regression_Visual</th>\n",
       "      <th>SVM (Gaussian Kernel)_Visual</th>\n",
       "      <th>Random Forest_Visual</th>\n",
       "      <th>AdaBoost_Visual</th>\n",
       "      <th>Gradient Boosting Tree_Visual</th>\n",
       "      <th>...</th>\n",
       "      <th>SVM (Gaussian Kernel)_Textual</th>\n",
       "      <th>k-Nearest neighbors_Metadata</th>\n",
       "      <th>Nearest mean classifier_Metadata</th>\n",
       "      <th>Decision tree_Metadata</th>\n",
       "      <th>Logistic regression_Metadata</th>\n",
       "      <th>SVM (Gaussian Kernel)_Metadata</th>\n",
       "      <th>Bagging_Metadata</th>\n",
       "      <th>Random Forest_Metadata</th>\n",
       "      <th>AdaBoost_Metadata</th>\n",
       "      <th>Gradient Boosting Tree_Metadata</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>23 rows × 22 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "    TARGET  Logistic regression_Audio  Gradient Boosting Tree_Audio  \\\n",
       "0        1                          1                             0   \n",
       "1        1                          1                             0   \n",
       "2        1                          1                             1   \n",
       "3        1                          1                             0   \n",
       "4        0                          1                             0   \n",
       "5        1                          1                             1   \n",
       "6        1                          1                             0   \n",
       "7        1                          1                             1   \n",
       "8        1                          0                             0   \n",
       "9        0                          0                             1   \n",
       "10       0                          1                             1   \n",
       "11       1                          1                             1   \n",
       "12       1                          1                             1   \n",
       "13       1                          1                             0   \n",
       "14       0                          0                             0   \n",
       "15       1                          0                             0   \n",
       "21       0                          0                             0   \n",
       "22       0                          0                             0   \n",
       "26       0                          1                             1   \n",
       "28       0                          1                             1   \n",
       "29       0                          1                             1   \n",
       "30       0                          1                             1   \n",
       "31       0                          1                             1   \n",
       "\n",
       "    k-Nearest neighbors_Visual  Decision tree_Visual  \\\n",
       "0                            1                     0   \n",
       "1                            1                     1   \n",
       "2                            1                     0   \n",
       "3                            1                     0   \n",
       "4                            1                     1   \n",
       "5                            1                     0   \n",
       "6                            0                     0   \n",
       "7                            1                     1   \n",
       "8                            1                     0   \n",
       "9                            0                     0   \n",
       "10                           1                     1   \n",
       "11                           1                     0   \n",
       "12                           0                     0   \n",
       "13                           0                     0   \n",
       "14                           1                     1   \n",
       "15                           0                     0   \n",
       "21                           0                     0   \n",
       "22                           1                     0   \n",
       "26                           1                     0   \n",
       "28                           1                     1   \n",
       "29                           0                     0   \n",
       "30                           0                     1   \n",
       "31                           1                     0   \n",
       "\n",
       "    Logistic regression_Visual  SVM (Gaussian Kernel)_Visual  \\\n",
       "0                            0                             1   \n",
       "1                            1                             1   \n",
       "2                            1                             1   \n",
       "3                            0                             1   \n",
       "4                            1                             1   \n",
       "5                            0                             1   \n",
       "6                            0                             1   \n",
       "7                            1                             1   \n",
       "8                            0                             1   \n",
       "9                            1                             1   \n",
       "10                           1                             1   \n",
       "11                           1                             1   \n",
       "12                           1                             0   \n",
       "13                           0                             1   \n",
       "14                           0                             1   \n",
       "15                           1                             0   \n",
       "21                           1                             1   \n",
       "22                           0                             1   \n",
       "26                           0                             1   \n",
       "28                           1                             1   \n",
       "29                           1                             0   \n",
       "30                           1                             1   \n",
       "31                           1                             1   \n",
       "\n",
       "    Random Forest_Visual  AdaBoost_Visual  Gradient Boosting Tree_Visual  \\\n",
       "0                      0                0                              0   \n",
       "1                      0                1                              1   \n",
       "2                      0                0                              0   \n",
       "3                      1                0                              1   \n",
       "4                      1                0                              1   \n",
       "5                      0                1                              1   \n",
       "6                      0                1                              0   \n",
       "7                      0                1                              1   \n",
       "8                      0                0                              0   \n",
       "9                      0                0                              0   \n",
       "10                     1                1                              1   \n",
       "11                     0                1                              1   \n",
       "12                     0                0                              0   \n",
       "13                     0                0                              1   \n",
       "14                     0                1                              0   \n",
       "15                     0                0                              0   \n",
       "21                     1                1                              1   \n",
       "22                     0                0                              0   \n",
       "26                     1                0                              0   \n",
       "28                     1                1                              0   \n",
       "29                     0                1                              0   \n",
       "30                     1                0                              0   \n",
       "31                     0                0                              1   \n",
       "\n",
       "                 ...                 SVM (Gaussian Kernel)_Textual  \\\n",
       "0                ...                                             1   \n",
       "1                ...                                             1   \n",
       "2                ...                                             1   \n",
       "3                ...                                             1   \n",
       "4                ...                                             1   \n",
       "5                ...                                             1   \n",
       "6                ...                                             1   \n",
       "7                ...                                             1   \n",
       "8                ...                                             1   \n",
       "9                ...                                             1   \n",
       "10               ...                                             1   \n",
       "11               ...                                             1   \n",
       "12               ...                                             1   \n",
       "13               ...                                             1   \n",
       "14               ...                                             1   \n",
       "15               ...                                             1   \n",
       "21               ...                                             1   \n",
       "22               ...                                             1   \n",
       "26               ...                                             1   \n",
       "28               ...                                             1   \n",
       "29               ...                                             1   \n",
       "30               ...                                             1   \n",
       "31               ...                                             1   \n",
       "\n",
       "    k-Nearest neighbors_Metadata  Nearest mean classifier_Metadata  \\\n",
       "0                              1                                 1   \n",
       "1                              0                                 0   \n",
       "2                              1                                 1   \n",
       "3                              1                                 1   \n",
       "4                              1                                 1   \n",
       "5                              0                                 0   \n",
       "6                              0                                 1   \n",
       "7                              1                                 1   \n",
       "8                              1                                 0   \n",
       "9                              0                                 1   \n",
       "10                             0                                 0   \n",
       "11                             1                                 1   \n",
       "12                             1                                 1   \n",
       "13                             1                                 1   \n",
       "14                             0                                 0   \n",
       "15                             0                                 1   \n",
       "21                             1                                 0   \n",
       "22                             1                                 1   \n",
       "26                             0                                 1   \n",
       "28                             1                                 1   \n",
       "29                             0                                 0   \n",
       "30                             0                                 0   \n",
       "31                             1                                 1   \n",
       "\n",
       "    Decision tree_Metadata  Logistic regression_Metadata  \\\n",
       "0                        1                             1   \n",
       "1                        0                             0   \n",
       "2                        1                             1   \n",
       "3                        1                             1   \n",
       "4                        1                             1   \n",
       "5                        0                             0   \n",
       "6                        0                             0   \n",
       "7                        1                             1   \n",
       "8                        1                             0   \n",
       "9                        1                             1   \n",
       "10                       0                             0   \n",
       "11                       0                             1   \n",
       "12                       1                             1   \n",
       "13                       1                             1   \n",
       "14                       0                             0   \n",
       "15                       0                             1   \n",
       "21                       1                             1   \n",
       "22                       0                             0   \n",
       "26                       0                             0   \n",
       "28                       1                             1   \n",
       "29                       0                             0   \n",
       "30                       0                             0   \n",
       "31                       1                             1   \n",
       "\n",
       "    SVM (Gaussian Kernel)_Metadata  Bagging_Metadata  Random Forest_Metadata  \\\n",
       "0                                1                 0                       1   \n",
       "1                                0                 0                       0   \n",
       "2                                1                 1                       0   \n",
       "3                                1                 1                       1   \n",
       "4                                1                 1                       1   \n",
       "5                                0                 0                       1   \n",
       "6                                1                 0                       0   \n",
       "7                                1                 1                       1   \n",
       "8                                1                 0                       0   \n",
       "9                                1                 1                       1   \n",
       "10                               0                 0                       0   \n",
       "11                               1                 0                       1   \n",
       "12                               1                 1                       1   \n",
       "13                               1                 1                       1   \n",
       "14                               0                 0                       0   \n",
       "15                               1                 0                       1   \n",
       "21                               0                 1                       1   \n",
       "22                               1                 1                       1   \n",
       "26                               0                 0                       0   \n",
       "28                               1                 0                       1   \n",
       "29                               1                 0                       0   \n",
       "30                               0                 0                       0   \n",
       "31                               1                 0                       1   \n",
       "\n",
       "    AdaBoost_Metadata  Gradient Boosting Tree_Metadata  \n",
       "0                   1                                1  \n",
       "1                   1                                0  \n",
       "2                   1                                1  \n",
       "3                   1                                1  \n",
       "4                   1                                1  \n",
       "5                   0                                0  \n",
       "6                   0                                0  \n",
       "7                   1                                1  \n",
       "8                   0                                0  \n",
       "9                   0                                1  \n",
       "10                  0                                0  \n",
       "11                  1                                0  \n",
       "12                  1                                1  \n",
       "13                  1                                1  \n",
       "14                  0                                0  \n",
       "15                  1                                1  \n",
       "21                  1                                1  \n",
       "22                  0                                1  \n",
       "26                  0                                0  \n",
       "28                  1                                1  \n",
       "29                  0                                0  \n",
       "30                  0                                0  \n",
       "31                  1                                1  \n",
       "\n",
       "[23 rows x 22 columns]"
      ]
     },
     "execution_count": 175,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ow.df_res_test[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>clf</th>\n",
       "      <th>precision</th>\n",
       "      <th>recall</th>\n",
       "      <th>f1</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Logistic regression_Audio</td>\n",
       "      <td>0.555556</td>\n",
       "      <td>0.833333</td>\n",
       "      <td>0.666667</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Gradient Boosting Tree_Audio</td>\n",
       "      <td>0.500000</td>\n",
       "      <td>0.333333</td>\n",
       "      <td>0.400000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>k-Nearest neighbors_Visual</td>\n",
       "      <td>0.444444</td>\n",
       "      <td>0.666667</td>\n",
       "      <td>0.533333</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Decision tree_Visual</td>\n",
       "      <td>0.600000</td>\n",
       "      <td>0.500000</td>\n",
       "      <td>0.545455</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Logistic regression_Visual</td>\n",
       "      <td>0.571429</td>\n",
       "      <td>0.666667</td>\n",
       "      <td>0.615385</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>SVM (Gaussian Kernel)_Visual</td>\n",
       "      <td>0.545455</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.705882</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Random Forest_Visual</td>\n",
       "      <td>0.714286</td>\n",
       "      <td>0.833333</td>\n",
       "      <td>0.769231</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>AdaBoost_Visual</td>\n",
       "      <td>0.625000</td>\n",
       "      <td>0.833333</td>\n",
       "      <td>0.714286</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Gradient Boosting Tree_Visual</td>\n",
       "      <td>0.666667</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.800000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Naive Bayes_Textual</td>\n",
       "      <td>0.333333</td>\n",
       "      <td>0.333333</td>\n",
       "      <td>0.333333</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>k-Nearest neighbors_Textual</td>\n",
       "      <td>0.545455</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.705882</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>SVM (Gaussian Kernel)_Textual</td>\n",
       "      <td>0.545455</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.705882</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>k-Nearest neighbors_Metadata</td>\n",
       "      <td>0.666667</td>\n",
       "      <td>0.333333</td>\n",
       "      <td>0.444444</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Nearest mean classifier_Metadata</td>\n",
       "      <td>0.571429</td>\n",
       "      <td>0.666667</td>\n",
       "      <td>0.615385</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Decision tree_Metadata</td>\n",
       "      <td>0.250000</td>\n",
       "      <td>0.166667</td>\n",
       "      <td>0.200000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Logistic regression_Metadata</td>\n",
       "      <td>0.500000</td>\n",
       "      <td>0.500000</td>\n",
       "      <td>0.500000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>SVM (Gaussian Kernel)_Metadata</td>\n",
       "      <td>0.500000</td>\n",
       "      <td>0.333333</td>\n",
       "      <td>0.400000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Bagging_Metadata</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.166667</td>\n",
       "      <td>0.285714</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Random Forest_Metadata</td>\n",
       "      <td>0.500000</td>\n",
       "      <td>0.166667</td>\n",
       "      <td>0.250000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>AdaBoost_Metadata</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.166667</td>\n",
       "      <td>0.285714</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Gradient Boosting Tree_Metadata</td>\n",
       "      <td>0.666667</td>\n",
       "      <td>0.333333</td>\n",
       "      <td>0.444444</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                 clf  precision    recall        f1\n",
       "0          Logistic regression_Audio   0.555556  0.833333  0.666667\n",
       "1       Gradient Boosting Tree_Audio   0.500000  0.333333  0.400000\n",
       "2         k-Nearest neighbors_Visual   0.444444  0.666667  0.533333\n",
       "3               Decision tree_Visual   0.600000  0.500000  0.545455\n",
       "4         Logistic regression_Visual   0.571429  0.666667  0.615385\n",
       "5       SVM (Gaussian Kernel)_Visual   0.545455  1.000000  0.705882\n",
       "6               Random Forest_Visual   0.714286  0.833333  0.769231\n",
       "7                    AdaBoost_Visual   0.625000  0.833333  0.714286\n",
       "8      Gradient Boosting Tree_Visual   0.666667  1.000000  0.800000\n",
       "9                Naive Bayes_Textual   0.333333  0.333333  0.333333\n",
       "10       k-Nearest neighbors_Textual   0.545455  1.000000  0.705882\n",
       "11     SVM (Gaussian Kernel)_Textual   0.545455  1.000000  0.705882\n",
       "12      k-Nearest neighbors_Metadata   0.666667  0.333333  0.444444\n",
       "13  Nearest mean classifier_Metadata   0.571429  0.666667  0.615385\n",
       "14            Decision tree_Metadata   0.250000  0.166667  0.200000\n",
       "15      Logistic regression_Metadata   0.500000  0.500000  0.500000\n",
       "16    SVM (Gaussian Kernel)_Metadata   0.500000  0.333333  0.400000\n",
       "17                  Bagging_Metadata   1.000000  0.166667  0.285714\n",
       "18            Random Forest_Metadata   0.500000  0.166667  0.250000\n",
       "19                 AdaBoost_Metadata   1.000000  0.166667  0.285714\n",
       "20   Gradient Boosting Tree_Metadata   0.666667  0.333333  0.444444"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ow.df_score_test[0]        "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>clf</th>\n",
       "      <th>mean_precision</th>\n",
       "      <th>mean_recall</th>\n",
       "      <th>mean_f1</th>\n",
       "      <th>var_precision</th>\n",
       "      <th>var_recall</th>\n",
       "      <th>var_f1</th>\n",
       "      <th>std_precision</th>\n",
       "      <th>std_recall</th>\n",
       "      <th>std_f1</th>\n",
       "      <th>l_95ci_precision</th>\n",
       "      <th>u_95ci_precision</th>\n",
       "      <th>l_95ci_recall</th>\n",
       "      <th>u_95ci_recall</th>\n",
       "      <th>l_95ci_f1</th>\n",
       "      <th>u_95ci_f1</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Logistic regression_Audio</td>\n",
       "      <td>0.566508</td>\n",
       "      <td>0.570000</td>\n",
       "      <td>0.547244</td>\n",
       "      <td>0.047184</td>\n",
       "      <td>0.048989</td>\n",
       "      <td>0.030090</td>\n",
       "      <td>0.217218</td>\n",
       "      <td>0.221334</td>\n",
       "      <td>0.173464</td>\n",
       "      <td>0.523933</td>\n",
       "      <td>0.609083</td>\n",
       "      <td>0.526618</td>\n",
       "      <td>0.613382</td>\n",
       "      <td>0.513245</td>\n",
       "      <td>0.581243</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Gradient Boosting Tree_Audio</td>\n",
       "      <td>0.486429</td>\n",
       "      <td>0.416667</td>\n",
       "      <td>0.438236</td>\n",
       "      <td>0.050547</td>\n",
       "      <td>0.054944</td>\n",
       "      <td>0.045175</td>\n",
       "      <td>0.224826</td>\n",
       "      <td>0.234402</td>\n",
       "      <td>0.212543</td>\n",
       "      <td>0.442363</td>\n",
       "      <td>0.530494</td>\n",
       "      <td>0.370724</td>\n",
       "      <td>0.462610</td>\n",
       "      <td>0.396578</td>\n",
       "      <td>0.479895</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>k-Nearest neighbors_Visual</td>\n",
       "      <td>0.568492</td>\n",
       "      <td>0.633333</td>\n",
       "      <td>0.588811</td>\n",
       "      <td>0.015035</td>\n",
       "      <td>0.035778</td>\n",
       "      <td>0.017594</td>\n",
       "      <td>0.122618</td>\n",
       "      <td>0.189150</td>\n",
       "      <td>0.132641</td>\n",
       "      <td>0.544459</td>\n",
       "      <td>0.592525</td>\n",
       "      <td>0.596260</td>\n",
       "      <td>0.670407</td>\n",
       "      <td>0.562814</td>\n",
       "      <td>0.614809</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Decision tree_Visual</td>\n",
       "      <td>0.550476</td>\n",
       "      <td>0.623333</td>\n",
       "      <td>0.581818</td>\n",
       "      <td>0.023185</td>\n",
       "      <td>0.043567</td>\n",
       "      <td>0.030200</td>\n",
       "      <td>0.152265</td>\n",
       "      <td>0.208726</td>\n",
       "      <td>0.173782</td>\n",
       "      <td>0.520632</td>\n",
       "      <td>0.580320</td>\n",
       "      <td>0.582423</td>\n",
       "      <td>0.664244</td>\n",
       "      <td>0.547757</td>\n",
       "      <td>0.615879</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Logistic regression_Visual</td>\n",
       "      <td>0.630952</td>\n",
       "      <td>0.656667</td>\n",
       "      <td>0.627471</td>\n",
       "      <td>0.021983</td>\n",
       "      <td>0.026233</td>\n",
       "      <td>0.012144</td>\n",
       "      <td>0.148267</td>\n",
       "      <td>0.161967</td>\n",
       "      <td>0.110201</td>\n",
       "      <td>0.601892</td>\n",
       "      <td>0.660013</td>\n",
       "      <td>0.624921</td>\n",
       "      <td>0.688412</td>\n",
       "      <td>0.605872</td>\n",
       "      <td>0.649070</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>SVM (Gaussian Kernel)_Visual</td>\n",
       "      <td>0.543434</td>\n",
       "      <td>0.983333</td>\n",
       "      <td>0.699755</td>\n",
       "      <td>0.000481</td>\n",
       "      <td>0.002500</td>\n",
       "      <td>0.000820</td>\n",
       "      <td>0.021922</td>\n",
       "      <td>0.050000</td>\n",
       "      <td>0.028633</td>\n",
       "      <td>0.539138</td>\n",
       "      <td>0.547731</td>\n",
       "      <td>0.973533</td>\n",
       "      <td>0.993133</td>\n",
       "      <td>0.694143</td>\n",
       "      <td>0.705367</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Random Forest_Visual</td>\n",
       "      <td>0.619762</td>\n",
       "      <td>0.653333</td>\n",
       "      <td>0.629573</td>\n",
       "      <td>0.006054</td>\n",
       "      <td>0.019600</td>\n",
       "      <td>0.008414</td>\n",
       "      <td>0.077811</td>\n",
       "      <td>0.140000</td>\n",
       "      <td>0.091730</td>\n",
       "      <td>0.604511</td>\n",
       "      <td>0.635013</td>\n",
       "      <td>0.625893</td>\n",
       "      <td>0.680773</td>\n",
       "      <td>0.611594</td>\n",
       "      <td>0.647552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>AdaBoost_Visual</td>\n",
       "      <td>0.584643</td>\n",
       "      <td>0.610000</td>\n",
       "      <td>0.593169</td>\n",
       "      <td>0.018714</td>\n",
       "      <td>0.025789</td>\n",
       "      <td>0.019354</td>\n",
       "      <td>0.136799</td>\n",
       "      <td>0.160589</td>\n",
       "      <td>0.139118</td>\n",
       "      <td>0.557830</td>\n",
       "      <td>0.611455</td>\n",
       "      <td>0.578525</td>\n",
       "      <td>0.641475</td>\n",
       "      <td>0.565902</td>\n",
       "      <td>0.620436</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Gradient Boosting Tree_Visual</td>\n",
       "      <td>0.594524</td>\n",
       "      <td>0.726667</td>\n",
       "      <td>0.646410</td>\n",
       "      <td>0.009215</td>\n",
       "      <td>0.032400</td>\n",
       "      <td>0.012671</td>\n",
       "      <td>0.095997</td>\n",
       "      <td>0.180000</td>\n",
       "      <td>0.112566</td>\n",
       "      <td>0.575708</td>\n",
       "      <td>0.613339</td>\n",
       "      <td>0.691387</td>\n",
       "      <td>0.761947</td>\n",
       "      <td>0.624347</td>\n",
       "      <td>0.668473</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Naive Bayes_Textual</td>\n",
       "      <td>0.535000</td>\n",
       "      <td>0.620000</td>\n",
       "      <td>0.550276</td>\n",
       "      <td>0.036233</td>\n",
       "      <td>0.055156</td>\n",
       "      <td>0.022024</td>\n",
       "      <td>0.190351</td>\n",
       "      <td>0.234852</td>\n",
       "      <td>0.148407</td>\n",
       "      <td>0.497691</td>\n",
       "      <td>0.572309</td>\n",
       "      <td>0.573969</td>\n",
       "      <td>0.666031</td>\n",
       "      <td>0.521189</td>\n",
       "      <td>0.579364</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>k-Nearest neighbors_Textual</td>\n",
       "      <td>0.547980</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.707843</td>\n",
       "      <td>0.000272</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000199</td>\n",
       "      <td>0.016482</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.014120</td>\n",
       "      <td>0.544749</td>\n",
       "      <td>0.551210</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.705076</td>\n",
       "      <td>0.710611</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>SVM (Gaussian Kernel)_Textual</td>\n",
       "      <td>0.547980</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.707843</td>\n",
       "      <td>0.000272</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000199</td>\n",
       "      <td>0.016482</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.014120</td>\n",
       "      <td>0.544749</td>\n",
       "      <td>0.551210</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.705076</td>\n",
       "      <td>0.710611</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>k-Nearest neighbors_Metadata</td>\n",
       "      <td>0.554563</td>\n",
       "      <td>0.616667</td>\n",
       "      <td>0.546934</td>\n",
       "      <td>0.012638</td>\n",
       "      <td>0.112278</td>\n",
       "      <td>0.043591</td>\n",
       "      <td>0.112419</td>\n",
       "      <td>0.335079</td>\n",
       "      <td>0.208786</td>\n",
       "      <td>0.532529</td>\n",
       "      <td>0.576598</td>\n",
       "      <td>0.550991</td>\n",
       "      <td>0.682342</td>\n",
       "      <td>0.506012</td>\n",
       "      <td>0.587856</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Nearest mean classifier_Metadata</td>\n",
       "      <td>0.531786</td>\n",
       "      <td>0.536667</td>\n",
       "      <td>0.526062</td>\n",
       "      <td>0.032573</td>\n",
       "      <td>0.017433</td>\n",
       "      <td>0.016190</td>\n",
       "      <td>0.180479</td>\n",
       "      <td>0.132035</td>\n",
       "      <td>0.127240</td>\n",
       "      <td>0.496412</td>\n",
       "      <td>0.567160</td>\n",
       "      <td>0.510788</td>\n",
       "      <td>0.562546</td>\n",
       "      <td>0.501123</td>\n",
       "      <td>0.551001</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Decision tree_Metadata</td>\n",
       "      <td>0.594524</td>\n",
       "      <td>0.546667</td>\n",
       "      <td>0.545072</td>\n",
       "      <td>0.085277</td>\n",
       "      <td>0.096933</td>\n",
       "      <td>0.066838</td>\n",
       "      <td>0.292022</td>\n",
       "      <td>0.311341</td>\n",
       "      <td>0.258531</td>\n",
       "      <td>0.537288</td>\n",
       "      <td>0.651760</td>\n",
       "      <td>0.485644</td>\n",
       "      <td>0.607690</td>\n",
       "      <td>0.494400</td>\n",
       "      <td>0.595744</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Logistic regression_Metadata</td>\n",
       "      <td>0.502857</td>\n",
       "      <td>0.560000</td>\n",
       "      <td>0.525657</td>\n",
       "      <td>0.004522</td>\n",
       "      <td>0.012400</td>\n",
       "      <td>0.005635</td>\n",
       "      <td>0.067249</td>\n",
       "      <td>0.111355</td>\n",
       "      <td>0.075065</td>\n",
       "      <td>0.489676</td>\n",
       "      <td>0.516038</td>\n",
       "      <td>0.538174</td>\n",
       "      <td>0.581826</td>\n",
       "      <td>0.510944</td>\n",
       "      <td>0.540369</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>SVM (Gaussian Kernel)_Metadata</td>\n",
       "      <td>0.491569</td>\n",
       "      <td>0.693333</td>\n",
       "      <td>0.558464</td>\n",
       "      <td>0.010384</td>\n",
       "      <td>0.102400</td>\n",
       "      <td>0.031869</td>\n",
       "      <td>0.101903</td>\n",
       "      <td>0.320000</td>\n",
       "      <td>0.178520</td>\n",
       "      <td>0.471596</td>\n",
       "      <td>0.511542</td>\n",
       "      <td>0.630613</td>\n",
       "      <td>0.756053</td>\n",
       "      <td>0.523474</td>\n",
       "      <td>0.593454</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Bagging_Metadata</td>\n",
       "      <td>0.566667</td>\n",
       "      <td>0.450000</td>\n",
       "      <td>0.468797</td>\n",
       "      <td>0.025333</td>\n",
       "      <td>0.027389</td>\n",
       "      <td>0.009250</td>\n",
       "      <td>0.159164</td>\n",
       "      <td>0.165496</td>\n",
       "      <td>0.096178</td>\n",
       "      <td>0.535470</td>\n",
       "      <td>0.597863</td>\n",
       "      <td>0.417563</td>\n",
       "      <td>0.482437</td>\n",
       "      <td>0.449946</td>\n",
       "      <td>0.487648</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Random Forest_Metadata</td>\n",
       "      <td>0.566429</td>\n",
       "      <td>0.510000</td>\n",
       "      <td>0.522879</td>\n",
       "      <td>0.008429</td>\n",
       "      <td>0.045789</td>\n",
       "      <td>0.023748</td>\n",
       "      <td>0.091810</td>\n",
       "      <td>0.213983</td>\n",
       "      <td>0.154104</td>\n",
       "      <td>0.548434</td>\n",
       "      <td>0.584423</td>\n",
       "      <td>0.468059</td>\n",
       "      <td>0.551941</td>\n",
       "      <td>0.492674</td>\n",
       "      <td>0.553083</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>AdaBoost_Metadata</td>\n",
       "      <td>0.528095</td>\n",
       "      <td>0.506667</td>\n",
       "      <td>0.477662</td>\n",
       "      <td>0.032297</td>\n",
       "      <td>0.059067</td>\n",
       "      <td>0.026339</td>\n",
       "      <td>0.179713</td>\n",
       "      <td>0.243036</td>\n",
       "      <td>0.162294</td>\n",
       "      <td>0.492871</td>\n",
       "      <td>0.563319</td>\n",
       "      <td>0.459032</td>\n",
       "      <td>0.554302</td>\n",
       "      <td>0.445853</td>\n",
       "      <td>0.509472</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Gradient Boosting Tree_Metadata</td>\n",
       "      <td>0.497024</td>\n",
       "      <td>0.543333</td>\n",
       "      <td>0.503807</td>\n",
       "      <td>0.011092</td>\n",
       "      <td>0.048900</td>\n",
       "      <td>0.017975</td>\n",
       "      <td>0.105317</td>\n",
       "      <td>0.221133</td>\n",
       "      <td>0.134071</td>\n",
       "      <td>0.476382</td>\n",
       "      <td>0.517666</td>\n",
       "      <td>0.499991</td>\n",
       "      <td>0.586675</td>\n",
       "      <td>0.477529</td>\n",
       "      <td>0.530085</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                 clf  mean_precision  mean_recall   mean_f1  \\\n",
       "0          Logistic regression_Audio        0.566508     0.570000  0.547244   \n",
       "1       Gradient Boosting Tree_Audio        0.486429     0.416667  0.438236   \n",
       "2         k-Nearest neighbors_Visual        0.568492     0.633333  0.588811   \n",
       "3               Decision tree_Visual        0.550476     0.623333  0.581818   \n",
       "4         Logistic regression_Visual        0.630952     0.656667  0.627471   \n",
       "5       SVM (Gaussian Kernel)_Visual        0.543434     0.983333  0.699755   \n",
       "6               Random Forest_Visual        0.619762     0.653333  0.629573   \n",
       "7                    AdaBoost_Visual        0.584643     0.610000  0.593169   \n",
       "8      Gradient Boosting Tree_Visual        0.594524     0.726667  0.646410   \n",
       "9                Naive Bayes_Textual        0.535000     0.620000  0.550276   \n",
       "10       k-Nearest neighbors_Textual        0.547980     1.000000  0.707843   \n",
       "11     SVM (Gaussian Kernel)_Textual        0.547980     1.000000  0.707843   \n",
       "12      k-Nearest neighbors_Metadata        0.554563     0.616667  0.546934   \n",
       "13  Nearest mean classifier_Metadata        0.531786     0.536667  0.526062   \n",
       "14            Decision tree_Metadata        0.594524     0.546667  0.545072   \n",
       "15      Logistic regression_Metadata        0.502857     0.560000  0.525657   \n",
       "16    SVM (Gaussian Kernel)_Metadata        0.491569     0.693333  0.558464   \n",
       "17                  Bagging_Metadata        0.566667     0.450000  0.468797   \n",
       "18            Random Forest_Metadata        0.566429     0.510000  0.522879   \n",
       "19                 AdaBoost_Metadata        0.528095     0.506667  0.477662   \n",
       "20   Gradient Boosting Tree_Metadata        0.497024     0.543333  0.503807   \n",
       "\n",
       "    var_precision  var_recall    var_f1  std_precision  std_recall    std_f1  \\\n",
       "0        0.047184    0.048989  0.030090       0.217218    0.221334  0.173464   \n",
       "1        0.050547    0.054944  0.045175       0.224826    0.234402  0.212543   \n",
       "2        0.015035    0.035778  0.017594       0.122618    0.189150  0.132641   \n",
       "3        0.023185    0.043567  0.030200       0.152265    0.208726  0.173782   \n",
       "4        0.021983    0.026233  0.012144       0.148267    0.161967  0.110201   \n",
       "5        0.000481    0.002500  0.000820       0.021922    0.050000  0.028633   \n",
       "6        0.006054    0.019600  0.008414       0.077811    0.140000  0.091730   \n",
       "7        0.018714    0.025789  0.019354       0.136799    0.160589  0.139118   \n",
       "8        0.009215    0.032400  0.012671       0.095997    0.180000  0.112566   \n",
       "9        0.036233    0.055156  0.022024       0.190351    0.234852  0.148407   \n",
       "10       0.000272    0.000000  0.000199       0.016482    0.000000  0.014120   \n",
       "11       0.000272    0.000000  0.000199       0.016482    0.000000  0.014120   \n",
       "12       0.012638    0.112278  0.043591       0.112419    0.335079  0.208786   \n",
       "13       0.032573    0.017433  0.016190       0.180479    0.132035  0.127240   \n",
       "14       0.085277    0.096933  0.066838       0.292022    0.311341  0.258531   \n",
       "15       0.004522    0.012400  0.005635       0.067249    0.111355  0.075065   \n",
       "16       0.010384    0.102400  0.031869       0.101903    0.320000  0.178520   \n",
       "17       0.025333    0.027389  0.009250       0.159164    0.165496  0.096178   \n",
       "18       0.008429    0.045789  0.023748       0.091810    0.213983  0.154104   \n",
       "19       0.032297    0.059067  0.026339       0.179713    0.243036  0.162294   \n",
       "20       0.011092    0.048900  0.017975       0.105317    0.221133  0.134071   \n",
       "\n",
       "    l_95ci_precision  u_95ci_precision  l_95ci_recall  u_95ci_recall  \\\n",
       "0           0.523933          0.609083       0.526618       0.613382   \n",
       "1           0.442363          0.530494       0.370724       0.462610   \n",
       "2           0.544459          0.592525       0.596260       0.670407   \n",
       "3           0.520632          0.580320       0.582423       0.664244   \n",
       "4           0.601892          0.660013       0.624921       0.688412   \n",
       "5           0.539138          0.547731       0.973533       0.993133   \n",
       "6           0.604511          0.635013       0.625893       0.680773   \n",
       "7           0.557830          0.611455       0.578525       0.641475   \n",
       "8           0.575708          0.613339       0.691387       0.761947   \n",
       "9           0.497691          0.572309       0.573969       0.666031   \n",
       "10          0.544749          0.551210       1.000000       1.000000   \n",
       "11          0.544749          0.551210       1.000000       1.000000   \n",
       "12          0.532529          0.576598       0.550991       0.682342   \n",
       "13          0.496412          0.567160       0.510788       0.562546   \n",
       "14          0.537288          0.651760       0.485644       0.607690   \n",
       "15          0.489676          0.516038       0.538174       0.581826   \n",
       "16          0.471596          0.511542       0.630613       0.756053   \n",
       "17          0.535470          0.597863       0.417563       0.482437   \n",
       "18          0.548434          0.584423       0.468059       0.551941   \n",
       "19          0.492871          0.563319       0.459032       0.554302   \n",
       "20          0.476382          0.517666       0.499991       0.586675   \n",
       "\n",
       "    l_95ci_f1  u_95ci_f1  \n",
       "0    0.513245   0.581243  \n",
       "1    0.396578   0.479895  \n",
       "2    0.562814   0.614809  \n",
       "3    0.547757   0.615879  \n",
       "4    0.605872   0.649070  \n",
       "5    0.694143   0.705367  \n",
       "6    0.611594   0.647552  \n",
       "7    0.565902   0.620436  \n",
       "8    0.624347   0.668473  \n",
       "9    0.521189   0.579364  \n",
       "10   0.705076   0.710611  \n",
       "11   0.705076   0.710611  \n",
       "12   0.506012   0.587856  \n",
       "13   0.501123   0.551001  \n",
       "14   0.494400   0.595744  \n",
       "15   0.510944   0.540369  \n",
       "16   0.523474   0.593454  \n",
       "17   0.449946   0.487648  \n",
       "18   0.492674   0.553083  \n",
       "19   0.445853   0.509472  \n",
       "20   0.477529   0.530085  "
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ow.df_score_stats"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 174,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>TARGET</th>\n",
       "      <th>Logistic regression_Audio</th>\n",
       "      <th>Gradient Boosting Tree_Audio</th>\n",
       "      <th>k-Nearest neighbors_Visual</th>\n",
       "      <th>Decision tree_Visual</th>\n",
       "      <th>Logistic regression_Visual</th>\n",
       "      <th>SVM (Gaussian Kernel)_Visual</th>\n",
       "      <th>Random Forest_Visual</th>\n",
       "      <th>AdaBoost_Visual</th>\n",
       "      <th>Gradient Boosting Tree_Visual</th>\n",
       "      <th>...</th>\n",
       "      <th>SVM (Gaussian Kernel)_Textual</th>\n",
       "      <th>k-Nearest neighbors_Metadata</th>\n",
       "      <th>Nearest mean classifier_Metadata</th>\n",
       "      <th>Decision tree_Metadata</th>\n",
       "      <th>Logistic regression_Metadata</th>\n",
       "      <th>SVM (Gaussian Kernel)_Metadata</th>\n",
       "      <th>Bagging_Metadata</th>\n",
       "      <th>Random Forest_Metadata</th>\n",
       "      <th>AdaBoost_Metadata</th>\n",
       "      <th>Gradient Boosting Tree_Metadata</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>188</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>189</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>190</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>191</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>192</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>194</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>195</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>196</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>197</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>201</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>202</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>203</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>204</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>205</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>206</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>207</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>209</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>210</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>211</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>212</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>213</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>214</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>215</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>216</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>217</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>218 rows × 22 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     TARGET  Logistic regression_Audio  Gradient Boosting Tree_Audio  \\\n",
       "0         1                          1                             1   \n",
       "1         1                          1                             1   \n",
       "2         1                          1                             1   \n",
       "3         1                          1                             1   \n",
       "4         0                          1                             0   \n",
       "5         1                          1                             1   \n",
       "6         1                          1                             1   \n",
       "7         1                          1                             1   \n",
       "8         1                          0                             1   \n",
       "9         0                          0                             0   \n",
       "10        0                          1                             0   \n",
       "11        1                          0                             1   \n",
       "12        1                          1                             1   \n",
       "13        1                          1                             1   \n",
       "14        0                          0                             0   \n",
       "15        1                          0                             1   \n",
       "16        1                          0                             1   \n",
       "17        1                          1                             0   \n",
       "18        1                          0                             1   \n",
       "19        1                          0                             0   \n",
       "20        1                          1                             0   \n",
       "21        0                          0                             0   \n",
       "22        0                          0                             0   \n",
       "23        1                          1                             1   \n",
       "24        1                          1                             1   \n",
       "25        1                          0                             1   \n",
       "26        0                          1                             0   \n",
       "27        1                          0                             0   \n",
       "28        0                          0                             0   \n",
       "29        0                          1                             0   \n",
       "..      ...                        ...                           ...   \n",
       "188       1                          1                             1   \n",
       "189       1                          1                             1   \n",
       "190       0                          1                             0   \n",
       "191       0                          0                             0   \n",
       "192       1                          1                             1   \n",
       "193       1                          1                             1   \n",
       "194       0                          1                             0   \n",
       "195       0                          1                             0   \n",
       "196       0                          0                             0   \n",
       "197       0                          0                             0   \n",
       "198       1                          0                             1   \n",
       "199       0                          1                             0   \n",
       "200       1                          0                             1   \n",
       "201       0                          0                             0   \n",
       "202       0                          1                             0   \n",
       "203       0                          1                             0   \n",
       "204       1                          1                             1   \n",
       "205       0                          0                             0   \n",
       "206       0                          0                             0   \n",
       "207       0                          0                             0   \n",
       "208       1                          1                             1   \n",
       "209       1                          1                             1   \n",
       "210       0                          1                             0   \n",
       "211       0                          0                             0   \n",
       "212       1                          1                             1   \n",
       "213       0                          1                             0   \n",
       "214       0                          1                             0   \n",
       "215       1                          1                             1   \n",
       "216       0                          0                             0   \n",
       "217       0                          0                             0   \n",
       "\n",
       "     k-Nearest neighbors_Visual  Decision tree_Visual  \\\n",
       "0                             1                     0   \n",
       "1                             1                     1   \n",
       "2                             1                     1   \n",
       "3                             1                     1   \n",
       "4                             1                     0   \n",
       "5                             1                     1   \n",
       "6                             0                     1   \n",
       "7                             1                     1   \n",
       "8                             1                     1   \n",
       "9                             1                     0   \n",
       "10                            1                     1   \n",
       "11                            1                     1   \n",
       "12                            1                     0   \n",
       "13                            0                     1   \n",
       "14                            1                     0   \n",
       "15                            1                     1   \n",
       "16                            1                     1   \n",
       "17                            1                     1   \n",
       "18                            1                     1   \n",
       "19                            1                     1   \n",
       "20                            0                     0   \n",
       "21                            0                     0   \n",
       "22                            1                     0   \n",
       "23                            1                     1   \n",
       "24                            1                     0   \n",
       "25                            1                     0   \n",
       "26                            0                     0   \n",
       "27                            0                     1   \n",
       "28                            1                     0   \n",
       "29                            1                     0   \n",
       "..                          ...                   ...   \n",
       "188                           1                     1   \n",
       "189                           1                     0   \n",
       "190                           1                     0   \n",
       "191                           0                     0   \n",
       "192                           1                     1   \n",
       "193                           1                     1   \n",
       "194                           1                     0   \n",
       "195                           1                     0   \n",
       "196                           0                     0   \n",
       "197                           0                     0   \n",
       "198                           1                     1   \n",
       "199                           1                     0   \n",
       "200                           1                     1   \n",
       "201                           1                     0   \n",
       "202                           1                     0   \n",
       "203                           1                     0   \n",
       "204                           1                     1   \n",
       "205                           1                     0   \n",
       "206                           0                     0   \n",
       "207                           0                     0   \n",
       "208                           1                     1   \n",
       "209                           1                     1   \n",
       "210                           1                     0   \n",
       "211                           1                     0   \n",
       "212                           1                     1   \n",
       "213                           0                     0   \n",
       "214                           0                     0   \n",
       "215                           1                     1   \n",
       "216                           1                     0   \n",
       "217                           0                     0   \n",
       "\n",
       "     Logistic regression_Visual  SVM (Gaussian Kernel)_Visual  \\\n",
       "0                             0                             1   \n",
       "1                             1                             1   \n",
       "2                             1                             1   \n",
       "3                             0                             1   \n",
       "4                             0                             0   \n",
       "5                             0                             1   \n",
       "6                             1                             1   \n",
       "7                             1                             1   \n",
       "8                             1                             1   \n",
       "9                             1                             0   \n",
       "10                            1                             1   \n",
       "11                            1                             1   \n",
       "12                            1                             0   \n",
       "13                            0                             1   \n",
       "14                            0                             0   \n",
       "15                            1                             0   \n",
       "16                            1                             1   \n",
       "17                            0                             1   \n",
       "18                            1                             1   \n",
       "19                            0                             1   \n",
       "20                            1                             1   \n",
       "21                            1                             0   \n",
       "22                            0                             1   \n",
       "23                            1                             1   \n",
       "24                            1                             0   \n",
       "25                            1                             0   \n",
       "26                            0                             0   \n",
       "27                            0                             1   \n",
       "28                            0                             0   \n",
       "29                            1                             0   \n",
       "..                          ...                           ...   \n",
       "188                           0                             1   \n",
       "189                           1                             0   \n",
       "190                           1                             0   \n",
       "191                           1                             0   \n",
       "192                           1                             1   \n",
       "193                           1                             1   \n",
       "194                           0                             0   \n",
       "195                           0                             0   \n",
       "196                           0                             0   \n",
       "197                           0                             0   \n",
       "198                           0                             1   \n",
       "199                           0                             0   \n",
       "200                           1                             1   \n",
       "201                           1                             0   \n",
       "202                           1                             0   \n",
       "203                           0                             0   \n",
       "204                           1                             1   \n",
       "205                           0                             0   \n",
       "206                           1                             0   \n",
       "207                           0                             1   \n",
       "208                           1                             1   \n",
       "209                           1                             1   \n",
       "210                           1                             0   \n",
       "211                           0                             0   \n",
       "212                           1                             1   \n",
       "213                           0                             0   \n",
       "214                           0                             0   \n",
       "215                           0                             1   \n",
       "216                           0                             0   \n",
       "217                           0                             0   \n",
       "\n",
       "     Random Forest_Visual  AdaBoost_Visual  Gradient Boosting Tree_Visual  \\\n",
       "0                       1                0                              0   \n",
       "1                       1                1                              1   \n",
       "2                       1                1                              1   \n",
       "3                       1                1                              1   \n",
       "4                       0                0                              0   \n",
       "5                       1                1                              1   \n",
       "6                       1                1                              1   \n",
       "7                       1                1                              1   \n",
       "8                       1                1                              1   \n",
       "9                       0                0                              0   \n",
       "10                      1                1                              1   \n",
       "11                      1                1                              1   \n",
       "12                      0                0                              0   \n",
       "13                      1                1                              1   \n",
       "14                      0                0                              0   \n",
       "15                      1                1                              1   \n",
       "16                      0                1                              1   \n",
       "17                      0                0                              0   \n",
       "18                      1                0                              0   \n",
       "19                      0                0                              0   \n",
       "20                      0                0                              0   \n",
       "21                      0                0                              0   \n",
       "22                      1                0                              0   \n",
       "23                      1                1                              1   \n",
       "24                      0                0                              0   \n",
       "25                      0                0                              0   \n",
       "26                      0                0                              0   \n",
       "27                      1                0                              0   \n",
       "28                      0                0                              0   \n",
       "29                      0                0                              0   \n",
       "..                    ...              ...                            ...   \n",
       "188                     1                1                              1   \n",
       "189                     0                0                              0   \n",
       "190                     0                0                              0   \n",
       "191                     0                0                              0   \n",
       "192                     1                1                              1   \n",
       "193                     1                1                              1   \n",
       "194                     0                0                              0   \n",
       "195                     0                0                              0   \n",
       "196                     0                0                              0   \n",
       "197                     0                0                              0   \n",
       "198                     1                1                              1   \n",
       "199                     0                0                              0   \n",
       "200                     1                1                              1   \n",
       "201                     0                0                              0   \n",
       "202                     0                0                              0   \n",
       "203                     0                0                              0   \n",
       "204                     1                1                              1   \n",
       "205                     0                0                              0   \n",
       "206                     0                0                              0   \n",
       "207                     0                0                              0   \n",
       "208                     1                1                              1   \n",
       "209                     1                1                              1   \n",
       "210                     0                0                              0   \n",
       "211                     0                0                              0   \n",
       "212                     1                1                              1   \n",
       "213                     0                0                              0   \n",
       "214                     0                0                              0   \n",
       "215                     0                1                              1   \n",
       "216                     0                0                              0   \n",
       "217                     0                0                              0   \n",
       "\n",
       "                  ...                 SVM (Gaussian Kernel)_Textual  \\\n",
       "0                 ...                                             1   \n",
       "1                 ...                                             1   \n",
       "2                 ...                                             1   \n",
       "3                 ...                                             1   \n",
       "4                 ...                                             1   \n",
       "5                 ...                                             1   \n",
       "6                 ...                                             1   \n",
       "7                 ...                                             1   \n",
       "8                 ...                                             1   \n",
       "9                 ...                                             1   \n",
       "10                ...                                             1   \n",
       "11                ...                                             1   \n",
       "12                ...                                             1   \n",
       "13                ...                                             1   \n",
       "14                ...                                             1   \n",
       "15                ...                                             1   \n",
       "16                ...                                             1   \n",
       "17                ...                                             1   \n",
       "18                ...                                             1   \n",
       "19                ...                                             1   \n",
       "20                ...                                             1   \n",
       "21                ...                                             1   \n",
       "22                ...                                             1   \n",
       "23                ...                                             1   \n",
       "24                ...                                             1   \n",
       "25                ...                                             1   \n",
       "26                ...                                             1   \n",
       "27                ...                                             1   \n",
       "28                ...                                             1   \n",
       "29                ...                                             1   \n",
       "..                ...                                           ...   \n",
       "188               ...                                             1   \n",
       "189               ...                                             1   \n",
       "190               ...                                             1   \n",
       "191               ...                                             1   \n",
       "192               ...                                             1   \n",
       "193               ...                                             1   \n",
       "194               ...                                             1   \n",
       "195               ...                                             1   \n",
       "196               ...                                             1   \n",
       "197               ...                                             1   \n",
       "198               ...                                             1   \n",
       "199               ...                                             1   \n",
       "200               ...                                             1   \n",
       "201               ...                                             1   \n",
       "202               ...                                             1   \n",
       "203               ...                                             1   \n",
       "204               ...                                             1   \n",
       "205               ...                                             1   \n",
       "206               ...                                             1   \n",
       "207               ...                                             1   \n",
       "208               ...                                             1   \n",
       "209               ...                                             1   \n",
       "210               ...                                             1   \n",
       "211               ...                                             1   \n",
       "212               ...                                             1   \n",
       "213               ...                                             1   \n",
       "214               ...                                             1   \n",
       "215               ...                                             1   \n",
       "216               ...                                             1   \n",
       "217               ...                                             1   \n",
       "\n",
       "     k-Nearest neighbors_Metadata  Nearest mean classifier_Metadata  \\\n",
       "0                               1                                 1   \n",
       "1                               1                                 0   \n",
       "2                               1                                 1   \n",
       "3                               1                                 1   \n",
       "4                               1                                 1   \n",
       "5                               1                                 0   \n",
       "6                               0                                 1   \n",
       "7                               1                                 1   \n",
       "8                               1                                 0   \n",
       "9                               0                                 1   \n",
       "10                              0                                 0   \n",
       "11                              1                                 1   \n",
       "12                              1                                 1   \n",
       "13                              1                                 1   \n",
       "14                              0                                 0   \n",
       "15                              0                                 1   \n",
       "16                              0                                 1   \n",
       "17                              1                                 1   \n",
       "18                              1                                 1   \n",
       "19                              0                                 1   \n",
       "20                              0                                 0   \n",
       "21                              0                                 0   \n",
       "22                              0                                 1   \n",
       "23                              0                                 1   \n",
       "24                              0                                 0   \n",
       "25                              1                                 1   \n",
       "26                              0                                 1   \n",
       "27                              0                                 0   \n",
       "28                              1                                 1   \n",
       "29                              0                                 0   \n",
       "..                            ...                               ...   \n",
       "188                             1                                 0   \n",
       "189                             1                                 1   \n",
       "190                             1                                 1   \n",
       "191                             1                                 1   \n",
       "192                             1                                 1   \n",
       "193                             1                                 0   \n",
       "194                             1                                 0   \n",
       "195                             0                                 0   \n",
       "196                             0                                 1   \n",
       "197                             0                                 0   \n",
       "198                             1                                 1   \n",
       "199                             1                                 1   \n",
       "200                             1                                 1   \n",
       "201                             0                                 0   \n",
       "202                             0                                 0   \n",
       "203                             1                                 1   \n",
       "204                             1                                 0   \n",
       "205                             1                                 0   \n",
       "206                             0                                 1   \n",
       "207                             0                                 0   \n",
       "208                             1                                 1   \n",
       "209                             0                                 1   \n",
       "210                             1                                 1   \n",
       "211                             0                                 1   \n",
       "212                             1                                 1   \n",
       "213                             0                                 0   \n",
       "214                             0                                 0   \n",
       "215                             1                                 0   \n",
       "216                             1                                 1   \n",
       "217                             0                                 1   \n",
       "\n",
       "     Decision tree_Metadata  Logistic regression_Metadata  \\\n",
       "0                         1                             1   \n",
       "1                         1                             1   \n",
       "2                         1                             1   \n",
       "3                         1                             1   \n",
       "4                         0                             1   \n",
       "5                         1                             1   \n",
       "6                         1                             1   \n",
       "7                         1                             1   \n",
       "8                         1                             1   \n",
       "9                         0                             0   \n",
       "10                        0                             0   \n",
       "11                        1                             1   \n",
       "12                        1                             1   \n",
       "13                        1                             1   \n",
       "14                        0                             0   \n",
       "15                        1                             1   \n",
       "16                        1                             1   \n",
       "17                        1                             1   \n",
       "18                        1                             0   \n",
       "19                        0                             1   \n",
       "20                        0                             1   \n",
       "21                        0                             1   \n",
       "22                        0                             0   \n",
       "23                        0                             1   \n",
       "24                        1                             1   \n",
       "25                        1                             1   \n",
       "26                        0                             0   \n",
       "27                        0                             0   \n",
       "28                        0                             0   \n",
       "29                        0                             0   \n",
       "..                      ...                           ...   \n",
       "188                       1                             1   \n",
       "189                       1                             1   \n",
       "190                       0                             1   \n",
       "191                       0                             0   \n",
       "192                       1                             1   \n",
       "193                       1                             1   \n",
       "194                       0                             0   \n",
       "195                       0                             0   \n",
       "196                       0                             0   \n",
       "197                       0                             0   \n",
       "198                       1                             1   \n",
       "199                       0                             0   \n",
       "200                       1                             1   \n",
       "201                       0                             0   \n",
       "202                       0                             1   \n",
       "203                       0                             1   \n",
       "204                       1                             0   \n",
       "205                       0                             0   \n",
       "206                       0                             1   \n",
       "207                       0                             0   \n",
       "208                       1                             1   \n",
       "209                       1                             1   \n",
       "210                       0                             0   \n",
       "211                       0                             1   \n",
       "212                       1                             1   \n",
       "213                       0                             0   \n",
       "214                       0                             0   \n",
       "215                       1                             0   \n",
       "216                       0                             0   \n",
       "217                       0                             1   \n",
       "\n",
       "     SVM (Gaussian Kernel)_Metadata  Bagging_Metadata  Random Forest_Metadata  \\\n",
       "0                                 1                 1                       1   \n",
       "1                                 0                 1                       1   \n",
       "2                                 1                 1                       1   \n",
       "3                                 1                 1                       1   \n",
       "4                                 1                 0                       0   \n",
       "5                                 0                 1                       1   \n",
       "6                                 0                 1                       1   \n",
       "7                                 1                 1                       1   \n",
       "8                                 1                 0                       1   \n",
       "9                                 1                 0                       0   \n",
       "10                                0                 0                       0   \n",
       "11                                1                 1                       1   \n",
       "12                                1                 1                       1   \n",
       "13                                1                 1                       1   \n",
       "14                                0                 0                       0   \n",
       "15                                0                 1                       1   \n",
       "16                                0                 0                       1   \n",
       "17                                1                 1                       0   \n",
       "18                                1                 0                       0   \n",
       "19                                0                 1                       0   \n",
       "20                                0                 1                       0   \n",
       "21                                0                 0                       0   \n",
       "22                                1                 0                       0   \n",
       "23                                0                 0                       0   \n",
       "24                                0                 1                       1   \n",
       "25                                1                 0                       1   \n",
       "26                                0                 0                       0   \n",
       "27                                0                 0                       1   \n",
       "28                                1                 0                       0   \n",
       "29                                0                 0                       0   \n",
       "..                              ...               ...                     ...   \n",
       "188                               1                 0                       1   \n",
       "189                               1                 1                       0   \n",
       "190                               1                 0                       1   \n",
       "191                               1                 0                       0   \n",
       "192                               1                 1                       1   \n",
       "193                               1                 1                       1   \n",
       "194                               0                 0                       0   \n",
       "195                               0                 0                       0   \n",
       "196                               1                 0                       0   \n",
       "197                               0                 0                       0   \n",
       "198                               1                 1                       1   \n",
       "199                               1                 0                       0   \n",
       "200                               1                 1                       1   \n",
       "201                               0                 0                       0   \n",
       "202                               0                 0                       1   \n",
       "203                               1                 0                       0   \n",
       "204                               1                 1                       1   \n",
       "205                               0                 0                       0   \n",
       "206                               0                 0                       0   \n",
       "207                               0                 0                       0   \n",
       "208                               1                 1                       1   \n",
       "209                               1                 1                       1   \n",
       "210                               1                 0                       0   \n",
       "211                               0                 0                       0   \n",
       "212                               1                 1                       1   \n",
       "213                               0                 0                       0   \n",
       "214                               0                 0                       0   \n",
       "215                               0                 0                       0   \n",
       "216                               1                 0                       0   \n",
       "217                               1                 0                       0   \n",
       "\n",
       "     AdaBoost_Metadata  Gradient Boosting Tree_Metadata  \n",
       "0                    1                                1  \n",
       "1                    1                                1  \n",
       "2                    1                                1  \n",
       "3                    1                                1  \n",
       "4                    1                                1  \n",
       "5                    1                                1  \n",
       "6                    0                                1  \n",
       "7                    1                                1  \n",
       "8                    1                                1  \n",
       "9                    0                                0  \n",
       "10                   0                                0  \n",
       "11                   1                                1  \n",
       "12                   1                                1  \n",
       "13                   1                                1  \n",
       "14                   0                                0  \n",
       "15                   1                                1  \n",
       "16                   1                                1  \n",
       "17                   0                                1  \n",
       "18                   0                                0  \n",
       "19                   0                                1  \n",
       "20                   1                                1  \n",
       "21                   0                                0  \n",
       "22                   0                                0  \n",
       "23                   0                                0  \n",
       "24                   1                                1  \n",
       "25                   1                                1  \n",
       "26                   0                                0  \n",
       "27                   0                                0  \n",
       "28                   0                                0  \n",
       "29                   0                                0  \n",
       "..                 ...                              ...  \n",
       "188                  1                                1  \n",
       "189                  1                                1  \n",
       "190                  1                                1  \n",
       "191                  0                                0  \n",
       "192                  1                                1  \n",
       "193                  1                                1  \n",
       "194                  0                                0  \n",
       "195                  0                                0  \n",
       "196                  0                                0  \n",
       "197                  0                                0  \n",
       "198                  1                                1  \n",
       "199                  1                                1  \n",
       "200                  1                                1  \n",
       "201                  0                                0  \n",
       "202                  0                                0  \n",
       "203                  1                                1  \n",
       "204                  0                                1  \n",
       "205                  0                                0  \n",
       "206                  1                                1  \n",
       "207                  0                                0  \n",
       "208                  1                                1  \n",
       "209                  1                                1  \n",
       "210                  0                                0  \n",
       "211                  0                                0  \n",
       "212                  1                                1  \n",
       "213                  0                                0  \n",
       "214                  0                                0  \n",
       "215                  0                                1  \n",
       "216                  0                                0  \n",
       "217                  1                                0  \n",
       "\n",
       "[218 rows x 22 columns]"
      ]
     },
     "execution_count": 174,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ow.df_res_all[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 177,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--------------------------------------------------\n",
      "Majority Voting Results:\n",
      "Mean Values:  [0.60745713 0.72272727 0.65133344]\n",
      "Variance Values:  [0.00550447 0.01688705 0.00523166]\n",
      "Std Values:  [0.0741921  0.12995019 0.07233022]\n",
      "95%-CI:\n",
      "Precision 0.5929154736721126-0.6219987787421398; Recall 0.6972570351399471-0.7481975103145985; F1 0.6371567184619235-0.6655101661408876;\n",
      "--------------------------------------------------\n",
      "Label Stacking Results:\n",
      "Mean Values:  [0.60834356 0.65227273 0.61756822]\n",
      "Variance Values:  [0.01057294 0.03077881 0.0138641 ]\n",
      "Std Values:  [0.10282479 0.17543891 0.11774592]\n",
      "95%-CI:\n",
      "Precision 0.5881898984436841-0.628497215611851; Recall 0.6178867010838592-0.6866587534615954; F1 0.5944900223336272-0.6406464242208542;\n",
      "--------------------------------------------------\n",
      "Label Attribute Stacking Results:\n",
      "Mean Values:  [0.53844687 0.89621212 0.67123546]\n",
      "Variance Values:  [0.00255192 0.01230544 0.00419044]\n",
      "Std Values:  [0.05051655 0.11092989 0.0647336 ]\n",
      "95%-CI:\n",
      "Precision 0.5285456312507618-0.5483481182745668; Recall 0.8744698625283465-0.9179543798958958; F1 0.6585476792426296-0.683923249575548;\n"
     ]
    }
   ],
   "source": [
    "def majorityVoting2(cvs_results):\n",
    "    results=[]\n",
    "    for fold in range(0,len(cvs_results[0])):\n",
    "        df_vars=cvs_results[0][fold]\n",
    "        df_labels=cvs_results[0][fold]['TARGET']\n",
    "        df_labels=df_labels.reset_index(drop=True)\n",
    "        for x in range(1,len(cvs_results)):\n",
    "            tmp=cvs_results[x][fold]\n",
    "            tmp=tmp.drop(['TARGET'],axis = 1)\n",
    "            df_vars=pd.concat([df_vars,tmp],axis = 1)\n",
    "            \n",
    "        res=df_vars.mode(axis=1)[0]\n",
    "        res=res.reset_index(drop=True)\n",
    "        res=pd.to_numeric(res)\n",
    "        df_labels=pd.to_numeric(df_labels)   \n",
    "        \n",
    "        #results.append(res)\n",
    "        precision = precision_score(df_labels, res)\n",
    "        recall = recall_score(df_labels,res)\n",
    "        f1 = f1_score(df_labels,res)\n",
    "        results.append([precision,recall,f1])\n",
    "        \n",
    "        #print(precision,recall,f1)\n",
    "        \n",
    "    return results\n",
    "   \n",
    "def majorityVoting(cvs_results,droppedClfs):\n",
    "    results=[]\n",
    "    for fold in range(0,len(cvs_results)):\n",
    "        df_vars=cvs_results[fold]\n",
    "        df_vars=df_vars.drop(['TARGET'],axis=1)\n",
    "        \n",
    "        for clf in droppedClfs:\n",
    "            df_vars= df_vars.drop([clf],axis = 1)\n",
    "        \n",
    "        df_labels=cvs_results[fold]['TARGET']\n",
    "        \n",
    "        res=df_vars.mode(axis=1)[0]\n",
    "        res=pd.to_numeric(res)\n",
    "        df_labels=pd.to_numeric(df_labels)   \n",
    "        \n",
    "        precision = precision_score(df_labels, res)\n",
    "        recall = recall_score(df_labels,res)\n",
    "        f1 = f1_score(df_labels,res)\n",
    "        results.append([precision,recall,f1])\n",
    "        \n",
    "    return results\n",
    "   \n",
    "    \n",
    "    \n",
    "def labelStacking(df_all_folds,df_test_folds,droppedClfs):\n",
    "    results=[]\n",
    "    for fold in range(0,len(df_all_folds)):\n",
    "        df_all = df_all_folds[fold]\n",
    "        df_test = df_test_folds[fold]\n",
    "        df_new=df_all.merge(df_test, how='left', indicator=True)\n",
    "        df_train = df_new[df_new['_merge'] == 'left_only']\n",
    "        #print(df_train)\n",
    "        df_train = df_train.drop(['_merge'],axis = 1)\n",
    "        #clf=SVC(gamma='auto')\n",
    "        #clf=LogisticRegression()\n",
    "        #clf=DecisionTreeClassifier()\n",
    "        #clf=NearestCentroid()\n",
    "        #clf=RandomForestClassifier(n_estimators=100)\n",
    "        clf=KNeighborsClassifier()\n",
    "        #clf=AdaBoostClassifier()\n",
    "        #clf=GradientBoostingClassifier()\n",
    "        X_train = df_train.loc[:, df_train.columns != 'TARGET']\n",
    "        y_train = df_train['TARGET']\n",
    "        \n",
    "        X_test = df_test.loc[:, df_test.columns != 'TARGET']\n",
    "        y_test = df_test['TARGET']\n",
    "        \n",
    "        for c in droppedClfs:\n",
    "            X_train= X_train.drop([c],axis = 1)\n",
    "            X_test= X_test.drop([c],axis = 1)\n",
    "            \n",
    "        model = clf.fit(X_train, y_train)\n",
    "        precision = precision_score(y_test,model.predict(X_test))\n",
    "        recall = recall_score(y_test,model.predict(X_test))\n",
    "        f1 = f1_score(y_test,model.predict(X_test))\n",
    "        results.append([precision,recall,f1])\n",
    "    \n",
    "    return results\n",
    "\n",
    "def labelFeatureStacking(df_all_folds,df_test_folds,droppedClfs):\n",
    "    results=[]\n",
    "    for fold in range(0,len(df_all_folds)):\n",
    "        df_all = df_all_folds[fold]\n",
    "        df_test = df_test_folds[fold]\n",
    "        df_new=df_all.merge(df_test, how='left', indicator=True)\n",
    "        df_train = df_new[df_new['_merge'] == 'left_only']\n",
    "        df_train = df_train.drop(['_merge'],axis = 1)\n",
    "        \n",
    "        df_combined_train=pd.merge(df_train, df_vis_train, left_index=True, right_index=True)\n",
    "        df_combined_train = df_combined_train.drop(['file_name'],axis = 1)\n",
    "        df_combined_test=pd.merge(df_test, df_vis_train, left_index=True, right_index=True)\n",
    "        df_combined_test = df_combined_test.drop(['file_name'],axis = 1)\n",
    "        \n",
    "        X_train = df_combined_train.loc[:, df_combined_train.columns != 'TARGET']\n",
    "        y_train = df_combined_train['TARGET']\n",
    "        \n",
    "        X_test = df_combined_test.loc[:, df_combined_test.columns != 'TARGET']\n",
    "        y_test = df_combined_test['TARGET']\n",
    "        for c in droppedClfs:\n",
    "            X_train= X_train.drop([c],axis = 1)\n",
    "            X_test= X_test.drop([c],axis = 1)\n",
    "        \n",
    "                                  \n",
    "        #clf=SVC(gamma='auto')\n",
    "        #clf=LogisticRegression()\n",
    "        #clf=DecisionTreeClassifier()\n",
    "        #clf=NearestCentroid()\n",
    "        #clf=RandomForestClassifier(n_estimators=100)\n",
    "        clf=KNeighborsClassifier()\n",
    "        #clf=AdaBoostClassifier()\n",
    "        #clf=GradientBoostingClassifier()\n",
    "                                  \n",
    "        model = clf.fit(X_train, y_train)\n",
    "        precision = precision_score(y_test,model.predict(X_test))\n",
    "        recall = recall_score(y_test,model.predict(X_test))\n",
    "        f1 = f1_score(y_test,model.predict(X_test))\n",
    "        results.append([precision,recall,f1])\n",
    "    \n",
    "\n",
    "    return results\n",
    "    \n",
    "def calcResults(resMat):\n",
    "    npres = np.asarray(resMat)\n",
    "    meanVals=np.mean(npres,axis=0)\n",
    "    varVals=np.var(npres,axis=0)\n",
    "    stdVals=np.std(npres,axis=0)\n",
    "    CI_95_FACTOR = 1.96\n",
    "    l_ci = meanVals - stdVals*CI_95_FACTOR/npres.shape[0]\n",
    "    u_ci = meanVals + stdVals*CI_95_FACTOR/npres.shape[0]\n",
    "    \n",
    "    print(\"Mean Values: \",meanVals)\n",
    "    print(\"Variance Values: \",varVals)\n",
    "    print(\"Std Values: \",stdVals)\n",
    "    print(\"95%-CI:\\nPrecision {}-{}; Recall {}-{}; F1 {}-{};\".format(l_ci[0],u_ci[0],l_ci[1],u_ci[1],l_ci[2],u_ci[2]))\n",
    "\n",
    "\n",
    "\n",
    "filtered_p = ow.df_score_stats['clf'][ow.df_score_stats['mean_precision']<0.5]\n",
    "filtered_r = ow.df_score_stats['clf'][ow.df_score_stats['mean_recall']<0.5]\n",
    "filtered_f = ow.df_score_stats['clf'][ow.df_score_stats['mean_f1']<0.5]\n",
    "df_filtered =pd.concat([filtered_p,filtered_r],axis = 0)\n",
    "df_filtered =pd.concat([df_filtered,filtered_f],axis=0)\n",
    "droppedClfs=df_filtered.drop_duplicates()\n",
    "\n",
    "res1=majorityVoting(ow.df_res_test,droppedClfs)\n",
    "print(\"-\"*50)\n",
    "print(\"Majority Voting Results:\")\n",
    "averages1=calcResults(res1)\n",
    "\n",
    "#print(\"Majority Voting:\")\n",
    "#print(\"CV Scores: \",res1)\n",
    "#print(\"AVG: \",averages1)\n",
    "\n",
    "res2=labelStacking(ow.df_res_all,ow.df_res_test,droppedClfs)\n",
    "print(\"-\"*50)\n",
    "print(\"Label Stacking Results:\")\n",
    "averages2=calcResults(res2)\n",
    "\n",
    "\n",
    "#print(\"Label Stacking:\")\n",
    "#print(\"CV Scores: \",res2)\n",
    "#print(\"AVG: \",averages2)\n",
    "\n",
    "res3=labelFeatureStacking(ow.df_res_all,ow.df_res_test,droppedClfs)\n",
    "print(\"-\"*50)\n",
    "print(\"Label Attribute Stacking Results:\")\n",
    "averages3=calcResults(res3)\n",
    "                                  \n",
    "\n",
    "#print(\"Label-Feature Stacking:\")\n",
    "#print(\"CV Scores: \",res3)\n",
    "#print(\"AVG: \",averages3)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 178,
   "metadata": {},
   "outputs": [
    {
     "ename": "NameError",
     "evalue": "name 'cv_modality' is not defined",
     "output_type": "error",
     "traceback": [
      "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[1;31mNameError\u001b[0m                                 Traceback (most recent call last)",
      "\u001b[1;32m<ipython-input-178-e0a48ff3466e>\u001b[0m in \u001b[0;36m<module>\u001b[1;34m\u001b[0m\n\u001b[1;32m----> 1\u001b[1;33m \u001b[0mdf_cvs\u001b[0m\u001b[1;33m=\u001b[0m\u001b[0mcv_modality\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_features\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_targets\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mclfs\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mcv\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;36m10\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mverbose\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mpredict_all\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;32mFalse\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m      2\u001b[0m \u001b[0mdf_cvs\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mapend\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mcv_modality\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_features\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_targets\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mclfs\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mcv\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;36m10\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mverbose\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mpredict_all\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;32mFalse\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      3\u001b[0m \u001b[0mdf_cvs\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mapend\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mcv_modality\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_features\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_targets\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mclfs\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mcv\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;36m10\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mverbose\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mpredict_all\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;32mFalse\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      4\u001b[0m \u001b[0mdf_cvs\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mapend\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mcv_modality\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_features\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_targets\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mclfs\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mcv\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;36m10\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mverbose\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mpredict_all\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;32mFalse\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      5\u001b[0m \u001b[0mdf_cvs\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mapend\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mcv_modality\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_features\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mdf_targets\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mclfs\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mcv\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;36m10\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mverbose\u001b[0m\u001b[1;33m=\u001b[0m\u001b[1;32mTrue\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mpredict_all\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;32mFalse\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;31mNameError\u001b[0m: name 'cv_modality' is not defined"
     ]
    }
   ],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}