Skip to content
Jerin Philip edited this page Nov 4, 2020 · 7 revisions

Documentation

API

Intgemm8 Models

Compilation instructions

Debian buster

sudo apt-get install cmake libprotobuf17 libprotobuf-dev libepoxy-dev autoconf2.13 nasm clang libpulse-dev yasm libopenblas-dev libgconf2-dev libdbus-glib-1-dev libalsaplayer-dev libatk-bridge2.0-dev

Install MKL, somehow. Then compile with

cmake .. -DUSE_SENTENCEPIECE=ON -DCOMPILE_CUDA=OFF -DPROTOBUF_LIBRARY=/usr/lib/x86_64-linux-gnu/libprotobuf.so -DPROTOBUF_INCLUDE_DIR=/usr/include -DPROTOBUF_PROTOC_EXECUTABLE=/usr/bin/protoc -DUSE_FBGEMM=OFF

On CSD3

The following sets the environment on CSD3 to compile browsermt/mts@06337f, , which was master at the time of writing this part.

#!/bin/bash

module purge

MODULES=(
 cmake/latest
 intel/mkl-DNN/2018.0.20170720
 intel/mkl/2020.2
 gcc-5.4.0-gcc-4.8.5-fis24gg
 protobuf-3.1.0-gcc-5.4.0-brjazgz
 pcre-8.42-gcc-5.4.0-tizef2i
 boost-1.69.0-gcc-5.4.0-ie2ce2k
)

for MODULE in ${MODULES[@]}; do 
    module load $MODULE;
done
Clone this wiki locally