GoPro: Telemetry extractor in Python

This project is a simple Python wrapper for the GoPro utilities provided by @stilldavid

Specifications:

• Python 3.5
• Ubuntu 16.04
• Videos captured on GoPro Hero 5 black (5 is the minimum GoPro model for which GPS telemetry can be obtained)

The telemetry data we can obtain are:

• ~400 Hz 3-axis gyro readings
• ~200 Hz 3-axis accelerometer readings
• ~18 Hz GPS position (lat/lon/alt/spd)
• 1 Hz GPS timestamps
• 1 Hz GPS accuracy (cm) and fix (2d/3d)
• 1 Hz temperature of camera

For more information on the data and their labels, please refer to the original GoPro utilities repo.

Prerequisites

• FFmpeg
• GoLang

Instructions

Compile GoPro telemetry extraction executables

The following guide is adapted from here

Clone the necessary repositories with the correct directory structure

mkdir -p $HOME/go/src/github.com/stilldavid/
git clone [email protected]:stilldavid/gopro-utils.git $HOME/go/src/github.com/stilldavid/gopro-utils
mkdir -p $HOME/go/src/github.com/paulmach
git clone [email protected]:paulmach/go.geo.git $HOME/go/src/github.com/paulmach
git clone [email protected]:paulmach/go.geojson.git $HOME/go/src/github.com/paulmach

To extract Gyro, Accel and Temp information in spreadsheet format, we need to do the following

cd $HOME/go/src/github.com/stilldavid/gopro-utils/bin/gpmdinfo/
mv gpmdinfo.go gpmdinfo.go.bkup
wget http://tailorandwayne.com/gpmdinfo.go

If you're using a GoPro Hero 5 Black, open the gpmdinfo.go and uncomment the all blocks marked with "Uncomment for Gps":

///////////////////////Uncomment for Gps
var gpsCsv = [][]string{{"Latitude","Longitude","Altitude","Speed","Speed3D","TS"}}
gpsFile, err := os.Create("gps.csv")
checkError("Cannot create gps.csv file", err)
defer gpsFile.Close()
gpsWriter := csv.NewWriter(gpsFile)

// ...

////////////////////Uncomment for Gps
for i, _ := range t.Gps {
  gpsCsv = append(gpsCsv, []string{floattostr(t.Gps[i].Latitude),floattostr(t.Gps[i].Longitude),floattostr(t.Gps[i].Altitude),floattostr(t.Gps[i].Speed),floattostr(t.Gps[i].Speed3D),int64tostr(t.Gps[i].TS)})
}

// ...

/////////////Uncomment for Gps
for _, value := range gpsCsv {
    err := gpsWriter.Write(value)
    checkError("Cannot write to gps.csv file", err)
}
defer gpsWriter.Flush()    

Finally build the executables

cd $HOME/go/src/github.com/stilldavid/gopro-utils/bin/gpmdinfo/
go build
#=> Creates 'gpmdinfo' within the directory
cd $HOME/go/src/github.com/stilldavid/gopro-utils/bin/gopro2gpx/
go build
#=> Creates 'gopro2gpx' within the directory
cd $HOME/go/src/github.com/stilldavid/gopro-utils/bin/gopro2json/
go build
#=> Creates 'gopro2json' within the directory

Configure

We need to tell our python script where to look for the executables we compiled

cd <THIS REPOSITORY>
cp config.yml.example config.yml

If you have followed the instructions exactly up to this point, then there's no need to edit the config file. Else, just make sure the paths point to the correct respective executables you just compiled

Usage

To extract the GoPro telemetries, simply import gopro_telemetry.py in your code and instantiate the GoProTelemetry class as follows:

GoProTelemetry(video_path, reprocess=False, config_path='config.yml'):

• video_path: File path to the GoPro .mp4 video
• reprocess: Indicates whether or not to reprocess the telemetries of a video. Defaults to False
• config_path: Path to the configuration Yaml file. Defaults to config.yml

Telemetry data files

Instantiating a GoProTelemetry object with the given video path will extract the video's telemetries into the same folder where it resides. So suppose the target video file is GOPR0123.MP4, the process will create the following 7 files beside GOPR0123.MP4:

GOPR0123.MP4.bin
GOPR0123.MP4.gpx
GOPR0123.MP4.json
GOPR0123.MP4_accl.csv
GOPR0123.MP4_gps.csv
GOPR0123.MP4_gyro.csv
GOPR0123.MP4_temp.csv

The contents of these 7 new files are as follows:

• .bin: Telemetry data in binary format. Output by ffmpeg
• .gpx: GPX file for the path undertaken during the GoPro capture. Output by gopro2gpx
• .json: Telemetry data in JSON format. Output by gopro2json
• _accl.csv: Acceleration data along 3D axes in CSV format. Output by gpmdinfo
  • Columns: Milliseconds, AcclX, AcclY, AcclZ
• _gps.csv: GPS data in CSV format. Output by gpmdinfo
  • Columns: Latitude, Longitude, Altitude, Speed, Speed3D, TS
• _gyro.csv: Gyroscope data in CSV format. Output by gpmdinfo
  • Columns: Milliseconds, GyroX, GyroY, GyroZ
• _temp.csv: Temperature data in CSV format. Output by gpmdinfo
  • Columns: Milliseconds, Temp