CNTK Evaluation Overview

This page is work in progress

This page presents an overview of model evaluation using CNTK.

What is model evaluation?

Evaluating a model using CNTK.exe

• CPU/GPU capability
• Eval Command (config file)
• Readers (and their transformations)
• Pitfalls (minibatch size)

Evaluating a model programmatically using C++

• CPU capability
• Interface
• Usage Pattern
• Example (CPPEvalClient)

Evaluating a model programmatically using C#

• CPU capability
• Interface (CLI)
• Usage Pattern
• Example (CSEvalClient)

Evaluating different data types and layers

• Vector
• Image Readers (e.g. MNIST, ResNet) Transformations
• Selecting different layers for output

Current interface

Future 2.0 interface

TBD