Skip to content

Commit

Permalink
Merge branch 'develop' of github.com:SkalskiP/make-sense into develop
Browse files Browse the repository at this point in the history
  • Loading branch information
SkalskiP committed Sep 30, 2019
2 parents 35ed48b + 5af60e8 commit 4a309e3
Showing 1 changed file with 20 additions and 3 deletions.
23 changes: 20 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,17 +21,33 @@ Andrew Ng
## Sneak Peek

<p align="center">
<img width="1000" src=".//examples/alfa-demo.gif" alt="alfa-demo">
<img width="1000" src=".//examples/demo-base.gif" alt="alfa-demo">
</p>

**Figure 1.** Basic version of the application - without AI support

## Advanced AI functionalities

[makesense.ai][1] strives to significantly reduce the time we have to spend on labeling photos. To achieve this, we are going to use many different AI models that will be able to give you recommendations as well as automate repetitive and tedious activities. The first step on this journey is to use a [SSD model][8] pretrained on the [COCO dataset][9], which will do some of the work for you in drawing bboxes on photos and - in future versions of the application - will also suggest a label. We also plan to add, among other things, models that classify photos, detect characteristic features of faces, whole faces, and also human pose. The engine that drives our AI functionalities is [TensorFlow.js][10] - JS version of the most popular framework for training neural networks. This choice allows us not only to speed up your work but also to care about the privacy of your data, because unlike with other commercial and open source tools, your photos do not have to be transferred to the server. This time AI comes to your device!
[makesense.ai][1] strives to significantly reduce the time we have to spend on labeling photos. To achieve this, we are going to use many different AI models that will be able to give you recommendations as well as automate repetitive and tedious activities.

* [SSD model][8] pretrained on the [COCO dataset][9], which will do some of the work for you in drawing bboxes on photos and also (in some cases) suggest a label.
* [PoseNet model][11] is a vision model that can be used to estimate the pose of a person in an image or video by estimating where key body joints are.

In the future, we also plan to add, among other things, models that classify photos, detect characteristic features of faces as well as whole faces. The engine that drives our AI functionalities is [TensorFlow.js][10] - JS version of the most popular framework for training neural networks. This choice allows us not only to speed up your work but also to care about the privacy of your data, because unlike with other commercial and open source tools, your photos do not have to be transferred to the server. This time AI comes to your device!

<p align="center">
<img width="1000" src=".//examples/ai-demo.gif" alt="ai-demo">
<img width="1000" src=".//examples/demo-ssd.gif" alt="ai-demo">
</p>

**Figure 2.** SSD model - allows you to detect multiple objects, speeding up the bbox labeling process


<p align="center">
<img width="1000" src=".//examples/demo-posenet.gif" alt="ai-demo">
</p>

**Figure 3.** PoseNet model - allows you to detect people's poses in photos, automating point labeling in some usecases

## Set Up the Project Locally

```bash
Expand Down Expand Up @@ -119,3 +135,4 @@ Copyright (c) 2019-present, Piotr Skalski
[8]: https://arxiv.org/abs/1512.02325
[9]: http://cocodataset.org
[10]: https://www.tensorflow.org/js
[11]: https://www.tensorflow.org/lite/models/pose_estimation/overview

0 comments on commit 4a309e3

Please sign in to comment.