Skip to content

Commit

Permalink
* added result.cfg to configure CK dashboards
Browse files Browse the repository at this point in the history
* improved module:result to push results to CK dashboards
* improved module:dashboard to work with new CK dashboards
* improved module:wfe to work with new CK dashboards
* added module:ck-platform to work with cKnowledge.io platform
  (moved cbench functionality from the CK incubator to the CK module
   to work with cKnowledge.io dashboards directly)
* provided better support to work with CK modules
  as standard Python packages (see module:ck-platform as example)
  • Loading branch information
gfursin committed Jun 26, 2021
1 parent c7f01b5 commit 31ae6b7
Show file tree
Hide file tree
Showing 47 changed files with 7,623 additions and 13 deletions.
11 changes: 11 additions & 0 deletions CHANGES.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,14 @@
* v2.5.5
* added result.cfg to configure CK dashboards
* improved module:result to push results to CK dashboards
* improved module:dashboard to work with new CK dashboards
* improved module:wfe to work with new CK dashboards
* added module:ck-platform to work with cKnowledge.io platform
(moved cbench functionality from the CK incubator to the CK module
to work with cKnowledge.io dashboards directly)
* provided better support to work with CK modules
as standard Python packages (see module:ck-platform as example)

* V2.5.4
* added support to automatically add simple packages from Git:
ck add package:my-git-repo --git={URL} --tags=my-repo --env_ext=MY_GIT_REPO
Expand Down
14 changes: 9 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,16 +12,19 @@ Windows: [![Windows Build status](https://ci.appveyor.com/api/projects/status/iw
[![Documentation Status](https://readthedocs.org/projects/ck/badge/?version=latest)](https://ck.readthedocs.io/en/latest/?badge=latest)
[![Coverage Status](https://coveralls.io/repos/github/ctuning/ck/badge.svg)](https://coveralls.io/github/ctuning/ck)

## License
## Versions and licenses

* **V2+** : Apache 2.0
* **V1.x** : BSD 3-clause
* **V3** (planning) : **Apache 2.0**
* **V2+** (development) : **Apache 2.0**
* **V1.x** (maintenance and bug fixes) : **BSD 3-clause**

## News

* [Project website](https://cKnowledge.org)
* [CK-powered MLPerf™ benchmark automation](https://github.com/ctuning/ck/blob/master/docs/mlperf-automation/README.md)
* [Community projects to improve and redesign CK](https://github.com/ctuning/ck/blob/master/incubator/README.md)
* [AI/ML repository with all aggregated CK components](https://github.com/ctuning/ai)
* [OctoML's CK-based MLOps/MLPerf repository](https://github.com/octoml/mlops)

## Overview

Expand All @@ -35,7 +38,8 @@ Our goal is to help researchers and practitioners share, reuse and extend their
in the form of portable workflows, automation actions and reusable artifacts with a common API, CLI,
and meta description. See how CK helps to automate benchmarking, optimization and design space
exploration of [AI/ML/software/hardware stacks](https://cknowledge.io/result/crowd-benchmarking-mlperf-inference-classification-mobilenets-all/),
simplifies [MLPerf™](https://mlperf.org) submissions and supports collaborative, reproducible and reusable ML Systems research:
simplifies [MLPerf™ inference benchmark](https://github.com/ctuning/ck/blob/master/docs/mlperf-automation/README.md) submissions
and supports collaborative, reproducible and reusable ML Systems research:

* [ACM TechTalk](https://www.youtube.com/watch?v=7zpeIVwICa4)
* [AI/ML/MLPerf™ automation workflows and components from the community](https://github.com/ctuning/ai);
Expand All @@ -47,7 +51,7 @@ simplifies [MLPerf™](https://mlperf.org) submissions and supports collabor
* [Automating MLPerf(tm) inference benchmark and packing ML models, data sets and frameworks as CK components with a unified API and meta description](https://github.com/ctuning/ck/blob/master/docs/mlperf-automation/README.md)
* Providing a common format to share artifacts at ML, systems and other conferences: [video](https://youtu.be/DIkZxraTmGM), [Artifact Evaluation](https://cTuning.org/ae)
* Redesigning CK together with the community based on user feedback
* [Other real-world use cases](https://cKnowledge.org/partners.html) from MLPerf™, Arm, General Motors, IBM, the Raspberry Pi foundation, ACM and other great partners;
* [Other real-world use cases](https://cKnowledge.org/partners.html) from MLPerf™, Qualcomm, Arm, General Motors, IBM, the Raspberry Pi foundation, ACM and other great partners;

## Documentation

Expand Down
2 changes: 1 addition & 1 deletion ck/kernel.py
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@


# We use 3 digits for the main (released) version and 4th digit for development revision
__version__ = "2.5.4"
__version__ = "2.5.5"
# Do not use characters (to detect outdated version)!

# Import packages that are global for the whole kernel
Expand Down
1 change: 1 addition & 0 deletions ck/repo/module/.cm/alias-a-ck-platform
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
2ba7a9eb1047fa35
1 change: 1 addition & 0 deletions ck/repo/module/.cm/alias-a-result.cfg
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
68d174e82bfa3f79
1 change: 1 addition & 0 deletions ck/repo/module/.cm/alias-u-2ba7a9eb1047fa35
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
ck-platform
1 change: 1 addition & 0 deletions ck/repo/module/.cm/alias-u-68d174e82bfa3f79
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
result.cfg
1 change: 1 addition & 0 deletions ck/repo/module/ck-platform/.cm/desc.json
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{}
20 changes: 20 additions & 0 deletions ck/repo/module/ck-platform/.cm/info.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
{
"backup_data_uid": "2ba7a9eb1047fa35",
"backup_module_uid": "032630d041b4fd8a",
"backup_module_uoa": "module",
"control": {
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T07:25:18.688282",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
},
"data_name": "ck-platform"
}
32 changes: 32 additions & 0 deletions ck/repo/module/ck-platform/.cm/meta.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
{
"actions": {
"access": {
"desc": "access platform"
},
"init_graph": {
"desc": "init graph"
},
"login": {
"desc": "login to the CK platform"
},
"publish": {
"desc": "publish CK component"
},
"push_result": {
"desc": "push result"
},
"setup": {
"desc": "setup the CK platform"
},
"versions": {
"desc": "list versions of a CK component"
}
},
"actions_redirect": {},
"copyright": "See CK COPYRIGHT.txt for copyright details",
"desc": "cKnowledge.io platform",
"developer": "Grigori Fursin",
"developer_email": "[email protected]",
"developer_webpage": "http://fursin.net",
"license": "See CK LICENSE.txt for licensing details"
}
102 changes: 102 additions & 0 deletions ck/repo/module/ck-platform/.cm/updates.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,102 @@
{
"control": [
{
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T07:25:31.333861",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
},
{
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T07:25:40.268085",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
},
{
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T08:48:34.498166",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
},
{
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T08:48:43.273879",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
},
{
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T08:52:33.681180",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
},
{
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T08:52:47.745312",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
},
{
"author": "Grigori Fursin",
"author_email": "[email protected]",
"author_webpage": "http://fursin.net",
"copyright": "See CK COPYRIGHT.txt for copyright details",
"engine": "CK",
"iso_datetime": "2021-06-26T08:52:52.861782",
"license": "See CK LICENSE.txt for licensing details",
"version": [
"2",
"5",
"4"
]
}
]
}
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Copyright 2019-2020 CodeReef. All rights reserved.
Copyright 2020-2021 cTuning foundation. All rights reserved.

Apache License
Version 2.0, January 2004
Expand Down
9 changes: 9 additions & 0 deletions ck/repo/module/ck-platform/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
## Init graph

Check `test/init-graph.bat`

https://cknowledge.io/c/result/fgg-test/?v=1.0.0#gfursin_1

## Push results to a graph

Check `test/push-to-graph.bat`
5 changes: 5 additions & 0 deletions ck/repo/module/ck-platform/ck_032630d041b4fd8a/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
#
# Developer(s): Grigori Fursin, https://fursin.net
#

__version__ = "1.3.1"
7 changes: 7 additions & 0 deletions ck/repo/module/ck-platform/ck_032630d041b4fd8a/__main__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
#
# Developer(s): Grigori Fursin, https://fursin.net
#

from . import main

main.cli()
Loading

0 comments on commit 31ae6b7

Please sign in to comment.