Below are the key features delivered in Adlik Release 0.1.0, see chinese version here Feature List中文版.
Training framework | Model format | Target runtime | compiled format |
Keras | h5 | Tf Serving | SavedModel |
|
| OpenVINO | IR |
|
| TensorRT | Plan |
|
| TF-Lite | tflite |
TensorFlow | Ckpt/pb | Tf Serving | SavedModel |
|
| OpenVINO | IR |
|
| TensorRT | Plan |
|
| TF-Lite | tflite |
PyTorch | pth | OpenVINO | IR |
|
| TensorRT | Plan |
Training framework | Inference engine | hardware environment |
| TensorFlow Serving-1.14 | CPU/GPU |
| TensorFlow Serving-2.2 | CPU/GPU |
| OpenVINO-2019 | CPU |
| TensorRT-6 | GPU |
| TensorRT-7 | GPU |
| TF Lite-2.1 | CPU(X86/ARM) |
TensorFlow | TensorFlow Serving-1.14 | CPU/GPU |
| TensorFlow Serving-2.2 | CPU/GPU |
| OpenVINO-2019 | CPU |
| TensorRT-6 | GPU |
| TensorRT-7 | GPU |
| TF Lite-2.1 | CPU(X86/ARM) |
PyTorch | OpenVINO-2019 | CPU |
| TensorRT-6 | GPU |
Integration of multiple DL inference runtime, including TensorFlow Serving, OpenVINO, TensorRT and TF Lite.
Integrated Inference engine | Hardware environment |
TensorFlow Serving-1.14 | CPU/GPU |
TensorFlow Serving-2.2 | CPU/GPU |
OpenVINO-2019 | CPU |
TensorRT-6 | GPU |
TensorRT-7 | GPU |
TF Lite-2.1 | CPU(X86/ARM) |
Benchmark Test Framework for Deep Learning Model