ONNX模型解析推理工具onnx-parser使用记录

onnx-parser是国内开发者开发的一个ONNX网络模型解析以及推理工具，当前已经被纳入了RT-Thread的开发包，由于RT-Thread的ENV环境支持，下面分析记录一下它的使用和原理分析。

首先下载代码：

git clone https://github.com/wuhanstudio/onnx-parser

下载Scons工具

Scons是一个开放源码、以Python语言编码的自动化构建工具。可以将SCons看作是经典Make实用程序的改进的、跨平台的替代品.

修改编译错误：

代码下载下来，默认是编译不过的，会出现下面的错误：

解决方式是修改其中的 onnx.pb-c.h实现：

diff --git a/onnx.pb-c.h b/onnx.pb-c.h
index 0fe2a2e..22a76f2 100644
--- a/onnx.pb-c.h
+++ b/onnx.pb-c.h
@@ -4,7 +4,7 @@
 #ifndef PROTOBUF_C_src_2fonnx_2eproto__INCLUDED
 #define PROTOBUF_C_src_2fonnx_2eproto__INCLUDED
 
-#include <protobuf-c.h>
+#include <protobuf-c/protobuf-c.h>
 
 PROTOBUF_C__BEGIN_DECLS
 

编译：

进入到example目录下：

​caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-parser/example$ scons 
scons: Reading SConscript files ...

scons: warning: Two different environments were specified for target /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o,
	but they appear to have the same action: $CC -o $TARGET -c $CFLAGS $CCFLAGS $_CCCOMCOM $SOURCES
File "/home/caozilong/Workspace/onnx/onnx-parser/example/SConstruct", line 18, in <module>

scons: warning: Two different environments were specified for target /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o,
	but they appear to have the same action: $CC -o $TARGET -c $CFLAGS $CCFLAGS $_CCCOMCOM $SOURCES
File "/home/caozilong/Workspace/onnx/onnx-parser/example/SConstruct", line 18, in <module>

scons: warning: Two different environments were specified for target /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o,
	but they appear to have the same action: $CC -o $TARGET -c $CFLAGS $CCFLAGS $_CCCOMCOM $SOURCES
File "/home/caozilong/Workspace/onnx/onnx-parser/example/SConstruct", line 18, in <module>
scons: done reading SConscript files.
scons: Building targets ...
gcc -o backend/add.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/add.c
gcc -o backend/conv2d.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/conv2d.c
gcc -o backend/dense.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/dense.c
gcc -o backend/info.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/info.c
gcc -o backend/matmul.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/matmul.c
gcc -o backend/maxpool.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/maxpool.c
gcc -o backend/model.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/model.c
gcc -o backend/relu.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/relu.c
gcc -o backend/softmax.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/softmax.c
gcc -o backend/transpose.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/transpose.c
gcc -o mnist/mnist.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend mnist/mnist.c
gcc -o mnist/mnist_model.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend mnist/mnist_model.c
gcc -o mnist/mnist_sm.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend mnist/mnist_sm.c
gcc -o /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.c
gcc -o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.c
gcc -o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.c
gcc -o onnx-mnist /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o mnist/mnist.o backend/add.o backend/conv2d.o backend/dense.o backend/info.o backend/matmul.o backend/maxpool.o backend/model.o backend/relu.o backend/softmax.o backend/transpose.o -lm
gcc -o onnx-mnist-model /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o mnist/mnist_model.o backend/add.o backend/conv2d.o backend/dense.o backend/info.o backend/matmul.o backend/maxpool.o backend/model.o backend/relu.o backend/softmax.o backend/transpose.o -lm
gcc -o onnx-mnist-sm /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o mnist/mnist_sm.o backend/add.o backend/conv2d.o backend/dense.o backend/info.o backend/matmul.o backend/maxpool.o backend/model.o backend/relu.o backend/softmax.o backend/transpose.o -lm
gcc -o parse/parse_test.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend parse/parse_test.c
gcc -o onnx-parser /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o parse/parse_test.o
gcc -o transpose/transpose_test.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend transpose/transpose_test.c
gcc -o onnx-transpose /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o transpose/transpose_test.o backend/transpose.o backend/info.o -lm
scons: done building targets.
caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-parser/example$ 

验证：

./onnx-parser mnist-sm.onnx

./onnx-mnist

./onnx-mnist-sm 

 ./onnx-mnist-model

backend目录中包含了算子的实现

另外一个算子库：

git clone https://github.com/wuhanstudio/onnx-backend

caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-backend$ tree
.
├── examples
│   ├── mnist.c
│   ├── mnist.h
│   ├── mnist_model.c
│   ├── mnist_sm.c
│   └── model
│       ├── mnist-keras.ipynb
│       ├── mnist-lg.onnx
│       └── mnist-sm.onnx
├── README.md
├── SConscript
└── src
    ├── add.c
    ├── conv2d.c
    ├── dense.c
    ├── info.c
    ├── matmul.c
    ├── maxpool.c
    ├── model.c
    ├── onnx.h
    ├── relu.c
    ├── softmax.c
    └── transpose.c

3 directories, 20 files
caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-backend$

网络模型结构：

---

程序打印出来的网络结构： 

---

规律，输入图像都进行了归一化

结束！