深度学习部署：FastDeploy部署教程(CSharp版本)

FastDeploy部署教程(CSharp版本)

1. FastDeploy介绍

FastDeploy是一款全场景、易用灵活、极致高效的AI推理部署工具，支持云边端部署。提供超过 🔥160+ Text，Vision， Speech和跨模态模型📦开箱即用的部署体验，并实现🔚端到端的推理性能优化。包括物体检测、字符识别（OCR）、人脸、人像扣图、多目标跟踪系统、NLP、Stable Diffusion文图生成、TTS 等几十种任务场景，满足开发者多场景、多硬件、多平台的产业部署需求。

在这里插入图片描述

2. FastDeploy 部署(C++)

参考：

FastDeploy 安装教程

3. FastDeploy 部署(CSharp)

FastDeploy C# SDK的接口实现，为用户需要C# API的场景提供解决方案。

3.1 FastDeploy 源码编译

CMAKE_CONFIGURATION_TYPES属性设置为Release
请不要勾选WITH_GPU和ENABLE_TRT_BACKEND

开启

ENABLE_ORT_BACKEND=ON
ENABLE_PADDLE_BACKEND=ON 
ENABLE_OPENVINO_BACKEND=ON 
ENABLE_VISION=ON 
ENABLE_TEXT=ON 
WITH_CAPI=ON 
WITH_CSHARPAPI=ON

指定CMAKE_INSTALL_PREFIX 安装路径
生成fastdeploy.sln解决方案文件选择Release版本，生成编译，点击"INSTALL"->右键点击"生成"将编译好的SDK安装到先前指定的目录步骤⑤。

3.2 创建CSharp项目

在项目引用中添加–>fastdeploy_csharp；
nuget 包添加OpenCvSharp、OpenCvSharp.Extensions等包
在debug\relese项目文件夹中添加Fastdeploy的动态链接库；

fastdeploy_init.bat install %cd% D:\workSpace\Paddle\deploy\FastDeplyCsharp\FastDeplyCsharp\bin\x64\Debug

结果预览

在这里插入图片描述

3.3 源代码

//目标检测
public  void fastdeployDetInfer(string image_path)
{
    string model_dir = "D://workSpace//Paddle//models//ppyoloe_crn_l_300e_coco";

    string model_file = model_dir + "\\" + "model.pdmodel";
    string params_file = model_dir + "\\" + "model.pdiparams";
    string config_file = model_dir + "\\" + "infer_cfg.yml";
    RuntimeOption runtimeoption = new RuntimeOption();
    int device_option = 0;
    if (device_option == 0)
    {
        runtimeoption.UseCpu();
    }
    else
    {
        runtimeoption.UseGpu();
    }
    fastdeploy.vision.detection.PPYOLOE model = new fastdeploy.vision.detection.PPYOLOE(model_file, params_file, config_file, runtimeoption, ModelFormat.PADDLE);
    if (!model.Initialized())
    {
        Console.WriteLine("Failed to initialize.\n");
    }
    Mat image = Cv2.ImRead(image_path);
    fastdeploy.vision.DetectionResult res = model.Predict(image);
    //Console.WriteLine(res.ToString());
    Mat res_img = fastdeploy.vision.Visualize.VisDetection(image, res, 0.5f, 1, 0.5f);
    InferPictureBox.Image = res_img.ToBitmap();
}
// 语义分割
public void fastdeplySegInfer(string image_path)
{
    string model_dir = "D://workSpace//Paddle//models//PP_LiteSeg_B_STDC2_cityscapes_without_argmax_infer";

    string model_file = model_dir + "\\" + "model.pdmodel";
    string params_file = model_dir + "\\" + "model.pdiparams";
    string config_file = model_dir + "\\" + "deploy.yaml";
    RuntimeOption runtimeoption = new RuntimeOption();
    runtimeoption.UseCpu();


    fastdeploy.vision.segmentation.PaddleSegModel model = new fastdeploy.vision.segmentation.PaddleSegModel(model_file, params_file, config_file, runtimeoption, ModelFormat.PADDLE);

    if (!model.Initialized())
    {
        Console.WriteLine("Failed to initialize.\n");
    }
    Mat image = Cv2.ImRead(image_path);

    fastdeploy.vision.SegmentationResult res = model.Predict(image);


    Console.WriteLine(res.ToString());
    Mat res_img = fastdeploy.vision.Visualize.VisSegmentation(image, res, 0.5f);
    InferPictureBox.Image = res_img.ToBitmap();
}