Atom Echo STT/TTS服务开发

Atom Echo STT/TTS服务由Wang QiXiang创建,2021年3月10日发布。主要功能包括语音控制,利用百度语音服务进行语言转文本。开发内容涉及ATOM ECHO协议栈的移植和STT/TTS服务的搭建,考虑了两种实施方案:中转服务器或直接访问Google/AWS服务。
部署运行你感兴趣的模型镜像

Atom Echo STT/TTS服务开发分析

Creator: Wang QiXiang
Date: 2021/03/10
1、产品介绍


https://docs.m5stack.com/#/en/atom/atomecho

2、缩写说明
  • STT : Speech-To-Text 语言转文本
  • TTS : Text-To-Speech 文本转语言
3、功能介绍
  • 蓝牙音箱
  • 语音控制 (本文档主要描述语音控制方面)
  • 物联网
4、ECHO STT (官方提供,语言转文本例程,采用百度语音服务)
speak
Post Speech
Http Speech-To-Text
Text
Text
printf
User
Microphone
AtomEcho
flow.m5stack.com
BaiduRest
Serial
  • Atom Echo 访问中转服务站flow.m5stack.com,由flow.m5stack.com去请求Baidu的STT/TTS服务,
5、开发内容:

1、ATOM ECHO需要移植自定义协议栈

2、搭建STT/TTS服务

  • `方案1:搭建中转服务器,Atom Echo访问中转服务器,由中转服务器访问Google/AWS服务;
write string
Self Defined Protocol
Post Text
Http Text-To-Speech
audio
audio
audio
User
ExternalController
AtomEcho
CloudServers
Google/AWS
Speaker
speak
Post Speech
Http Text-To-Speech
string
string
User
Microphone
AtomEcho
CloudServers
Google/AWS
  • 方案2:直接访问,由Atom Echo直接访问Google/AWS服务;
write string
Self Defined Protocol
Http Text-To-Speech
audio
audio
User
ExternalController
AtomEcho
Google/AWS
Speaker
speak
Http Speech-To-Text
string
string
User
Microphone
AtomEcho
Google/AWS
ExternalController
6、参考内容
  • Google API[https://cloud.google.com/speech-to-text/docs/samples?hl=zh-cn]
  • AWS API[https://docs.aws.amazon.com/transcribe/latest/dg/API_Reference.html]
  • BAIDU API[https://ai.baidu.com/ai-doc/SPEECH/Hk38lxo4u]

您可能感兴趣的与本文相关的镜像

Wan2.2-T2V-A5B

Wan2.2-T2V-A5B

文生视频
Wan2.2

Wan2.2是由通义万相开源高效文本到视频生成模型,是有​50亿参数的轻量级视频生成模型,专为快速内容创作优化。支持480P视频生成,具备优秀的时序连贯性和运动推理能力

stt@stt:~/test_fa_ws$ ros2 launch moveit_setup_assistant setup_assistant.launch.py Package 'moveit_setup_assistant' not found: "package 'moveit_setup_assistant' not found, searching: ['/home/stt/ros2_ws/install/fairino5_v6_moveit2_config', '/home/stt/ros2_ws/install/fairino_description', '/home/stt/ros2_ws/install/fairino_hardware', '/home/stt/ros2_ws/install/fairino_msgs', '/home/stt/ros2_control_ws/install/ros2_controllers', '/home/stt/ros2_control_ws/install/ros2_control_demos', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_3', '/home/stt/ros2_control_ws/install/ign_ros2_control_demos', '/home/stt/ros2_control_ws/install/gz_ros2_control_demos', '/home/stt/ros2_control_ws/install/velocity_controllers', '/home/stt/ros2_control_ws/install/tricycle_steering_controller', '/home/stt/ros2_control_ws/install/tricycle_controller', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_8', '/home/stt/ros2_control_ws/install/ros2_control', '/home/stt/ros2_control_ws/install/transmission_interface', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_11', '/home/stt/ros2_control_ws/install/bicycle_steering_controller', '/home/stt/ros2_control_ws/install/ackermann_steering_controller', '/home/stt/ros2_control_ws/install/steering_controllers_library', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_15', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_1', '/home/stt/ros2_control_ws/install/rqt_joint_trajectory_controller', '/home/stt/ros2_control_ws/install/rqt_controller_manager', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_9', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_7', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_6', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_13', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_5', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_4', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_2', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_14', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_12', '/home/stt/ros2_control_ws/install/ros2_control_demo_example_10', '/home/stt/ros2_control_ws/install/ros2controlcli', '/home/stt/ros2_control_ws/install/ros2_controllers_test_nodes', '/home/stt/ros2_control_ws/install/ign_ros2_control', '/home/stt/ros2_control_ws/install/hardware_interface_testing', '/home/stt/ros2_control_ws/install/gz_ros2_control', '/home/stt/ros2_control_ws/install/controller_manager', '/home/stt/ros2_control_ws/install/ros2_control_test_assets', '/home/stt/ros2_control_ws/install/ros2_control_demo_description', '/home/stt/ros2_control_ws/install/range_sensor_broadcaster', '/home/stt/ros2_control_ws/install/position_controllers', '/home/stt/ros2_control_ws/install/pose_broadcaster', '/home/stt/ros2_control_ws/install/pid_controller', '/home/stt/ros2_control_ws/install/mecanum_drive_controller', '/home/stt/ros2_control_ws/install/joint_trajectory_controller', '/home/stt/ros2_control_ws/install/joint_state_broadcaster', '/home/stt/ros2_control_ws/install/imu_sensor_broadcaster', '/home/stt/ros2_control_ws/install/gripper_controllers', '/home/stt/ros2_control_ws/install/gpio_controllers', '/home/stt/ros2_control_ws/install/effort_controllers', '/home/stt/ros2_control_ws/install/forward_command_controller', '/home/stt/ros2_control_ws/install/force_torque_sensor_broadcaster', '/home/stt/ros2_control_ws/install/diff_drive_controller', '/home/stt/ros2_control_ws/install/admittance_controller', '/home/stt/ros2_control_ws/install/control_toolbox', '/home/stt/ros2_control_ws/install/realtime_tools', '/home/stt/ros2_control_ws/install/kinematics_interface_kdl', '/home/stt/ros2_control_ws/install/kinematics_interface', '/home/stt/ros2_control_ws/install/joint_limits', '/home/stt/ros2_control_ws/install/controller_interface', '/home/stt/ros2_control_ws/install/hardware_interface', '/home/stt/ros2_control_ws/install/gz_ros2_control_tests', '/home/stt/ros2_control_ws/install/controller_manager_msgs', '/home/stt/ros2_control_ws/install/control_msgs', '/opt/ros/humble']"
05-14
评论 1
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值