[ESP32-Korvo Review] 08 ESP-Skainet Development Preparation

天意无罪

[ESP32-Korvo Review] 08 ESP-Skainet Development Preparation [Copy link]

 

After a few nights of hard work, I finally set up the ESP-IDF development environment. Now it’s time to get down to business: voice application development.

Espressif's voice development component is ESP-Skainet, which supports the development of wake-up word recognition and command word recognition applications based on Espressif's ESP32 chip in the most convenient way. Using ESP-Skainet, you can easily build wake-up word recognition and command word recognition applications.

Wake-up word recognition

The wake-up word model

链接已隐藏，如需查看请登录或者注册

is committed to providing a high-performance model with low resource consumption, supporting the recognition of wake-up words such as "Alexa", "Tmall Genie", and "Xiao Ai".

Currently, Espressif provides free wake-up words such as "Hi, Espressif", "Hello Xiaozhi", "Hello Xiaoxin", and "hi, Jeson". If users need other wake-up words, Espressif provides wake-up word customization services. For details, please refer to

链接已隐藏，如需查看请登录或者注册

.

Voice command word recognition

The command word recognition model

链接已隐藏，如需查看请登录或者注册

is dedicated to providing a flexible offline voice command recognition framework. Users can easily customize voice commands according to their needs without retraining the model.

Currently, the model supports recognition of Chinese command words such as "Turn on the air conditioner" and "Turn on the bedroom light" and English command words such as "Turn on/off the light". The maximum number of custom voice command words is 100.

Acoustic Algorithm

Currently, ESP-Skainet integrates Acoustic Echo Cancellation (AEC), automatic gain control (AGC), noise suppression (NS), voice activity detection (VAD) and microphone array algorithm (Mic Array Speech Enhancement).

To develop applications using ESP-Skainet , you must first clone the development package from GitHub. When I thought of this, I started to get mad again, because when I installed ESP-IDF before, cloning files from GitHub was very slow and often failed. There was no other way but to give it a try.

Start ESP-IDF Command Prompt and enter the command:

git clone --recursive https://github.com/espressif/esp-skainet.git

After waiting for a few minutes, it still failed.

I kept trying again, but there was no response after more than ten minutes. There was no failure message or success message.

After a long time, it still prompts that it cannot connect to GitHub .

I continued trying, and finally the download progress prompt message popped up, and I was so moved.

It was another long wait, but the result was still failure.

Oh, it seems that it depends on the internet speed and luck. Never mind. I’ll try again another day.

littleshrimp

The image in the post cannot be displayed

freebsder

The picture seems to be cracked

天意无罪

freebsder posted on 2021-3-22 22:03 The picture seems to be cracked

Yes, indeed. I'll upload it again tonight.

天意无罪

littleshrimp posted on 2021-3-22 21:20 The image in the post cannot be displayed

Hmm, I don't know if there was a problem when uploading. I'll try it again after get off work tonight.