[Speech and vision module based on ESP32S3] Software development progress - ESP32S3 JPEG encoding performance test

IC爬虫

[Speech and vision module based on ESP32S3] Software development progress - ESP32S3 JPEG encoding performance test [Copy link]

 

<i class="pstatus"> This post was last edited by IC Crawler on 2022-9-28 23:15 </i> **ESP32S3 comes with a full-speed USB, so when transmitting image data, JPEG compression is done to reduce the amount of data, but using ESP32S3 for JPEG encoding is still very laborious. ** #### Resolution VGA, jpeg compression, sampling 2X2: single frame takes 600+ms, and the rate of transmission to OPenmv IDE is less than 2 frames <ignore_js_op> <img style="cursor:pointer;" id="aimg_645289" aid="645289" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202209/28/230325jz3khkz4ikui18li.png" file="data/attachment/forum/202209/28/230325jz3khkz4ikui18li.png" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_645289_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-09-28 22-51-40屏幕截图.png</strong> <em class="xg1">(26.07 KB, downloads: 0)</em></p> <p> <a href="javascript:;" class="loginf" >download attach</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_645289" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=645289&handlekey=savephoto_645289">save to album</a> </p> <p class="xg1 y">2022-9-28 23:03 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> #### Resolution QVGA, jpeg compression, sampling 2X2: single frame takes 180+ms, and the rate of transmission to OPenmv IDE is only 7-8 frames <ignore_js_op> <img style="cursor:pointer;" id="aimg_645290" aid="645290" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202209/28/230504l9rb2b98mksqk8bv.png" file="data/attachment/forum/202209/28/230504l9rb2b98mksqk8bv.png" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_645290_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-09-28 23-04-35屏幕截图.png</strong> <em class="xg1">(22.84 KB, downloads: 0)</em></p> <p> <a href="javascript:;" class="loginf" >download attach</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_645290" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=645290&handlekey=savephoto_645290">save to album</a> </p> <p class="xg1 y">2022-9-28 23:05 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> **If the image format of the sensor is initialized and configured as jpg mode, encoding is not required, and the full frame rate of 25 frames can be achieved even with a resolution of VGA** <ignore_js_op> <img style="cursor:pointer;" id="aimg_645292" aid="645292" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202209/28/231307l4o8omp9mzk428tw.png" file="data/attachment/forum/202209/28/231307l4o8omp9mzk428tw.png" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_645292_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-09-28 23-12-47屏幕截图.png</strong> <em class="xg1">(268.98 KB, downloads: 0)</em></p> <p> <a href="javascript:;" class="loginf" >download attach</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_645292" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=645292&handlekey=savephoto_645292">save to album</a> </p> <p class="xg1 y">2022-9-28 23:13 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> **In view of the jpeg encoding speed problem of ESP32S3, it is considered not to compress and directly transmit the original image in the future. It is estimated that the speed may be faster. **

Jacktang

The traditional understanding is that it is not compressed and the original image is transmitted directly.

RCSN

According to the full-speed USB speed, the ideal speed of CDC is 1.0MB/S or above, which is enough for transmitting YUV/RGB, and is always faster than software encoding. Moreover, image processing is required, and you can't do without YUV, and JPEG still needs decoding.

wangerxian

Jpg is not compressed, so the decoding speed is fast?

IC爬虫

wangerxian posted on 2022-9-29 14:40 Jpg is not compressed, so the decoding speed is fast?

Configuring the sensor to jpg image format is not convenient for image processing and requires decoding.

IC爬虫

RCSN posted on 2022-9-29 10:02 According to the full-speed USB speed, cdc can ideally reach a speed of more than 1.0MB/S, which is sufficient for transmitting YUV/RGB, etc., and is always faster than software encoding...

Yes, I have seen the following code before openmv version 3.9, which has jpeg compression.

安子1977

What is the direct transmission speed of 8-bit grayscale image 640*480?

安子1977

IC Crawler published on 2022-9-29 14:57 Yes, I have seen the following openmv code before version 3.9, which has jpeg compression

Is openmv a hardware jpg encoding or a software encoding?

安子1977

What does sampling 2X2 mean?

安子1977

IC Crawler published on 2022-9-29 14:57 Yes, I have seen the following openmv code before version 3.9, which has jpeg compression

Is it true that after 3.9, the encoding and compression will be changed to hardware encoder?