[Mil MYD-YG2LX development board] Experience in multimedia application scenarios - application development experience starting from source code

qinyunti

[Mil MYD-YG2LX development board] Experience in multimedia application scenarios - application development experience starting from source code [Copy link]

Preface

Earlier, we built the ffmpeg development environment, conducted ffmpeg performance tests, and demonstrated ffmepg for network streaming video playback. However, in many cases, we need custom development, and the built ffmpeg cannot meet our needs. In this case, we must develop based on the source code. This article will provide an experience of application development based on ffmpeg.

Prepare

The environment built in front

Coding Test

Code

Take the official routine code as an example

Located in FFmpeg/doc/examples/encode_video.c

Compile

aarch64-linux-gnu-gcc doc/examples/encode_video.c -O3 -o ./encode_video -I/home/lhj/opt/ffmpeg/board/include/ -L/home/lhj/opt/ffmpeg/board/lib -lavcodec -lavutil -lswresample -lpthread -lm

run

Export to Windows

cp encode_video /mnt/d

Then log in to the development board via ssh or serial port, and import rz into the ~ directory of the development board

chmod +x encode_video

./encode_video encode.bin mpeg1video

result

root@myir-yg2lx:~# ./encode_video encode.bin mpeg1video

Send frame 0

Send frame 1

Write packet 0 (size= 6731)

Send frame 2

Write packet 2 (size= 3727)

Send frame 3

Write packet 1 (size= 1698)

Send frame 4

Write packet 4 (size= 2744)

Send frame 5

Write packet 3 (size= 1676)

Send frame 6

[mpeg1video @ 0xaaaae25232a0] warning, clipping 1 dct coefficients to -255..255

Write packet 6 (size= 2955)

Send frame 7

Write packet 5 (size= 1810)

Send frame 8

[mpeg1video @ 0xaaaae25232a0] warning, clipping 1 dct coefficients to -255..255

Write packet 8 (size= 3170)

Send frame 9

Write packet 7 (size= 1937)

Send frame 10

Write packet 10 (size=12306)

Send frame 11

Write packet 9 (size= 2173)

Send frame 12

Write packet 12 (size= 3770)

Send frame 13

Write packet 11 (size= 2064)

Send frame 14

[mpeg1video @ 0xaaaae25232a0] warning, clipping 1 dct coefficients to -255..255

Write packet 14 (size= 3340)

Send frame 15

Write packet 13 (size= 1941)

Send frame 16

[mpeg1video @ 0xaaaae25232a0] warning, clipping 1 dct coefficients to -255..255

Write packet 16 (size= 3121)

Send frame 17

Write packet 15 (size= 1897)

Send frame 18

[mpeg1video @ 0xaaaae25232a0] warning, clipping 1 dct coefficients to -255..255

Write packet 18 (size= 3392)

Send frame 19

Write packet 17 (size= 2172)

Send frame 20

Write packet 20 (size=12266)

Send frame 21

Write packet 19 (size= 2169)

Send frame 22

[mpeg1video @ 0xaaaae25232a0] warning, clipping 1 dct coefficients to -255..255

Write packet 22 (size= 4000)

Send frame 23

Write packet 21 (size= 2018)

Send frame 24

[mpeg1video @ 0xaaaae25232a0] warning, clipping 1 dct coefficients to -255..255

Write packet 24 (size= 3072)

Write packet 23 (size= 1935)

root@myir-yg2lx:~#

Generate encode.bin

root@myir-yg2lx:~# ls -al encode.bin

-rw-r--r-- 1 root root 88088 Jan 1 03:11 encode.bin

Export the encoded file to your computer

sz encode.bin

Play

.\ffplay.exe .\encode.bin

PS D:\BaiduSyncdisk\ffmpeg-master-latest-win64-gpl-shared\bin> .\ffplay.exe .\encode.bin

built with gcc 12.1.0 (crosstool-NG 1.25.0.55_3defb7b)

configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-w64-mingw32- --arch=x86_64 --target -os=mingw32 --enable-gpl --enable-version3 --disable-debug --enable-shared --disable-static --disable-w32threads --enable-pthreads --enable-iconv --enable-libxml2 - -enable-zlib --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-libvorbis --enable-opencl --disable-libpulse --enable-libvmaf - -disable-libxcb --disable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-libdav1d --enable-libdavs2 --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libkvazaar --enable-libass - -enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-librist --enable-libssh --enable-libtheora --enable-libvpx --enable-libwebp --enable-lv2 - -enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --enable-schannel -- enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --disable-libdrm --disable-vaapi --enable-libvidstab --enable-vulkan --enable-libshaderc --enable-libplacebo --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags= -pthread --extra-ldexeflags= --extra-libs=-lgomp --extra-version=20221018

libavutil 57. 39.101 / 57. 39.101

libavcodec 59. 51.100 / 59. 51.100

libavformat 59. 34.101 / 59. 34.101

libavdevice 59.8.101/59.8.101

libavfilter 8.49.101 / 8.49.101

libswscale 6. 8.112 / 6. 8.112

libswresample 4. 9.100 / 4. 9.100

libpostproc 56.7.100 / 56.7.100

[mpegvideo @ 000001e9075d38c0] Estimating duration from bitrate, this may be inaccurate

Input #0, mpegvideo, from '.\encode.bin':

Duration: 00:00:00.01, bitrate: 104851 kb/s

Stream #0:0: Video: mpeg1video, yuv420p(tv), 352x288 [SAR 1:1 DAR 11:9], 104857 kb/s, 25 fps, 25 tbr, 1200k tbn

10.54 MV: 0.008 fd= 0 aq= 0KB vq= 0KB sq= 0B f=0/0

Decoding test

Code

Take the official routine code as an example

Located in FFmpeg/doc/examples/decode_video.c

Compile

aarch64-linux-gnu-gcc doc/examples/decode_video.c -O3 -o ./decode_video -I/home/lhj/opt/ffmpeg/board/include/ -L/home/lhj/opt/ffmpeg/board/lib -lavcodec -lavutil -lswresample -lpthread -lm

run

Export to Windows

cp decode_video /mnt/d

Then log in to the development board via ssh or serial port, and import rz into the ~ directory of the development board

chmod +x decode_video

./decode_video encode.bin decode.bin

result

root@myir-yg2lx:~# ./decode_video encode.bin decode.bin

saving frame 1

saving frame 2

saving frame 3

saving frame 4

saving frame 5

saving frame 6

saving frame 7

saving frame 8

saving frame 9

saving frame 10

saving frame 11

saving frame 12

saving frame 13

saving frame 14

saving frame 15

saving frame 16

saving frame 17

saving frame 18

saving frame 19

saving frame 20

saving frame 21

saving frame 22

saving frame 23

saving frame 24

saving frame 25

root@myir-yg2lx:~#

The generated file is as follows

root@myir-yg2lx:~# ls -al decode*

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-1

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-10

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-11

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-12

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-13

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-14

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-15

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-16

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-17

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-18

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-19

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-2

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-20

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-21

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-22

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-23

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-24

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-25

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-3

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-4

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-5

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-6

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-7

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-8

-rw-r--r-- 1 root root 101391 Jan 1 03:17 decode.bin-9

-rwxr-xr-x 1 root root 80663160 May 20 2023 decode_video

root@myir-yg2lx:~#

Summarize

The above is an experience of application development based on ffmpeg starting from source code compilation. It can be seen that based on the complete operating environment and excellent performance of the development board, it becomes very convenient to develop multimedia applications.

火辣西米秀

The official source code compilation experience is relatively friendly for ffmpeg-based application development

lugl4313820

66666666

okhxyyo

Thanks for sharing~~

[Mil MYD-YG2LX development board] Experience in multimedia application scenarios - application development experience starting from source code [Copy link]

Preface

Prepare

Coding Test

Code

Compile

run

result

Decoding test

Code

Compile

run

result

Summarize

Latest reply