Huawei invents a modifiable user authentication solution with lip movement detection technology

According to Jiwei.com, with the development of password technology, there are many ways to unlock smart terminal devices. Currently, there are two main ways to unlock terminal devices: password feature unlocking and biometric feature unlocking.

Password feature unlocking includes digital password unlocking and pattern password unlocking, which are easy to be seen by others when inputting and can also be cracked by brute force, and complex passwords are easy to forget. Biometric unlocking includes fingerprint feature unlocking and face unlocking. Although fingerprint and face-based unlocking solutions can achieve basic user identity authentication, in actual use, the wetness, dryness, coldness and heat of the user's fingers will affect the collection of fingerprints, and faces can also be replaced by photos, so additional liveness detection is required.

In addition, solutions based on fingerprint and face recognition cannot be modified because fingerprint and face data are unique. Users are not convenient to use them and cannot modify their identity data, so there are certain security risks.

In order to seek a more flexible and modifiable user authentication solution, Huawei applied for an invention patent called "Device Unlocking Method and Apparatus" (application number: 201911362158.2) on December 26, 2019, and the applicant was Huawei Technologies Co., Ltd.

Based on the relevant information currently disclosed by the patent, let us take a look at this user identity authentication solution based on lip movement detection.

As shown in the figure above, it is a hardware system diagram of the device unlocking method terminal invented in the patent, which includes: light source transmitter 110, spectrum analysis module 130, color camera 140, central processing unit 150, touch screen 160, non-volatile memory 170 and memory 180. The central processing unit is used for lip movement feature analysis and unlocking behavior judgment and peripheral control; the non-volatile memory is used to store program files, system files and lip movement feature information; the memory is used for system and program operation cache; the touch screen is used to interact with the user.

In order to capture the user's facial features, the patent uses a color camera and a light source transmitter as a spectral input module, and a spectral analysis module constitutes an image generation module. For example, an infrared transmitter is used as a light source, and an infrared spectral analysis instrument is used as a spectral analysis module. The light source transmitter encodes the image projection scene through infrared light, and the light source transmitter outputs an ordinary laser light source, which is filtered by frosted glass and an infrared filter to form near-infrared light.

When the user sets the unlocking lip movement feature, the solution can analyze the lip movement feature in real time, and the central processor starts to extract the lip movement feature value and save it in the memory. When the user needs to verify the lip movement feature to unlock the screen, the lip movement feature data is obtained in real time and the lip movement feature is extracted. The data will be compared with the lip movement feature data saved in the system. If they match, the unlocking is successful, otherwise the unlocking fails.

As shown in the figure above, it is a flow chart of the device unlocking method configured in the hardware system. First, the user's lip movement image is obtained. The image range obtained by the camera includes the complete face or the complete lip area for lip movement recognition. Secondly, the first lip movement feature is obtained according to the lip movement image, for example, the lip movement feature is extracted by a convolutional neural network or a long short-term memory network.

According to the lip movement features, the corresponding password can also be obtained. The password is a piece of text or a string of numbers read by the user to the camera. Finally, the device is unlocked based on the matching degree between the first lip movement feature and the second lip movement feature. The second lip movement feature is the pre-stored lip movement feature used to unlock the device. For example, when the matching degree is set to more than 80%, the system determines that the user authentication is passed, and if it is less than 50%, the unlocking of the device can be directly prohibited to ensure the security of the data in the device.

The above is the user identity authentication method invented by Huawei that relies on lip movement detection. The lip movement feature is used to complete the user's identity authentication and unlock the device. This solution has excellent characteristics such as flexibility, anti-forgetfulness, anti-plagiarism and modifiability. It can be predicted that such a user identity authentication solution will appear around us in the near future.