【2024 DigiKey Innovation Contest】Progress Sharing

lzhan

【2024 DigiKey Innovation Contest】Progress Sharing [Copy link]

# 【2024 DigiKey Creative Competition】 Keyboard and Mouse Unified Manager (0) Introduction## 1. Background In daily work, when using multiple computers, you generally need to equip them with corresponding keyboards and mice, and frequent switching of keyboards and mice is very inconvenient. In order to improve efficiency and reduce operational errors, this work designs an intelligent keyboard and mouse system that allows users to easily control two computers with only one set of keyboard and mouse, solving the above problems to a certain extent. The system uses OPENMV4 CAM H7 for facial orientation detection to determine which computer the user wants to control, and then uses the NUCLEO-L476RG development board to forward the data obtained from the keyboard and mouse to the corresponding computer, thereby achieving seamless switching and control of multiple computers, simplifying the operation process, and greatly improving the user's work efficiency and usage experience. It aims to help users get rid of complex physical connections and cumbersome software settings, provide a simple and efficient integrated device management solution, and provide a more humane and intelligent working environment. ## 2. Implementation plan### 2.1 Hardware structure
<ignore_js_op>

<div class="tip tip_4 aimg_tip" id="aimg_837547_menu" style="position: absolute; display: none" disautofocus="true">
<div class="xs0">
<p><strong>arch_hw.drawio.png</strong> <em class="xg1">(61.61 KB, downloads: 0)</em></p>
<p>
<a href="javascript:;" class="loginf" >download attach</a>

<a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_837547" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=837547&handlekey=savephoto_837547">save to album</a>

</p>

</div>
<div class="tip_horn"></div>
</div>

</ignore_js_op>
 The hardware connection method is shown in the figure. OpenMV-H7 runs the face orientation algorithm to detect which screen the person is currently looking at, that is, the face orientation, and then sends the orientation result to L476 and other homemade boards. According to the orientation, the keyboard and mouse data used are forwarded to the corresponding computer. ### 2.2 Software algorithm
<ignore_js_op>

<div class="tip tip_4 aimg_tip" id="aimg_837548_menu" style="position: absolute; display: none" disautofocus="true">
<div class="xs0">
<p><strong>Flowchart of image processing algo.drawio.png</strong> <em class="xg1">(20.49 KB, downloads: 0)</em></p>
<p>
<a href="javascript:;" class="loginf" >download attach</a>

<a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_837548" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=837548&handlekey=savephoto_837548">save to album</a>

</p>

</div>
<div class="tip_horn"></div>
</div>

</ignore_js_op>
 The software algorithm flow is shown in the figure: (1) First, the image is obtained through the camera; (2) Then the image is converted to a grayscale image to reduce the amount of calculation to increase the subsequent detection speed; (3) Use the Haar operator for face detection (4) Then fit the obtained face according to the template to obtain the position of the eyes, nose, mouth and other organs (5) Then perform posture estimation based on the position of the organs to obtain the rotation vector (6) Convert the rotation vector to a quaternion to obtain the Euler angle to obtain the orientation.

wangerxian

This is a good idea. Whoever you aim at will be used. Good!

【2024 DigiKey Innovation Contest】Progress Sharing [Copy link]

Latest reply