Click the link below to follow Anmou Technology Academy
In the era of intelligent interconnection of all things, NPU has become a "rigorous need" for AI computing power. As an algorithm siege lion, are you still struggling with a series of problems in upper-level software applications and algorithm development? There are many solutions for the inference side of AI chips on the market. How to choose the software tool that is most suitable for your own hardware? For "algorithm transplantation" that takes up most of the workload, how to find the right tools to avoid "reinventing the wheel"...
In response to the common problems encountered by the above developers in NPU research and development,
ARM Technology recently launched the "Zhouyi" NPU software open source plan to meet customers' more independent and flexible algorithm transplant needs through open source code and join hands with more developers and partners to build the domestic NPU industry ecosystem. "Zhouyi" NPU is a dedicated processor for artificial intelligence independently developed by Arm Technology. It has been implemented in the Internet of Things, smart terminals, automobiles and other markets. It has formed a complete tool chain and technical services that can Adapt to more than 100 algorithms.
Under the "Zhouyi" NPU software open source plan, ARM Technology is the first to open up the NPU intermediate presentation layer specification, model parser, model optimizer, driver, etc., and provides free software tool chains, including software simulators, debuggers, C translater. At present, Arm Technology has open sourced the front end of its "Zhouyi" NPU software tool Compass, and has opened up the following resources in the first phase of the open source plan:
-
Compass parser - parser source code and middle layer representation specification;
-
NPU Linux driver - easier to deploy on existing SoC and compliant with GPLv2 agreement;
-
Compass integration - provides an end-to-end verification environment for the "Zhouyi" NPU network construction tool;
-
Model Warehouse - Verified open source NN models for easy testing and quick start-up.
Among them, the main function of the Compass parser is to convert models of various frameworks into the intermediate representation of "Zhouyi" NPU. Developers can modify it based on the source code to adapt to more neural network models. In addition to debugging and verifying the functions of the parser itself, developers can also obtain free software tool chains on the Jishu community for end-to-end debugging and verification of algorithm models. As shown in the figure below, the Compass parser not only supports debugging and result verification based on software emulators, but can also be deployed on chips with embedded "Zhouyi" NPU for testing and performance optimization.
Amou Technology has established open source libraries for the project on the code hosting platforms Gitee and GitHub respectively. Developers can easily obtain resources on these platforms. It is reported that this is only the first step in the "Zhouyi" NPU software open source plan. Arm Technology will gradually open more resources in the future, such as model optimizer, model quantification, operator implementation and other source codes.
So far, the "Zhouyi" NPU software open source plan has attracted the first batch of partners to "settled in" and received collective praise from the settled partners, including many star companies from the fields of AIoT, smart cars, intelligent operating systems and other fields. These partners have stated that they will continue to deepen cooperation with Arm Technology based on this plan and accelerate the construction of China's intelligent computing ecological "circle of friends".
Project link
:
Follow Anmou Technology Academy
*Disclaimer: This article is original by the author. The content of the article is the personal opinion of the author. The reprinting by Semiconductor Industry Watch is only to convey a different point of view. It does not mean that Semiconductor Industry Watch agrees or supports the view. If you have any objections, please contact Semiconductor Industry Watch.
Today is the 3230th content shared by "Semiconductor Industry Observation" with you. Welcome to pay attention.
Semiconductor Industry Watch
"
Semiconductor's First Vertical Media
"
Real-time professional original depth
Identify the QR code
, reply to the keywords below, and read more
Wafers | Integrated circuits | Equipment
| Automotive chips | Storage | TSMC | AI | Packaging
Reply
Submit an article
and read "How to Become a Member of "Semiconductor Industry Watch""
Reply
Search
and you can easily find other articles you are interested in!
Click " Read the original text
"
below
to view more "Zhouyi" NPU articles!
京公网安备 11010802033920号