How IoT device manufacturers can obtain Zigbee testing tools

This article aims to explain how to accelerate IoT device development with Zigbee test tools. The key points are as follows:

• Improve test quality by simulating application environments and actual use cases through automated testing tools.

• Diagnostic and monitoring functions as well as clear test reports facilitate verification and error correction.

• Product developers can accelerate time to market, reduce costs and de-risk the approval process through in-house pre-testing.

• Improve the consistency of test results through repeatable test cases and reproducible test conditions.

Please click Read original article Visit Silicon Labs Chinese community for full content.

introduce

The software testing tools provided by the Zigbee Alliance are part of the Zigbee certification program, which assists the development of Zigbee products, improves test verification procedures, reduces the overall cost of products and shortens time to market. The Zigbee test tool can be used for manual or automated testing, improves the quality of software components by expanding the coverage of test cases, and allows product developers to perform internal pre-testing during the development phase of Zigbee products to shorten the time to market, thereby improving productivity. It can be said that the Zigbee test tool is an important part of the overall Zigbee solution that is widely used in the Internet of Things .

Zigbee Test Tool ( ZTT )

The complete software testing tool set includes a test engine ( Windows -based application) that uses a large number of test scripts and a wireless USB dongle (support hardware specified by the alliance). These components are configured to run Zigbee devices under a series of different conditions and environments and perform analysis and testing. This process verifies whether the device complies with the Zigbee technical specifications, confirms the operation and output information, and generates corresponding test reports.

Figure 1: Screenshot of the Zigbee test tool interface

Specific test scripts are used to process different test data and execute various test scenarios. The test precondition setting function can simulate test cases that are usually difficult to implement (such as network overload) or perform error testing (for example, receiving commands in abnormal formats or encountering non-compliant scenarios) to ensure that the product application can properly handle invalid attributes and variables and deal with unexpected user interaction instructions. It is often difficult to discover the failover process when executing errors by using only the golden unit or reference application.

The generated test report has clear test conclusions and provides a summary of test results in a uniform format, which allows developers to quickly and accurately evaluate the Zigbee performance of the device, and helps implementers and testers to diagnose and monitor, clearly identifying which test passed, which test failed, and why. The test tool analyzes the response of the implementation under test ( IUT ) and compares it with the expected response of the script, which is less error-prone than manually analyzing the results.

Figure 2: Zigbee test tools

In addition, the test tool allows test automation, calling established parameters and preconditions for routine testing. Executing test cases using the test tool is highly controllable in terms of the strict sequence of test steps and the precise timing of commands and events. The available test script library helps subsequent tests to run the same conditions and parameter values ​​repeatedly. This ensures that the test results are consistent regardless of which authorized third-party Zigbee certification test agency performs the test process.

Another major benefit of making Zigbee test tools available to Alliance members is maintaining consistency in device operation and reducing the risk of test failures. Zigbee device developers can pre-test their applications internally before submitting their devices to authorized third-party test agencies. Developers can reliably predict whether certification testing will succeed with immediate feedback and avoid retesting, which can shorten development cycles and increase the rate of first-time certification pass, saving time and costs.

In addition, manufacturers can also create and add their own test cases through dedicated and tailor-made test scripts, easily expanding the functionality of the test tool, helping developers enhance product stability or test differentiated features that add value to products based on specific market needs.

The more Zigbee Certified devices there are, the more choices and flexibility developers and users have, and the more confidence that products and services will work together. Zigbee test tools enable member companies to take full advantage of the professional services provided by the Zigbee Alliance and quickly bring products to market with confidence.

Zigbee Certification Program

The Zigbee Certification Program was implemented more than 10 years ago and provides Zigbee Alliance members and the entire market with a clear, repeatable, and independent method to verify that products comply with Zigbee Alliance standards as claimed . The Zigbee Certification Program includes two main levels of certification:

• Zigbee compatible platform
  

1. This certification level verifies that member products comply with the IEEE 802.1.54 PHY/MAC and applicable Zigbee Alliance network layer specifications (e.g., Zigbee PRO )

• Zigbee Certified Products

1. Needing to be built on top of a Zigbee -compatible platform, this certification level verifies that the application layer of a Zigbee product (e.g. Zigbee 3.0 ) complies with the standard requirements.

2. Application layer interoperability is also verified as part of this program.

The Zigbee Certification Program follows international certification guidelines ( ISO Guide No. 67 Type 1b ) and is largely compliant with ISO Guide No. 65 , “General Requirements for Bodies Engaged in Product Certification.” The program makes a clear distinction between testing and certification:

• Testing is performed by an independent testing service provider

• Certification is only performed by the Zigbee Alliance

The Zigbee Alliance currently has five Authorized Test Service Providers with locations around the world to ensure that most members can obtain localized services:

• Element Materials (Europe)

• China Electronics Standardization Institute (China)

• National Technical Systems (North America)

• TÜV Rheinland (North America, Europe, Asia)

• Under writer Laboratories (North America, Europe)

All Alliance test service providers are ISO 17025 certified and must undergo a rigorous process to validate their knowledge of Zigbee technology and their ability to perform the test processes defined by the Alliance before being authorized to provide testing services to Alliance members. These service providers are also required to pass annual audits to ensure that their services and capabilities continue to meet Zigbee Alliance requirements.

The Zigbee Test Tool is an important part of the Zigbee certification program. All Alliance Authorized Test Service Providers are equipped with and trained on the Zigbee Test Tool. They are required to use the test tool along with the validated and approved Zigbee Alliance test scripts when testing Zigbee products . The output of the test tool is included in the test reports they provide to member companies and submitted to the Alliance as part of the product certification application documentation. By using the same test tool across our different test service providers, we ensure comparability of results for all tested products, helping to improve the quality of the test program and increase member value.

The Zigbee certification program verifies product compliance, and manufacturers can optionally use software test tools to test product interoperability. The Zigbee test tool provides detailed information to track and log Zigbee packets transmitted over the air, which can help find the root cause if certain behaviors are not as expected.

Where to get Zigbee test tools?

Alliance members can access the Zigbee Alliance Test Tools Suite content through the Members Area, where installers, usage guides, a library of test scripts and technical support resources can be found. These tools are available to all Zigbee Alliance members, and some members (depending on their membership level) are eligible for discounts on annual licenses. For more information on the Zigbee Alliance Test Tools Suite, please contact certification@zigbee.org

Conclusion

The Zigbee Test Tool is a software testing tool that provides a variety of benefits, including improving product quality through automation of the test process; simulating difficult-to-achieve conditions and use cases for testing; facilitating the verification process with diagnostic and monitoring capabilities and clear test reports; reducing time to market; reducing the risk of the certification test process through in-house pre-testing; and improving the consistency of test results with repeatable test cases and reproducible test conditions. Coupled with the strong Zigbee certification program supported by five reputable authorized test service providers with global coverage, the Zigbee Alliance's test tool can bring huge advantages to IoT device manufacturers.

This article was written by: Musa Unmehopa , Vice Chairman of the Zigbee Alliance Board of Directors and Senior Director of Standards and Regulatory Affairs at Philips Lighting , and Henk Veldhuis, Global Director of Smart Lighting / Smart Home at TÜV Rheinland

Original link: https://mp.weixin.qq.com/s/IIITD7WvN0fX4q3tqDB6wg

You can also scan the following QR code to follow Silicon Labs on social media platforms