Jul 2 2020
Himax Technologies, Inc. (“Himax” or “Company”), a leading supplier and fabless manufacturer of display drivers and other semiconductor products, today announced the launch of WiseEye WE-I Plus HX6537-A solution that supports Google’s TensorFlow Lite for Microcontrollers. In this collaboration, Himax is providing the HX6537-A processor with NN (neural network) based SDK (Software Development Kit) for developers to generate deep learning inferences running on TensorFlow Lite for Microcontrollers kernel to boost overall system AI performance.
The Himax WiseEye solution is composed of the Himax HX6537-A processor and Himax AoS sensor. With support to TensorFlow Lite for Microcontrollers, developers are able to take advantage of the WE-I Plus platform as well as the integrated ecosystem from TensorFlow Lite for Microcontrollers to develop their NN based edge AI applications targeted for Notebook, TV, Home Appliance, Battery Camera and IP Surveillance edge computing markets. The benefits of the Himax HX6537-A processor are driven by three unique features.
Ultra low power and high-performance AI processor
The HX6537-A processor adopts a programmable DSP that runs at 400MHz with power-efficient and multi-level power schemes that incorporate CDM, HOG and JPEG hardware accelerators for real-time motion detection, object detection and image processing. The processor remains in low power mode until a movement/object is identified by accelerators. Afterwards, DSP coped with the running NN inference on TensorFlow Lite for Microcontrollers kernel will be able to perform the needed CV operation to send out the metadata results over TLS (Transport Level Security) protocol to main SOC and/or cloud service for application level operation. The average power consumption for Google Person Detection example inference could be under 5mW.
Support Google TensorFlow Lite for Microcontrollers
As a result of Himax support to TensorFlow Lite for Microcontrollers, it is now possible to leverage the TensorFlow ecosystem to train and deploy TensorFlow models onto Himax's ultra low power hardware. For software development, Himax has ported WE-I Plus SDK.AI with optimized Machine Learning Inference (MLI) library dedicated to TensorFlow Lite for Microcontrollers. The MLI software library could bolster inference running on TensorFlow Lite for Microcontrollers MLI kernel 5 times faster than the reference kernel. This will enable developers to get the benefit of performance and comprehensive NN based machine learning models and kernel of TensorFlow Lite for Microcontrollers to easily deploy their video and voice-oriented AI applications.
Comprehensive WiseEye Computer Vision solution with Himax AoS Sensor
To address overall system low power needs, HX6537-A provides a proprietary sensor interface that works with Himax’s ultra low power AoS (Always On Sensor) sensor solutions to support up to VGA@60fps image input and fast wake-up for speedy sensor image capture. Additionally, average Himax AoS sensor power consumption can be less than 1mW.
“Himax WE-I Plus, coupled with Himax AoS image sensors, broadens TensorFlow Lite ecosystem offering and provides developers with possibilities of high performance and ultra low power,” said Pete Warden, Technical Lead of TensorFlow Lite for Microcontrollers at Google.
“Himax continues to demonstrate its expertise in developing innovative technologies that enable the company to partner with leaders such as Google in the AIoT industry. The unique design of HX6537-A by Himax provides a state-of-the-art CNN based deep learning SDK.AI with TensorFlow Lite for Microcontrollers which will enable developers and customers to accelerate the development of CV applications to drive ultra low power system goals for edge AI applications,” said Jordan Wu, President and Chief Executive Officer of Himax Technologies.
Himax showcase the WiseEye WE-I Plus empower AI deep learning example on TensorFlow Lite for Microcontrollers GitHub on June 17, 2020. Reference Link of TensorFlow Lite for Microcontrollers GitHub: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/lite/micro/examples/person_detection_experimental/README.md
Source: http://www.himax.com.tw