Ambarella, an AI vision silicon company, announced its new Artificial Intelligence Image Signal Processor (AISP). Ambarella’s new AI-based ISP architecture uses neural networks to augment the image processing done by the hardware ISP integrated into its SoCs. This approach enables color imaging with low light at very low lux levels and minimal noise, a 10 to 100X improvement over state-of-the-art traditional ISPs, and new levels of high dynamic range (HDR) processing with more natural color reproduction and higher dynamic range.

Initially demonstrated on the CV2 SoCs during CES this week, the new AISP will become available across Ambarella’s entire CVflow SoC portfolio at resolutions up to 4K.

The applications of this technology encompass all of the company’s target markets, where low-light and HDR processing are critical. This includes security and automotive cameras, where full-color night vision is a key operating point, and where better low-light and HDR enable reductions in external illumination, the use of lower cost sensors, and cleaner video for both human viewing and analytics processing.

Being able to see clearly in low-light or high-contrast conditions is key to robust camera systems. Traditional camera systems have had to live with noisy or dark black and white video in low-light conditions, and dark shadows or blown-out highlights in high contrast conditions. Both of these cases result in the loss of details that are detrimental to both human viewing and AI applications. With our new AISP technology, we increase the useful range of camera systems while reducing the total system cost to build high quality cameras.

—Les Kohn, Ambarella’s CTO and co-founder

A good example of this new technology in action is a typical security camera trying to identify a license plate at night. With noisy video, the text on the license plate would be unreadable, even to the best AI algorithm. And with black and white video, all color information on the car would be lost. By using Ambarella’s AISP technology and restoring colors at the source before AI processing, the license plate can be clearly read and the color of the car identified.

The AISP processing happens in parallel on the silicon with other higher-level AI applications running on Ambarella’s CVflow AI engine. This enables customers to build their next generation of cameras with both higher visual quality and more accurate AI algorithms, while staying within the low power budgets required by small embedded systems.

Other Key features of the AISP include:

• Support for mainstream sensors

• Seamless switching between different lighting conditions, including day, night, and HDR scenes

• A set of tuning tools for sharpening, CE, AE, AWB, etc.

• Ability to run in parallel with other AI algorithms on the CVflow engine

• Advanced operational modes to fit application-specific use cases

The new AISP is expected to be made available across Ambarella’s entire CVflow SoC portfolio during 2022, with different price and performance options.