Ara Software Development Kit

ARA-SDK new

Ara AI software development kit (SDK) streamlines deployment of AI models onto Ara-1 and Ara-2 discrete neural processing units (DNPUs) and modules. It features an extensible compiler that supports diverse model architectures, including CNNs, Large Language Models (LLMs) and Vision Language Models (VLMs). The SDK offers efficient dataflow optimization, flexible quantization methods and support for multiple datatypes, ensuring high performance and low latency for edge AI applications.

Diagram

Choose a diagram:

Machine learning deployment flow

ARA-1-DNPU-BD

NXP Applications Processor and Ara DNPU Connection

ARA-1-DNPU-BD-2

Integration of Ara DNPU and Applications Processors Host with Drivers

ARA-1-DNPU-BD-3
Get diagram PDF

Key Features

  • Optimal execution planning to automatically determine efficient data and compute flow for any AI graph
  • Extensible compiler that supports models from CNNs to complex vision transformers and Large Language Models
  • Programmable compute engines easily accommodate new model operators
  • Multiple datatype support - Handles INT8 (Ara-1, Ara-2), INT4, and MSFP16 (Ara-2 only)
  • Software-defined tensor partitioning and routing optimized for dataflow
  • Flexible quantization methods

Supported Devices

  • ARA-2-DNPU: Ara-2: Discrete NPU for Real-Time Generative AI
  • ARA-1-DNPU: Ara-1: Discrete NPU for Optimized Edge AI

Design Resources

Hardware

Quick reference to our board types.
Filters

4 hardware offerings

Support

What do you need help with?

  • Narrow your search
Search