-

+

Quick Start Guides
Pre-Built Binaries
Software Overview

The Arm NN TF Lite Delegate provides the widest ML operator support in Arm NN and is an easy way to accelerate your ML model. To start using the TF Lite Delegate, first download the Pre-Built Binaries for the latest release of Arm NN. Using a Python interpreter, you can load your TF Lite model into the Arm NN TF Lite Delegate and run accelerated inference. Please see this Quick Start Guide on GitHub or this more comprehensive Arm Developer Guide for information on how to accelerate your TF Lite model using the Arm NN TF Lite Delegate.

The fastest way to integrate Arm NN into an Android app is by using our Arm NN AAR (Android Archive) file with Android Studio. The AAR file nicely packages up the Arm NN TF Lite Delegate, Arm NN itself and ACL; ready to be integrated into your Android ML application. Using the AAR allows you to benefit from the vast operator support of the Arm NN TF Lite Delegate. We held an Arm AI Tech Talk on how to accelerate an ML Image Segmentation app in 5 minutes using this AAR file. To download the Arm NN AAR file, please see the Pre-Built Binaries section below.

We also provide Debian packages for Arm NN, which are a quick way to start using Arm NN and the TF Lite Parser (albeit with less ML operator support than the TF Lite Delegate). There is an installation guide available here which provides instructions on how to install the Arm NN Core and the TF Lite Parser for Ubuntu 20.04.

To build Arm NN from scratch, we provide the Arm NN Build Tool. This tool consists of parameterized bash scripts accompanied by a Dockerfile for building Arm NN and its dependencies, including Arm Compute Library (ACL). This tool replaces/supersedes the majority of the existing Arm NN build guides as a user-friendly way to build Arm NN. The main benefit of building Arm NN from scratch is the ability to exactly choose which components to build, targeted for your ML project.
+

To build Arm NN from scratch, we provide the Arm NN Build Tool. This tool consists of parameterized bash scripts accompanied by a Dockerfile for building Arm NN and its dependencies, including Arm Compute Library (ACL). This tool replaces/supersedes the majority of the existing Arm NN build guides as a user-friendly way to build Arm NN. The main benefit of building Arm NN from scratch is the ability to exactly choose which components to build, targeted for your ML project.

Pre-Built Binaries

Operating System	Architecture-specific Release Archive (Download)
Android (AAR)
Android 10 "Q/Quince Tart" (API level 29)
Android 11 "R/Red Velvet Cake" (API level 30)
Android 12 "S/Snow Cone" (API level 31)
Android 13 "T/Tiramisu" (API level 32)
Linux

Operating System	Architecture-specific Release Archive (Download)
Android (AAR)
Android 10 "Q/Quince Tart" (API level 29)
Android 11 "R/Red Velvet Cake" (API level 30)
Android 12 "S/Snow Cone" (API level 31)
Android 13 "T/Tiramisu" (API level 32)
Linux

Software Overview

The Arm NN SDK supports ML models in TensorFlow Lite (TF Lite) and ONNX formats.

If you find something that concerns you, please email terms.nosp@m.@arm.nosp@m..com

Third-party

Third party tools used by Arm NN:

Tool	License (SPDX ID)	Description	Version	Provenience
cxxopts	MIT	A lightweight C++ option parser library	SHA 12e496da3d486b87fa9df43edea65232ed852510	https://github.com/jarro2783/cxxopts
doctest	MIT	Header-only C++ testing framework	2.4.6	https://github.com/onqtam/doctest
fmt	MIT	{fmt} is an open-source formatting library providing a fast and safe alternative to C stdio and C++ iostreams.	7.0.1	https://github.com/fmtlib/fmt
ghc	MIT	A header-only single-file std::filesystem compatible helper library	1.3.2	https://github.com/gulrak/filesystem
half	MIT	IEEE 754 conformant 16-bit half-precision floating point library	1.12.0	http://half.sourceforge.net
mapbox/variant	BSD	A header-only alternative to 'boost::variant'	1.1.3	https://github.com/mapbox/variant
stb	MIT	Image loader, resize and writer	2.16	https://github.com/nothings/stb

Tool	License (SPDX ID)	Description	Version	Provenience
cxxopts	MIT	A lightweight C++ option parser library	SHA 12e496da3d486b87fa9df43edea65232ed852510	https://github.com/jarro2783/cxxopts
doctest	MIT	Header-only C++ testing framework	2.4.6	https://github.com/onqtam/doctest
fmt	MIT	{fmt} is an open-source formatting library providing a fast and safe alternative to C stdio and C++ iostreams.	7.0.1	https://github.com/fmtlib/fmt
ghc	MIT	A header-only single-file std::filesystem compatible helper library	1.3.2	https://github.com/gulrak/filesystem
half	MIT	IEEE 754 conformant 16-bit half-precision floating point library	1.12.0	http://half.sourceforge.net
mapbox/variant	BSD	A header-only alternative to 'boost::variant'	1.1.3	https://github.com/mapbox/variant
stb	MIT	Image loader, resize and writer	2.16	https://github.com/nothings/stb

Build Flags

Arm NN uses the following security related build flags in their code:

Build flags
-Wall
-Wextra
-Wold-style-cast
-Wno-missing-braces
-Wconversion
-Wsign-conversion
-Werror

Build flags
-Wall
-Wextra
-Wold-style-cast
-Wno-missing-braces
-Wconversion
-Wsign-conversion
-Werror

+