aboutsummaryrefslogtreecommitdiff
path: root/shim
AgeCommit message (Collapse)Author
6 daysAdd deprecation notices for items to be removed in 24.08.Colm Donelan
* Onnx parser. * Async execution interface. * Shim and support library. * Arm NN converter * GpuFsa backend. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: Ia9adae4da6d9bd2b92a4f4492a022e8337f57f14
6 daysIVGCVSW-8259 Reivew and update documentation related with operators for 24.05Nikhil Raj
* Debug layer supported data types updated * Added deprecation notices in md files to functionalities that will be removed Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I8673bdc2d596bfa4de751fc95dae010b195ad0b1
2024-04-17MLCE-1248 Removing limitations on zero scale value in quantization.Colm Donelan
Currently Arm NN will fail to load models containing quantization scale value of zero. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: Ifefcee1279b8667da63d1aa7d42e5d44875f9fbe
2023-12-05IVGCVSW-8159 Fixed issues building with NDK r26Mike Kelly
* The compiler shipped with NDK r26 has stricter rules around certain warnings and deprecation notices. * Fixed warnings for unqualified call to 'std::move' * Fixed error where the half values weren't being cast to a float when calling 'std::nan' * Removed unnecessary subtensor unit tests for neon Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: I4ceb46e55ff5f2a754452e3a43de2188d58bf927
2023-09-26IVGCVSW-8053 Update TensorFlow and FlatBuffers versions on ArmNN guidesNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I975cf4ccbddd1ea756e1d9f2148dcb8e320346f5
2023-09-19IVGCVSW-7855 removed ASSERTs from shim codeJim Flynn
Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: I8b34e74800ebdb43e1b3f996eacd6c3360a331eb
2023-08-23IVGCVSW-7957 Fix weights checking when converting in Support LibraryKevin May
* An Operand can only have NO_VALUE if it is an optional argument of an operation * Add a check to see if the operand is optional to IsWeightsValid Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Ib22cb7e60f6121d64f8a3bf6cb8c3d13930aa315
2023-08-02IVGCVSW-7880 Add check for FP16 backend supportRyan OShea
* Check if preferred backends have FP16 support before enable fp16-turbo-mode * Unit tests * Replaced global gpuAccCapabilities with getter method construction * Replaced deprecated function call in SL shim Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: If29b62b330ca8987de8acf6408db11daf25ca0b5
2023-08-01IVGCVSW-7899 Cannot handle tensors with more than 5 dimensionsMike Kelly
* Fixed issue where then dimensions specificity didn't match the number of dimensions. Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: Ic4da6f23c1e8ca38f321aa88c69ef57558a8f393
2023-07-31IVGCVSW-7787 Fix READ memory access caused by missing printf argumentsKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I669621b384b7560f558ecbf803b62da373de728d
2023-07-28IVGCVSW-7924 Add TILE to Support Library (SL)Teresa Charlin
* Add serialize parameters so that the multiples appear in the dot file Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Id02ed709c97b866dabefed655b06bdb1b20c9026
2023-07-28IVGCVSW-7925 Add REVERSE V2 to Support Library (SL)experimental/IVGCVSW-6964_Weight_Bias_ConstTensorTeresa Charlin
* Fix typos in README Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I6e30536d353fae7a7828d9e02e7301ab8dd8c115
2023-07-12IVGCVSW-7846 Refactor ElementBinaryOps to use ElementBinaryLayerKevin May
* Refactor all functions to convert Add, Div, Maximum, Minimum, Mul and Sub to use ElementwiseBinary layers instead * Add POW Operation support * Add REDUCE_PROD Operation support Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I8c91980e585f7ff2561610084e7c6b48fb278171
2023-07-06IVGCVSW-7848 Add cache size check to Support LibraryKevin May
* Fix for 2 VTS tests named CacheSavingAndRetrievalNonZeroOffset Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Id8e02b6383be5706311583aab3f507b5bb43c0bb
2023-07-06IVGCVSW-7846 Fix incorrect Concat permutation params in Support LibraryKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I17e49ee167a208d9810eedbb0d3a220b66d34aa7
2023-05-09IVGCVSW-5846 Remove TODO statements from Armnn CodeDavid Monahan
* Removed all instances of TODO statements from comments * Removed statements are noted as part of IVGCVSW-5846 * Removed ProtoxtFixture.cpp from the Onnx Parser tests as it's not used Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: Ia0a15f8a0d4123c8831638634eaa0d1018c40e2c
2023-04-26Update cxxopts from 3.0 to 3.1.1Jim Flynn
!android-nn-driver:9431 Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: I58143445b5c5cf2aafd0838156c9543adce21e6a
2023-04-12IVGCVSW-7197 Implement Pimpl Idiom for OptimizerOptionsJohn Mcloughlin
Signed-off-by: John Mcloughlin <john.mcloughlin@arm.com> Change-Id: Id4bdc31e3e6f18ccaef232c29a2d2825c915b21c
2023-04-03IVGCVSW-3808 Deprecation notices for old ElementwiseBinary layersMike Kelly
* Added Deprecation notices for old ElementwiseBinary layers. Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: I5bd0f186aaed675885d667f47e1e210ee9ec84f8
2023-03-31Revert "IVGCVSW-3808 Deprecation notices for old ElementwiseBinary layers"Mike Kelly
This reverts commit 52e90bf59ecbe90d33368d8fc1fd120f07658aaf. Change-Id: I5a0d244593d8e760ee7ba0c9d38c02377e1bdc24 Signed-off-by: Mike Kelly <mike.kelly@arm.com>
2023-03-30IVGCVSW-3808 Deprecation notices for old ElementwiseBinary layersMike Kelly
* Added Deprecation notices for old ElementwiseBinary layers. Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: Iebbbaff38cc9c347b25eb2f9054c914a4f931c68
2023-03-22IVGCVSW-7526 Upgrade ArmNN to Tensorflow 2.12Ryan OShea
When creating a flatbuffers model, we need to provide an empty buffer 0 that is reserved by tensorflow. When creating empty buffers for inputs and outputs we can not pass in an empty vector, or tflite will assume that we know how many bytes to allocate in advance. Instead we need to only pass in the builder. * Update libraries in FindTfLite.cmake * Add nullptr to delegate struct for OpaqueDelegateBuilder * Fix issue in unit tests where Flatbuffers model was not being parsed by tflite * Tensorflow 2.12 now includes C++ 17 features. Update our cmake build to require a compiler to support these features. * Change minimum cmake in Arm NN to 3.7 as that's the minimum for the delegate build. Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I7d15b196b8c59b1914f8fc1c4c2f8960630c069c
2023-03-02IVGCVSW-7420 Prevent CpuAcc & GpuAcc from running during support library ↵Cathal Corbett
aync execution Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I6f921feaf591f0a1e27c373bb708c7ec8dfcbe43
2023-01-10IVGCVSW-7402 Fix for Native crashes in Arm NNAPI SLKevin May
* Instead of extending ArmnnDevice with ArmnnDriver make it a member * This will allow us to construct the ArmnnDriver and return a DEVICE_UNAVAILABLE NN_ERROR instead of segfaulting with the armnn::InvalidArgumentException if we cannot create a device Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Ibbcdbeb33dfd170dd1fb393204620e5b9e6342b8
2022-12-19Github #712: Use static libraries not object libraries for support libraryFrancis Murtagh
* .o files were being installed by cmake. Change-Id: Ie2056e09b4800fe208d784a90f3908d508b8cadf Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2022-12-12Optimize the calling of IsLayerSupported().Cathal Corbett
* Done as part of 22.11/23.02 innovation days. * IsLayerSupported() is called in model prepare (delegate, android-nn-driver and shim/support_library) and again in ArmNN once model otimization is performed. * From calling IsLayerSupported() the first time, we should know that the layers are supported and what backend they are supported on. * Solution is to set the BackendId of the IConnectableLayer when IsLayerSupported() is called the first time, * In the Optimize() function we then check if the backend is set. If so, we do not call IsLayerSupported() again. * In the case a layer that is supported gets optimized, then the BackendId of that layer get set to "Unknown" for the new optimized layer and IsLayerSupported() will get called on the newly optimized layer. * Includes bug fix IVGCVSW-7213 for Android Mean FP16 CpuAcc tests. Also related to bug IVGCVSW-7211. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I7a7820d0cdb079ffb5a3a2e0c44e252f652df53b
2022-11-08Update Readme files with newer versions of tools added during 22.11Nikhil Raj
* Flatbuffer version updated to 2.0.6 * Android NDK version updated to r25 * Removed cross-compilation guide as its been moved to build-tools * Android binaries updated in Readme Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ia7054707c9463d8ce8b344ec5d86fdd83424b2c3
2022-10-20Fix Building Support Library with NDK r25Kevin May
* Add flags -Wno-c99-designator and -Wno-unused-but-set-variable Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I7b1a1a353a0474d7ef967f6f3c8d13c36fa31844
2022-09-22IVGCVSW-6495 Add Support for BATCH_MATMUL to Arm Support LibraryKevin May
* Update feature level support to FL6 * Add ConvertBatchMatMul function Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I93a77ba869bcddf432229a20e619304305d3982e
2022-09-16Use ARMNN_VERSION for Support Library versionStringKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I6f2b52f7277215c97be3d53969a9eaef137e3636
2022-09-06IVGCVSW-7006 Remove deprecated code due to be removed in 22.08Teresa Charlin
* AddConv and AddDWConv with weights and bias * ResizeBilinearDescriptor * b,blacklist option in accuracy tool !android-nn-driver:8172 Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ibbc04fd18be7f938b11590bf67cd7af103cb4d99
2022-08-29IVGCVSW-6954 'Arm NN SL Improvements'Sadik Armagan
* Move the Conv2D and DepthwiseConv2D validation to Optimization level when the weights and tensors are as constant inputs * Take into account offset and scales values when doing INT8 to FP32 dequantization Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I1f81f15640395ac041923b10dbe9151159715117
2022-08-05IVGCVSW-7062 'Gpu Tuning does not work with TfLite Benchmark tool'Sadik Armagan
* Load the tuning file when GpuAcc is selected as a backend. Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I1d6b0237a87301f07681293a2c6dbc37e352dd28
2022-08-05IVGCVSW-7063 'Support Library NNAPI Caching'Sadik Armagan
* Fixed caching issue. Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ic7b3e0bd4438b2fd1b3dbfa86b6c89d625bbf9dd
2022-07-27IVGCVSW-6954 'Arm NN Support Library Implementation'Sadik Armagan
* Fixed model converting issue * Fixed import memory issue Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ied61810b308e0c5d5754f122a6ea2bac1d0725f1
2022-07-27IVGCVSW-7113 Fix building nn driver failed in our Android OOBTKevin May
* Android.bp file gets picked up by older Android versions so rename it to "switch it off" and update guide on how to enable it Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I1fc59a0d0dc2e6ce9cdc19f94b0b34d08d414351
2022-07-27IVGCVSW-7107 'Error while running Arm NN Sl with -d option'Sadik Armagan
* Templated the DumpTensor() function based on tensor type Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I08775e480f89010be61daf0a09a2ab0274e05978
2022-07-08IVGCVSW-7024 Add missing license info for reuse lintJim Flynn
Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: I97dee6982e0a7be01c13e9e803c0997547a39ff1
2022-07-08IVGCVSW-6957 'Import Host Memory in SL'Sadik Armagan
* Enabled import host memory in SL as default * Updated import host memory functionality in GpuAcc Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I22132b1e1008159b0e7247219762e3e9ae5eba10
2022-06-26IVGCVSW-6989 'Fixed build issue'Sadik Armagan
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I20e22821b6d4532953ddec2a8eac2a0f09e8013b
2022-06-24IVGCVSW-6958 'Integrate Import Host Memory to POINTER memory type'Sadik Armagan
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I8b05fb1e6ba31e46bf23ebfdaf55142dbe17980e
2022-06-21IVGCVSW-6954 'Fixed test failures on Conv2d"Sadik Armagan
Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ifd5ad4d4ca553e3f58ea246a0ac3c6e6b8b31215
2022-06-20IVGCVSW-6989 "Merged experimental/armnn_shim_sl"Sadik Armagan
* Updated Serializer CMakeLists.txt to build armnnSerializerObj * Added constant tensors as input support to SL Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I22f6cf50147d99a01f7fe70d7446b114a4c57af3