Age | Commit message (Collapse) | Author |
|
* In ref broadcast layer added broadcast support to expand tensor shapes
* Added function to check for zero dimension tensors
* Added check for unsupported zero dimension tensors during broadcast
* Added DelegateUtils unit test file with unit tests for the new function
Signed-off-by: Patryk Kaiser <patryk.kaiser@arm.com>
Change-Id: If4e786f7ba580399e781c48335888e8da8458019
|
|
* Creates a numpy parser helper header
* Adds ability to parse numpy file in PopulateTensorWithData
* Reuse ExNet compare-output flag to compare against npy golden files.
* Reuse ExNet write-outputs-to-file flag to write output to npy file.
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Signed-off-by: Ryan OShea <ryan.oshea3@arm.com>
Change-Id: I52df822f72f6ce9d191ac4bd26ca5718ccaa7a4a
|
|
* Onnx parser.
* Async execution interface.
* Shim and support library.
* Arm NN converter
* GpuFsa backend.
Signed-off-by: Colm Donelan <colm.donelan@arm.com>
Change-Id: Ia9adae4da6d9bd2b92a4f4492a022e8337f57f14
|
|
Change-Id: I03c26ab763ec306a6efe31f9b4e0b1c058589bf7
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
|
|
Neither the armnn_delegate nor the ArmNNExecutor unloaded their network
before being destructed. This was leaking significant memory.
Signed-off-by: Colm Donelan <colm.donelan@arm.com>
Change-Id: I61db2e6cbbff4ec4771e86ac71eab90c02389c9e
|
|
Signed-off-by: Kevin May <kevin.may@arm.com>
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I5839f54c71f74eaa6819333393bb3054db9db5be
|
|
Previously the JSON profiling was printed once per delegate invoke call.
Modify that to print only once per ArmnnSubgraph. Data from multiple
inferences is grouped together.
Signed-off-by: Colm Donelan <colm.donelan@arm.com>
Change-Id: I1beb60eae4685c8e628dd1939f41bd649fc2a6ba
|
|
* Fixed issue where backends were asked to support FP16 layers that would
be optimized out.
* Fixed issue where backends were asked to support non-constant filter
and bias tensors when those tensors would be replaced by constant
tensors during optimization.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: Ib54b9cb99d5014e27172841a665daf57d1d5b23d
|
|
* This helps debug when running the DTS
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I623001529e8b56f654e0d93cbb96d3f5b38a7882
|
|
Signed-off-by: Ciara Sookarry <ciara.sookarry@arm.com>
Change-Id: I16ef18a4d4afce0ae17c98cfb5267f51b7708539
|
|
* Fix order for reading options to read backend first independently of the order given
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ia87b5920c7cd79b3e66bb6e5779e2355b21a7ec6
|
|
This reverts commit 008270f8c1359a7d62c2f881326b4d3f0d8b7b56.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: If8f5151aa349ff3834f03391e813669e5c51ed66
|
|
ShapeInferenceMethod::ValidateOnly
Signed-off-by: Idriss Chaouch <idriss.chaouch@arm.com>
Change-Id: Iac4a81ecda50bb179a718522d87caea1fd3760fd
|
|
Signed-off-by: Ciara Sookarry <ciara.sookarry@arm.com>
Signed-off-by: Idriss Chaouch <idriss.chaouch@arm.com>
Change-Id: I21c8811d696d871d5c6b41df036c791ac4828ff4
|
|
* Updated Opaque Delegate, TfliteParser, OnnxParser, and Deserializer to handle the Zero In Shape edge case
Signed-off-by: Tianle Cheng <tianle.cheng@arm.com>
Change-Id: I4a0d1e72a66de1fa56de99af9b6730a84e0ff596
|
|
* Add support to CpuRef, CpuAcc and GpuAcc
* Add support to tflite parser, classic and opaque tflite delegates
* Add support to serializer and deserializer
* Add Unit tests
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ibc60ef2ef2a051e6d9af6e15d24c46316ec19de4
|
|
* Added initializers for async_kernel and inplace_operator during
Classic Delegate registration.
* Updated failing Delegate unit tests.
* Updated experimental Opaque Delegate header paths.
* Updated libraries in FindTfLite.cmake for building with a debug
TensorFlow build.
* Update get_tensorflow.sh to TensorFlow 2.14
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Signed-off-by: Idriss Chaouch <idriss.chaouch@arm.com>
Change-Id: I084d54bcd1cd941d7cab8122bc244d94821ce6fc
|
|
Signed-off-by: Idriss Chaouch <idriss.chaouch@arm.com>
Change-Id: Ibc145d0ea1ac9414b6a68b5b547bf2ea2852fd36
|
|
* Fix incorrect batch size and time size
* Fix incorrect time major when max time =1
* Fix incorrect permutation
* Fix incorrect scratch buffer
* Unit tests
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
Change-Id: I510fae55528be412a58d020e82bd283852e7800b
|
|
This reverts commit 4980e21193f0a14fef084a7f4b4197392f3c0845.
Reason for revert: Android Build for v82a failed due to schema not re-generating
Change-Id: Ic19cf471b487f321c97ff837d36526512fb12fa4
|
|
!android-nn-driver:10089
* Disabled SubTensors on CL and Neon Backends.
* Added Axis to ViewsDescriptor to store the value where ever possible.
* Updated Splitter tests to provide all the information needed in the
Descriptor.
* Updated Serializer and Deserializer to handle axis.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I6a22d4750e04003689495b5e9e3c33deb37162bd
|
|
* Replace most ARMNN_ASSERT's from tflite parser
* Replace most ARMNN_ASSERT's from onnx parser
* Replace some ARMNN_ASSERT's from tflite delegate
* Replace some ARMNN_ASSERT;s from include files
Signed-off-by: Ryan OShea <ryan.oshea3@arm.com>
Change-Id: Ie052e0180060203f28f64ebf54acad298f431caf
|
|
* All layers added through the classic delegate will have a name that
includes the nodeIndex from the tflite model.
* Added utilities to ClassicDelegateUtils to get the names for the layers.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: Iac567486d1f91c0a99b77ed8963f6b6ca26b0b59
|
|
* Fixed issue where then dimensions specificity didn't match the number
of dimensions.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: Ic4da6f23c1e8ca38f321aa88c69ef57558a8f393
|
|
* Added LEAKY_RELU support to classic and opaque delegate
* CMake files updated
* Test added
Signed-off-by: Tianle Cheng <tianle.cheng@arm.com>
Change-Id: Ib9a2ce8f637b14afcd796bbae11fd3fa03653a2c
|
|
* Adding support for Tile in classic and opaque delegates
* CMake files updated
* Tests added
Signed-off-by: Tianle Cheng <tianle.cheng@arm.com>
Change-Id: I9b52cea3480eb71961cbccb1a346805f73b5661a
|
|
* Adding support for ReverseV2 in the classic and opaque delegates
* CMake files updated
* Tests added
* Gpu/Cpu Acc tests compiled out until functionality is written
Signed-off-by: Tracy Narine <tracy.narine@arm.com>
Change-Id: I8b41b7e71f2e28e5ea8dddbd00657900e6d7ab9a
|
|
* Added 2 new operators as ElementWiseBinary ops
* Ref End to End and unit tests
* Serialize and Deserialize tests
* Delegate and Opaque Delegate tests
* TfLite Parser tests
Signed-off-by: John Mcloughlin <john.mcloughlin@arm.com>
Change-Id: I537158127f602f0c41ca0402aa31655cd3bd4281
|
|
output size
* Added fix to Classic and Opaque Delegate which now matches
the TfLiteParser.
* Removed uses of single parameter IsValid function in classic
Convolution visit functions.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I5be91ec25c11354a9b8472d0a429e71e02df6f9c
|
|
* If the dimension Size[n] in a Slice is -1 then it should be treated as
"InputShape[n] - Begin[n]" but the Delegate simply cast the Size to
uint and treated it as 4294967295.
* Added the layer name that includes the node index to the Slice to aid
debugging.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I45fa88b24982c3c97f48d0dc05cf7d9bb6db4074
|
|
Classic and Opaque Delegate
* Implemented unsupported operators in Classic Delegate.
* Added unit tests.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: Ib39eeea53c114b15943e8dc2e796ce64c40cb3a5
|
|
* Moved CreateOutputTensorShape function to common DelegateUtils.hpp
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I3d8a9834ecd6b7cda170cce958677a0dde62824a
|
|
* Added visit functions for ElementwiseBinary Ops
* Moved MultiLayerFacade.hpp to common directory and updated both delegates to use it
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I84b8bd74d15a194895e63da47c29be994531a889
|
|
in Opaque Delegate
* Removed input slot check from Connect function as number of TFLite
and Arm NN inputs can differ.
* Moved SetupConcatViewOrigin function to DelegateUtils.hpp
* Simplified validation checks in VistConvolution functions as IsValid
and IsDynamic were already being called.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I858dbe4b643f9d350d9c38ea255ce5effbda4612
|
|
* Reference workload
* TfLite Delegate
* TfLite Parser
* Serializer and Deserializer
* Changed fallback tests in delegate to use COS instead of CEIL
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I36e0dbff33694182d1dba0c95d463506428e2f04
|
|
Signed-off-by: John Mcloughlin <john.mcloughlin@arm.com>
Change-Id: Id4bdc31e3e6f18ccaef232c29a2d2825c915b21c
|
|
* Added opaque delegate DelegateTestInterpreter implementation
* Moved classic specific tests to ArmnnClassicDelegateTest.cpp
* Moved opaque specific tests to ArmnnOpaqueDelegateTest.cpp
* Removed ArmnnDelegateTest.cpp
* Moved TfLiteStableDelegate implementation to armnn_delegate.cpp
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: Ifc92b6fb38dc370f3fb88a4daca56d457e74bc2e
|
|
* Updated all tests to use new DelegateTestInterpreter.
* Fixed some unit tests where the shape was incorrect.
* Add file identifier to FlatBuffersBuilder, as it is required for
validation when creating the model using new API.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I1c4f5464367b35d4528571fa94d14bfaef18fb4d
|
|
* Implement OpaqueDelegateUtils.hpp using new accessors.
* Moved classic delegate utils to ClassicDelegateUtils.hpp.
* DelegateUtils.hpp now contains common utils.
* Removed unused ConnectConstant function.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I0fa611c82f5c06b0b7e0c37bfc343e09fb6a96c9
|
|
* Also added cmake for the new layers to reduce merge conflicts.
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Ieb59aa2b7e2a18c57c9357b8d5b5cd63d8211c85
|
|
* New folders created:
* common is for common code where TfLite API is not used
* classic is for existing delegate implementations
* opaque is for new opaque delegate implementation,
* tests is for shared between existing Delegate and Opaque Delegate which have test utils to work which delegate to use.
* Existing delegate is built to libarmnnDelegate.so and opaque delegate is built as libarmnnOpaqueDelegate.so
* Opaque structure is introduced but no API is added yet.
* CmakeList.txt and delegate/CMakeList.txt have been modified and 2 new CmakeList.txt added
* Rename BUILD_ARMNN_TFLITE_DELEGATE as BUILD_CLASSIC_DELEGATE
* Rename BUILD_ARMNN_TFLITE_OPAQUE_DELEGATE as BUILD_OPAQUE_DELEGATE
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ib682b9ad0ac8d8acdc4ec6d9099bb0008a9fe8ed
|