Age | Commit message (Collapse) | Author |
|
* Folding of pad into conv2d expected a Constant layer not Dequantisation
* Fusing Dequantisation with Constant to a Constant ensures that.
* Group Constant layer optimizations together where possible.
* Add unit test.
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: Id0393313bf097595f2f13738b7513e427116ea4a
|
|
The -F execute network option creates a directory to print intermediate
tensors but minor problems caused serious failures. This attempts
to clean up the error handling.
Signed-off-by: Colm Donelan <colm.donelan@arm.com>
Change-Id: Ia44c008919b1bee299b43a672235b1fcc25bf1bd
|
|
* This issue was caused by https://review.mlplatform.org/c/ml/armnn/+/8771
* Not able to find the lib suffix due to condition set in GlobalConfig
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I176279757dce7ba8262342d69a6f550e383cf138
|
|
* Some code was moved to aclcommon to facilitate GpuFsa. It causes
build problems when ACL is build without CL support.
Signed-off-by: Colm Donelan <colm.donelan@arm.com>
Change-Id: Ia49d1fb7e69aaa8a694f402968e9ae689c2a874c
|
|
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I60e9284b90467f58e0acd74d3f1493546b6f1b9b
|
|
Fix delegate fallback during VisitNode
05b6a3e5946a3f58b6f5b0caface9153a1c2b364
Signed-off-by: Ryan OShea <ryan.oshea3@arm.com>
Change-Id: Iba2c70fd49ce8d7c49fb6deb7183b42db2cc68c7
|
|
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Iefe255ed27e1f69d99dc0cae9cfa1d6d1a51720e
|
|
* Added ElementwiseUnary support with a mapping for Rsqrt
* Added unittests
* Added Rsqrt EndtoEnd tests for all backends
* Changed TosaRefLayerSupport to default to false on unsupported layers
Signed-off-by: David Monahan <david.monahan@arm.com>
Change-Id: I3eaa9c684647ead61520a563815581aa68bee51b
|
|
* Call Reshape EndToEnd test from 3 backends
* Tidy up some naming of tests.
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I5546af35e89d352d3f1529368518aecc0a4a534b
|
|
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: I55c1020dbfe13af439236fa72057f114e78e8bd3
|
|
* Added ability to calculate dynamic tensors and propagate
them through the model so that when those tensors are later
used as inputs they have the right shapes.
* Added InferOutputShapes to DetectionPostProcessLayer.
* Added InferOutputShapes to MeanLayer.
* Added InferOutputShapes to RankLayer.
* Added InferOutputShapes to ReduceLayer.
* Fixed typos in TfLiteParser.
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I880c0716938ef278f5dbf01a8a73a5cc99ce5ded
|
|
* API to remove need for workaround so backend users can get slots
* OutputSlots outside the SubgraphView needed to obtain TensorInfo
* Fix a few Copyright headers
* Add shared_ptr back to original subgraph view using
std::enable_shared_from_this
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I033a00d6fc4020619d406ac06a156b7e380a426a
|
|
During VisitNode throwing an ArmNN exception incorrectly
terminates the process instead of handing over to tflite
* Catches ArmNN exceptions during VisitNode
Signed-off-by: Ryan OShea <ryan.oshea3@arm.com>
Change-Id: I6c71be11e9b73694747b27fe9febab8d9669b4d4
|
|
* Required to enable easier future merging and rebase into experimental/GpuFsa
as part of IVGCVSW-7380.
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Change-Id: I066dcf00523ff430a0908666e452548ab848bd86
|
|
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Change-Id: Id765f6d766e623a157b614ca935113a9f32a5801
|
|
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Change-Id: Ic6bbbaa04aabaa5c3fd525acd5121f07d3392120
|
|
* Instead of extending ArmnnDevice with ArmnnDriver make it a member
* This will allow us to construct the ArmnnDriver and return a
DEVICE_UNAVAILABLE NN_ERROR instead of segfaulting with the
armnn::InvalidArgumentException if we cannot create a device
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: Ibbcdbeb33dfd170dd1fb393204620e5b9e6342b8
|
|
Optimize
* Add unit test for WorkingCopy of SubgraphView with Inputs and Outputs
* Added check to ensure InputSlot is connected before trying to disconnect
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I261d55e38c94687a9de64cdee726a7c7442ed537
|
|
* GpuAcc only supports up to 3D, so no 4D test have been added
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ie926cd45c350be624cbdc6cb27c89d2d3f60884b
|
|
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ia783db31d553e2a70067fde6efbaba6644490980
|
|
OptimizationViews::GetINetwork()
* Also provide API to return reference via GetINetworkRef().
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
Change-Id: I80f4912cb7e22a2023e9bb880182ad4610c219e9
|
|
* Build ExecNet lib dependencies as object libs except libarmnn
* Disable PIPE when building static ExecNet
* Remove multiple definition from AsyncExecutionCallback
* Disable DynamicBackend for ExecNet Static build
* Disable inference tests for TfLiteParser and ONNX during static ExecNet
* Remove Tensorflow Parser if condition
* Add Disable thread macro to InferenceModel
* Don't compile dynamic backend symbols in Runtime.cpp for Baremetal and
Exenet Static
Signed-off-by: Ryan OShea <ryan.oshea3@arm.com>
Change-Id: If41c063eab5f05b3df0a6e064924a36a177f116a
|
|
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: If9531f74d0b503c36f1b72ef51eee7e9f65559f2
|
|
Signed-off-by: Colm Donelan <colm.donelan@arm.com>
Change-Id: Ib148daf81700d9038d6e91a35c9c17e770c26e84
|
|
* Fixed bug when converting Constants with Per-Axis Quantization
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: Ifbea23e60483746ec987da491dae96e74cb33af4
|
|
This reverts commit 21cf67af47a9cebbc10a98184c204fffa3722abd.
Reason for revert: IVGCVSW-7397 Segmentation fault/Bus error in Backends CI job nightly
Change-Id: I563e79700a857f8cf0fce0923a7040aeda29629b
|
|
* This fixes the build failure happening in nightly job running
Arm NN and EthosN main branches
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I2b1f861fdfef2b6025dfdcc0725b00c82fac13a8
|
|
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I8cf59fab3b4a06de69a3825f92b42464c0d552ce
|
|
android-nn-driver.
* Not a concern with the delegate/parser as tflite builtin operators have
little float16 support
* Will also fix float16 workloads running on the support_library.
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Change-Id: Iec2033dbc8ece2140b188de1f193c344a68b9c36
|
|
* Added CreateNetworkFromBinary to the ONNX parser
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: I5ca72ee49c7b098f9fb4aaf55a8bc077230cb30e
|
|
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I409ba5ccdd1f62f4142f69cf99bb6c78042a41e6
|
|
* test_optimizer_options_fail test failing due to BF16 check
removed from OptimizerOptions() in IVGCVSW-7214
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Change-Id: Ibce5c0b0324f6d8761ffcb3e84532ca2656fcbc0
|
|
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Change-Id: I11505f672349e1f04143edfdc2df8775f685372d
|
|
IsLayerSupported()."
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com>
Change-Id: I7fa4110a1b545c1fcd79e387d53ae7d6cd381f31
|
|
TOSA Reference Backend
* Removed AdditionOperator and moved to new ElementwiseBinaryOperator.
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I8ce20f7575d68334aadcd176827bca3db53d0052
|
|
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: Ice8000c47664faf967809d3ac4dd79ceafafa03d
|
|
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: Ia7d714eb227a96ad9eeb1441afbc83e6ad2bb197
|
|
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I54d4a017e5f2d0bbeb742b6a33121e9ca5327f47
|
|
Two problems here:
* First the Delegate was using the parameter options after the execution
of std::move on it.
* In ExecuteNetworkParams 3 GPU backend options were instead being set as
optimizer options.
Signed-off-by: Colm Donelan <colm.donelan@arm.com>
Change-Id: I61c7fad8a5819a0a4aec0243899019a342c5cc5f
|
|
* .o files were being installed by cmake.
Change-Id: Ie2056e09b4800fe208d784a90f3908d508b8cadf
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
|
|
* From dependabot
Signed-off-by: Mike Kelly <mike.kelly@arm.com>
Change-Id: Ibf4dc2a679b4d588f823b8b1f1d34f7d4a2125c5
|
|
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
Change-Id: I75ff1d006d27d53898e6749a18f52359c043ec3a
|
|
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I5ac1f1032cc2507ce0b8677a08e9debefab2779c
|
|
* Change comment for the unique tensor names in all tosa common operators
Signed-off-by: Kevin May <kevin.may@arm.com>
Change-Id: I247b4b2365d5f0173218c5dfd11fba12d2399959
|
|
* alphabetical order,
* specify floats
* fix order of parameters in convolution operator
* fix uninitiated variable in ConvertConstantTensorDataToBuffer
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
Change-Id: Ic82e6127cac6b94da4c859a284893b838ab248bc
|
|
This makes it possible to call Import on an Allocated() or memory-managed Tensor,
which is needed for the current implementation of OptimizerOptions::m_ExportEnabled
to work (as the last layer before the OutputLayer needs to be able to Import the
user's OutputTensor, but this is done after other memory allocation).
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I1a885c2da7b1f0f3964ae53b8135b5e96a66614f
|
|
* Fixed issue where duplicate tensors where being created.
* Fixed issue where output name could be generated with the wrong id.
* Updated bias tensor for Conv2d, so the size matches the channel.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I1de6947e036b3e629ec6446d24d69e50603a5593
|
|
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: I9bfd597afd41468f304edfbe5d7141378ce60d4f
|
|
* Replace current IsLayerSupported checks with ModelRunner for
better validation.
* Added options to be able to disable the output from the
TOSA Reference Model during layer support.
* Updated layer support tests to reflect actual support.
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
Change-Id: Iaea17343d0ad51b495477024c44a34d9335d1438
|
|
Test was checking a freshly constructed BackendRegistry, rather
than the single instance.
Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
Change-Id: I7c64cf089cb406ac4e5ceefedb17163f39801b07
|