aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2022-10-19MLCE-545 INT8 TFLite model execution abnormalKeith Davis
* Add functionality to print output tensors to file in tempdir * UnitTests Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: Idfb4c186544187db1fecdfca11c662540f645439
2022-10-18ExecuteNetwork: Fix output format issue for int8 when using -wAdam Jalkemo
Change-Id: I594ded82493e9cc48cafa6f00d63769fefba5afe
2022-10-14IVGCVSW-7267 Make the AllowExpandedDims option workJim Flynn
Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: I3573078206272c3a72a2b3acf8781ab458ea6c90
2022-10-14Update ACL pin to 299d3a1f51b68857a0742bf68cc2567dbdfaefe2Nikhil Raj
* Add scons option to generate Map files. Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ic1485f4f544ae1139e2475b95bc6d4f0d4791f02
2022-10-13IVGCVSW-7288 ExecuteNetwork fix for multiple outputsAdam Jalkemo
* When a model with multiple outputs was used and output to file, e.g. with "-w ./boxes,./classes,./scores,./detection", the results where not saved in the correct files. * Applies only to the ArmNNExecutor. Change-Id: I2899322622a4c3fd1d0ddc75b100b81669417660
2022-10-13IVGCVSW-7283 Use stricter file extension check in CreateParserAdam Jalkemo
* I had issues when folder name contained "armnn" and a .tflite model was used, as the wrong parser was selected. * Now only the extension, and not the full string, is considered when selecting parser. Change-Id: If7964d2ce5535f7d25762d2a2d7e810bf1a1ed43
2022-10-11IVGCVSW-7222 Fix incorrect kernel measurements in profiling outputKevin May
* Some CL kernels are not run after the first inference and this breaks the profiler which is expecting a measurement for every kernel each run * Add a function HasKernelMeasurements() to ascertain if the Event is returning kernel measurements and if so insert 0.0 values for any missing kernel measurements. * Fix ExecuteNetwork to only print a json object after all inferences have completed Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I99f2bb0db847f5a52ab4c5705b072155c6b6f333
2022-10-11Fix TosaOperatorMapping tests when building for releaseMatthew Sloyan
* Asserts are removed during a release build, which causes build failures due to unused variables. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ie36f2bd22f5b2916b03ba7e64c1895fdf21f11f0
2022-10-10Update ACL pin to 2ffab6dc8afb3716c189a30f75c33b2f2c35a6d4Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I6c712d6b817f87f3d3a996e11e81208e9449da9f
2022-10-05Update ACL pin to db14af697b934d684d8b3d63a00ad5bea5c07bfbNikhil Raj
* Update GEMM reshaped rhs only heuristic Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I3b7489c1133ed8ae03dbc7c1e30b1979d604f4ba
2022-10-05IVGCVSW-7122 Remove support for py35 in pyarmnn/tox.iniNikhil Raj
* As part of testing IVGCVSW-7122, pyarmnn tests were failing as py35 is no more the default version in Odroids. Also we do mention Python 3.6+ as the supported version in pyarmnn/README.md Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I39407ba8689fbb064c32841d16d66c5080acbc10
2022-10-04MLCE-609 Update PyArmNN Installation GuideRyan OShea
This reduces build steps to a single guide rather than providing multiple options - Remove Standalone build from documentation - Remove Wheel installation from documentation Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: Ic1411eba5889434b2e1761ce2b9c8fdd2453b352
2022-10-04MLCE-545 INT8 TFLite model execution abnormalKeith Davis
* Signed32 missing from CompareAndPrintOutput Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: If3c93fb0d73c566ddcf439fceaa6d629029df18f
2022-10-04MLCE-545 INT8 TFLite model execution abnormalKeith Davis
* Fix for Debug mode in ExNet does not work with ConstTensorsAsInputs * Remove unnecessary assertion with ambiguous message in LoadedNetwork Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I9cd5d1f811dbbc89072d1190c510bf1b22e3069c
2022-10-03IVGCVSW-7227 Forward declare ILocalPacketHandlerSharedPtr in IRuntime.hppColm Donelan
* IRuntime.hpp includes one file from the profiling interface and it's causing some build problems for some users. Replace the include with a forward declaration of arm::pipe::ILocalPacketHandlerSharedPtr. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I6064e02db4ca056423bb448ddc0d712b50a704cb
2022-09-29Update ACL pin to ff81de5a9a0f6b9331c3b112cc2aed552f0482a9Nikhil Raj
* Fix overflow in NEActivationLayer for FP16 type Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I0f2e1609b8a46b69a9d83a4fa2cb6cf22af8c8d3
2022-09-28IVGCVSW-7209 Delay one release the removal of weights and biasTeresa Charlin
* This affects only to the layers (not workloads) Conv, DWConv and FC Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I66a91ed1a78bc0464e00423c7fc7c28c91d199ce
2022-09-27IVGCVSW-7235 Errors from LoadNetwork are being ignored in ArmNNExecutor.Colm Donelan
In ArmNNExecutor::ArmNNExecutor the call to m_Runtime->LoadNetwork was ignoring the Status result and continuing to execute with a failed network. In addition throwing an exception from the constructor resulted in a segmentation fault. * Modify IExecutor to allow the constructor to mark itself as failed. * Modify ArmNNExecutor to mark itself as failed when LoadNetwork returns an error. * Modify ExecuteNetwork to check the value of m_constructionFailed. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: Idf222cb2b66e1051875dc67046734f2b00b288d1
2022-09-27Update ACL pin to d6b8a71714361881a249a6f6ed67125f290f4a83Nikhil Raj
* Add FP32 Neon™ swish activation Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I606855096d90aa16aef9282e5860d41e3dc64d7f
2022-09-26IVGCVSW-7158 TfLiteParser supports reshape when output 'shape_signature' ↵Cathal Corbett
param contains a value of -1. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I538347083e9f22b3f3b6c048aebc2cf5cf4dc786
2022-09-22Remove aarch32 build from build-toolJames Conroy
* Removing support for aarch32 builds from the build-tool as Arm NN is dropping support for this target architecture. * Fixed missing additional ACL scons params in ACL build. Change-Id: Ib18b3286ce18d169ce8d8af2bd9b5d54f110eb3b Signed-off-by: James Conroy <james.conroy@arm.com>
2022-09-22Update ACL pin to a77c6d774053672b7bf0261e1a7a229bb6be5f21Nikhil Raj
* Add test for ClGemmLowpMatrixMultiplyCore to test a batched matrix multiplication with variable input tensors Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Id1531ff661de6a01c861737111924e4c23e814fb
2022-09-22IVGCVSW-7240 Adjoint is Transpose in TFLite. Change in TFLite parserTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I1bc3d50b8fa6e216d8b6b7e3421d2ff37a21712c
2022-09-22IVGCVSW-6498 Add Support for Batch MatMul to TfLite DelegateRyan OShea
* Creates delegate/src/BatchMatMul.hpp * Add VisitBatchMatMul function * Add BatchMatMul to switch in armnn_delegate * Creates delegate/src/test/BatchMatMulTest.cpp * Creates delegate/src/test/BatchMatMulTestHelper.hpp * Add Int8 and Fp32 unit tests on ref backend * Add BatchMatMul to delegate supported ops Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: I50e61314cf063f986c8a0f7d508847a96953735e
2022-09-22IVGCVSW-6495 Add Support for BATCH_MATMUL to Arm Support LibraryKevin May
* Update feature level support to FL6 * Add ConvertBatchMatMul function Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I93a77ba869bcddf432229a20e619304305d3982e
2022-09-21IVGCVSW-6790 Adding runtime options to Doxygen.Colm Donelan
* Add a breakdown of the runtime options to the documentation. * Exclude test classes from Doxygen generation. * Limit the file extension selection for Doxygen generation. * Add the support library to be generated. * Fix some broken markups. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I81896f2d7fff503a1d51d6d4ac3876aa8b84118e
2022-09-20IVGCVSW-7040 TfLiteParser fails to prepare model due to unspecified size ↵Cathal Corbett
buffer data for Slice operator. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I86735faf8d57168a63ca6657f281ec03b90f7235
2022-09-16Use ARMNN_VERSION for Support Library versionStringKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I6f2b52f7277215c97be3d53969a9eaef137e3636
2022-09-15Make SubgraphViewSelector give deterministic resultsRob Hughes
The subgraphs produced by SubgraphViewSelector were not produced in a deterministic order, as the order was determined by the pointer values of some objects, which are not guaranteed to be the same for each execution. This patch adds a post-processing sorting step based on the GUIDs of the layers and the slot indices so that the results will be the same for each execution. This makes debugging the optimised graph much easier as subsequent stages can also be deterministic. It also simplifies some unit tests. Change-Id: I64f552706b7fb1bf82c19d85a448e054277917bc Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2022-09-14Update ACL pin to a4814e8394ffdd7e268614d54cc22e30648f48ffNikhil Raj
* Add test case for disable Winograd on fp16 if fast-math = false Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Id4543f566a095c5822aa0f7df5ad9af4c4bd739e
2022-09-09Update ACL pin to e4e3b2ead5b6720af8039f3c9ac15ea6b51b915fNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I3f0637b4b2911c9cf314b3459ff84e959e467073
2022-09-08Fix misspelling in get_compute_library.shJames Conroy
Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I61096136abba9c8c6b9c4c7c5ade4156cb49c8c0
2022-09-07IVGCVSW-7201 Generalize get_compute_library.sh usageJames Conroy
* Allow user-specified directory name for the ACL repo (other than 'clframework') with the '-n' option. * Fix indentation. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: Iadec158bd9469fbc0d0875b085a5702e4a89ae83
2022-09-07IVGCVSW-7159 Implement simple TOSA Reference Backend skeletonFrancis Murtagh
* Added files based on RefBackend * Added PreCompiled Workload skeleton * Increment ABI version of armnnTestUtils for CreateInput which had been left as pure virtual, added base implementation for it. * Add IsTosaLayerSupported() for Addition Change-Id: I4c963adf3f50593d17ecdf21554502a64ad3bd76
2022-09-07IVGCVSW-7209 Remove deprecated code due to be removed in 22.11Teresa Charlin
* Files deleted when Stabilizing the API Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I0ae73ee36968fa880761c10358bfa827be5fe054
2022-09-06IVGCVSW-7155 SubgraphView::SubstituteSubgraph IOutputSlots incorrectly ↵Cathal Corbett
overridden Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: If594e291951a5f9ed1957a19a971c498f6e7843f
2022-09-06Remove branch switch announcement from main Readme fileNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ief9171e77306f4392481beac1b3e413c08797532
2022-09-06IVGCVSW-7006 Remove deprecated code due to be removed in 22.08Teresa Charlin
* AddConv and AddDWConv with weights and bias * ResizeBilinearDescriptor * b,blacklist option in accuracy tool !android-nn-driver:8172 Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ibbc04fd18be7f938b11590bf67cd7af103cb4d99
2022-09-06IVGCVSW-7088 Update CONTRIBUTING.md with main branchCathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I89636c3f693cc5ace5c686cea1cedefaddc57867
2022-09-05Update ACL pin to 552fe4c67d3cd2994cdbd5662cde79da5caf0c4dNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I45d26029c90f80afb79bc1e6a4360a263f61df95
2022-09-05IVGCVSW-6497: BatchMatMul TfLite ParserSamuel Yap
* Added armnnTfLiteParser for BatchMatMul * Added unit testing for parser * Updated CMakeLists Signed-off-by: Samuel Yap <samuel.yap@arm.com> Change-Id: If6842aaf7cf08f688093b714e2ecea6e8cd87161
2022-08-30IVGCVSW-7104: BatchMatMul Serializer/Deserializer SupportSamuel Yap
* Updated FlatBuffers schema for BatchMatMul layer type * Added Serializer and Deserializer implementations for BatchMatMul * Added unit tests for BatchMatMul serialization and deserialization * Updated CMakeLists and docs Signed-off-by: Samuel Yap <samuel.yap@arm.com> Change-Id: Iad63afbd036a3eb648683eb7416a475561aa20cb
2022-08-30IVGCVSW-7105: BatchMatMul Optional Parameter SupportSamuel Yap
* Added transpose parameters to pre-transpose each input tensor's slices * Added adjoint parameters to pre-adjoint each input tensor's slices * Small refactoring (BatchMatMulDescriptor static helpers and BatchMatMulImpl constructor) * Updated input validation and output shape inference for parameters * Additional layer unit tests for parameters added * Versionings incremented Signed-off-by: Samuel Yap <samuel.yap@arm.com> Change-Id: Ibe5242a8a5bf604c13de0dc65844fd6c421cc667
2022-08-30IVGCVSW-7133 Add TosaMappings backbone structure with support for Addition ↵Cathal Corbett
TosaMappings operator. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ibea0cf625b3af4ab38e8b985f7a129c983ca9659
2022-08-30Update ACL pin to a331e48ad8a4856837cf0afdd44de69af43581afNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I12f2993d6e7476f9d9cb4590de9ac40bc6dd6449
2022-08-29IVGCVSW-6779 Add build-tool Docs and update docsJames Conroy
* Added Arm NN Build Tool README.md and license. * Added Dockerfile diagram image and license. * Updated existing guides: added note to the cross compile guide to use build-tool, removed content from the Delegate BuildGuideNative.md. * Added Arm NN logo image to homepage README.md and added license. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I9306ad24165cf3b0203c2a1852ec3afd718e9eab
2022-08-29IVGCVSW-6603 'Add a no fallback mode to the TfLite Delegate'Sadik Armagan
* Added disable-tflite-runtime-fallback option to armnn_delegate * Updated armnn_delegate version Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I449b16404d3ffe98e6dac52a43e7c25225addd73
2022-08-29IVGCVSW-7106 Additional fix models with multiple input and output tensors.Colm Donelan
* The previous fix for IVGCVSW-7106 introduced a problem around operators with multiple inputs and outputs: addSeparator was being applied to all tensors in the list not just the last one. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I0325d9abcb7fb512f834c61686c698bbfc29a3be
2022-08-29IVGCVSW-6954 'Arm NN SL Improvements'Sadik Armagan
* Move the Conv2D and DepthwiseConv2D validation to Optimization level when the weights and tensors are as constant inputs * Take into account offset and scales values when doing INT8 to FP32 dequantization Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I1f81f15640395ac041923b10dbe9151159715117
2022-08-29IVGCVSW-7140 Produce map file for AndroidNN build for debug and release.Cathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ib4433767ba8bd3282a9b19c2a85ff1a6e7e83df5
generated by cgit v1.2.1 (git 2.23.0) at 2024-07-01 14:13:28 +0000