aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-10-12Update ACL pin to 0d11b70fbfa95431dacd7dce02403cf90bc688d5Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ie8ac84a9edcc7f41c9a726a702ce7d034d25bd25
2021-10-11IVGCVSW-5752 Add missing runtime parameters to TfLite delegate.Colm Donelan
* Adding Runtime parameter: dynamic-backends-path * Add profiling parameters: gpu-enable-profiling, enable-internal-profiling, internal-profiling-detail, enable-external-profiling, timeline-profiling, outgoing-capture-file, incoming-capture-file, file-only-external-profiling, counter-capture-period, profiling-file-format * Adding utility parameter "serialize-to-dot" Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Ibff4b9a85ff0f0da5d70e8aa0bb6cba96aaabbc3
2021-10-08IVGCVSW-6449 Add GEMM operator support to ONNX parserNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I3c6979c72d44a15fb2dc3afc22ac30d1428684b0
2021-10-08IVGCVSW-6313 Support pre-importing outputsFinn Williams
* Add ClearImportedInputs/Outputs function to IRuntime * Add UnImport function to ITensorHandle * Remove mutex from IWorkingMemHandle Change-Id: I34c9b6e1618755e10f3b4597afa1d9a9ea97e5fe Signed-off-by: Finn Williams <finwil01@e127804.cambridge.arm.com>
2021-10-08IVGCVSW-6417: Catch AddFullyConnected API error when weights TensorInfo ↵Cathal Corbett
isn't set * Updated code in Graph.cpp InferTensorInfos() to be more descriptive. * Added method VerifyConstantLayerSetTensorInfo() in Graph.cpp/hpp to error when ConstantLayer TensorInfo is not set. * Updated Optimize() in Network.cpp to call VerifyConstantLayerSetTensorInfo(). * Added unit test with ConstantLayer TensorInfo not set to catch error in VerifyConstantLayerSetTensorInfo(). * Added comments around method VerifyConstantLayerSetTensorInfo(). Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I366596243f7c5823676222e2d0cce1335bc8c325
2021-10-08Update ACL pin to c9fe9fc3fc8c58a9d724776f75831ab35f07b253Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I45e45dfeaf0176c9be68a773e16776414581edce
2021-10-07IVGCVSW-6459 Add support of scalar and flexible output datatypes to ONNX parserNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Id1e933f6ae55ddc1a57c80c9f6a5757ccb61f018
2021-10-07IVGCVSW-6461 Building Arm NN failed after adding Conv3d to TFLiteparserMatthew Sloyan
* Add hash define to Conv3d for backwards compatibility when compiling with TF 2.3.1 Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I70eec3b26430240852938af34b065b32bab91ebe
2021-10-07Fix compile errors/warnings found on MSVCRob Hughes
* Fix incorrect type used for loop variable (leading to conversion warnings) * Fix use of non-standard datatype u_int8_t Change-Id: Ide43d504e2df259c036e38c448247636dba278ad Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2021-10-06IVGCVSW-6338 IMemoryOptimizerStrategy Create a wrapper validator strategyFrancis Murtagh
* Add validator wrapper * Add validation logic: Condition #1: All Memblocks have been assigned to a MemBin Condition #2: No Memblock is assigned to multiple MemBins Condition #3: No two Memblocks overlap in both the X and Y axis Memblocks can overlap on the X axis for SingleAxisPacking Memblocks can overlap on the Y axis or the X for MultiAxisPacking but not both * Add test strategies and tests for overlap, duplicates and unassigned blocks Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I7a779b35538ecf18a33b62b84512eba69eda1f86
2021-10-06IVGCVSW-6165 Add Support for Conv3d to TfLiteParserMatthew Sloyan
* Added CONV_3D operator support. * Fixed TfLiteParser test issue where QAsymmU8 tests were incorrectly using the Boolean comparison function. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I9db03b54b6de63f918717af80c5ac5310fe26183
2021-10-06IVGCVSW-6300 'IMemoryOptimizerStrategy Add strategy library and add support ↵Sadik Armagan
in BackendRegistry' * Updated IRuntime interface for providing custom memory optimizer strategy. * Enabled selecting existing memory optimizer strategy by using BackendOptions * Added MemoryOptimizerStrategyLibrary that sets one of the existing memory optimizer strategies selected by user Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I037f8ac8efa79c0f71bd63e379101e3ad92d80c9
2021-10-05IVGCVSW-6382 Add Concat operator support to ONNX parserNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I435723160e9b639a70e0b48ee9d722d306461291
2021-10-02IVGCVSW-5985 Remove deprecated codeJan Eilers
* Removes deprecated AddLayer, IsLayerSupported functions * Marks the whole LayerVisitor class as deprecated not just the constructor. This required to wrap all Accept functions in a no deprecate macro because the LayerVisitor is used as a parameter in there * Removes usage of deprecated LayerVisitor and replaces it with ExecuteStrategy. This required a few structural changes in the unit tests * Adds a default implementation for IStrategy called StrategyBase * Changes pyarmnn to use non deprecated constructor for INetworkProperties and adds related unit test * Marks usage of deprecated code in pyarmnn as deprecated. This required to extend INetworkProperties to allow backwards compatibility * Removes deprecated functions from CpuAcc, GpuAcc and Ref backends Note: This patch breaks compatibility with backends that are not updated in this patch !android-nn-driver:6325 Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Id13b6f37a74d26eadeda2da1dc92915e725ed5a5
2021-10-01IVGCVSW-6163 Add Conv3d FrontEnd and Ref ImplementationMatthew Sloyan
* Added front-end * Added Reference workload * Added Serializer & Deserializer support * Added unit tests * Added NDHWC DataLayout Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Iec4d39e7433b5334d52fa44cf8efc6bcd39319d8
2021-09-30IVGCVSW-6293 Add Unit test int8 Channel ShuffleTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Icf69b4c707014c5ae76425ad326bd2826381f305
2021-09-30Check for GNU-like compiler before appending argumentsRob Hughes
This code was assuming a gnu-like compiler, which might not always be the case. This patch adds a if-statement to check, similar to other code in the CMake files. Change-Id: I1c807b68b15365241c4d349c42c612145ad9a105 Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2021-09-30Update ACL to 63e0beb9fb9646407d123e830165546e9129e95dNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I40495de528dcfe31c89ebcfaf28418de66d1ffea
2021-09-29IVGCVSW-6382 Add Unsqueeze operator support to ONNX parserNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ie0b68b08fc31444c58b0ffc9babdd456bbb51f35
2021-09-29IVGCVSW-6293 Add Channel Shuffle to documentationTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I1ca7a750e3fe327eddd01a856c18112cc66849ff
2021-09-29IVGCVSW-3716 Add EndToEnd Layer test for Channel Shuffle WorkloadTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I43d052d020f90c13688901929cd22c715471ef4f
2021-09-29IVGCVSW-6160 Support building tensorflowlite 2.5 through cmakeKeith Davis
Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I825f09d008505e701d42b79be936f4da24620c06
2021-09-29IVGCVSW-3707 Add Channel Shuffle Workload to CpuAcc backendTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I2e3dee3c73fe58c7cfcb3ce3667884202f46e6aa
2021-09-29Update ACL pin to 2e53f17f4f3c9179455c05d49a47a236067e00c0Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I98a00245a782416e37253c3e01ff7f47534ef1d4
2021-09-28IVGCVSW-3706 Add Channel Shuffle Workload to GpuAcc backendTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ic37fc49a97a5ca570a23bc415d15ee3841534336
2021-09-28Update ACL pin to a71711008dad9a786a66dcd734b19cb102d65ec5Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ic3cba4dd139e4396971ee41448f581e24b043e53
2021-09-24IVGCVSW-3705 Add Channel Shuffle Front end and Ref ImplementationSimon Obute
* Add front end * Add reference workload * Add unit tests * Add Serializer and Deserializer * Update ArmNN Versioning Signed-off-by: Simon Obute <simon.obute@arm.com> Change-Id: I9ac1f953af3974382eac8e8d62d794d2344e8f47
2021-09-24IVGCVSW-6382 Add Gather operator support to ONNX parserNarumol Prangnawarat
* Add ParseGather to support Gather operator on ONNX * Add Support of int64 converted to int32 for constant * Add OnnxParserTestUtils * Refactor ValidateTensorShapesFromInputs of GatherLayer * Unit tests Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ie9dff640240e14a062fef38f7faf0ccc212de5f7
2021-09-24Update ACL pin to 93d6cf0028aea111f624b320027576a26354e998Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Idc9ea276ae0056f617c161f5aa6d64390f423bfd
2021-09-23IVGCVSW-6181 patch to allow building against tflite > v2.3Jim Flynn
Change-Id: I292add699b2af32fab87b98929fe6fee79fdf356 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2021-09-23Fix catch by valueFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I257c3e79fa715170ac57caafc59131057c3a3b9c
2021-09-23Fix undefined reinterpret_cast in BFloat16.hppDiego Lopez Recas
This fixes gcc builds with version 8 or above. Signed-off-by: Diego Lopez Recas <Diego.LopezRecas@arm.com> Change-Id: I4b886854f4f3391f766e95c3478d3a5f9661507a
2021-09-22IVGCVSW-6331 Update documentation for Debian PackagesFrancis Murtagh
* Allow users to install latest ArmNN via dependency package removing requirement for Major Version Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I643ccca392f895dcfd5fd84fa403335ab7a1f8bf
2021-09-22IVGCVSW-6232 Integrate static library libtensorflow-lite.a with ArmNNKeith Davis
Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: Ieb5fa0c4bb6753f0af21cfd80f1bf9faba55f7d0
2021-09-21Fix compile error in TransformIteratorRob Hughes
The operator= functions were raising a compiler error on MSVC. The implementations of these functions also looked very suspicious as they were not behaving as a normal operator= would - they did not modify the 'this' object at all, and returned a copy rather than a reference. This patch changes them to be more conventional, which required removing the 'const' qualifier from m_fn in order to make the object assignable. Change-Id: I1c8b526581ed8973e64f1cffc43b97ac88e07699 Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2021-09-21Revert "IVGCVSW-6181 patch to allow building against tflite > v2.3"Jim Flynn
This reverts commit fc8d434bb318aebb433a2f6d8ce9c066cd9c1b1e. Reason for revert: Causes failures in the armv8 builds need to back out and fix again later Change-Id: I5ccdbb622caaa6413de41e1ee073f38dcabff7d8
2021-09-16IVGCVSW-6382 Add Shape operator support to ONNX parserNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I3547effcbebf1ebc02d3b20f5db394a26991424d
2021-09-16Add support for Clip with attribute on ONNX parserNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I1bae42dade7eabf3da09252066e912e803a8ea32
2021-09-15GitHub #577 slice layer does not handle a size of -1Mike Kelly
* Added support for size of -1 A size of -1 is treated as size = dimension - begin Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: I4e381a3794852ec45be029028e2d29bc87791635
2021-09-15IVGCVSW-6262 Add Reduce Prod to documentationTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Icbb7115e4fe0c72d357ccb215430298e723a2253
2021-09-15IVGCVSW-6296 Add -Wno-psabi to GCC flagsFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I4f9800e53b80a836ab6fa0ee3bb5643ce8d7181b
2021-09-15IVGCVSW-6331 Fixup include directive in RedirectMembersToConstantInputsFrancis Murtagh
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I2503e6995c83316094257318743a756da600bb6c
2021-09-15Fix incorrect string name for workload constructKeith Davis
Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I0334a772c1453a1d568f27cddea9d0effff8a0a0
2021-09-15IVGCVSW-6312 Support pre-importing inputsFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: Ifc5e6f2e36767cb2a5cbf281d40ec9989b581abc
2021-09-15IVGCVSW-6181 patch to allow building against tflite > v2.3Jim Flynn
Change-Id: I4199239228f7d5f4c819a7fe04cca059a830bf1f Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2021-09-15IVGCVSW-6298 'IMemoryOptimizerStrategy Add declarations and constant layer ↵Sadik Armagan
strategy' * Added IMemoryOptimizerStrategy interface * Added ConstLayerMemoryOptimizer strategy Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I6a92e659379e5cc39c375b669678eee8a8c08c20
2021-09-14IVGCVSW-6369 Fix ExecuteNetwork output failureJan Eilers
Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I01aa6ea4b21ad4504d6ae04850a2236588e5ddd3
2021-09-14IVGCVSW-6339 'IMemoryOptimizerStrategy Add backend capabilities'Sadik Armagan
* Added ExternallyManagedMemory capability, set false for backends * Added MultiAxisPacking capability, set false for backends Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I96a2b66ed069a82552dae33f6e8ebe067bbd6c44
2021-09-13Add 'do-not-print-output' option to ExNetJan Eilers
Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I10fb010ee8d3f813d2264cefb526f352e30d7046
2021-09-08MLECO-2207 Fix issue with the PyArmNN OD example, for FP32 models.Éanna Ó Catháin
Change-Id: I6b8887f0b3e23c0c1529719e20b17a9f55ccf4e7 Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>