aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-09-15IVGCVSW-6312 Support pre-importing inputsFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: Ifc5e6f2e36767cb2a5cbf281d40ec9989b581abc
2021-09-15IVGCVSW-6181 patch to allow building against tflite > v2.3Jim Flynn
Change-Id: I4199239228f7d5f4c819a7fe04cca059a830bf1f Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2021-09-15IVGCVSW-6298 'IMemoryOptimizerStrategy Add declarations and constant layer ↵Sadik Armagan
strategy' * Added IMemoryOptimizerStrategy interface * Added ConstLayerMemoryOptimizer strategy Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I6a92e659379e5cc39c375b669678eee8a8c08c20
2021-09-14IVGCVSW-6369 Fix ExecuteNetwork output failureJan Eilers
Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I01aa6ea4b21ad4504d6ae04850a2236588e5ddd3
2021-09-14IVGCVSW-6339 'IMemoryOptimizerStrategy Add backend capabilities'Sadik Armagan
* Added ExternallyManagedMemory capability, set false for backends * Added MultiAxisPacking capability, set false for backends Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I96a2b66ed069a82552dae33f6e8ebe067bbd6c44
2021-09-13Add 'do-not-print-output' option to ExNetJan Eilers
Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I10fb010ee8d3f813d2264cefb526f352e30d7046
2021-09-08MLECO-2207 Fix issue with the PyArmNN OD example, for FP32 models.Éanna Ó Catháin
Change-Id: I6b8887f0b3e23c0c1529719e20b17a9f55ccf4e7 Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
2021-09-08Add sample app for asynchronous executionJan Eilers
Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I6d903c721d71a28bc02e4e98aaa813fb9159b678
2021-09-06IVGCVSW-4578 Initialise m_PacketDataLength in constructor for SendTimelinePacketJim Flynn
Change-Id: Ie97436006c53492896172c4c59df94efe8047feb Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2021-09-03IVGCVSW-6262 Add support for Reduce ProdTeresa Charlin
* Tflite parser * Tflite delegate * Serializer * Deserializer * Ref, CpuAcc and GpuAcc workloads Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I601a9ee1680b372c7955d9a628857d08c3cfd377
2021-09-02IVGCVSW-6344 Remove definition of CapabilityTestHelper if no backends are ↵Finn Williams
enabled Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I97b3302204e6a576220c800e21c5d031c84819a5
2021-09-02MLCE-401 Added helpers to query backend typePablo Tello
Signed-off-by: Pablo Tello <pablo.tello@arm.com> Change-Id: I6c3aa179eeaefa298e5c3a08f4d35708661615f0
2021-09-02IVGCVSW-6294 Added support for LRN to TfLiteParserMike Kelly
* Added support for LRN to TfLiteParser Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: Ia34441a4adeecd1f17c65af047d6c207729703ec
2021-09-02GitHub #572 ExecuteNetwork Segfault for TFLite DelegateMike Kelly
* Fixed Segfault when optional input tensor shapes aren't provided Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: Ib18be62d3654020037e6101976d58297b2a983c4
2021-08-31MLCE-530 Add support of int8 weight for UnidirectionalSequenceLstmNarumol Prangnawarat
to Ref backend and armnn delegate Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I203d0029c12221228ffe229acda3c90594394e9b
2021-08-31MLCE-530 Add support for UnidirectionalSequenceLstm to armnn delegateNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ib04f8d6b9e60a4204c56eba4c2ecd2b316509dcc
2021-08-31Update ACL pin to 7891a73ef36f4ad7b71069b3c57694f85bb79454Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ic988c01173b86b8a7944d2dbae1e2eaf9420f780
2021-08-26IVGCVSW-6311 Add the pre-import backend capabilityFinn Williams
* Update acl and ref backend capabilities * Add check for AsyncExecution capability in LoadedNetwork * Add new exception for capabilities Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I2f053c845a64f336e96d452793639c6e0d3eaa89
2021-08-24IVGCVSW-6216 PCA: Documentation UpdatesDavid Monahan
* Added the UseCustomMemoryAllocator interface to the Backend Developer Guide * Added the GetCapabilities interface to the Backend Developer Guide Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: I26e96ec1b3fe74b52c770269f3f79e688d196667
2021-08-24Update Arm NN FAQ with intermittent error informationNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I4f2e5c975fe4f273e80c065aa57861d0d78f0ea0
2021-08-20IVGCVSW-6294 Detect and remove extraneous fp16 conversion layersJan Eilers
Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I69a6ceda0d3e8d39947df71a2ad0d365ac7767d8 Signed-off-by: Finn Williams <Finn.Williams@arm.com>
2021-08-20Make samples visible in doxygenJan Eilers
* uses the @example doxygen command to add all our simple examples into an 'Examples' tab in the doxygen documentation Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Ie8ae19ca471a0616eeea7f708d547388c8ee860e Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
2021-08-20IVGCVSW-6249 Add ProfilingDetails Macros to all workloads in Ref, Neon, CLKeith Davis
* Add functionality to only output network details in ExNet Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I0c45e67193f308ce7b86f1bb1a918a266fefba2e
2021-08-19IVGCVSW-5924 Update TfLiteParser and TfLiteDelegate documentationMatthew Sloyan
* Added EXPAND_DIMS and SHAPE operator references. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I759c37db07c2ed2fa1a037a8b1e312367f4073ff
2021-08-19Updating get_compute_library.sh to handle ACL release branches.Colm Donelan
* CLFRAMEWORKREVISION in this script can be a SHA or a branch specifier. If it is a branch we need to pull. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Ibc46f803817b2c8983ebb9720417a1bd90679f9e
2021-08-18IVGCVSW-6179 Deprecate ILayerVisitorFrancis Murtagh
* Test code still using Visitor will be removed in a later patch. Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I01253e1af53d264918dc39498f45b96edb16678b
2021-08-17IVGCVSW-6073 Return Backend API Version to 1.0Francis Murtagh
* Backend API is still unstable and we shouldn't start to increment until we are ready, the change it was incremented in originally was also a major break due to the addition of a virtual method which would misalign the v-table. Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I9c15bba29fe3b3258ae592e96889402f950b2a95
2021-08-17IVGCVSW-6119: Restore FullyConnectedDescriptor::GetNumViews for backward ↵Francis Murtagh
compatibility * Deprecate publicly visible API and forward to new function name Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I25fe8a303b50ecb478abd35ca034ad09bd737fe4
2021-08-17IVGCVSW-6317 Cleaning up BackendRegistry following negative tests.Colm Donelan
* Deregister backends in BackendHintTest. * Deregister backend in ThrowBackendUnavailableException * Clean up dynamic backends when an exception is thrown from RuntimeImpl::RuntimeImpl. * Use CHECK_THROWS_AS_MESSAGE syntax in ClCustomAllocatorTests. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: I0e6e5413dd074b5fcfc9515c85cb8d40a4a0b73c
2021-08-16Bugfix: Only run ClCustomAllocatorCpuAccNegativeTest if Neon EnabledFrancis Murtagh
* Also call DeregisterAllocator on CpuAcc backend. * Removed problematic ClCustomAllocatorGpuAccNullptrTest unit test. Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ia2894c82a2b5de1c8d662551ea07b9123dd682cb
2021-08-16IVGCVSW-5924 Update 21.08 Doxygen DocumentsMatthew Sloyan
* Added ConstantTensorAsInput note to AddFullyConnectedLayer description. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I1f901023b5e421ca14183dd735996c1fe5ddb3d9
2021-08-13IVGCVSW-6076 PCA: Add support for Importing Protected DMA buffersFrancis Murtagh
* Add DmaBufProtected support to ClImportTensorHandle::Import() * Add DmaBufProtected to Map/Unmap switch case in ClBackend * Remove unreachable return statement Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I5918f6235af74ae287b8a73744a8cc979a07b0bf
2021-08-13IVGCVSW-6291 'Issue parsing profiling layer details'Sadik Armagan
* Initialized the new variable. Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I3d86d43455dd2df4246d76a2ac7cb49d8a48b786
2021-08-13Fixed logic error.Mike Kelly
* Condition used to check if m_BiasTensorInfo had a value then obtain a value from m_WeightsTensorInfo Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: I1b68ed98baa54a20663728b8871dcfa35c3347f0
2021-08-12Github #562: Use standard linux multiple path delimiter for PyArmNN includesFrancis Murtagh
* Update Readme Change-Id: Iaf9e50d7c13cfd3fa1fd75fc423265288c0c7f32 Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2021-08-12IVGCVSW-6078 Add support for Dma_buf CustomMemoryAllocatorDavid Monahan
* Updated supported sources in ICustomAllocator * Added MemorySource to the overridden MemoryRegion in ClBackend * Added switch statements to handle mapping/unmapping of differing memory sources * Added Import handler to map allocated DmaBuf memory Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: I2125f6f6fe72363d87ead62e211fc45e4fa28b3f
2021-08-12IVGCVSW-6077 Add Custom Allocator testsFrancis Murtagh
* Add test for invalid backend and nullptr * Small refactor * Throw exception on nullptr allocator instead of assert Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I94ce4f61d7cb3123831f1acd98165ae14c40033a
2021-08-11Update BuildAndroid NDK guideNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I4a0b78ff839004f55b47174e4ebf6461da27eaae
2021-08-11IVGCVSW-6297 'Issue with Profiling output'Sadik Armagan
* Added missing comma to output. Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I10dde7666ea1e6ea7ebe5bd497d18fc838cb9812
2021-08-11Bugfix: Update BuildGuideCrossCompilation.mdFrancis Murtagh
* Go back to armnn-devenv before making tflite directory * This is so tflite directory is in correct location for cmake * -DTF_LITE_GENERATED_PATH=$HOME/armnn-devenv/tflite Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I74730df3175cba724efcdd41cda2c2e413a5ce39
2021-08-11IVGCVSW-6087 Add an Assertion check to make sure we aren't given null allocatorsDavid Monahan
Add conditional compilation check to Cl specific header Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: Ib196b8ef4dc5fcfd1d1ccd3f29abf8e0ecd020cb
2021-08-10MLCE-530 Add support for UnidirectionalSequenceLstm to RefWorkloadexperimental/daves_custom_allocator_dmabufNarumol Prangnawarat
* Add implementation of IsUnidirectionalSequenceLstmSupported to RefLayerSupport * Add RefUnidirectionalSequenceLstmWorkload * Refactor Lstm to be able to use for Lstm and SequenceLstm * Unit tests Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ibc066d213213a11b955dfefbe518de643298ba0c
2021-08-10Adds CustomAllocator interface and Sample AppJan Eilers
* Updates the runtime options with a CustomAllocatorMap which allows to define a CustomAllocator for specific backends * Change IBackendInternal interface to use a shared pointer to a custom allocator * Update ClBackend.hpp/cpp to use the CustomAllocator * Adds an example application and unit test which uses a CustomAllocator for GpuAcc * Refactor of the interface to use MemorySource instead of the user Mapping cl_mem directly * Modify the BackendRegistry to also hold a registry of CustomAllocators * BackendRegistry Deregister will also deregister any allocators associated with that backend id * set_global_allocator within the BaseMemoryManager so that it always matches the currently used allocator Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I156d819686021865f4375e6cb7a5c5dec8fee9e8 Signed-off-by: David Monahan <david.monahan@arm.com>
2021-08-10IVGCVSW-6292 Allow profiling details to be switched off during profilingKeith Davis
* Add switch for network details during profiling Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I8bd49fd58f0e0255598106e9ab36806ee78391d6
2021-08-10IVGCVSW-6249 Add ProfilingDetails Macros to all workloads in CLKeith Davis
Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I92dd410da7ad633a46d025fdc2b26093041c439b
2021-08-10IVGCVSW-6249 Add ProfilingDetails Macros to all workloads in NeonKeith Davis
Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I7be77712a9f790928219ce91222d46cc766ab9dd
2021-08-10IVGCVSW-6289 Separate tensor shape inference and validation callsFinn Williams
* Pass m_shapeInferenceMethod to OptimizerOptions in ExecuteNetwork Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I90280fb7629092d3b66e8a3968ca9e35a0df854a
2021-08-09IVGCVSW-6119 ConstTensorsAsInput: FullyConnected Bug FixMatthew Sloyan
* Updated FullyConnected layer member variables when cloning as some backends still require them. * Added SetConstant call when using deprecated AddFullyConnectedLayer method to ensure backwards compatibility. * Added SetConstant to SimpleSample to ensure it runs on all backends. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ie7b4e4b868f23f8fcf9c41ffd12e2ea9ea53afca
2021-08-06Fix SimpleSample to use new FullyConnected APIFrancis Murtagh
* Remove deprecated code from public examples Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: Ia6c4f8d7f8c477b776d96e66085996487e8fdc75
2021-08-06IVGCVSW-5922 Update minor version for all parsers.Matthew Sloyan
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I3a3e5b017c307e374457b18712585dce210f8922