aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2022-05-19IVGCVSW-6124 ConstTensorsAsInput: Convolution2dv22.05branches/android-nn-driver_22_05Keith Davis
* Add support for Android-nn-driver !armnn:7382 Signed-off-by: Keith Davis <keith.davis@arm.com> Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I7ace53cf1c8954c1f2d5588387616d7179ef3bf7
2022-05-09IVGCVSW-6127 Fixing seg fault in LayerInputHandleColm Donelan
* Fixing a segmentation fault when SanitizeQuantizationScale is called on a LayerInputHandle whose m_OutputSlot is nullptr. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I447c405086ff327a28a72938fbf82844d715a17d
2022-05-05IVGCVSW-6127 ConstTensorsAsInput: DepthwiseConvolution2dCathal Corbett
!armnn:7417 Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ic37d6b8677e040c60a90358dd0a4a8eb33fb6ea0
2022-05-04IVGCVSW-6806 Fixed issue with missing TensorInfos in UnidirectionalSequenceLSTMMike Kelly
* Corrected TensorInfo order for IsUnidirectionalSequenceLstmSupported * outputStateOut TensorInfo is not optional. * cellStateOut TensorInfo is not optional. * TensorInfo Order matches other QLSTM/LSTM layers. !armnn:7455 Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: I5b0e0fa4b6e1c3da6689d9aefc9b959172c2e7d4
2022-04-29IVGCVSW-6838 Disable Import/Export by default in the Android-NN-DriverDavid Monahan
Signed-off-by: David Monahan <David.Monahan@arm.com> Change-Id: If873ed691e1878e8b0c1dc52717b4418a178c72f
2022-03-31IVGCVSW-6732 Tests surrounded in '#if defined(ARMNNREF_ENABLED)' in ↵Cathal Corbett
android-nn-driver do not execute. * Change to ConvertionUtils.hpp fix ConcatTests_GpuAcc tests. !armnn:7300 Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I1543b57c6d1f9660916ca530b421c87e54b13f72
2022-03-23IVGCVSW-6706 Update header includes for new client profiling libJim Flynn
!armnn:7327 Change-Id: If4efc2195eb8713e98767fd4732ae9f4f2bfe09b Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2022-03-16IVGCVSW-6801 Add some timing information to ExecuteGraph.Colm Donelan
* Modify all versions of ExecuteGraph to include timing information. This can give a rough guide as to how much overhead the driver is adding. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: Ie168e060c22b8417efa2ede0c9bdc7ef2631b913
2022-03-08IVGCVSW-6649 Add Timepoints to Android NN DriverRyan OShea
* Added timepoints to ArmnnDriverImpl across all versions * Added ALOGV message to display time taken for prepareModel function * Added ALOGV message to display time taken for prepareModelFromCache function Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: I07f341099e81a0da45db0e8f575ba3c26631e024
2022-02-28IVGCVSW-6704 Change the namespace from armnn::profiling to arm::pipe in ↵Cathal Corbett
android-nn-driver !armnn:7222 Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ie7e3802a1a4a43abbb924a86d6608b77d19f327c
2022-02-21IVGCVSW-6700 Enable Import by defaultDavid Monahan
!armnn:7173 Signed-off-by: David Monahan <David.Monahan@arm.com> Change-Id: I642734b414a785f831e1a825790a78ee5078950f
2022-02-16Revert "Revert "IVGCVSW-6700 Enable import aligned host memory in ↵Narumol Prangnawarat
android-nn-driver"" This reverts commit 8069603dc44b7673b356f66517cd8b25af8080f0. * Reason for revert: Try reenable import aligned host memory in android-nn-driver * Added a check to ArmNNDriverImpl.cpp to not call ExecuteWithDummyInputs with GpuAcc * Added new android-nn-driver driver options to enable / disable Import and Export * Import is disabled by default for now due to conv2d issues * Export is enabled by default !armnn:7147 Change-Id: I91110c58ebb3931d1c458e3774944e55c1250dd8 Signed-off-by: David Monahan <David.Monahan@arm.com>
2022-02-16Document updatesNikhil Raj
* Added a note in the Integrator guide for the new error while building android * Removed boost from FAQs Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I1dc08bf2ff772550ac4e766bdf791301ea11cd5c
2022-02-15IVGCVSW-6783 Re-ordering DumpJsonProfilingIfRequired in ArmnnPreparedModelColm Donelan
* In the destructor of ArmnnPreparedModel, DumpJsonProfilingIfRequired was being called with a potentially null profiler. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: Id0d3a2403878fedc4e05dc498edb48d574232c71
2022-02-10IVGCVSW-6388 Update android-nn-driver NnapiSupport.txt for 22.02Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I8fbfa37b2ccd7066dc2dda6d595fe33eca79618b
2022-02-03Add Android S info to Integrator guideNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I4be1bda78c4343f8ccbb8df331538cb4f5d763a6
2022-02-02Revert "IVGCVSW-6700 Enable import aligned host memory in android-nn-driver"David Monahan
This reverts commit 8509422e1e7d629f88d6a5e4e4bded8a682f435b. Reason for revert: Reverting as this might be the cause of several segfaults on CI Change-Id: I902b4ddaec23dc46a2459f8512ec458e1aa722f3
2022-01-31Make ETHOSN backend disabled by defaultKevin May
* Use ARMNN_ETHOS_ENABLE variable to enable it Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I5465b7738556604367262cf9aa8e1ce6e01639b9
2022-01-28IVGCVSW-6700 Enable import aligned host memory in android-nn-driverNarumol Prangnawarat
!armnn:7025 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Iaa6112fb52d0f2942e6c52f90d96a8dc96000518
2022-01-25Cast Device and Driver in log message to unsigned longZingo Andersen
When building Android S this is during the build ending up as both unsigned long long and unsigned long, this makes the build break when building the tests. As both seem to be used during a normal build it will not help to just change the %ul to %ull as you get an error on that instead. This fixes so it's always printing with unsigned long. Signed-off-by: Zingo Andersen <zingo.andersen@arm.com> Change-Id: I1d1e4b8ab72c563a3b570f30112a7ce076f0a54e
2022-01-24IVGCVSW-6269 Add support of Unidirectional Sequence Lstm fp32/fp16 to AndroidCathal Corbett
* Unidirectional Sequence Lstm is supported in android-nn-driver. * CTS and VTS pass for Unidirectional Sequence Lstm if there are any without weights as inputs. If that isn't the case use the tests implemented in the android driver for LSTM. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ie3a237b67f5101c4f9a2c7bea796e9c674bedba1
2021-12-14Make it possible to add libs from armnn backends during linking for testZingo Andersen
Change-Id: I95e6a3819ba99e41883f9d64a0bd6ce8706a7a4f Signed-off-by: Zingo Andersen <zingo.andersen@arm.com>
2021-11-09Fixed Driver Crash in DumpTensorMike Kelly
* When handling Tensors DumpTensor was automatically trying to turn them into ConstTensors but then threw an exceptions when IsConstant returned false Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: I8681bb3dd41cfe19c60fbd1cc9394c8b6cca551e
2021-11-08IVGCVSW-5636 'Implement NNAPI caching functions'Sadik Armagan
* Fixed test failures. !armnn:6617 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I9989ece8999d67dd40dfcf69b73f4d80f71687a4
2021-11-04IVGCVSW-6420: Constant flag in tensor info is not set correctlyCathal Corbett
!armnn:6495 * Made fixes to 3 files ArmnnPreparedModel(_1_2/_1_3).cpp to set TensorInfo to constant in PrepareMemoryForInputs(). * Fixes made due to cts and vts failures in https://review.mlplatform.org/c/ml/armnn/+/6495 when a Tensor is passed to a ConstTensor without the TensorInfo isConstant parameter being set. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Iee179586652f365665a22f1e3409c1488c2d8bb3
2021-11-04IVGCVSW-5636 'Implement NNAPI caching functions'Sadik Armagan
* Cached serialized ArmNN model. !armnn:6384 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I78120a7f8ea892a28c0ff25f1b54e67a4f912574
2021-11-04IVGCVSW-6430 Clear up coverity issuesMike Kelly
* Removed unreachable code * break after if else where both branches return * Removed unused operations * Result of dstPtr++ is unused * Fixed possible overflow * Axis dimensionSequence assignment can result in overflow where rank is not 4 * Removed use of old-style casts * Fixed spelling mistakes in error messages Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: If2a7ab63fc1d200cb18b494d99a67bbddb42f0f8
2021-11-03Make it possible to add libs from armnn backends during linkingZingo Andersen
Signed-off-by: Zingo Andersen <zingo.andersen@arm.com> Change-Id: I95e6a3819ba60e41885f9d64c0bd6ce8706a7b1e
2021-11-02IVGCVSW-6035 Update android-nn-driver NnapiSupport.txt for 21.11Teresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ic82d8ac6461e404f41e8888336e8d7514bef6433
2021-11-02IVGCVSW-6515 Restricting CpuRef LSTM tests to run only when CpuRef is enabledTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Icabc39559efd9e621657eb48454fe52155e8c9ff
2021-10-22IVGCVSW-6440 Enable internal profiling of Optimizer in Arm NN DriverKevin May
Signed-off-by: Kevin May <kevmay01@e126674.cambridge.arm.com> Change-Id: I92334f3215160ccdd3eb974456a6400bced42065
2021-10-14IVGCVSW-6428 Remove assertsMike Kelly
* Changed asserts to check for errors and return appropriate values or throw exceptions * Changed unit tests to use Doctest's long macro names as the short macro names clashed with Android's Logging macros * Removed unused #includes * Clarified ambiguous #includes Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: Ice92a37590df727fd581d3be5ff2716665f26a13
2021-09-28IVGCVSW-5985 Remove deprecated codeJan Eilers
!armnn:6254 Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I728048874839cddedc8421233294d51d7f3e2415
2021-09-23IVGCVSW-3715 Add Channel Shuffle supportTeresa Charlin
!armnn:6211 Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ie5e5d160f6d826c30f1fff298a4a73151c1ccdbb
2021-09-03android-nn-driver getType returns the right devicePablo Tello
* ArmnnDriver queries the options and returns CPU or GPU depending on which is the first backend listed in the options * Resolves MLCE-401 Change-Id: If4e63e144507e817449f37926711fa325861b57d Signed-off-by: Pablo Tello <pablo.tello@arm.com>
2021-09-02IVGCVSW-6262 Add support for Reduce ProdTeresa Charlin
!armnn:6053 Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I678be047c0919d98dbd22d22f4c1fd1ea80ea0b7
2021-08-11IVGCVSW-5919 Update android-nn-driver NnapiSupport.txt for 21.08Matthew Sloyan
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I2006f1d696d155742227eed940d7d97ed9385a66
2021-08-10BugFix: Fix skipping VTS tests.Matthew Sloyan
* Some tests on GpuAcc and CpuAcc P & Q were skipping because IsConstant flag wasn't set on TensorInfo passed to validation function. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Idd977bf621b71bb9625d8fc6620c29915de4b431
2021-07-27IVGCVSW-6158 ConstTensorsAsInput: FullyConnected - ToolsMatthew Sloyan
* Constant weights and biases are now stored as Constant layers. !armnn:5942 Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I867a696eb684df2d0d5f7db8dd9c38933445f388
2021-07-23IVGCVSW-5354 Fix skipped VTS DynamicOutputShape ComparisonTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I2c3f5f2a638bf99e379f91b9d1d1c99d491a0153
2021-07-19NNXSW-3081 Move Filesystem.hpp and Threads.hpp to public includeRob Hughes
!armnn:5954 Change-Id: Ic2904a0ccbcf24b30041a55d9c369c2424da1624 Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2021-07-15IVGCVSW-5965: Remove the boost library from android-nn-driver build files.Sadik Armagan
* Remove all references to boost from the android-nn-driver build files: !armnn:5811 Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I7df7d815e658a52acf3e32305bc300dfaf9a1fe4
2021-07-12IVGCVSW-6062 update ArmnnPreparedModels to have a single static instance of ↵Finn Williams
the threadpool Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: Ie350a11eab5d677dd6a5571ea4094aa51b23c501
2021-06-25IVGCVSW-6178 Add additional compiler warnings to the driverFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I2209251736a095583fffc8da774188e0dccfc932
2021-06-25IVGCVSW-6178 Fix Wsign-compare error in android driverFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I7cb21e18a7031b8cfe579046b33ad0491aa5c629
2021-06-23IVGCVSW-6062 Rework the async threadpoolFinn Williams
!armnn:5801 Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I9964d0899ce752441f380edddbd974010257b2dd
2021-06-17IVGCVSW-5943 Updates for latest AndroidKevin May
* Use the correct method to get memory size * Remove extra line that was a pre-existing typo Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I807fc6b5d6fe32b28975ae2a98a6179712c26a96
2021-06-16IVGCVSW-6088 Add Sin and Log to ElementWiseUnaryTeresa Charlin
!armnn:5755 Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I82dc434ee9bfff452ec6c27527a5b3f91ebfe2ea
2021-06-16Add QUANT8_ASYMM_SIGNED in PadV2 for HAL1.3Teresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I597344d91975d7067f137e6587b751500de33837
2021-06-12IVGCVSW-5826 Change weights layout for depthwise to [1,H,W,I*M]Jan Eilers
!armnn:5552 Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I5bbc998f1a29030f718d85b646907c5a314ceecf