aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2023-01-17IVGCVSW-7402 Fix for Native crashes in Arm NNAPI SLv22.11.01branches/armnn_22_11_01Kevin May
* Instead of extending ArmnnDevice with ArmnnDriver make it a member * This will allow us to construct the ArmnnDriver and return a DEVICE_UNAVAILABLE NN_ERROR instead of segfaulting with the armnn::InvalidArgumentException if we cannot create a device Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Ibbcdbeb33dfd170dd1fb393204620e5b9e6342b8
2022-11-22Remove link to Crosscompile guide in the Doxygenv22.11branches/armnn_22_11Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I3362442456df2bc5ee71080238881b390a9029d8
2022-11-21Change name of AAR file in the Readme download pathNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Id5521e527b4b8d738acf673c4c51e54c80b71a74
2022-11-18IVGCVSW-7330 Add end-to-end dynamic sample build stepsJames Conroy
* Moving from other build guides which are being removed and/or consolidated. Provides steps on how to build the standalone backend unit tests using the build-tool. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I3994bffc9038632ab7271ac31db25a38157f2bb7
2022-11-18Update FAQ with GCC8.3 Tflite 2.10 IssueRyan OShea
* Inform users of potential gcc8.3 issue when linking against TfLite 2.10 Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: Ie58b7f8a9c11f9d5088c531ecffd4cc06a4ab7ca
2022-11-18IVGCVSW-7330 Fix build-tool args for Docker buildsJames Conroy
* This change requests users to supply a comma separated string of CMake/scons args so that they can passed down from Docker into the bash script correctly. * Updated documentation to reflect this. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: Icbd1d1458e11382936690ca6cc4417677e063ddb
2022-11-11IVGCVSW-7075 Update project number in DoxyfileNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ie1989cdf743eb9de87bae1ff19af75f28b49f762
2022-11-09IVGCVSW-7318 Support basic addition model in the TOSA Reference BackendRyan OShea
* Create Simple Addition EndtoEnd test * Create EndToEndTest file in TosaRef/test directory * Add AdditionEndToEnd test to CpuRef,CpuAcc,GpuAcc,TosaRef Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: Ic44e2b457c25dcb41bb3b17c05cce0e74bf17a80
2022-11-09IVGCVSW-7165 Implement TosaRefPreCompiledWorkload::Execute()Matthew Sloyan
* Added FP32 support for TOSA Reference Backend. * Added main block creation to OptimizeSubgraphView, this will only occur once. Change-Id: I169dac50b78e2c693da6327962c9f1d3ae3bd712 Signed-off-by: James Conroy <james.conroy@arm.com> Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com>
2022-11-08Update Readme files with newer versions of tools added during 22.11Nikhil Raj
* Flatbuffer version updated to 2.0.6 * Android NDK version updated to r25 * Removed cross-compilation guide as its been moved to build-tools * Android binaries updated in Readme Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ia7054707c9463d8ce8b344ec5d86fdd83424b2c3
2022-11-07Update ACL pin to 22.11 release branchNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Id32a970b0fe7a6af3b8d5e17a6f380b5e09341db
2022-11-04IVGCVSW-7333 Add missing TFLite Delegate operator support to documentationMatthew Sloyan
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Id7747e85119eb70254ad7795168ce31b137f2f49
2022-11-03Update ACL pin to 73f19af80aaee8929553739894b8dd8fedb163c3Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I54ec99383e723cd1323c1cce8cef6ed4fbde9f46
2022-11-02IVGCVSW-7164 Implement TosaRefBackend::OptimizeSubgraphViewMatthew Sloyan
* Added TosaRefBackend::OptimizeSubgraphView implementation. * Generalised TosaRefLayerSupport::IsLayerSupported to work with any operator. * Changed TosaCommon.hpp utils to inline functions. * Added source files for TosaMappings.hpp and AdditionOperator.hpp. * Fixed multiple defines issue with HALF_ROUND_STYLE and HALF_ROUND_TIES_TO_EVEN. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ib2576ec3fb97faa3a2256b2fb93ec16ac8745760
2022-11-02Fix TF Lite cross compile for build-toolJames Conroy
* Build Flatc only on x86_64 when cross compiling * Add Linux CMAKE System name Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: Ibd0f636b3cc149e0492d66330baf0e3707a9d3f7
2022-11-01IVGCVSW-6496 Add EndToEnd Layer test for Batch MatMul WorkloadTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I6a541db9a602609282cc6f33af930ca141b83c41
2022-10-28Update ACL pin to 910e3f9b686d16657e37d4c18f234b566c8deec2Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I6338fe09067a90ef2f52f252b3d5cf2c8810f3ff
2022-10-28IVGCVSW-7296 REDUCE_PROD tests fail when using Tf 2.10Teresa Charlin
* In TF what ArmNN calls quantized data types can be non-quantized as well. * This patch creates 2 models: * ArmNN: model where int8 and uint8 will always be quantized, but scale can be 1 and offset 0 * TFLite: model where int8 and uint8 can be quantized and non-quantized Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Id960f2f30988f2bbec88cb4e0c52c189ac957bae
2022-10-28IVGCVSW-6494 Add CpuAcc Batch MatMul Workload Fp32Teresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I2def6995f81d33e68f1ea45d8d19a1e6294049b1
2022-10-27IVGCVSW-7282 Issues in ExNet when iterations and number of inputs do not matchTeresa Charlin
* The intention is to keep the flexibility given by the ExNet before the refactor. * When iteration > inputFiles, we repeat the usage in order * When iteration < inputFiles, we just discard extra files. Signed-off-by: Adam Jalkemo <adam.jalkemo@arm.com> Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I2fbe69f8affe0e3a5cc86fc1748164967f0c2d64
2022-10-27Revert "IVGCVSW-7282 Issues in ExNet when iterations and number of inputs do ↵Teresa Charlin
not match" This reverts commit 6c95836e894f88c4bab6b22f974341f0dd2dddaa. Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I8be2147feb557a0849de5785fb63b464abc7dbb9
2022-10-27IVGCVSW-7273 Fix TOSA Serialization Library integrationMatthew Sloyan
* half.hpp is now required as an include for numpy_utils.h * DType_FLOAT was changed to DType_FP32. * DType_FP16 support has been added to ArmNNToDType utility function. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ib25be9a5abfbd9db2a90b3e42d592259a6df0e01
2022-10-27IVGCVSW-7273 Integrate TOSA Reference Model into Arm NNMatthew Sloyan
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ie9aa1aa20a5bc837e005a7a36d4d07b4cd8d021b
2022-10-26Update ACL pin to dc73246af4fec0b36ca3ae3d8e47f51561308309Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I9bc849ec3375c74647b637758e38fdb1870832b7
2022-10-25IVGCVSW-7282 Issues in ExNet when iterations and number of inputs do not matchCathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ib30fc633a10b6ff8090b50314278fe5dc46fb250
2022-10-24IVGCVSW-7126 Upgrade build-tool TensorFlow/FlatbuffersJames Conroy
* Upgrade FlatBuffers to 2.0.6. * Upgrade TensorFlow to 2.10.0. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I537141ccfea208e2ff5c16d76f288f477efd89f9
2022-10-24Make it optional to provide custom ACL to build-toolJames Conroy
* Currently, the build-tool requires the user provide both Arm NN and ACL repos, if providing custom repos. * This change allows the user to provide only a custom Arm NN repo, making a custom ACL optional in the case of --neon-backend or --cl-backend not being chosen in BUILD_ARGS. * Updated script help/usage and docs to reflect this. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I821f07dcd4c32ada60cd33713234b47c330d217e
2022-10-23IVGCVSW-7126 Modify odrer of Tf 2.10 librariesColm Donelan
* Modify the order of Tf absl libraries in delegate build. * Disable failing delegate unit tests. * Add -Wno-comment to delegate ExecuteNetwork build. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I9e4696e032a5e26df8ba578b980456cbac4d0ab0
2022-10-21IVGCVSW-7126 Update Arm NN to Tensorflow 2.10Colm Donelan
* Modify get_tensorflow.sh to point to the 2.10 Tensorflow tag. * Modify FindTfLite.cmake to handle the break up of libruy.a * Modify armnn_delegate.cpp to add registration_external field. * Prevent the serializer/deserializer from using a system installed version of flatc. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I688f33f387924ba29bf400f60e56f73b2329fdc1
2022-10-20Update ACL pin to 0a36f58e711a19040b1b65ef0afa83cce0c9dc4cNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I07fc2fc524452ff3631abe8aafd5993cb23a2258
2022-10-20Fix Building Support Library with NDK r25Kevin May
* Add flags -Wno-c99-designator and -Wno-unused-but-set-variable Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I7b1a1a353a0474d7ef967f6f3c8d13c36fa31844
2022-10-19MLCE-545 INT8 TFLite model execution abnormalKeith Davis
* Bug fix where files were being overwritten at each debug layer Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I609fdc82afcee925824efb02183c7dbc942fced0
2022-10-19MLCE-545 INT8 TFLite model execution abnormalKeith Davis
* Add functionality to print output tensors to file in tempdir * UnitTests Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: Idfb4c186544187db1fecdfca11c662540f645439
2022-10-18ExecuteNetwork: Fix output format issue for int8 when using -wAdam Jalkemo
Change-Id: I594ded82493e9cc48cafa6f00d63769fefba5afe
2022-10-14IVGCVSW-7267 Make the AllowExpandedDims option workJim Flynn
Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: I3573078206272c3a72a2b3acf8781ab458ea6c90
2022-10-14Update ACL pin to 299d3a1f51b68857a0742bf68cc2567dbdfaefe2Nikhil Raj
* Add scons option to generate Map files. Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ic1485f4f544ae1139e2475b95bc6d4f0d4791f02
2022-10-13IVGCVSW-7288 ExecuteNetwork fix for multiple outputsAdam Jalkemo
* When a model with multiple outputs was used and output to file, e.g. with "-w ./boxes,./classes,./scores,./detection", the results where not saved in the correct files. * Applies only to the ArmNNExecutor. Change-Id: I2899322622a4c3fd1d0ddc75b100b81669417660
2022-10-13IVGCVSW-7283 Use stricter file extension check in CreateParserAdam Jalkemo
* I had issues when folder name contained "armnn" and a .tflite model was used, as the wrong parser was selected. * Now only the extension, and not the full string, is considered when selecting parser. Change-Id: If7964d2ce5535f7d25762d2a2d7e810bf1a1ed43
2022-10-11IVGCVSW-7222 Fix incorrect kernel measurements in profiling outputKevin May
* Some CL kernels are not run after the first inference and this breaks the profiler which is expecting a measurement for every kernel each run * Add a function HasKernelMeasurements() to ascertain if the Event is returning kernel measurements and if so insert 0.0 values for any missing kernel measurements. * Fix ExecuteNetwork to only print a json object after all inferences have completed Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I99f2bb0db847f5a52ab4c5705b072155c6b6f333
2022-10-11Fix TosaOperatorMapping tests when building for releaseMatthew Sloyan
* Asserts are removed during a release build, which causes build failures due to unused variables. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ie36f2bd22f5b2916b03ba7e64c1895fdf21f11f0
2022-10-10Update ACL pin to 2ffab6dc8afb3716c189a30f75c33b2f2c35a6d4Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I6c712d6b817f87f3d3a996e11e81208e9449da9f
2022-10-05Update ACL pin to db14af697b934d684d8b3d63a00ad5bea5c07bfbNikhil Raj
* Update GEMM reshaped rhs only heuristic Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I3b7489c1133ed8ae03dbc7c1e30b1979d604f4ba
2022-10-05IVGCVSW-7122 Remove support for py35 in pyarmnn/tox.iniNikhil Raj
* As part of testing IVGCVSW-7122, pyarmnn tests were failing as py35 is no more the default version in Odroids. Also we do mention Python 3.6+ as the supported version in pyarmnn/README.md Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I39407ba8689fbb064c32841d16d66c5080acbc10
2022-10-04MLCE-609 Update PyArmNN Installation GuideRyan OShea
This reduces build steps to a single guide rather than providing multiple options - Remove Standalone build from documentation - Remove Wheel installation from documentation Signed-off-by: Ryan OShea <ryan.oshea3@arm.com> Change-Id: Ic1411eba5889434b2e1761ce2b9c8fdd2453b352
2022-10-04MLCE-545 INT8 TFLite model execution abnormalKeith Davis
* Signed32 missing from CompareAndPrintOutput Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: If3c93fb0d73c566ddcf439fceaa6d629029df18f
2022-10-04MLCE-545 INT8 TFLite model execution abnormalKeith Davis
* Fix for Debug mode in ExNet does not work with ConstTensorsAsInputs * Remove unnecessary assertion with ambiguous message in LoadedNetwork Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I9cd5d1f811dbbc89072d1190c510bf1b22e3069c
2022-10-03IVGCVSW-7227 Forward declare ILocalPacketHandlerSharedPtr in IRuntime.hppColm Donelan
* IRuntime.hpp includes one file from the profiling interface and it's causing some build problems for some users. Replace the include with a forward declaration of arm::pipe::ILocalPacketHandlerSharedPtr. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I6064e02db4ca056423bb448ddc0d712b50a704cb
2022-09-29Update ACL pin to ff81de5a9a0f6b9331c3b112cc2aed552f0482a9Nikhil Raj
* Fix overflow in NEActivationLayer for FP16 type Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I0f2e1609b8a46b69a9d83a4fa2cb6cf22af8c8d3
2022-09-28IVGCVSW-7209 Delay one release the removal of weights and biasTeresa Charlin
* This affects only to the layers (not workloads) Conv, DWConv and FC Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I66a91ed1a78bc0464e00423c7fc7c28c91d199ce
2022-09-27IVGCVSW-7235 Errors from LoadNetwork are being ignored in ArmNNExecutor.Colm Donelan
In ArmNNExecutor::ArmNNExecutor the call to m_Runtime->LoadNetwork was ignoring the Status result and continuing to execute with a failed network. In addition throwing an exception from the constructor resulted in a segmentation fault. * Modify IExecutor to allow the constructor to mark itself as failed. * Modify ArmNNExecutor to mark itself as failed when LoadNetwork returns an error. * Modify ExecuteNetwork to check the value of m_constructionFailed. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: Idf222cb2b66e1051875dc67046734f2b00b288d1
generated by cgit v1.2.1 (git 2.23.0) at 2024-05-17 09:41:20 +0000