aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2022-09-20IVGCVSW-7040 TfLiteParser fails to prepare model due to unspecified size ↵Cathal Corbett
buffer data for Slice operator. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I86735faf8d57168a63ca6657f281ec03b90f7235
2022-09-16Use ARMNN_VERSION for Support Library versionStringKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I6f2b52f7277215c97be3d53969a9eaef137e3636
2022-09-15Make SubgraphViewSelector give deterministic resultsRob Hughes
The subgraphs produced by SubgraphViewSelector were not produced in a deterministic order, as the order was determined by the pointer values of some objects, which are not guaranteed to be the same for each execution. This patch adds a post-processing sorting step based on the GUIDs of the layers and the slot indices so that the results will be the same for each execution. This makes debugging the optimised graph much easier as subsequent stages can also be deterministic. It also simplifies some unit tests. Change-Id: I64f552706b7fb1bf82c19d85a448e054277917bc Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2022-09-14Update ACL pin to a4814e8394ffdd7e268614d54cc22e30648f48ffNikhil Raj
* Add test case for disable Winograd on fp16 if fast-math = false Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Id4543f566a095c5822aa0f7df5ad9af4c4bd739e
2022-09-09Update ACL pin to e4e3b2ead5b6720af8039f3c9ac15ea6b51b915fNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I3f0637b4b2911c9cf314b3459ff84e959e467073
2022-09-08Fix misspelling in get_compute_library.shJames Conroy
Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I61096136abba9c8c6b9c4c7c5ade4156cb49c8c0
2022-09-07IVGCVSW-7201 Generalize get_compute_library.sh usageJames Conroy
* Allow user-specified directory name for the ACL repo (other than 'clframework') with the '-n' option. * Fix indentation. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: Iadec158bd9469fbc0d0875b085a5702e4a89ae83
2022-09-07IVGCVSW-7159 Implement simple TOSA Reference Backend skeletonFrancis Murtagh
* Added files based on RefBackend * Added PreCompiled Workload skeleton * Increment ABI version of armnnTestUtils for CreateInput which had been left as pure virtual, added base implementation for it. * Add IsTosaLayerSupported() for Addition Change-Id: I4c963adf3f50593d17ecdf21554502a64ad3bd76
2022-09-07IVGCVSW-7209 Remove deprecated code due to be removed in 22.11Teresa Charlin
* Files deleted when Stabilizing the API Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I0ae73ee36968fa880761c10358bfa827be5fe054
2022-09-06IVGCVSW-7155 SubgraphView::SubstituteSubgraph IOutputSlots incorrectly ↵Cathal Corbett
overridden Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: If594e291951a5f9ed1957a19a971c498f6e7843f
2022-09-06Remove branch switch announcement from main Readme fileNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ief9171e77306f4392481beac1b3e413c08797532
2022-09-06IVGCVSW-7006 Remove deprecated code due to be removed in 22.08Teresa Charlin
* AddConv and AddDWConv with weights and bias * ResizeBilinearDescriptor * b,blacklist option in accuracy tool !android-nn-driver:8172 Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ibbc04fd18be7f938b11590bf67cd7af103cb4d99
2022-09-06IVGCVSW-7088 Update CONTRIBUTING.md with main branchCathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I89636c3f693cc5ace5c686cea1cedefaddc57867
2022-09-05Update ACL pin to 552fe4c67d3cd2994cdbd5662cde79da5caf0c4dNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I45d26029c90f80afb79bc1e6a4360a263f61df95
2022-09-05IVGCVSW-6497: BatchMatMul TfLite ParserSamuel Yap
* Added armnnTfLiteParser for BatchMatMul * Added unit testing for parser * Updated CMakeLists Signed-off-by: Samuel Yap <samuel.yap@arm.com> Change-Id: If6842aaf7cf08f688093b714e2ecea6e8cd87161
2022-08-30IVGCVSW-7104: BatchMatMul Serializer/Deserializer SupportSamuel Yap
* Updated FlatBuffers schema for BatchMatMul layer type * Added Serializer and Deserializer implementations for BatchMatMul * Added unit tests for BatchMatMul serialization and deserialization * Updated CMakeLists and docs Signed-off-by: Samuel Yap <samuel.yap@arm.com> Change-Id: Iad63afbd036a3eb648683eb7416a475561aa20cb
2022-08-30IVGCVSW-7105: BatchMatMul Optional Parameter SupportSamuel Yap
* Added transpose parameters to pre-transpose each input tensor's slices * Added adjoint parameters to pre-adjoint each input tensor's slices * Small refactoring (BatchMatMulDescriptor static helpers and BatchMatMulImpl constructor) * Updated input validation and output shape inference for parameters * Additional layer unit tests for parameters added * Versionings incremented Signed-off-by: Samuel Yap <samuel.yap@arm.com> Change-Id: Ibe5242a8a5bf604c13de0dc65844fd6c421cc667
2022-08-30IVGCVSW-7133 Add TosaMappings backbone structure with support for Addition ↵Cathal Corbett
TosaMappings operator. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ibea0cf625b3af4ab38e8b985f7a129c983ca9659
2022-08-30Update ACL pin to a331e48ad8a4856837cf0afdd44de69af43581afNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I12f2993d6e7476f9d9cb4590de9ac40bc6dd6449
2022-08-29IVGCVSW-6779 Add build-tool Docs and update docsJames Conroy
* Added Arm NN Build Tool README.md and license. * Added Dockerfile diagram image and license. * Updated existing guides: added note to the cross compile guide to use build-tool, removed content from the Delegate BuildGuideNative.md. * Added Arm NN logo image to homepage README.md and added license. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I9306ad24165cf3b0203c2a1852ec3afd718e9eab
2022-08-29IVGCVSW-6603 'Add a no fallback mode to the TfLite Delegate'Sadik Armagan
* Added disable-tflite-runtime-fallback option to armnn_delegate * Updated armnn_delegate version Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I449b16404d3ffe98e6dac52a43e7c25225addd73
2022-08-29IVGCVSW-7106 Additional fix models with multiple input and output tensors.Colm Donelan
* The previous fix for IVGCVSW-7106 introduced a problem around operators with multiple inputs and outputs: addSeparator was being applied to all tensors in the list not just the last one. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I0325d9abcb7fb512f834c61686c698bbfc29a3be
2022-08-29IVGCVSW-6954 'Arm NN SL Improvements'Sadik Armagan
* Move the Conv2D and DepthwiseConv2D validation to Optimization level when the weights and tensors are as constant inputs * Take into account offset and scales values when doing INT8 to FP32 dequantization Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I1f81f15640395ac041923b10dbe9151159715117
2022-08-29IVGCVSW-7140 Produce map file for AndroidNN build for debug and release.Cathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ib4433767ba8bd3282a9b19c2a85ff1a6e7e83df5
2022-08-29Fixing documents for 22.08Nikhil Raj
* Fixed broken links * Updated link to bazel guide * Fixed versioning issues in packaging doc * Updated paths to binary files Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I6120bb2dd56d55a994cd12d99bed054ce4d7c058
2022-08-29IVGCVSW-7106 Incorrect Json format for some networks.Colm Donelan
* ProfilingDetails assumed that every workload description included both tensors and parameters. This is not always the case. * Modify ProfilingDetails::AddDetailsToString to check the next element to be printed before deciding to add a separator and new line. Signed-off-by: Colm Donelan <colm.donelan@arm.com> Change-Id: I2577b0e8a149d0a172ee12975e18b78238d8256e
2022-08-29Bug Fix for refactor of the ExecuteNetwork for strategy in Precompiled layer.Teresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ib91b734d4add47e23ad00f76e53f1873ff617831
2022-08-29IVGCVSW-7154 'Constant Tensors As Inputs'Sadik Armagan
* Fixed the issues about converting Conv2D and DepthwiseConv2d input issues * Read 1D input tensors that do not have shape specified Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I12f3d1c57a2afedac42c6e7b31e4b1fc689abeca
2022-08-05IVGCVSW-7179 Segfault running ssd_mobilenet_v2_int8 with ExNet and delegate.Teresa Charlin
* model was declared in the TfLiteExecutor constructor, instead of intializing m_Model * Working with this model that has 4 output we saw the the output names were not correct, this got fixed too Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I48f194ad4ba6af43d43e6eea336eb87ffee02dcc
2022-08-05IVGCVSW-7103 ExecuteNetwork failed while doing Yolov4 executionNikhil Raj
* Adding the check only if it's not a const layer which is needed to run ai_benchmark_v5_yolo_v4_tiny_quant.tflite model * We still won't be able to run the model due to IVGCVSW-7158 Signed-off-by: Nikhil Raj <nikraj01@e126673.cambridge.arm.com> Change-Id: Ib7e77a0b5a64be0c92a8e4eae45729f799770b37
2022-08-05IVGCVSW-6777 Add Arm NN build-tool DockerfileJames Conroy
* Adds Dockerfile associated with Arm NN build-tool scripts. * The Dockerfile encapsulates the installation of system-wide packages (install-packages.sh), download/install of Arm NN dependencies (setup-armnn.sh) and the building of Arm NN and ACL (build-armnn.sh). * A helper script for copying build contents from the built Docker image is provided for by docker-copy-to-host.sh. * Modified existing scripts: moved the cloning of Arm NN and ACL from setup-armnn.sh to build-armnn.sh and decoupled setup-armnn.sh from scripts outside of build-tool directory e.g. armnn/scripts/get_tensorflow.sh. * The build-armnn.sh script clones the latest release branches of Arm NN and ACL by default. Custom repos can be placed in the build-tool directory prior to 'docker build' and they will be used instead (advanced usage). * Support added for Linux targets only, Android to be added in future work. Signed-off-by: James Conroy <james.conroy@arm.com> Change-Id: I336013cf93821d2cd3e5d9fe2ca4e955ffdd2386
2022-08-05IVGCVSW-6777 Replace old Dockerfile with build-toolJames Conroy
* Removed old Dockerfile and associated docs. * Keeping README as it currently ranks highly on web searches for "armnn docker" and providing a link to new alternative Arm NN Build Tool. Change-Id: I0ce79cedffa035728e394c116912f36481804931 Signed-off-by: James Conroy <james.conroy@arm.com>
2022-08-05IVGCVSW-7157 ExNet. interpreter chooses a different input type.Cathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: If00d8dab2846c484a1969fb152cb9f8bd16e1b3e
2022-08-05Update ACL pin to 22.08 release branchNikhil Raj
Signed-off-by: Nikhil Raj <nikraj01@e126673.cambridge.arm.com> Change-Id: Ica451b6e4b2f8dd474f1e216d0cb38163a7d2953
2022-08-05Update PROJECT_NUMBER in Doxyfile for 22.08Nikhil Raj
Signed-off-by: Nikhil Raj <nikraj01@e126673.cambridge.arm.com> Change-Id: I2446013092221f3016f8d2d57256ea0f384d0cec
2022-08-05IVGCVSW-7062 'Gpu Tuning does not work with TfLite Benchmark tool'Sadik Armagan
* Load the tuning file when GpuAcc is selected as a backend. Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I1d6b0237a87301f07681293a2c6dbc37e352dd28
2022-08-05Update ACL pin to f67903b8ab8205b47f0ee2c27aeca8bed405c58eNikhil Raj
Signed-off-by: Nikhil Raj <nikraj01@e126673.cambridge.arm.com> Change-Id: I849476ac201c151a9c2087bab03af1fc67732bce
2022-08-05IVGCVSW-7089 Add LICENSE.spdx for Arm NNJim Flynn
Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: I6e5f41a7a4432f448156755389c108692b7213e2
2022-08-05IVGCVSW-7111 change backend deprecation from 22.11 to 23.08Jim Flynn
Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: I3a3aab7b5042349cb2df8517678306665e037610
2022-08-05Bug Fixes for refactor of the ExecuteNetwork.Teresa Charlin
* dot file to be generated when -v is given. It was only being generated when using the delegate as executor * output name read from m_Params.m_OutputNames instead of m_TfLiteInterpreter * typo: "delage" instead of "delegate" * QAsymmS8 templated as int8, instead of uint8 Change-Id: Ie13ae0f7e6395c0ebcb5ecda32e72082dee8aa6c Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Iac97a23927ba42290ebeb3446bbd36da15045e07
2022-08-05Update ACL pin to 3c4d085da54c3d9727cb31718c5b407c18ff646aNikhil Raj
Signed-off-by: Nikhil Raj <nikraj01@e126673.cambridge.arm.com> Change-Id: Ibd6f971f275c115f97a0d8338f6e7770790f2e67
2022-08-05Fix '#if defined(ARMNN_POST_TFLITE_2_3)' in TfLiteParser Conv3D test.Cathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I5c68b81a67fc2b5a33cf62753351440564bb868e
2022-08-05IVGCVSW-6992 Update Major, Minor release versions for 22.08Cathal Corbett
Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ic134f73f217fff420fec089cd817e48ef62641c6
2022-08-05IVGCVSW-7145: BatchMatMul Fix for Raspi Cross Compile FailingSamuel Yap
* Changed long variable declaration to int Signed-off-by: Samuel Yap <samuel.yap@arm.com> Change-Id: I2df6f8f6df8780e48e09f7e68c04626a8a8a207d
2022-08-05IVGCVSW-6889 Seg fault running ExeNet with --bf16-turbo-mode on fpgaFrancis Murtagh
* Added case for Bf16 to switch and changed Assertion to Exception so it shows up in Release build. Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I817260dc7b7667386c4aa734bea649383866a785
2022-08-05IVGCVSW-7063 'Support Library NNAPI Caching'Sadik Armagan
* Fixed caching issue. Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ic7b3e0bd4438b2fd1b3dbfa86b6c89d625bbf9dd
2022-08-05Update ACL pin to 9b921be1ff7283050eb39d9ce1b10b5c8bfc1300Nikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Iecfb4ef0f821f71aaf16c6f3c80f26a4c39f2e3a
2022-08-05IVGCVSW-7149 FoldPadIntoQuantizedAvgPoolCpuRefTest test failing while ↵Cathal Corbett
running Arm NN Unittest Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: I567452000287babad345e61ea85ea84f362f48e0
2022-08-05IVGCVSW-7147 Bug Fix for refactor of the ExecuteNetwork for strategy in ↵Teresa Charlin
ConvertLayers. * ConvertBf16ToFp32Layer * ConvertFp16ToFp32Layer * ConvertFp32ToBf16Layer * ConvertFp32ToFp16Layer Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: I5e763519a12f017dc14b09ea191fdb3b7398c0d7
2022-08-05GitHub #667: Neon fold padding into average pool 2D quantization bug fix.Cathal Corbett
* Originated from a GitHub issue: https://github.com/ARM-software/armnn/issues/667 * Initially, Arm NN supports the pool 2D operation because there is no padding on the pool2d. Neon failure occurs when padding is followed by average pool 2D due to folding optimization. * Here we prevent the folding optimization from happening for the above special case and add it in as a backend specific optimization. Signed-off-by: Cathal Corbett <cathal.corbett@arm.com> Change-Id: Ia0fd90c3a6b4b9d29c81106f154617d2e893e26b