aboutsummaryrefslogtreecommitdiff
path: root/delegate
AgeCommit message (Collapse)Author
2021-04-21IVGCVSW-5842 Remove cross-wiring in depthwiseJan Eilers
* Reading tensor infos won't allow a permutation vector anymore. The permutation only changed the quantization dimension not the shape and was therefore misleading * The permutation of the full tensor info is now performed in armnnUtils::Permuted * Changed TfLite Parser depthwise parsing function * Added unit tests to TfLite Parser with more random data * Changed TfLite Delegate depthwise parsing function * Added unit test to the delegate with per channel quantization !android-nn-driver:5412 Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I1f985ee69547bcaf16a72201e00a6b6fe1ef9a97
2021-04-19IVGCVSW-5829 Segfault in TfLiteDelegateMatthew Sloyan
* Updated Split function to read correct axis data. * Improved validation in Split and SplitV function. * Moved ComputeWrappedIndex function to DelegateUtils.hpp. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I8c7d0c9b747d1ab548df98da930d838c2f57659e
2021-04-09MLCE-328 Serializer/Deserializer does not support Signed64Mike Kelly
* Added support for Signed64 to flatbuffer's schema & updated source tree * Added support for Signed64 to TFLite Delegate * Added support for Signed64 to Serializer * Added support for Signed64 to Deserializer * Added unit test for ArgMinMax to Deserializer * Deprecated m_Output_Type from the ArgMinMaxDescriptor: the output type is solely determined by the DataType of the output Tensor * Fixed issue where RefArgMinMaxWorkload could output data using the wrong DataType * Added Signed64 to RefLayerSupport::IsArgMinMaxSupported as a supported type Signed-off-by: Mike Kelly <mike.kelly@arm.com> Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ib622c052a1f8aa3e658262f8bde5a6881a8cbe10
2021-04-09IVGCVSW-5803 Delegate Unit Tests Failure on Android: Normalization & SoftmaxKeith Davis
Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I2873f8563cc11da550d460b04e5175372489a564
2021-03-25IVGCVSW-5736 and IVGCVSW-5743 'NonConstWeights: Update front-end and ↵Sadik Armagan
TfLiteDelegate support for FullyConnected Operator' * Added front-end support for non-const weights for FULLY_CONNECTED operator * Added FULLY_CONNECTED end-to-end test * Updated FULLY_CONNECTED operator support in TfLite Arm NN Delegate for non-const weights * Updated the version numbers Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Iffa5b9aa9297aca4c02d923cce4636c88ac21faa
2021-03-05IVGCVSW-5401 Remove unused variable.David Monahan
Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: I127e6923f257bb4094485aa1716ead1067cf8d34
2021-03-03IVGCVSW-5612 Fix tiny_wav2letter_relu_fixed_int8 delegate outputexperimental/abi-testsFinn Williams
* fix delegate perchannel quantization * change delegate to check reshape options before inputs * Add int8 "qsymms8" option to ExecuteNetwork * Add option to run ExecuteNetwork on tflite w/o delegate !referencetests:301301 Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: If3e12599b17aff1199d7ab0a55e1c901e480083d
2021-03-03Point readme files to latest doxygen documentationJan Eilers
* excluding our top level readme Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I45b156c248178a141b8497dcc4d09148b67bf406
2021-02-25IVGCVSW-5401 Implement the FILL operatorSadik Armagan
* Added FILL operator to TfLite ArmNN Delegate * Added unit tests Signed-off-by: David Monahan <david.monahan@arm.com> Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I335ef469ff773fa4305eb87f6e93ae9c03fc6997
2021-02-18IVGCVSW-5394 TfLiteDelegate: Implement the Lstm operatorMike Kelly
* Add LSTM operator Signed-off-by: Mike Kelly <mike.kelly@arm.com> Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: If8c667685fa1176738ffe2e6d08b1c684e7ee6b2
2021-02-17IVGCVSW-5654 Fix failing float 16 delegate tests on androidFinn Williams
* add template specialization declaration to header to resolve clang issue Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: Id8104d6feda19ed3f5f0cb018d719b1677772d9b
2021-02-15IVGCVSW-5694 Update Major, Minor release versionsNikhil Raj
* Update Arm NN version in Version.hpp and all guides * Change Project Version in Doxyfile Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: I05ab20a1ae5d0376a641df68a5877f97e7609052
2021-02-15IVGCVSW-5686 Add GpuAcc MLGO tuning file configuration argumentFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I3f320499c379162f9d1b00cc8816bd144cd7eee4
2021-02-15IVGCVSW-5386 TfLiteDelegate: Add Strided Slice operatorJan Eilers
Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Icd87b1c54e1a5de84893882da30840a9097f6d84
2021-02-12IVGCVSW-5685 Add CpuAcc specific configuration option numberOfThreadsMatthew Sloyan
* Added ability to set number of threads used in CpuAcc backend * Enabled number-of-threads option in ExecuteNetwork * Added TfLiteDelegate ModelOptions test * Added unsigned int type to BackendOptions.hpp Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ia576d4f45cbe5df3654bc730bb5ebd5181d82b5a
2021-02-11IVGCVSW-5392 TfLiteDelegate: Implement the Batch/Space operatorsMatthew Sloyan
* Added support for BATCH_TO_SPACE_ND and SPACE_TO_BATCH_ND Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ib29333f3e2bc1a18bcc63533da4369b63c45ab90
2021-02-10IVGCVSW-5400 'TfLiteDelegate: FLOOR operator support'Sadik Armagan
* Added FLOOR operator support to Arm NN TfLiteDelegate Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I986ce8c5a825f509e0f8b3d257fd5b60834c322f
2021-02-09MLCE-347 'REDUCE_MIN, REDUCE_MAX, REDUCE_SUM Support'Sadik Armagan
* Added TfLiteParser support for REDUCE_MIN and REDUCE_MAX operators * Added ACL workloads support for REDUCE_MIN, REDUCE_MAX, and REDUCE_SUM operators * Added TfLite Delegate support for REDUCE_MIN, REDUCE_MAX, and REDUCE_SUM operators Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I8085d59946bfd4ab78a59a61f899031ae53371a8
2021-02-08IVGCVSW-4901 Add semantic versioning to Parsers and TfLite DelegateMatthew Sloyan
* Added Version.hpp to all Parsers * Added Version.hpp to TfLite Delegate * Updated CMakeLists to use new versions * Added GetVersion method to parsers and TfLite Delegate Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: If29e1e6d9e615f9095ec1c01ad47acfff40b1dd5
2021-02-04Remove LFS configurationNarumol Prangnawarat
* Remove LFS configuration * Add mock test models for external delegate Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I9f5b427a995aff22391548cd45821cb2afc8a474
2021-02-03Fix LFS issueNarumol Prangnawarat
Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I6b3321cf0d51c06b742432995ea486c987806afc
2021-02-03IVGCVSW-5605 Doxygen: Add the TfLite Delegate to Doxygen docuJan Eilers
* Moves TensorFlowLiteDelegateSupport.md to doxygen * Renames a few .dox files to represent the structure of the documentation * Adds sections for build and use guides * Integrates markdown guides for the delegate into doxygen Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I68b7a29239be88c0617da9bdfce5323ebf26f5bc
2021-02-02IVGCVSW-5619 Enable OptimizerOptions for the python external delegateNarumol Prangnawarat
* Add reduce-fp32-to-fp16, reduce-fp32-to-bf16, debug-data, memory-import options to external delegate * Simplify DelegateOptions * Add test mock models * Unit tests * Configure lfs to manage tflite files Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I1e4db468862ba03d4cb031347bc307cf940b3cb1
2021-01-31IVGCVSW-5374 Provide Android Build for DelegateKeith Davis
Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: Ie8c03153f82434d73572278eedb8a4b5b89ed837
2021-01-28IVGCVSW-4874 Provide LayerSupportHandle to frontend usersFrancis Murtagh
* Add test for new IsBackendRegistered member function of Handle * Move deprecated messages to new frontend API of LayerSupportHandle * Update delegate to use dot operator for IsXXXLayerSupported Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: I70d7166e207a10e4b3583a827ca0dda2169bcba1 !android-nn-driver:4940
2021-01-28IVGCVSW-5374 Provide Android Build for DelegateKeith Davis
* Remove double brackets for scalars * Add in extra location in cmake for tf lite dynamic library Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: I31ef9a955d4677faabedc0068ae2cfbfe570b58c
2021-01-26IVGCVSW-5391 'ArmNN TfLiteDelegate: Implement the Space/Depth operators'Sadik Armagan
* Added DEPTH_TO_SPACE and SPACE_TO_DEPTH operators support Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I2595f759181bd7339127e7b114b850b534210dd5
2021-01-26IVGCVSW-5390 'TfLiteDelegate: Implement the Normalisation operators'Sadik Armagan
* Added L2_NORMALIZATION and LOCAL_RESPONSE_NORMALIZATION opertor support Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ic9e66879cf6469fa8761fb1c9dd5950771f629b0
2021-01-25IVGCVSW-5619 Add OptimizerOptions and NetworkProperties to ArmNN DelegateNarumol Prangnawarat
* Add OptimizerOptions, NetworkProperties, DebugCallbackFunction to DelegateOptions * Enable OptimizerOptions when the network is being optimized * Enable NetworkProperties when loading network * Enable DebugCallbackFunction * Add error message when loading network * Log warning instead of error when operator is not supported but could fallback to another backend * Improve uint16_t CompareData * Unit tests Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I353035afb442774bfeb1c62570a90755c2ceaf38
2021-01-22IVGCVSW-5571 Expose the TfLite Delegate to the TfLite python APIJan Eilers
* Implemented external delegate adaptor interface for TfLite * Activated armnn logging for delegate * Added logging info to indicate if gpu tuning is turned on * Added pytests to ensure functionality of the external delegate adaptor * Included the delegate directory into doxygen * Added documentation on how to use the external delegate in python Signed-off-by: Finn Williams <Finn.Williams@arm.com> Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Id3b4588fb0b9ac7e3f47ba2c19feead7beb58e18
2021-01-19IVGCVSW-5399 'TfLiteDelegate: Implement the ArgMinMax operators'Sadik Armagan
* Added ARG_MIN and ARG_MAX support to armnn_delegate Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ia000c4b64378e28320164edd4df2902ca13dcda6
2021-01-13IVGCVSW-5625 Add support for Float16 to DelegateNarumol Prangnawarat
* Float16 unit tests for Reshape * Remove unsupported data type from Pad Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ib1804bb6e708a0552fb40d05fe8a6511936f9793
2020-12-17IVGCVSW-5383 TfLiteDelegate: Implement Pad and PadV2 operatorsNarumol Prangnawarat
* Add Pad and PadV2 operators support to Armnn Delegate * Add dimension check to CompareOutputData test utility * Unit tests Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I9d00eb08f71e791498908fcbdb9de561e1c01aef
2020-12-17IVGCVSW-5374 Provide an Android build for the delegateFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I33eb8c650be654ad891afd2295f2057f13a9d084
2020-12-17IVGCVSW-4625 Add CL Rank WorkloadDavid Monahan
* Added CL implementation of Rank Workload * Removed references to memcpy_s as it's a windows only function Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: Ia63666b9640d76a775f2ab98b3cd7e9f77b5a507
2020-12-17IVGCVSW-5614 Enable Hard Swish and Elu activationsMatthew Sloyan
* Enabled Hard Swish and Elu in TfLiteDelegate * Added support for Elu in TfLiteParser Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: If09321b58568a98e14cabce610a1586556da041e
2020-12-08IVGCVSW-5560 Fix TfLiteDelegate Reshape operator failureMatthew Sloyan
* Fixed issue when running certain models with 2D shape tensor. * Falls back to inbuilt options if encountered. * Fixed ExecuteNetwork so that error messages are logged if NULL. * Updated TfLiteDelegate docs to include Logical Operators. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Signed-off-by: David Monahan <david.monahan@arm.com> Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I5dbaf30351f7fc86e6178a0caf46c152812088d3
2020-12-07IVGCVSW-5381 TfLiteDelegate: Implement the Logical operatorsMatthew Sloyan
* Implemented Logical AND, NOT and OR operators. * NOT uses existing ElementwiseUnary VisitLayer function & tests. * AND/OR uses new LogicalBinary VisitLayer function & tests. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I5e7f1e78b30c36ac7f14c70a712b54f98d664b83
2020-11-30IVGCVSW-5587 Remove Tensorflow requirement from Arm NN TfLite delegateFinn Williams
* Added support for building the delegate with an external armnn path * Replaced potentially troublesome package manager * Explicitly set the privacy levels of delegate libraries * Fixed some error handling in ExecuteNetwork Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I2a7abc099796012cbb043c5b319f81778c9f3b56
2020-11-30IVGCVSW-5374 Provide Android Build for DelegateKeith Davis
* Fix Arm Android Compiler errors Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: If5fae0fda08b6102eb46217564a096f87a3b6740
2020-11-30IVGCVSW-5393 'TfLiteDelegate: Implement the split operators'Sadik Armagan
* Added SPLIT and SPLIT_V support to armnn_delegate Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I2def9b8be783b25ef17a997e521c6027553035d3
2020-11-26IVGCVSW-5384 TfLiteDelegate: Implement the Gather operatorTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Iaf2112363d2b191327711d8e083fee2a751c35c5
2020-11-26Bug fix TfLiteDelegate: wrong operator name in FullyConnected activationTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ic52b27d462f498314050576b5195f759f5f00c63
2020-11-26IVGCVSW-5457 Add How-To documentation for the TfLite DelegateJan Eilers
* Add guide.md to the delegate directory * Mentioned the guide in README.md Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Iaa373ecf28f57f4d8383489fecf43670ae8ca190
2020-11-26Doc update TfLiteDelegate: FullyConnected does not support fused activationTeresa Charlin
Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com> Change-Id: Ie83c3b366214ceff2366c0a20a052582749c4fa4
2020-11-24Fix reshape delegate intermittent errorNarumol Prangnawarat
* Make sue that incorrect corrupted data from reshapeOptions is not used instead of shape from input tensor * Remove redundant check Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ib30f632b5fdb039a618234c1faae183c98033e57
2020-11-24IVGCVSW-5347 Update Readme for 20.11Teresa Charlin
* Adding delegate readme.md and TensorFlowLiteDelegateSupport.md Change-Id: I1b8012440cf4cd6120902ad69c5b3a2a5e410d71 Signed-off-by: Teresa Charlin <teresa.charlinreyes@arm.com>
2020-11-23IVGCVSW-5574 Change directory for tensorflow libs for the delegateJan Eilers
* TENSORFLOW_ROOT is already in use with a different expected value Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I199987989678d8712a1f3e0a79ae066376429eec
2020-11-20IVGCVSW-5538 Fix delegate DepthwiseConv2d, DIV, ReshapeNarumol Prangnawarat
* Correct filter shape for DepthwiseConv2d * Remove non-support data type * Allow check for flatten on Reshape Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ic4be63d7c2f3a2b5e13a1530025a49464c21171b
2020-11-20IVGCVSW-5544 Fix FullyConnected Delegate testsNarumol Prangnawarat
* Correct input shape Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I9d1fe4c8ef32a9dfba7f7fdd6af314e9a522fce8