aboutsummaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)Author
2021-04-29IVGCVSW-5819 5820 5821 Add MemorySourceFlags to ↵Francis Murtagh
TensorHandleFactoryRegistry::GetFactory * Modify Layer::CreateTensorHandles to include MemorySource * Modify INetworkProperties to add MemorySource * Disable Neon/Cl fallback tests until full import implementation complete Change-Id: Ia4fff6ea3d4bf6afca33aae358125ccaec7f9a38 Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2021-04-29IVGCVSW-5744 Remove Tensorflow, Caffe and Quantizer from documentationKevin May
* Remove from .md files and Doxygen * Remove from armnn/docker build * Remove Tensorflow model format from ExecuteNetworkParams * Remove Tensorflow model format from ImageTensorGenerator Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Id6ed4a7d90366c396e8e0395d0ce43a3bcddcee6
2021-04-29IVGCVSW-5775 'Add Async Support to ExecuteNetwork'Sadik Armagan
* Enabled async mode with '-n, concurrent' and 'simultaneous-iterations' in ExecuteNetwork * Number of input files provided should be equal to number of input files provided multiply by number of simultaneous iterations divided by comma !armnn:5443 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ibeb318010430bf4ae61a02b18b1bf88f3657774c
2021-04-27IVGCVSW-5721 Remove the Tensorflow Parser from ArmNNNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ida37d3ee3a1af0c75aa905199bd861726c646846
2021-04-27IVGCVSW-5719 Remove QuantizerKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I8a29df03afdd6f1cc8413b219e179272cd2d51cf
2021-04-16IVGCVSW-5720 Remove the Caffe Parser from ArmNNNikhil Raj
Signed-off-by: Nikhil Raj <nikhil.raj@arm.com> Change-Id: Ib00be204f549efa9aa5971ecf65c2dec4a10b10f
2021-04-07Fix graph copy memory spikeFinn Williams
* Change layer storage of ConstTensors to std::shared_ptr<ConstCpuTensorHandle> * Change clone to share ConstTensor rather than copy * Remove uses of non-const GetTensor() call * Reduce scope of non-optimized network in ExeNet, so memory can be released after use Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: Ibb2c7309d12411d21405bd6024c76bcdf5404545
2021-04-01IVGCVSW-5651 'Regression in CLConvolution2dWorkload'Sadik Armagan
* Enable GPU profiling on ExecuteNetwork Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I57bb4eeb45674e5218fce7e67b9bddf16ba0894d
2021-03-24Fix YoloV3 test program incorrect use of absKeith Mok
abs is int type, use fabsf instead for float type Signed-off-by: Keith Mok <ek9852@gmail.com> Change-Id: I157d471da25d66cbe39fa9809ff9ee536d4e95a1
2021-03-04armnn_tfl_benchmark: allow string of backend to pass directlyKeith Mok
Instead of using the predefined backend ids, we should just pass the backend string directly to the optimator, otherwise we cannot use vendor specific backends or GpuAcc Signed-off-by: Keith Mok <ek9852@gmail.com> Change-Id: Ic52c81d48364a19f0fcc59bc3c975cf3bd740e21
2021-03-03IVGCVSW-5612 Fix tiny_wav2letter_relu_fixed_int8 delegate outputexperimental/abi-testsFinn Williams
* fix delegate perchannel quantization * change delegate to check reshape options before inputs * Add int8 "qsymms8" option to ExecuteNetwork * Add option to run ExecuteNetwork on tflite w/o delegate !referencetests:301301 Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: If3e12599b17aff1199d7ab0a55e1c901e480083d
2021-03-03armnn_tfl_benchmark: Fix crashKeith Mok
The input tensor data pointer was passed incorrectly Signed-off-by: Keith Mok <ek9852@gmail.com> Change-Id: I03f872c57ec588fde0f7d444c80b38823ea4f9b4
2021-02-25This application allow to benchmark tflite models by providing average ↵Jim Flynn
inference time. Usage: armnn_tfl_benchmark -m <model .tflite> -m --model_file <.tflite file path>: .tflite model to be executed -b --backend <device>: preferred backend device to run layers on by default. Possible choices: CpuAcc, CpuRef -l --loops <int>: provide the number of time the inference will be executed (by default nb_loops=1) Signed-off-by: Vincent ABRIOU <vincent.abriou@st.com> Signed-off-by: Jim Flynn <jim.flynn@arm.com> Change-Id: Ia26fafd4f382f0ad03856436dcae6e71b5abbd26
2021-02-17IVGCVSW-5581 ExecuteNetwork: Fix pass backends as comma separated listJan Eilers
* Allow passing multiple preferred backends as comma separated list e.g. "-c CpuAcc,CpuRef" or by repeating the option "-c CpuAcc -c CpuRef" Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I8e304d26c2890b99d5ec4c1af6c372458fa70051
2021-02-15IVGCVSW-5675 Implement Pimpl Idiom for IProfiler (lower priority)Francis Murtagh
Signed-off-by: Francis Murtagh <francis.murtagh@arm.com> Change-Id: If716f5f4e9b5433586b8a939d326830482da2f74
2021-02-15IVGCVSW-5686 Add GpuAcc MLGO tuning file configuration argumentFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I3f320499c379162f9d1b00cc8816bd144cd7eee4
2021-02-12IVGCVSW-5685 Add CpuAcc specific configuration option numberOfThreadsMatthew Sloyan
* Added ability to set number of threads used in CpuAcc backend * Enabled number-of-threads option in ExecuteNetwork * Added TfLiteDelegate ModelOptions test * Added unsigned int type to BackendOptions.hpp Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ia576d4f45cbe5df3654bc730bb5ebd5181d82b5a
2021-02-08IVGCVSW-4873 Implement Pimpl Idiom for IRuntimeKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I52448938735b2aa678c47e0f3061c87fa0c693b1
2021-01-29IVGCVSW-5484 Add Network loading time to InferenceModelMatthew Sloyan
* Added output log to capture time taken to load network into runtime. * This time is cut down when loading a cached network. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I043c177f17d01df35fbe0752ec5d77e350749164
2021-01-20MLCE-336 'TfLite parser and ExecuteNetwork issues'Sadik Armagan
* Report the error thrown Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: If5e5160f43c11a284b919d76b04d9c4d53e9c56c
2021-01-15IVGCVSW-5644 Add documentation for cache loaded networkMatthew Sloyan
* Added ModelOptions documentation to CLBackendModelContext * Improved options descriptions in ExecuteNetworkProgramOptions.cpp Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I14f0c8bb4f299809b89f49c616b691e2f7956d5b
2021-01-12IVGCVSW-5484 Add CacheLoadedNetwork options to ExecuteNetworkMatthew Sloyan
* Enable ability to save/load ClContext in ExecuteNetwork. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I58c61a53f6713853eb06520cc372ed47baf7f8c4
2020-12-09Default comparisons-files option to empty vectorDerek Lamberti
Change-Id: Iecd8d9b333fa4456d081b4787c1a5b5d0b4a2b79 Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2020-12-08IVGCVSW-5560 Fix TfLiteDelegate Reshape operator failureMatthew Sloyan
* Fixed issue when running certain models with 2D shape tensor. * Falls back to inbuilt options if encountered. * Fixed ExecuteNetwork so that error messages are logged if NULL. * Updated TfLiteDelegate docs to include Logical Operators. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Signed-off-by: David Monahan <david.monahan@arm.com> Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I5dbaf30351f7fc86e6178a0caf46c152812088d3
2020-11-30IVGCVSW-5587 Remove Tensorflow requirement from Arm NN TfLite delegateFinn Williams
* Added support for building the delegate with an external armnn path * Replaced potentially troublesome package manager * Explicitly set the privacy levels of delegate libraries * Fixed some error handling in ExecuteNetwork Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: I2a7abc099796012cbb043c5b319f81778c9f3b56
2020-11-20IVGCVSW-5559 Add int8_t to tflite delegate on ExecuteNetworkFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I56afc73d48848bc40842692831c05316484757a4
2020-11-18IVGCVSW-5377 'Add ArmNN TfLite delegate to ExecuteNetwork'Sadik Armagan
* Assign correct input values for the model * Call the right Validate function for Mul and Sub operators * Return the correct data type for kTfLiteInt8 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: I6d23adf68d33d8be9a1fbf5d19dfe47939a6d3d6
2020-11-17IVGCVSW-5377 Add ArmNN TfLite delegate to ExecuteNetworkSadik Armagan
* Added package manger to turn internal calls to find_package into a no-op * Changed delegate cmake so it can now be built within armnn Change-Id: I2a7ecb9a3c1ca05474cd1dccd91498f6f6c0b32e Signed-off-by: Finn Williams <Finn.Williams@arm.com> Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
2020-11-17IVGCVSW-5465 ExecuteNetworkTestsDynamicBackends Bug FixKeith Davis
* When invalid backend specified an ARMNNLOG should be invoked to fail more gracefully Signed-off-by: Keith Davis <keith.davis@arm.com> Change-Id: Iec34fbc03dbeeb66836b0d5e1dd381d021a379b1
2020-11-11IVGCVSW-5507 ExecuteNetwork fixJan Eilers
* Allow multiple backends to be defined seperately like " --compute CpuAcc --compute CpuRef " Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Ic2a827f6e3463a7413c98a7eefacef8864c1e87b
2020-11-09IVGCVSW-5462 Link fmt staticallyJan Eilers
* Fmt didn't get installed properly. Each component of an interface library needs to be installed separately. * Changed fmt to be a static library Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Ic69bc9536ee01eed7b434b1ff53150581ba60e00
2020-10-30IVGCVSW-5265 Removing more Boost references from test executables.Colm Donelan
* Removed unused includes from InferenceModel.hpp. * Replaced use of boost multi-array with vectors in YoloInferenceTest. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Ieadf3471ed170b09859187c83616c8e249f94543
2020-10-29IVGCVSW-5468 Rewrite QuantizationDataSet.cpp to avoid use of CsvReaderJames Ward
* Remove armnnUtils/CsvReader and usage * Remove armnn/CsvReaderTest and usage * Replace functionality in QuantizationDataSet.cpp Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I7213904482afa93ae6d607aa5e69117c8c34ea81
2020-10-29IVGCVSW-5265 Remove boost from core ArmNN CMakeColm Donelan
* Remove all but Boost_UNIT_TEST_FRAMEWORK_LIBRARY from ArmNN Cmake files. * Remove references to boost::fpc from old test applications. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Ibb1261dee4b971d1788d2805528aa800a8b883ce
2020-10-27Bugfix: Allow use of dynamic backendId in execute networkFrancis Murtagh
* Stops execute network rejecting backendId based on BackendRegistry * Dynamically loaded backends arent visible yet as runtime isn't initialized Change-Id: I87adfd137b2225ab07f8c3e996db9565caf276eb Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2020-10-20IVGCVSW-5284 Refactor ExecuteNetworkJan Eilers
* Removed boost program options and replaced it with cxxopts * Unified adding, parsing and validation of program options into the struct ProgramOptions * Program options are now parsed directly into ExecuteNetworkParams which can be passed directly to MainImpl * Split NetworkExecutionUtils into header and source * Removed RunTest * Removed RunCsvTest * Removed RunClTuning * Moved MainImpl back to ExecuteNetwork.cpp * Added additional util functions The functionality of ExecuteNetwork remains the same. Only cl tuning runs need to be started separately and there is no short option for fp16-turbo-mode because -h is reserved in cxxopts to print help messages Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: Ib9689375c81e1a184c17bb3ea66c3550430bbe09
2020-10-14IVGCVSW-5280 Switch tests/InferenceTest and derived tests over to cxxoptsJames Ward
* refactor AddCommandLineOptions() functions to allow checking of required options * add CxxoptsUtils.hpp file for convenience functions !referencetests:268500 Signed-off-by: James Ward <james.ward@arm.com> Change-Id: Ica954b210b2981b7cd10995f0d75fcb2a2f7b443
2020-10-13IVGCVSW-4489 Remove remaining occurrence of boost::formatMatthew Sloyan
* Replaced with fmt::format in Descriptors.cpp. * Removed remaining boost/format headers in ArmNN codebase. * Removed additional boost header in Network.cpp Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ib98b83bf4ec99ef98ce7a3635ec0dd478c3e43e1
2020-10-12IVGCVSW-5335 Documentation for fast_mathMike Kelly
* Changed documentation for fast_math to add warning about possibly reduction in precision. Signed-off-by: Mike Kelly <mike.kelly@arm.com> Change-Id: If954471efc6aef702e8490585571815d9e19b3fc
2020-10-12Load dynamic backends for YoloV3Derek Lamberti
* Optional cmd option to dump optimized model to dot * Optional cmd option to specify dynamic backends path * input is now optional and must exist if given * comparison files now optional and must exist if given Change-Id: I1499c9eb715be3cacdba2c227e1a93dd997f355d Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2020-10-12IVGCVSW-5287 Switch tests/MultipleNetworksCifar10 over to cxxoptsJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: Ia4ff69f2c8dd538ad7845053dc7a690f434c381c
2020-10-09IVGCVSW-5282 Switch tests/TfLiteMobilenetQuantized-Armnn over to cxxoptsMatthew Sloyan
* Required update to cxxopts v3.0 for unrecognised options to work. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: If1803731474e42580d663c802a1f3ff240fadffe
2020-10-08IVGCVSW-5286 Switch tests/ModelAccuracyTool-Armnn over to cxxoptsMatthew Sloyan
* Fixed two code errors which were causing compiler issues. * Added support for multiple input and output tensors. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I298e4bf52a0b41349adab60295e0f22da3cc057b
2020-10-07IVGCVSW-5405 Remove boost::make_iterator_range and boost::to_upper_copyMatthew Sloyan
* Removed from ModelAccuracyTool-Armnn and ImageCSVFileGenerator * Fixed formatting in ImageCSVFileGenerator Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I09dfca27813582cc48f46d0507680368ed823a9c
2020-10-02IVGCVSW-5334 Remove remaining boost::numeric_cast from armnnMatthew Sloyan
* Floating point casts now use armnn::numeric_cast. * Also removed remaining header imports. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I2d37847d67f164fc0a0ae17f34d49ff3d2210c30
2020-10-01IVGCVSW-5281 Switch tests/ImageCSVFileGenerator over to cxxoptsMatthew Sloyan
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I1b2ba4fcaebbafb70693b83b40b79db0071b4522
2020-10-01IVGCVSW-5285 Switch tests/ImageTensorGenerator over to cxxoptsMatthew Sloyan
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I9d43e347021634022a875fc4526baa438c467df0
2020-10-01IVGCVSW-5283 Switch tests/profiling/gatordmock over to cxxoptsMatthew Sloyan
Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: I4f06a414d6bd5f18c2ced882ac518052ed371cfc
2020-09-30IVGCVSW-4519 Remove Boost Variant and apply_visitor variantJames Ward
* replace boost::variant with mapbox::util::variant * replace boost::apply_visitor with mapbox::util::apply_visitor * replace boost::get with mapbox::util::get Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I38460cabbcd5e56d4d61151bfe3dcb5681ce696e
2020-09-29IVGCVSW-5295 Change fmt to be a header-only interface libraryJan Eilers
* Fix non-virtual-dtor warnings in fmt * Fix wrong fmt include in TfParser * Make fmt work in nn-driver * Make fmt a header-only interface library * Link fmt where necessary Signed-off-by: Jan Eilers <jan.eilers@arm.com> Change-Id: I9db7cd9a133a81262cbf79f04fb419ab97b88ea8