aboutsummaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)Author
2019-05-28IVGCVSW-3129 Image pre-processing fix for TFLitev19.05FinnWilliamsArm
* Resized images for quantized models are now statically cast to uint8 instead of quantized * Removed optional quantization parameters from ImagePreprocessor constructor * Changed mean and scale for TFLite models Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com> Change-Id: Id5ffdf77f3614d10c417e769bd8ffc4a4c07308b
2019-05-21IVGCVSW-3088 Update Readme for 19.05Nina Drozd
* Added Readme file for ArmnnQuantizer * Added section about ArmnnQuantizer in armnn Readme file * Updated ModelAccuracyTool Readme file with default values for --compute Signed-off-by: Nina Drozd <nina.drozd@arm.com> Change-Id: I5fcead522b70086dcf63dfc6c77910a7d33d83f0
2019-05-20IVGCVSW-3060 Classification tests display output value as raw floatDerek Lamberti
Change-Id: I92a1e043d60fa2fe3414dc9339ef36204aca42e2 Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-05-14IVGCVSW-3001 Dequantize the output prior to printingDerek Lamberti
Change-Id: Ibd5fb4ad102aec1f71ab99402a3e3a08b04b926b Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-05-14IVGCVSW-3069 Add documentation for ModelAccuracyTool-ArmnnConor Kennedy
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com> Change-Id: I1e128982ba0e1c99ee4532276f679dda37095201
2019-05-13IVGCVSW-3070 Add Documentation for ImageTensorGenerator & ImageCSVFileGeneratorConor Kennedy
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com> Change-Id: I071225a812e6f85b6abe83172be71913186523f4
2019-05-08IVGCVSW-2900 Adding the Accuracy Checker Tool and testsÉanna Ó Catháin
Change-Id: I4ac325e45f2236b8e0757d21046f117024ce3979 Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
2019-05-07IVGCVSW-3038 Move MakeInputTensors to armnnUtilsJim Flynn
Change-Id: I4352a645badde788b9e33b3675a9cc9c0fc3dc33 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-05-02IVGCVSW-3039 Unify BindingPointInfo declarationsJim Flynn
Change-Id: I3deb2b9a37e8a8f8f2ed93c64ed0656ae911e24c Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-05-02IVGCVSW-2941 THIRD_PARTY_INCLUDE_DIRS is not set in ↵Sadik Armagan
armnn/tests/CMakeLists.txt for external builds * Added stb_image libraries under third-party/stb_image * Updates test/CMakeLists.txt to include those stb_image libraries * stb_image libraries are dual-licensed under public domain and MIT Change-Id: Ic179928598bb236d39fb5992042183099e78a0d7 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
2019-04-30IVGCVSW-2405 Rename SubGraph to SubgraphViewDerek Lamberti
Change-Id: Ie50aeccf053c20c3a01a75042bbc3acd824375af Signed-off-by: Derek Lamberti <derek.lamberti@arm.com> Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-04-26IVGCVSW-3005 Correct the order of inputs and outputs of deepspeech v1Narumol Prangnawarat
Change-Id: I36b3467e74508ad4e8f3140285f965bc63433d1d Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
2019-04-23IVGCVSW-2657: New Mobilenet Timings test which includes quantisation and softmaxDavid Monahan
Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: Ieeb6ead55a3af851eea666334e41c3c9c3e3803b
2019-04-23IVGCVSW-2657: Model update to fix failing timings test: TfLiteVGG16QuantizedDavid Monahan
Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: I49bd93766f8f3cf41a9471c87c1c61ed1ec6034c
2019-04-23IVGCVSW-2899 Create a tool to preprocess the images, generating the RAW ↵Sadik Armagan
tensor data from the image files * ImageTensorGenerator tool generates .raw file contains tensor of the image * ImageCSVFileGenerator tool generates .csv file contains list of .raw files Change-Id: Ic7e148857b9f885044bd69da1077b60104cd6509 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
2019-04-17IVGCVSW-2855 Update Command Line Processing of commonOptionsJim Flynn
Change-Id: I79f483b9854bd57cd712bc29b83983342cf8191f Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-04-16IVGCVSW-2855 Create TfLite reference test for DeepSpeechV1Jim Flynn
Change-Id: I4492a85c8337bf4ea0eb998c88b9cbfc932dc4e6 Signed-off-by: Ruomei Yan <ruomei.yan@arm.com> Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-04-16IVGCVSW-2959: Update TfLiteResNetV2-50-Quantized-Armnn testNina Drozd
* updated the output name parameter in TfLiteResNetV2-50-Quantized test to correct output name as in model Change-Id: Ic657d5e7972a610ea63d4fc709fe42c86c997249 Signed-off-by: Nina Drozd <nina.drozd@arm.com>
2019-04-16MLCE-103: MDK changes for running multiple inferences qasymm8Pablo Tello
Change-Id: I34e8e0736e133ffb5f931ce3b5f5bfa4e2c975c2 Signed-off-by: Pablo Tello <pablo.tello@arm.com>
2019-04-15IVGCVSW-2965: Add ResnetV2 50 Timings job in CINina Drozd
* Added building of TfLiteParserTest target and sources for TfLiteResNetV2-50-Quantized-Armnn test Signed-off-by: Nina Drozd <nina.drozd@arm.com> Change-Id: I0cfc48ee3426187f748d3731e6c060302e9b6afa
2019-04-15IVGCVSW-2928 Fix issue with GPU profilingMatthew Bentham
Correctly enable GPU profiling when test profiling is enabled. Remove extra copy of the profiling-enabled flag from InferenceModel::Params and correctly pass around the copy that is in InferenceTestOptions. !referencetests:180329 Change-Id: I0daa1bab2e7068fc479bf417a553183b1d922166 Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
2019-04-15IVGCVSW-2959 Update TfLiteResNetV2-50-Quantized-Armnn testnikraj01
Change-Id: I6cbf2a6668894b7964f98b70216f56db4c99b718 Signed-off-by: nikraj01 <nikhil.raj@arm.com>
2019-04-11IVGCVSW-2543 Add timing for ExecuteNetwork inferenceJames Conroy
* Adds a new command line option 'threshold-time' to ExecuteNetwork, the maximum allowed time for inference in EnqueueWorkload. * ExecuteNetwork now outputs inference time elapsed and (if supplied) threshold time. * If actual elapsed inference time is greater than supplied threshold time, fail the test. Change-Id: If441b49a29cf5450687c07500c9046a80ece56fc Signed-off-by: James Conroy <james.conroy@arm.com>
2019-04-05IVGCVSW-2926 Add test for ResNetV2 50 quantized tflite modelnikraj01
Change-Id: I9389cf32d0efb303ea0930ecb4a87af884943b06 Signed-off-by: nikraj01 <nikhil.raj@arm.com>
2019-04-03IVGCVSW-2802 Ability to run FP16 turbo mode through ExecuteNetworkRuomei Yan
Change-Id: I679883234d78b95d1e01ed5602c5cab296b0c6bf Signed-off-by: Ruomei Yan <ruomei.yan@arm.com>
2019-03-28IVGCVSW-2827: adding Validation file for TfLiteInceptionV4QuantizedNina Drozd
Change-Id: I209e4e4e674f486328197eda6438e93ba0c7bda6 Signed-off-by: Nina Drozd <nina.drozd@arm.com>
2019-03-27IVGCVSW-2884:Add Validation.txt for TfliteInceptionV3nikraj01
Change-Id: I08fb551d27ad80e657460242f567a59303d4879b Signed-off-by: nikraj01 <nikhil.raj@arm.com>
2019-03-15IVGCVSW-2354 Caffe SqueezeNet through armnn Cl and NeonNarumol Prangnawarat
* Compute Softmax Acl axis for Cl and Neon * Add unittests for Softmax in 3D and 4D * Correct input and output layer names in CaffeSqueezeNet inference test Change-Id: I2d369d9a2db19c40f2af3341039dd33f0c5637b1 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
2019-02-26IVGCVSW-2560 Verify Inference test for TensorFlow Lite MobileNet SSDNarumol Prangnawarat
* Assign output shape of MobileNet SSD to ArmNN network * Add m_OverridenOutputShapes to TfLiteParser to set shape in GetNetworkOutputBindingInfo * Use input quantization instead of output quantization params * Correct data and datatype in Inference test Change-Id: I01ac2e07ed08e8928ba0df33a4847399e1dd8394 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
2019-02-26IVGCVSW-2629 Adding support for uint8 in ExecuteNetwork to fix issues with ↵Éanna Ó Catháin
output tensor being all zero Change-Id: I4da1ffd684672fff0853fb053c3340d06a3bc165 Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
2019-02-22IVGSVSW-2736 Fix dangling reference to temporary storageDerek Lamberti
Change-Id: Ie6c553798eac732f37148d81970366e5a4ede1be Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-02-20IVGSVSW-2736 Rename DeserializeParser => Deserializer & fix namespacesDerek Lamberti
Change-Id: I4166c0bbb5ba7f8b8884e71134c21f43d1fc27b0 Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-02-20IVGCVSW-2436 Modify MobileNet SSD inference testNarumol Prangnawarat
* change MobileNet SSD input to uint8 * get quantization scale and offset from the model * change data layout to NHWC as TensorFlow lite layout * update expected output as result from TfLite with quantized data Change-Id: I07104d56286893935779169356234de53f1c9492 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
2019-02-19IVGCVSW-2736 Deserialize using istream instead of filenameDerek Lamberti
Change-Id: I5656b23d9783e7f953e677001d16e41eedeb42b2 Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-02-12IVGCVSW-2663 Enable ExecuteNetwork to load ArmNN filesAron Virginas-Tar
Change-Id: I1a61a1da2258bd07b39da6063d22a5bd22c1884d Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
2019-02-11IVGCVSW-2529 DeepSpeech v1 testFerran Balaguer
Change-Id: Ieb99ac1aa347cee4b28b831753855c4614220648
2019-02-08Added TfLiteParser test for MnasNetBruno Goncalves
Change-Id: Ie31eee48cc14ada37526130998da7a482d56b1ea
2019-02-07Added TfLiteParser test for InceptionV4QuantizedBruno Goncalves
Change-Id: Iad57395b0231a0960e7fc27c1d487bdee8a1f464
2019-02-07Added TfLiteParser test for ResNetV2Bruno Goncalves
Change-Id: If45696594503cd093c7d5f3b5001b20e9bb2e573
2019-02-01Added TfLiteParser test for InceptionV3QuantizedBruno Goncalves
Change-Id: I6ed434b798c617f85ca1faa7c5eef4cdabff4a07
2019-02-01Added TfLiteParser test for MobilenetV2QuantizedBruno Goncalves
Change-Id: I0896c5f74d4e432a2ea8eff3cbe2db0702aa9ed9
2019-02-01IVGCVSW-2604 Fix bug that made it impossible to execute inference tests on ↵Aron Virginas-Tar
certain backends * Read compute devices from the CL as strings and convert them into BackendId objects afterwards Change-Id: Icded1c572778f5a213644e3052ff6dfe7022128b Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
2019-01-31IVGCVSW-2601 Fix for ExecuteNetwork output data printing bugAron Virginas-Tar
Change-Id: I7e8d377cdbddf0176ae05d8b6b2fd03c6f614168 Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
2019-01-31IVGCVSW-2564 Fix output buffer initialization bug in ExecuteNetworkAron Virginas-Tar
Change-Id: I69eac52c9c944a5d209c5c7432c1b7f46e64f05b Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com>
2019-01-30IVGCVSW-2437 Inference test for TensorFlow Lite MobileNet SSDAron Virginas-Tar
Change-Id: If7ee1efa3ee79d9eca41c5a6219b3fc42e740efe
2019-01-30IVGCVSW-2564 Add support for multiple input and output bindings in ↵Aron Virginas-Tar
InferenceModel Change-Id: I64d724367d42dca4b768b6c6e42acda714985950
2019-01-22IVGCVSW-2535 Fix crash in ExecuteNetwork when no compute device is specifiedAron Virginas-Tar
Change-Id: If8d6516286557a6381561805cd53b5659b38f6a6
2019-01-15IVGCVSW-2454 Merge together the pluggable backends work (was in aMatteo Martincigh
separate branch) and master * Brings in all the changes done for the pluggable backends * Added sub-graph support and tests * Added precompiled layer support and tests * Moved BackendSettings to a separate file * Removed the backend-specific code * Ported DebugLayer and associated functionality * Included fixes to make those changes work with master Change-Id: Id7028fa7917527b844628d5aff5732e3d94c0488
2019-01-07IVGCVSW-2421 Remove the template-based version of armnnUtils::PermuteMatteo Martincigh
in favor of a type-indepent implementation that takes void-pointers * The new implementation requires the size of the type to be passed to the function * Updated all the usages accordingly * Removed the old implementation no longer used !android-nn-driver:469 Change-Id: I37f4e6d62a38fbb8ec8c39bb559a2c54c83365d4
2018-11-26IVGCVSW-2199 Call Resize only if H and/or W changesJames Conroy
* Wrap Resize function call with conditional checking if height and/or width need to be changed. Change-Id: Ic33c3ed29cc985c147d29db8e9dd237ab9c741d1