aboutsummaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)Author
2019-09-09IVGCVSW-3720 Start a UDS server that accepts connections.Colm Donelan
* Add a CLI paramter to the Gatord mock client to specify a namespace. * Open a listening socket on that namespace. * Wait for one connection on the socket. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Ic85b4defd5ad2010bb255472c030a91a23cec1d9
2019-09-06IVGCVSW-3719 Create test program executable.Colm Donelan
Introduce a new test utility that simulates the Gatord service. This will be used to test the external profiling features. Change-Id: Ib7c75c1302650e140945cd66d272c23af3aac760 Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
2019-09-06IVGCVSW-3816 Make compute option required in ExecuteNetworkMatthew Jackson
Signed-off-by: Matthew Jackson <matthew.jackson@arm.com> Change-Id: If13b731d95c79e3e296d7dfc6c1ac94bf3a93ff3
2019-09-04IVGCVBENCH-1337 Added additional layer parameters to dot file and -v optionAndre Ghattas
* Generic layer parameters now show up in dot file * Convolution layer parameters have also been added to dot file * ExecucteNetwork has an additional -v flag which generated dot file if there Change-Id: I210bb19b45384eb3639b7e488c7a89049fa6f18d Signed-off-by: Andre Ghattas <andre.ghattas@arm.com> Signed-off-by: Szilard Papp <szilard.papp@arm.com>
2019-09-02IVGCVSW-2945 ExecuteNetwork should have an option to save the output to a fileSadik Armagan
* Added "output-tensor-files,w" option to save output tensors to a file Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ida457177c5cbd7dca228772405fd505d03b61bf9
2019-08-29Add a check for the number of output types to ExecuteNetworkMatteo Martincigh
* If the number of the declared output types does not match the number of outputs, throw an error (just like we do for the inputs) Change-Id: I1cb873bf443a31ecdbc11195462e9614ae3a6637 Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-08-28IVGCVSW-3675 Add ExecuteNetwork option to print intermediate layersMatthew Jackson
Signed-off-by: Matthew Jackson <matthew.jackson@arm.com> Change-Id: Id7ab186ec607ff6e5ee6869c4ad562af4c40b97a
2019-08-23IVGCVSW-3547 Use ExecuteNetwork to run a dynamic backend end to end testMatteo Martincigh
* Added path override for dynamic backend loading * Do not default to CpuRef, as there could be dynamic backends loaded at runtime * Do not check right away whether the backends are correct, as more of them can be loaded at runtime as dynamic backends Change-Id: If23f79aa1480b8dfce57e49b1746c23b6b9e6f82 Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-08-22IVGCVSW-3564 Add optional InputLayerBindingID argument to ImageCSVFileGeneratorFinnWilliamsArm
Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com> Change-Id: Ibf2b5ce5e50d72d661a7c720c1f3bb1c0d811700
2019-07-26Fix ModelAccuracyTool and ImageTensorGenerator's command line option typoSiCong Li
Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: Id753fa1ea7a0aabc95b319cb78492f4220b701a4
2019-07-23Fix various uses of non-standard C++:Rob Hughes
* Replace u_int32_t with uint32_t * Replace size_t with uint32_t for initializer list of TensorInfo * Replace variable size arrays with std::vector * Replace reference to local variable during its initialisation Change-Id: I298b3995f1525f90a1ab2416d7e270315698fae3
2019-07-23Fix and clean up ImageTensorGeneratorSiCong Li
* Fix the issue that uint8_t image tensors are written out as characters. * Add doxygen comments. Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: Ic5b3af489f405abcc1ed1e7dd76f56c5ae7ffbf4
2019-07-16MLCE-103 Clean up ModelAccuracyTool and ImageTensorGeneratorSiCong Li
* Fix ImageTensorGenerator command line options * Update ModelAccuracyTool README * Update ImageTensorGenerator README Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I19e573f2b4aa0d7ecab63dc3886a66aa9d8724bc
2019-07-15MLCE-103 Add necessary enhancements to ModelAccuracyToolSiCong Li
* Evaluate model accuracy using category names instead of numerical labels. * Add blacklist support * Add range selection support Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I7b1d2d298cfcaa56a27a028147169404b73580bb
2019-07-11IVGCVSW-3492 - Fix for Array must be initialized errorKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Ic4177278bb8fb9e6e7e3c03ff8f49bfa99f5efdd
2019-07-09MLCE-103 Remove hardcoded output shape in ModelAccuracyToolSiCong Li
We can obtain the output tensor shape from the model provided by the user. Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I5074734315174c1b5dc8eea1eff18a4a1c566f2a
2019-07-09MLCE-103 Use ImageTensorGenerator in ModelAccuracyToolSiCong Li
* Refactor ImageTensorGenerator into a header so that it can be used inside ModelAccuracyTool. ModelAccuracyTool now can accept image files instead of tensor text files as input. ImageTensorGenerator remains a standalone tool for converting images into tensors text files. * Inside the ImageTensorGenerator, use the existing image preprocessing method InferenceTestImage::Resize which has the correct image normalization techniques and other resize utilities. Change-Id: Ia662fed4752fb81c5cfa6d15967c6aae4aaf1155 Signed-off-by: SiCong Li <sicong.li@arm.com>
2019-06-26IVGCVSW-3193 Allow ExecuteNetwork to have qasymm8 input typeNarumol Prangnawarat
and add option to quantize float inputs to qasymm8 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I54b13b8b53c31c05658fe9c310ca5a66df759aa5
2019-06-20IVGCVSW-3193 Update bounding box value of MobileNet SSD after refactorNarumol Prangnawarat
Convolution2d and DepthwiseConvolution2d to use Encoders and Decoders Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ic87b8ce6f68343983f3c825902425516cbb23b06
2019-06-19IVGCVSW-3299 Add Uint8 Support to Model Accuracy CheckerFrancis Murtagh
* Seperate ExecuteNetwork main function into standalone application * Include NetworkExecutionUtils header and remove duplicate functions * Add uint8 and int32 support to ModelAccuracyChecker Change-Id: I5fb4bc147232f8388f37eea7db5130b04fd215d1 Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2019-05-31IVGCVSW-3182 Updated Validation filesFinnWilliamsArm
* Validation files need to be changed due to image pre-processor fix: IVGCVSW-3129 * Updated TfLiteVGG16Quantized-Armnn Validation.txt * Updated TfLiteMobileNetQuantizedSoftmax Validation.txt Change-Id: I801978cc9d658542e5b5d966347de3381191ad66 Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com>
2019-05-30IVGCVSW-3182 Corrected expected model predictionsFinnWilliamsArm
* Changed expected predictions for TfLiteVGG16Quantized-Armnn.cpp * Changed expected predictions for TfLiteMobileNetQuantizedSoftmax-Armnn Change-Id: I3fe0bd3f6e44655b14b10887bc40fb0df31f81c8 Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com>
2019-05-27IVGCVSW-3129 Image pre-processing fix for TFLiteFinnWilliamsArm
* Resized images for quantized models are now statically cast to uint8 instead of quantized * Removed optional quantization parameters from ImagePreprocessor constructor * Changed mean and scale for TFLite models Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com> Change-Id: Id5ffdf77f3614d10c417e769bd8ffc4a4c07308b
2019-05-21IVGCVSW-3088 Update Readme for 19.05Nina Drozd
* Added Readme file for ArmnnQuantizer * Added section about ArmnnQuantizer in armnn Readme file * Updated ModelAccuracyTool Readme file with default values for --compute Signed-off-by: Nina Drozd <nina.drozd@arm.com> Change-Id: I5fcead522b70086dcf63dfc6c77910a7d33d83f0
2019-05-20IVGCVSW-3060 Classification tests display output value as raw floatDerek Lamberti
Change-Id: I92a1e043d60fa2fe3414dc9339ef36204aca42e2 Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-05-14IVGCVSW-3001 Dequantize the output prior to printingDerek Lamberti
Change-Id: Ibd5fb4ad102aec1f71ab99402a3e3a08b04b926b Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-05-14IVGCVSW-3069 Add documentation for ModelAccuracyTool-ArmnnConor Kennedy
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com> Change-Id: I1e128982ba0e1c99ee4532276f679dda37095201
2019-05-13IVGCVSW-3070 Add Documentation for ImageTensorGenerator & ImageCSVFileGeneratorConor Kennedy
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com> Change-Id: I071225a812e6f85b6abe83172be71913186523f4
2019-05-08IVGCVSW-2900 Adding the Accuracy Checker Tool and testsÉanna Ó Catháin
Change-Id: I4ac325e45f2236b8e0757d21046f117024ce3979 Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
2019-05-07IVGCVSW-3038 Move MakeInputTensors to armnnUtilsJim Flynn
Change-Id: I4352a645badde788b9e33b3675a9cc9c0fc3dc33 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-05-02IVGCVSW-3039 Unify BindingPointInfo declarationsJim Flynn
Change-Id: I3deb2b9a37e8a8f8f2ed93c64ed0656ae911e24c Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-05-02IVGCVSW-2941 THIRD_PARTY_INCLUDE_DIRS is not set in ↵Sadik Armagan
armnn/tests/CMakeLists.txt for external builds * Added stb_image libraries under third-party/stb_image * Updates test/CMakeLists.txt to include those stb_image libraries * stb_image libraries are dual-licensed under public domain and MIT Change-Id: Ic179928598bb236d39fb5992042183099e78a0d7 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
2019-04-30IVGCVSW-2405 Rename SubGraph to SubgraphViewDerek Lamberti
Change-Id: Ie50aeccf053c20c3a01a75042bbc3acd824375af Signed-off-by: Derek Lamberti <derek.lamberti@arm.com> Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-04-26IVGCVSW-3005 Correct the order of inputs and outputs of deepspeech v1Narumol Prangnawarat
Change-Id: I36b3467e74508ad4e8f3140285f965bc63433d1d Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
2019-04-23IVGCVSW-2657: New Mobilenet Timings test which includes quantisation and softmaxDavid Monahan
Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: Ieeb6ead55a3af851eea666334e41c3c9c3e3803b
2019-04-23IVGCVSW-2657: Model update to fix failing timings test: TfLiteVGG16QuantizedDavid Monahan
Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: I49bd93766f8f3cf41a9471c87c1c61ed1ec6034c
2019-04-23IVGCVSW-2899 Create a tool to preprocess the images, generating the RAW ↵Sadik Armagan
tensor data from the image files * ImageTensorGenerator tool generates .raw file contains tensor of the image * ImageCSVFileGenerator tool generates .csv file contains list of .raw files Change-Id: Ic7e148857b9f885044bd69da1077b60104cd6509 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
2019-04-17IVGCVSW-2855 Update Command Line Processing of commonOptionsJim Flynn
Change-Id: I79f483b9854bd57cd712bc29b83983342cf8191f Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-04-16IVGCVSW-2855 Create TfLite reference test for DeepSpeechV1Jim Flynn
Change-Id: I4492a85c8337bf4ea0eb998c88b9cbfc932dc4e6 Signed-off-by: Ruomei Yan <ruomei.yan@arm.com> Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-04-16IVGCVSW-2959: Update TfLiteResNetV2-50-Quantized-Armnn testNina Drozd
* updated the output name parameter in TfLiteResNetV2-50-Quantized test to correct output name as in model Change-Id: Ic657d5e7972a610ea63d4fc709fe42c86c997249 Signed-off-by: Nina Drozd <nina.drozd@arm.com>
2019-04-16MLCE-103: MDK changes for running multiple inferences qasymm8Pablo Tello
Change-Id: I34e8e0736e133ffb5f931ce3b5f5bfa4e2c975c2 Signed-off-by: Pablo Tello <pablo.tello@arm.com>
2019-04-15IVGCVSW-2965: Add ResnetV2 50 Timings job in CINina Drozd
* Added building of TfLiteParserTest target and sources for TfLiteResNetV2-50-Quantized-Armnn test Signed-off-by: Nina Drozd <nina.drozd@arm.com> Change-Id: I0cfc48ee3426187f748d3731e6c060302e9b6afa
2019-04-15IVGCVSW-2928 Fix issue with GPU profilingMatthew Bentham
Correctly enable GPU profiling when test profiling is enabled. Remove extra copy of the profiling-enabled flag from InferenceModel::Params and correctly pass around the copy that is in InferenceTestOptions. !referencetests:180329 Change-Id: I0daa1bab2e7068fc479bf417a553183b1d922166 Signed-off-by: Matthew Bentham <matthew.bentham@arm.com>
2019-04-15IVGCVSW-2959 Update TfLiteResNetV2-50-Quantized-Armnn testnikraj01
Change-Id: I6cbf2a6668894b7964f98b70216f56db4c99b718 Signed-off-by: nikraj01 <nikhil.raj@arm.com>
2019-04-11IVGCVSW-2543 Add timing for ExecuteNetwork inferenceJames Conroy
* Adds a new command line option 'threshold-time' to ExecuteNetwork, the maximum allowed time for inference in EnqueueWorkload. * ExecuteNetwork now outputs inference time elapsed and (if supplied) threshold time. * If actual elapsed inference time is greater than supplied threshold time, fail the test. Change-Id: If441b49a29cf5450687c07500c9046a80ece56fc Signed-off-by: James Conroy <james.conroy@arm.com>
2019-04-05IVGCVSW-2926 Add test for ResNetV2 50 quantized tflite modelnikraj01
Change-Id: I9389cf32d0efb303ea0930ecb4a87af884943b06 Signed-off-by: nikraj01 <nikhil.raj@arm.com>
2019-04-03IVGCVSW-2802 Ability to run FP16 turbo mode through ExecuteNetworkRuomei Yan
Change-Id: I679883234d78b95d1e01ed5602c5cab296b0c6bf Signed-off-by: Ruomei Yan <ruomei.yan@arm.com>
2019-03-28IVGCVSW-2827: adding Validation file for TfLiteInceptionV4QuantizedNina Drozd
Change-Id: I209e4e4e674f486328197eda6438e93ba0c7bda6 Signed-off-by: Nina Drozd <nina.drozd@arm.com>
2019-03-27IVGCVSW-2884:Add Validation.txt for TfliteInceptionV3nikraj01
Change-Id: I08fb551d27ad80e657460242f567a59303d4879b Signed-off-by: nikraj01 <nikhil.raj@arm.com>
2019-03-15IVGCVSW-2354 Caffe SqueezeNet through armnn Cl and NeonNarumol Prangnawarat
* Compute Softmax Acl axis for Cl and Neon * Add unittests for Softmax in 3D and 4D * Correct input and output layer names in CaffeSqueezeNet inference test Change-Id: I2d369d9a2db19c40f2af3341039dd33f0c5637b1 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
generated by cgit v1.2.1 (git 2.23.0) at 2024-06-01 17:35:20 +0000