aboutsummaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)Author
2019-10-21IVGCVSW-3989 Create the Counter Directory DecoderFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: If388e60434eae39d82b639d2275680679963624c
2019-10-18IVGCVSW-3721 Add support for startup sequence (Mock Gatord service).Colm Donelan
Fixing logic error in PeriodicCounterCaptureCommandHandler. Default quiet operation should be false and the unit tests should set it to true. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Icabf30819985811e42168a98909b44a6c5f5d4df
2019-10-18IVGCVSW-4005 Add PacketFamilyId to version resolverJim Flynn
Change-Id: Ief9373871438df4e1d353bbc545a3ee4f25c1fb0 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-10-18IVGCVSW-4002 Add FamilyId to CommandHandlerKeyJim Flynn
Change-Id: I0bb0bf77da2bcd7f4746078c4ccee9acc98638a7 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-10-17IVGCVSW-3721 Add support for startup sequence (Mock Gatord service).Colm Donelan
* Updated ExecuteNetwork to propagate a configured Runtime down to RunTest. * Fixed the creation of PeriodicCounterCaptureCommandHandler to match other handlers. * Moved around some printouts to make the MockGatorD output more useful. * Added details to the exception handling for problems in the GatordMockService receive thread. * Mockutils::ConstructHeader is only used in GatordMockTests. Moved it in there and deleted MockUtils.hpp * Refactored SendPeriodicCounterSelectionList to use ProfilingUtils. * Added PeriodicCounterSelectionResponseHandler to received packet echoed back. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: I4accdbf6cf5dd3f7dcc12b210b8360b4a5e4e277
2019-10-17IVGCVSW-3400 Fixed include directives for Gatord buildsMatteo Martincigh
* Using proper include directives with include paths * The relative paths used were causing trouble when building on other CI systems Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com> Change-Id: I897a80d1f56fbdbc3c714a50a0598210d8f0a03c
2019-10-11IVGCVSW-3551 Fix CounterCaptureHandlingTestFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: If481bc80fbad307f14d89beac9dc0d8fc575d788
2019-10-11IVGCVSW-3721 Add support for startup sequence (Mock Gatord service).Colm Donelan
* Receive and process the stream metadata from the client. * Send the connection ack packet. * Wait in a receiving thread and print the packets. * GatordMockTest and Impl for PeriodicCounterCapture CommandHandler * CaptureData class to retain packet data * MockUtils * Update SocketProfilingConnection to fix non blocking receipt of packets. * Restructure directory layout following review comments. * Extract the mock service into a static library in the cmake files. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Signed-off-by: Keith Davis <keith.davis@arm.com> Signed-off-by: Mike Kelly <mike.kelly@arm.com> Signed-off-by: Finn Williams <Finn.Williams@arm.com> Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I33c1c9f93976708c9315f71290d42cff53b8c075
2019-10-08IVGCVSW-3669 Fix bug parsing multiple InputShapes in ExecuteNetworkFrancis Murtagh
* Change shape separator from semicolon, a command separator, to colon. * Update ExecuteNetwork --help prompts. Change-Id: I6c6d18007cd219482d8187d69962944b833e302e Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2019-10-04IVGCVSW-3948 Adds External Profiling cmdline to ExecuteNetworkJim Flynn
Change-Id: If172bcb64e8202abbde4b8a6cee14f672bc259cd Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-09-23Replace uses of non-standard C++:Rob Hughes
* Variable-length array replaced with std::vector * "and" replaced with "&&" (OK, this one is standard but MSVC doesn't like it and it's inconsistent with the rest of the codebase) * Replace u_int8_t with uint8_t Change-Id: I7b968a2cfa85a5492a2a547364464c594efb067b Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2019-09-09IVGCVSW-3720 Start a UDS server that accepts connections.Colm Donelan
* Add a CLI paramter to the Gatord mock client to specify a namespace. * Open a listening socket on that namespace. * Wait for one connection on the socket. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Ic85b4defd5ad2010bb255472c030a91a23cec1d9
2019-09-06IVGCVSW-3719 Create test program executable.Colm Donelan
Introduce a new test utility that simulates the Gatord service. This will be used to test the external profiling features. Change-Id: Ib7c75c1302650e140945cd66d272c23af3aac760 Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
2019-09-06IVGCVSW-3816 Make compute option required in ExecuteNetworkMatthew Jackson
Signed-off-by: Matthew Jackson <matthew.jackson@arm.com> Change-Id: If13b731d95c79e3e296d7dfc6c1ac94bf3a93ff3
2019-09-04IVGCVBENCH-1337 Added additional layer parameters to dot file and -v optionAndre Ghattas
* Generic layer parameters now show up in dot file * Convolution layer parameters have also been added to dot file * ExecucteNetwork has an additional -v flag which generated dot file if there Change-Id: I210bb19b45384eb3639b7e488c7a89049fa6f18d Signed-off-by: Andre Ghattas <andre.ghattas@arm.com> Signed-off-by: Szilard Papp <szilard.papp@arm.com>
2019-09-02IVGCVSW-2945 ExecuteNetwork should have an option to save the output to a fileSadik Armagan
* Added "output-tensor-files,w" option to save output tensors to a file Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ida457177c5cbd7dca228772405fd505d03b61bf9
2019-08-29Add a check for the number of output types to ExecuteNetworkMatteo Martincigh
* If the number of the declared output types does not match the number of outputs, throw an error (just like we do for the inputs) Change-Id: I1cb873bf443a31ecdbc11195462e9614ae3a6637 Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-08-28IVGCVSW-3675 Add ExecuteNetwork option to print intermediate layersMatthew Jackson
Signed-off-by: Matthew Jackson <matthew.jackson@arm.com> Change-Id: Id7ab186ec607ff6e5ee6869c4ad562af4c40b97a
2019-08-23IVGCVSW-3547 Use ExecuteNetwork to run a dynamic backend end to end testMatteo Martincigh
* Added path override for dynamic backend loading * Do not default to CpuRef, as there could be dynamic backends loaded at runtime * Do not check right away whether the backends are correct, as more of them can be loaded at runtime as dynamic backends Change-Id: If23f79aa1480b8dfce57e49b1746c23b6b9e6f82 Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-08-22IVGCVSW-3564 Add optional InputLayerBindingID argument to ImageCSVFileGeneratorFinnWilliamsArm
Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com> Change-Id: Ibf2b5ce5e50d72d661a7c720c1f3bb1c0d811700
2019-07-26Fix ModelAccuracyTool and ImageTensorGenerator's command line option typoSiCong Li
Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: Id753fa1ea7a0aabc95b319cb78492f4220b701a4
2019-07-23Fix various uses of non-standard C++:Rob Hughes
* Replace u_int32_t with uint32_t * Replace size_t with uint32_t for initializer list of TensorInfo * Replace variable size arrays with std::vector * Replace reference to local variable during its initialisation Change-Id: I298b3995f1525f90a1ab2416d7e270315698fae3
2019-07-23Fix and clean up ImageTensorGeneratorSiCong Li
* Fix the issue that uint8_t image tensors are written out as characters. * Add doxygen comments. Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: Ic5b3af489f405abcc1ed1e7dd76f56c5ae7ffbf4
2019-07-16MLCE-103 Clean up ModelAccuracyTool and ImageTensorGeneratorSiCong Li
* Fix ImageTensorGenerator command line options * Update ModelAccuracyTool README * Update ImageTensorGenerator README Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I19e573f2b4aa0d7ecab63dc3886a66aa9d8724bc
2019-07-15MLCE-103 Add necessary enhancements to ModelAccuracyToolSiCong Li
* Evaluate model accuracy using category names instead of numerical labels. * Add blacklist support * Add range selection support Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I7b1d2d298cfcaa56a27a028147169404b73580bb
2019-07-11IVGCVSW-3492 - Fix for Array must be initialized errorKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Ic4177278bb8fb9e6e7e3c03ff8f49bfa99f5efdd
2019-07-09MLCE-103 Remove hardcoded output shape in ModelAccuracyToolSiCong Li
We can obtain the output tensor shape from the model provided by the user. Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I5074734315174c1b5dc8eea1eff18a4a1c566f2a
2019-07-09MLCE-103 Use ImageTensorGenerator in ModelAccuracyToolSiCong Li
* Refactor ImageTensorGenerator into a header so that it can be used inside ModelAccuracyTool. ModelAccuracyTool now can accept image files instead of tensor text files as input. ImageTensorGenerator remains a standalone tool for converting images into tensors text files. * Inside the ImageTensorGenerator, use the existing image preprocessing method InferenceTestImage::Resize which has the correct image normalization techniques and other resize utilities. Change-Id: Ia662fed4752fb81c5cfa6d15967c6aae4aaf1155 Signed-off-by: SiCong Li <sicong.li@arm.com>
2019-06-26IVGCVSW-3193 Allow ExecuteNetwork to have qasymm8 input typeNarumol Prangnawarat
and add option to quantize float inputs to qasymm8 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I54b13b8b53c31c05658fe9c310ca5a66df759aa5
2019-06-20IVGCVSW-3193 Update bounding box value of MobileNet SSD after refactorNarumol Prangnawarat
Convolution2d and DepthwiseConvolution2d to use Encoders and Decoders Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ic87b8ce6f68343983f3c825902425516cbb23b06
2019-06-19IVGCVSW-3299 Add Uint8 Support to Model Accuracy CheckerFrancis Murtagh
* Seperate ExecuteNetwork main function into standalone application * Include NetworkExecutionUtils header and remove duplicate functions * Add uint8 and int32 support to ModelAccuracyChecker Change-Id: I5fb4bc147232f8388f37eea7db5130b04fd215d1 Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2019-05-31IVGCVSW-3182 Updated Validation filesFinnWilliamsArm
* Validation files need to be changed due to image pre-processor fix: IVGCVSW-3129 * Updated TfLiteVGG16Quantized-Armnn Validation.txt * Updated TfLiteMobileNetQuantizedSoftmax Validation.txt Change-Id: I801978cc9d658542e5b5d966347de3381191ad66 Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com>
2019-05-30IVGCVSW-3182 Corrected expected model predictionsFinnWilliamsArm
* Changed expected predictions for TfLiteVGG16Quantized-Armnn.cpp * Changed expected predictions for TfLiteMobileNetQuantizedSoftmax-Armnn Change-Id: I3fe0bd3f6e44655b14b10887bc40fb0df31f81c8 Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com>
2019-05-27IVGCVSW-3129 Image pre-processing fix for TFLiteFinnWilliamsArm
* Resized images for quantized models are now statically cast to uint8 instead of quantized * Removed optional quantization parameters from ImagePreprocessor constructor * Changed mean and scale for TFLite models Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com> Change-Id: Id5ffdf77f3614d10c417e769bd8ffc4a4c07308b
2019-05-21IVGCVSW-3088 Update Readme for 19.05Nina Drozd
* Added Readme file for ArmnnQuantizer * Added section about ArmnnQuantizer in armnn Readme file * Updated ModelAccuracyTool Readme file with default values for --compute Signed-off-by: Nina Drozd <nina.drozd@arm.com> Change-Id: I5fcead522b70086dcf63dfc6c77910a7d33d83f0
2019-05-20IVGCVSW-3060 Classification tests display output value as raw floatDerek Lamberti
Change-Id: I92a1e043d60fa2fe3414dc9339ef36204aca42e2 Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-05-14IVGCVSW-3001 Dequantize the output prior to printingDerek Lamberti
Change-Id: Ibd5fb4ad102aec1f71ab99402a3e3a08b04b926b Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-05-14IVGCVSW-3069 Add documentation for ModelAccuracyTool-ArmnnConor Kennedy
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com> Change-Id: I1e128982ba0e1c99ee4532276f679dda37095201
2019-05-13IVGCVSW-3070 Add Documentation for ImageTensorGenerator & ImageCSVFileGeneratorConor Kennedy
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com> Change-Id: I071225a812e6f85b6abe83172be71913186523f4
2019-05-08IVGCVSW-2900 Adding the Accuracy Checker Tool and testsÉanna Ó Catháin
Change-Id: I4ac325e45f2236b8e0757d21046f117024ce3979 Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
2019-05-07IVGCVSW-3038 Move MakeInputTensors to armnnUtilsJim Flynn
Change-Id: I4352a645badde788b9e33b3675a9cc9c0fc3dc33 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-05-02IVGCVSW-3039 Unify BindingPointInfo declarationsJim Flynn
Change-Id: I3deb2b9a37e8a8f8f2ed93c64ed0656ae911e24c Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-05-02IVGCVSW-2941 THIRD_PARTY_INCLUDE_DIRS is not set in ↵Sadik Armagan
armnn/tests/CMakeLists.txt for external builds * Added stb_image libraries under third-party/stb_image * Updates test/CMakeLists.txt to include those stb_image libraries * stb_image libraries are dual-licensed under public domain and MIT Change-Id: Ic179928598bb236d39fb5992042183099e78a0d7 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
2019-04-30IVGCVSW-2405 Rename SubGraph to SubgraphViewDerek Lamberti
Change-Id: Ie50aeccf053c20c3a01a75042bbc3acd824375af Signed-off-by: Derek Lamberti <derek.lamberti@arm.com> Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-04-26IVGCVSW-3005 Correct the order of inputs and outputs of deepspeech v1Narumol Prangnawarat
Change-Id: I36b3467e74508ad4e8f3140285f965bc63433d1d Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com>
2019-04-23IVGCVSW-2657: New Mobilenet Timings test which includes quantisation and softmaxDavid Monahan
Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: Ieeb6ead55a3af851eea666334e41c3c9c3e3803b
2019-04-23IVGCVSW-2657: Model update to fix failing timings test: TfLiteVGG16QuantizedDavid Monahan
Signed-off-by: David Monahan <david.monahan@arm.com> Change-Id: I49bd93766f8f3cf41a9471c87c1c61ed1ec6034c
2019-04-23IVGCVSW-2899 Create a tool to preprocess the images, generating the RAW ↵Sadik Armagan
tensor data from the image files * ImageTensorGenerator tool generates .raw file contains tensor of the image * ImageCSVFileGenerator tool generates .csv file contains list of .raw files Change-Id: Ic7e148857b9f885044bd69da1077b60104cd6509 Signed-off-by: Sadik Armagan <sadik.armagan@arm.com>
2019-04-17IVGCVSW-2855 Update Command Line Processing of commonOptionsJim Flynn
Change-Id: I79f483b9854bd57cd712bc29b83983342cf8191f Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-04-16IVGCVSW-2855 Create TfLite reference test for DeepSpeechV1Jim Flynn
Change-Id: I4492a85c8337bf4ea0eb998c88b9cbfc932dc4e6 Signed-off-by: Ruomei Yan <ruomei.yan@arm.com> Signed-off-by: Jim Flynn <jim.flynn@arm.com>
generated by cgit v1.2.1 (git 2.23.0) at 2024-07-01 04:17:15 +0000