aboutsummaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)Author
2019-12-03IVGCVSW-4206 Correctly pass execute network parameter.v19.11Derek Lamberti
Change-Id: I595b89dcb6419f7cb73cee51705b90f6eec7088b Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-12-03IVGCVSW-4206 Optionally parse unsupported ops in ExecuteNetworkDerek Lamberti
Change-Id: I593e2540bd870d70aabb2c959f4e63a899967269 Signed-off-by: Derek Lamberti <derek.lamberti@arm.com>
2019-11-19IVGCVSW-4068 Add Guid to WorkloadNarumol Prangnawarat
* Add Guid to Workload * Remove circular dependency Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Signed-off-by: janeil01 <jan.eilers@arm.com> Change-Id: I15342fa7481c6bdc050e057dce2d74bba07fe2dd
2019-11-15IVGCVSW-4129 Fix thread starvation due to low capture periodsColm Donelan
* Set default capture period to 10mSec. * Validate capture period in PeriodicCounterSelectionCommandHandler pull it up to 10mSec if it is lower. * Fix segmentation fault in GatordMock when receive thread closes. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: I9f7ddc70bd99c102c5baef872d28329976a4dc07
2019-11-15IVGCVSW-4073 Send stream info in the ConnectionAcknowledgedCommandHandlerMatteo Martincigh
* Added call to ISendTimelinePacket::SendStreamMetaDataPacket * Added call to ISendTimelinePacket::SendTimelineMessageDirectoryPackage * Added new StreamMetadataCommandHandler class to the mock Gatord service * Updated code and unit tests * Added include paths to the gatord mock target Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com> Change-Id: Ic6d200b513175884607b7c0563cbfa4942ff2fc6
2019-11-15IVGCVSW-4072 Add stream header to Timeline Message Directory packetMatteo Martincigh
* Refactored the WriteTimelineMessageDirectoryPacket function * Added the stream header to the packet * Updated decoders/parsers * Updated unit tests accordingly * Minor refactoring Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com> Change-Id: I58f15fde54adc6414ca9fd5fb8d6157cad867339
2019-11-14Fix a few compile errors:Rob Hughes
* Replace use of non-standard integral types (e.g. u_char) * Convert boost::filesystem::paths to std::strings using the .string() method rather than .c_str(), because on Windows .c_str() returns a wide character string, which is not convertible to a std::string. Change-Id: Ia86b0653697033bb1afa01e64b5b2103dd042ffd Signed-off-by: Robert Hughes <robert.hughes@arm.com>
2019-11-07IVGCVSW-3951 Create the timeline decoderFinn Williams
* Added ITimelineDecoder.h C interface * Added an example implementation of ITimelineDecoder.h * Added command handlers for the timeline directory and objects * Added tests for the decoder implementation * Changed ReadSwTraceMessage to take a const unsigned char* so it can be used by the directory command handler * Fixed some bugs in ProfilingUtils.cpp and related tests Change-Id: If06faf1fe0274a8f022f194a6d3527f5ce5374c6 Signed-off-by: Finn Williams <Finn.Williams@arm.com>
2019-11-06IVGCVSW-3444 File Only Profiling ConnectionKeith Davis
* Add FileOnlyProfilingConnection Decorator * Fix bug where Conn Ack not automatically sent back * Modify GatordMock to use the Counter Directory class. * Promote DirectoryCaptureCommandHandler from GatordMock into ArmNN. * Remove MockUtils as it's contents were moved or deleted. * Rewrite GatordMockTests to use Counter Directory class. * Flush streams in ProfilingConnectionDumpToFileDecorator::Close. Signed-off-by: Keith Davis <keith.davis@arm.com> Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: I77b2aedece24150dd31691b577f3b5d81b2e226f
2019-11-01GitHub #292 Build the ML-examples using only ArmNN's public frontend APIMatteo Martincigh
* Refactoring of some of the public API headers Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com> Change-Id: I9006fe49945b10a6b83908b05aa4a6556639b491
2019-10-31GitHub #292 Move BackendRegistry.hpp to the public APIMatteo Martincigh
* Moved to BackendRegistry.hpp include/armnn * Updated makefiles and sources accordingly Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com> Change-Id: I4d83abb581d523218a880c879fcf30c9611f7fd7
2019-10-28Fix ExecuteNetwork no longer printing out the inference results,Matteo Martincigh
breaking some of the nightly builds * The TensorPrinter must be called regardless of the value of the output tensor files, it will automatically handle an empty file path by only printing the results to the console * Code refactoring Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com> Change-Id: I548ec7cf6d51badf78643c9a6c1c56ea9200142b
2019-10-25IVGCVSW-4018 Move QuantizeHelper.hpp to armnnUtilsAron Virginas-Tar
* Moved QuntizeHelper.hpp to armnnUtils * Reordered parameters for QuantizedVector and added default values for qScale and qOffset to make life easier when using the function for non-quantized types such as Float16 Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com> Change-Id: I28c263dfa425f1316feccb4116839a84f5d568e5
2019-10-25IVGCVSW-4008 Add profiling mode to ExecuteNetworkAron Virginas-Tar
* Removed the requirement for specifying a data file for each input tensor * Added the possibility to generate dummy tensor data (filled with 0s) if no data files are specified by the user * Warn the user when they request to save the output to a file, but the input was generate, therefore rendering the output useless Signed-off-by: Aron Virginas-Tar <Aron.Virginas-Tar@arm.com> Change-Id: I8baed116dcd99fe380e419db322dc7e04ab1c653
2019-10-23Fix build failures on RPi 4BJammy Zhou
Signed-off-by: Jammy Zhou <jammy.zhou@gmail.com> Change-Id: I12562c4a9671cd43884e7c0c023ca463a99c3aa2
2019-10-22IVGCVSW-4021 Fixing failure in the ExecuteNetworkDynamicBackends testNikhil Raj
Change-Id: I24ecd8ccf3e3c1586abc906f6ee9bdfd652e5c39 Signed-off-by: Nikhil Raj <nikhil.raj@arm.com>
2019-10-21IVGCVSW-3989 Create the Counter Directory DecoderFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: If388e60434eae39d82b639d2275680679963624c
2019-10-18IVGCVSW-3721 Add support for startup sequence (Mock Gatord service).Colm Donelan
Fixing logic error in PeriodicCounterCaptureCommandHandler. Default quiet operation should be false and the unit tests should set it to true. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Icabf30819985811e42168a98909b44a6c5f5d4df
2019-10-18IVGCVSW-4005 Add PacketFamilyId to version resolverJim Flynn
Change-Id: Ief9373871438df4e1d353bbc545a3ee4f25c1fb0 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-10-18IVGCVSW-4002 Add FamilyId to CommandHandlerKeyJim Flynn
Change-Id: I0bb0bf77da2bcd7f4746078c4ccee9acc98638a7 Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-10-17IVGCVSW-3721 Add support for startup sequence (Mock Gatord service).Colm Donelan
* Updated ExecuteNetwork to propagate a configured Runtime down to RunTest. * Fixed the creation of PeriodicCounterCaptureCommandHandler to match other handlers. * Moved around some printouts to make the MockGatorD output more useful. * Added details to the exception handling for problems in the GatordMockService receive thread. * Mockutils::ConstructHeader is only used in GatordMockTests. Moved it in there and deleted MockUtils.hpp * Refactored SendPeriodicCounterSelectionList to use ProfilingUtils. * Added PeriodicCounterSelectionResponseHandler to received packet echoed back. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: I4accdbf6cf5dd3f7dcc12b210b8360b4a5e4e277
2019-10-17IVGCVSW-3400 Fixed include directives for Gatord buildsMatteo Martincigh
* Using proper include directives with include paths * The relative paths used were causing trouble when building on other CI systems Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com> Change-Id: I897a80d1f56fbdbc3c714a50a0598210d8f0a03c
2019-10-11IVGCVSW-3551 Fix CounterCaptureHandlingTestFinn Williams
Signed-off-by: Finn Williams <Finn.Williams@arm.com> Change-Id: If481bc80fbad307f14d89beac9dc0d8fc575d788
2019-10-11IVGCVSW-3721 Add support for startup sequence (Mock Gatord service).Colm Donelan
* Receive and process the stream metadata from the client. * Send the connection ack packet. * Wait in a receiving thread and print the packets. * GatordMockTest and Impl for PeriodicCounterCapture CommandHandler * CaptureData class to retain packet data * MockUtils * Update SocketProfilingConnection to fix non blocking receipt of packets. * Restructure directory layout following review comments. * Extract the mock service into a static library in the cmake files. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Signed-off-by: Keith Davis <keith.davis@arm.com> Signed-off-by: Mike Kelly <mike.kelly@arm.com> Signed-off-by: Finn Williams <Finn.Williams@arm.com> Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: I33c1c9f93976708c9315f71290d42cff53b8c075
2019-10-08IVGCVSW-3669 Fix bug parsing multiple InputShapes in ExecuteNetworkFrancis Murtagh
* Change shape separator from semicolon, a command separator, to colon. * Update ExecuteNetwork --help prompts. Change-Id: I6c6d18007cd219482d8187d69962944b833e302e Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2019-10-04IVGCVSW-3948 Adds External Profiling cmdline to ExecuteNetworkJim Flynn
Change-Id: If172bcb64e8202abbde4b8a6cee14f672bc259cd Signed-off-by: Jim Flynn <jim.flynn@arm.com>
2019-09-23Replace uses of non-standard C++:Rob Hughes
* Variable-length array replaced with std::vector * "and" replaced with "&&" (OK, this one is standard but MSVC doesn't like it and it's inconsistent with the rest of the codebase) * Replace u_int8_t with uint8_t Change-Id: I7b968a2cfa85a5492a2a547364464c594efb067b Signed-off-by: Rob Hughes <robert.hughes@arm.com>
2019-09-09IVGCVSW-3720 Start a UDS server that accepts connections.Colm Donelan
* Add a CLI paramter to the Gatord mock client to specify a namespace. * Open a listening socket on that namespace. * Wait for one connection on the socket. Signed-off-by: Colm Donelan <Colm.Donelan@arm.com> Change-Id: Ic85b4defd5ad2010bb255472c030a91a23cec1d9
2019-09-06IVGCVSW-3719 Create test program executable.Colm Donelan
Introduce a new test utility that simulates the Gatord service. This will be used to test the external profiling features. Change-Id: Ib7c75c1302650e140945cd66d272c23af3aac760 Signed-off-by: Colm Donelan <Colm.Donelan@arm.com>
2019-09-06IVGCVSW-3816 Make compute option required in ExecuteNetworkMatthew Jackson
Signed-off-by: Matthew Jackson <matthew.jackson@arm.com> Change-Id: If13b731d95c79e3e296d7dfc6c1ac94bf3a93ff3
2019-09-04IVGCVBENCH-1337 Added additional layer parameters to dot file and -v optionAndre Ghattas
* Generic layer parameters now show up in dot file * Convolution layer parameters have also been added to dot file * ExecucteNetwork has an additional -v flag which generated dot file if there Change-Id: I210bb19b45384eb3639b7e488c7a89049fa6f18d Signed-off-by: Andre Ghattas <andre.ghattas@arm.com> Signed-off-by: Szilard Papp <szilard.papp@arm.com>
2019-09-02IVGCVSW-2945 ExecuteNetwork should have an option to save the output to a fileSadik Armagan
* Added "output-tensor-files,w" option to save output tensors to a file Signed-off-by: Sadik Armagan <sadik.armagan@arm.com> Change-Id: Ida457177c5cbd7dca228772405fd505d03b61bf9
2019-08-29Add a check for the number of output types to ExecuteNetworkMatteo Martincigh
* If the number of the declared output types does not match the number of outputs, throw an error (just like we do for the inputs) Change-Id: I1cb873bf443a31ecdbc11195462e9614ae3a6637 Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-08-28IVGCVSW-3675 Add ExecuteNetwork option to print intermediate layersMatthew Jackson
Signed-off-by: Matthew Jackson <matthew.jackson@arm.com> Change-Id: Id7ab186ec607ff6e5ee6869c4ad562af4c40b97a
2019-08-23IVGCVSW-3547 Use ExecuteNetwork to run a dynamic backend end to end testMatteo Martincigh
* Added path override for dynamic backend loading * Do not default to CpuRef, as there could be dynamic backends loaded at runtime * Do not check right away whether the backends are correct, as more of them can be loaded at runtime as dynamic backends Change-Id: If23f79aa1480b8dfce57e49b1746c23b6b9e6f82 Signed-off-by: Matteo Martincigh <matteo.martincigh@arm.com>
2019-08-22IVGCVSW-3564 Add optional InputLayerBindingID argument to ImageCSVFileGeneratorFinnWilliamsArm
Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com> Change-Id: Ibf2b5ce5e50d72d661a7c720c1f3bb1c0d811700
2019-07-26Fix ModelAccuracyTool and ImageTensorGenerator's command line option typoSiCong Li
Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: Id753fa1ea7a0aabc95b319cb78492f4220b701a4
2019-07-23Fix various uses of non-standard C++:Rob Hughes
* Replace u_int32_t with uint32_t * Replace size_t with uint32_t for initializer list of TensorInfo * Replace variable size arrays with std::vector * Replace reference to local variable during its initialisation Change-Id: I298b3995f1525f90a1ab2416d7e270315698fae3
2019-07-23Fix and clean up ImageTensorGeneratorSiCong Li
* Fix the issue that uint8_t image tensors are written out as characters. * Add doxygen comments. Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: Ic5b3af489f405abcc1ed1e7dd76f56c5ae7ffbf4
2019-07-16MLCE-103 Clean up ModelAccuracyTool and ImageTensorGeneratorSiCong Li
* Fix ImageTensorGenerator command line options * Update ModelAccuracyTool README * Update ImageTensorGenerator README Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I19e573f2b4aa0d7ecab63dc3886a66aa9d8724bc
2019-07-15MLCE-103 Add necessary enhancements to ModelAccuracyToolSiCong Li
* Evaluate model accuracy using category names instead of numerical labels. * Add blacklist support * Add range selection support Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I7b1d2d298cfcaa56a27a028147169404b73580bb
2019-07-11IVGCVSW-3492 - Fix for Array must be initialized errorKevin May
Signed-off-by: Kevin May <kevin.may@arm.com> Change-Id: Ic4177278bb8fb9e6e7e3c03ff8f49bfa99f5efdd
2019-07-09MLCE-103 Remove hardcoded output shape in ModelAccuracyToolSiCong Li
We can obtain the output tensor shape from the model provided by the user. Signed-off-by: SiCong Li <sicong.li@arm.com> Change-Id: I5074734315174c1b5dc8eea1eff18a4a1c566f2a
2019-07-09MLCE-103 Use ImageTensorGenerator in ModelAccuracyToolSiCong Li
* Refactor ImageTensorGenerator into a header so that it can be used inside ModelAccuracyTool. ModelAccuracyTool now can accept image files instead of tensor text files as input. ImageTensorGenerator remains a standalone tool for converting images into tensors text files. * Inside the ImageTensorGenerator, use the existing image preprocessing method InferenceTestImage::Resize which has the correct image normalization techniques and other resize utilities. Change-Id: Ia662fed4752fb81c5cfa6d15967c6aae4aaf1155 Signed-off-by: SiCong Li <sicong.li@arm.com>
2019-06-26IVGCVSW-3193 Allow ExecuteNetwork to have qasymm8 input typeNarumol Prangnawarat
and add option to quantize float inputs to qasymm8 Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: I54b13b8b53c31c05658fe9c310ca5a66df759aa5
2019-06-20IVGCVSW-3193 Update bounding box value of MobileNet SSD after refactorNarumol Prangnawarat
Convolution2d and DepthwiseConvolution2d to use Encoders and Decoders Signed-off-by: Narumol Prangnawarat <narumol.prangnawarat@arm.com> Change-Id: Ic87b8ce6f68343983f3c825902425516cbb23b06
2019-06-19IVGCVSW-3299 Add Uint8 Support to Model Accuracy CheckerFrancis Murtagh
* Seperate ExecuteNetwork main function into standalone application * Include NetworkExecutionUtils header and remove duplicate functions * Add uint8 and int32 support to ModelAccuracyChecker Change-Id: I5fb4bc147232f8388f37eea7db5130b04fd215d1 Signed-off-by: Francis Murtagh <francis.murtagh@arm.com>
2019-05-31IVGCVSW-3182 Updated Validation filesFinnWilliamsArm
* Validation files need to be changed due to image pre-processor fix: IVGCVSW-3129 * Updated TfLiteVGG16Quantized-Armnn Validation.txt * Updated TfLiteMobileNetQuantizedSoftmax Validation.txt Change-Id: I801978cc9d658542e5b5d966347de3381191ad66 Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com>
2019-05-30IVGCVSW-3182 Corrected expected model predictionsFinnWilliamsArm
* Changed expected predictions for TfLiteVGG16Quantized-Armnn.cpp * Changed expected predictions for TfLiteMobileNetQuantizedSoftmax-Armnn Change-Id: I3fe0bd3f6e44655b14b10887bc40fb0df31f81c8 Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com>
2019-05-27IVGCVSW-3129 Image pre-processing fix for TFLiteFinnWilliamsArm
* Resized images for quantized models are now statically cast to uint8 instead of quantized * Removed optional quantization parameters from ImagePreprocessor constructor * Changed mean and scale for TFLite models Signed-off-by: FinnWilliamsArm <Finn.Williams@arm.com> Change-Id: Id5ffdf77f3614d10c417e769bd8ffc4a4c07308b