aboutsummaryrefslogtreecommitdiff
path: root/applications/inference_process/include/inference_process.hpp
AgeCommit message (Collapse)Author
2023-04-26Make inference process reusableMåns Nilsson
Private members are protected and run job is virtual to make it more flexible to customize running jobs. Change-Id: I2e4a0760000a451eead062ef758b467ea248dffe
2022-08-22Check the validity of the buffer before parsing the modelDavide Grohmann
If the buffer does not point to a well defined flatbuffer the parsing segfaults. Change-Id: Icb8dfef37dc28b2b7a22c6d3804851be8198aa9d
2022-06-14Refactor performance measurementsJonny Svärd
Change 'Inference runtime' to measure CPU cycles for the Tensorflow Lite Micro interpreter.Invoke() call. Add 'Operator(s) runtime' print that prints a summary for cycles spent on all operators during an inference. (This is equivalent to the old reported 'Inference runtime') Move prints out of the EndEvent() function in ArmProfiler as it otherwise interferes with the inference cycle measurement. Change-Id: Ie11b5abb5b12a3bcf5a67841f04834d05dfd796d
2022-01-31Set TFLu external contextKristofer Jonsson
Remove PMU configuration from the InferenceJob struct and add an external context parameter intead. The external context is passed to the TFLu interpreter and will be returned in the ethosu_inference_begin() and ethosu_inference_end() callbacks. Change-Id: I6dab04c0ab5088b1325be365d77d65d1182e7441
2022-01-27Inference process updateKristofer Jonsson
Split runJob() into smaller functions to make the code easier to read and maintain. Correct return type of Layer By Layer profiler GetTotalTicks(). Change-Id: Ie414522017b3b6c6da9a09182439dbe4b2efdb1f
2022-01-14Remove unused functionsKristofer Jonsson
Change-Id: Idffa9b21385451883795412076ea48218d6c74ba
2021-12-22Use lbl-profiler to setup PMU and PMU eventsJonny Svärd
Adapt layer-by-layer profiler to handle PMU event configuration, PMU setup and retrieving PMU counter values. Adapt the inference process application to support the lbl-profiler PMU setup and retrieve/save PMU counter values in the InferenceJob struct. Change-Id: I1667a5b11c43c54e7d28232b594dd118bf3f79a8
2021-03-31Update license headersAnton Moberg
Update all license headers to the correct years Change-Id: I638a854b39b4afe8db6a4a76ca6dcb89c126e3c1
2021-02-12core_software - Move TensorArena21.02-rc2Anton Moberg
Moved TensorArena in inference_process.ccp to application level. InferenceProcess class now takes TensorArena pointer and TensorArenaSize as parameters. Needs to be set by application before runJob() is called. Change-Id: I530b96039868305fa903ae7f93419d9d00f9c16f
2020-12-08MLBEDSW-3269 Add pmu counters for inference_processBhavik Patel
Change-Id: I6594acc228fe8048f56cb96ac7846a87491eed38
2020-11-25Improved cache maintenanceKristofer Jonsson
Invalidating and cleaning buffers exchanged between Core and remote CPU. Change-Id: Icd9ce6c916422a6bbcdd42e31651a622240d0ce4
2020-09-15Support inferences with multiple inputs and outputsKristofer Jonsson
Update inference process apis to support inferences with multiple inputs and multiple outputs. Update message process to handle new inference request message with an array of input- and output buffers. Change-Id: Ide0897385a1d829f58edace79140d01d8e3b85a3
2020-09-01Moving message- and inference processes to core software20.08Kristofer Jonsson
Change-Id: I76e94440402d58848116d06ff3fd1ed2000ac505