summaryrefslogtreecommitdiff
path: root/source/use_case
AgeCommit message (Collapse)Author
2023-03-21MLECO-3802: [Maintenance] Remove Pillow warning23.02Isabella Gottardi
- Image.Resampling.BILINEAR replace deprecated Image.BILINEAR - Trivial documentation fixes Change-Id: Ia75af2d2bf171085d4a0a2c472f0e3f94dbdc5b9 Signed-off-by: Isabella Gottardi <isabella.gottardi@arm.com>
2023-03-17MLECO-3842, MLECO-3801, MLECO-3899: Minor improvementsKshitij Sisodia
Some minor improvements in this patch: * Added notes on troubleshooting WSL2 build issues. * Fixed a stray guard for MPS3_PLATFORM from noise reduction use-case. * The default build script `build_default.py` will now return an error code to the calling process if it fails. Change-Id: I4557a402646fdf903b2cb043bf68d5d0b0d12972 Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2022-12-19MLECO-3611: Formatting fixes for generated files.Kshitij Sisodia
Template files updated for generated files to adhere to coding guidelines and clang format configuration. There will still be unavoidable violations, but most of the others have been fixed. Change-Id: Ia03db40f8c62a369f2b07fe02eea65e41993a523 Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2022-12-01MLECO-3620 MLECO-3619: Update to 22.11 dependencies22.11-rc122.11Richard Burton
* CMSIS-NN is now a seperate dependency * Added inclusive language commitment * TensorFlow Lite Micro dependency is moved ahead of 22.11 to fix compilation issue Change-Id: I60e3311ff7da2ce064cbcdca054a86bdd1f620d8
2022-11-17MLECO-3583: Update copyright notice according to new guidelinesRichard Burton
Change-Id: I0f057b33993e5196a60e52f4fb0c60e09693dcfe
2022-10-06MLECO-3164: Additional refactoring of KWS APIRichard Burton
Part 1 * Add KwsClassifier * KwsPostProcess can now be told to average results * Averaging is handlded by KwsClassifier * Current sliding window index is now an argument of DoPreProcess Change-Id: I07626da595ad1cbd982e8366f0d1bb56d1040459
2022-09-28MLECO-3518: Separates CMakePrestsMaksims Svecovs
Separates CMakePresets to respective. Adds options preset file with log-level and single-input for use-cases. Adds use-case file with base build preset with all the targets. Adds a configurable targets to all build presets. Adds additional config/build preset to show-off options-presets. Signed-off-by: Maksims Svecovs <maksims.svecovs@arm.com> Change-Id: Id82ce9c5b8d7cc48b80d784141dc22efa2690222
2022-09-26MLECO-3254 Default to using only one file per UCEanna O Cathain
Signed-off-by: Eanna O Cathain <eanna.ocathain@arm.com> Change-Id: I4a1cd2b5746cb479ae0d81ed973961cec2f3046e
2022-08-25MLECO-3252: Minor documentation additionsKshitij Sisodia
Documentation md files added under source tree with links to the main docs. Minor updates to FAQs for MLECO-3251 as well. Change-Id: Ifdcc587f2fcf77228fd46e211d3f9c3963bc9b97 Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2022-05-20Remove dependency on extern defined constants from OD use caseRichard Burton
OD API now takes in these paramaters as part of the constructor Change-Id: I4cce25e364b2a99847b4540440db059997f6a81b
2022-05-12MLECO-3186: Each use case should same namespace convention as KWS and ASRLiam Barry
Certain UCs required additional work due to case context variables which also became part of a namespace in generated files. Solution was to declare these extra variables as part of the UC namespace in the respective model.hpp files. Additional changes to standardise use of namespaces may be required - proposing new task. Minor typo and rewording of customizing.md in relevant sections included. Signed-off-by: Liam Barry <liam.barry@arm.com> Change-Id: Ie78f82a30be252cb841136ea5115f21fc8d762cb
2022-05-11MLECO-3187: Remove NPU op inclusion checksMatthew Sloyan
* If an optimized model is accidentally supplied with Ethos-U support disabled it will return from the model.Init() function before it gets to these checks so they are redundant. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: Ibe25531347ce29cb0866a9cc087c7267673ab4da
2022-05-10MLECO-3189: Object detection keeps all detectionsMatthew Sloyan
* Clear vector before each inference to make sure there are no leftover results when running all inferences. Signed-off-by: Matthew Sloyan <matthew.sloyan@arm.com> Change-Id: If2417364151d7f380c3311447b10f971a5475f9e
2022-05-06MLECO-3183: Refactoring application sourcesKshitij Sisodia
Platform agnostic application sources are moved into application api module with their own independent CMake projects. Changes for MLECO-3080 also included - they create CMake projects individial API's (again, platform agnostic) that dependent on the common logic. The API for KWS_API "joint" API has been removed and now the use case relies on individual KWS, and ASR API libraries. Change-Id: I1f7748dc767abb3904634a04e0991b74ac7b756d Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2022-05-05MLECO-3171: Add flag to make VWW grayscale conversion optionalRichard Burton
Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I4ae40a60efc0c09f27b02f739769238e95bb112c
2022-05-04MLECO-3173: Add AD, KWS_ASR and Noise reduction use case API'sRichard Burton
Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I36f61ce74bf17f7b327cdae9704a22ca54144f37
2022-04-27MLECO-3076: Add use case API for object detectionRichard Burton
* Removed unused prototype for box drawing Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I1b03b88e710a5efb1ff8e107859d2245b1fead26
2022-04-22MLECO-3174: Minor refactoring to implemented use case APISRichard Burton
Looks large but it is mainly just many small adjustments Removed the inference runner code as it wasn't used Fixes to doc strings Consistent naming e.g. Asr/Kws instead of ASR/KWS Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I43b620b5c51d7910a29a63b509ac4d8a82c3a8fc
2022-04-22MLECO-3077: Add ASR use case APIRichard Burton
* Minor adjustments to doc strings in KWS * Remove unused score threshold in KWS Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: Ie1c5bf6f7bdbebb853b6a10cb7ba1c4a1d9a76c9
2022-04-19MLECO-3078: Add VWW use case APIRichard Burton
We now expect that img_class and vww use cases model inputs should have 4 dims as dictated by use case logic Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I67a57a3a28a7ff2e09c917c40e9fc2c08384a45c
2022-04-13MLECO-3075: Add KWS use case APIRichard Burton
Removed some of the templates for feature calculation that we are unlikely to ever use. We might be able to refactor the feature caching and feature calculator code in the future to better integrate it with with PreProcess API. Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: Ic0c0c581c71e2553d41ff72cd1ed3b3efa64fa92
2022-04-08MLECO-3070: Further HAL cleanup.Kshitij Sisodia
Cleaning up HAL sources by removing unnecessary redirections with function pointers. The "platform packages" under HAL are now streamlined enough to not need any major HAL wrapping (as was the case before). This allows us to have a very thin HAL layer that sits on top of the platform and compnent packs. Also helps in getting rid of "hal platform" pointer being passed around in the code to use any HAL functionality. Change-Id: I04b2057f972aad7a5cfb4a396bcdf147c9f9ef1c Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2022-04-07MLECO-3079: Implement image classification APIRichard Burton
All ML related work for image classification seperated out and accessed via new Runner Further work to improve profiling integration to be done in follow up ticket: MLECO-3154 Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I0fe0550c932241a2d335a560ecb7abc329c934e9
2022-04-06MLECO-3096: Removing data_acq and data_psnKshitij Sisodia
Further to the HAL refactoring done in previous commits, this CR simpifies HAL by removing data_acq and data_psn "modules". The associated function pointers have been removed. Change-Id: I04c194c08dfe0aff98ce4e0f0f056bac254c137d Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2022-02-16MLECO-2946: Use cmake option to select which image display on LCDIsabella Gottardi
Signed-off-by: Isabella Gottardi <isabella.gottardi@arm.com> Change-Id: I076c3431e8106ff9430e66727607438c36d1acbc
2022-02-15MLECO-2946: Draw boxes directly on the LCDRichard Burton
* No longer copy the source image * Boxes are drawn directly to LCD rather than on source image * Change c style casts to static casts Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: Ib8e926cb1a87bc2c40424eb5aace40170c526f1d
2022-02-14MLECO-2874: Move NMS out of the OD use_caseRichard Burton
* Add ImageUtils * Move image related code from UseCaseCommonUtils to ImageUtils * Move NMS related code to ImageUtils * Delete test specific ImageUtils and use new ImageUtils Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: Icbf5dd9c6a941b0126ecdf69a0c9d9969f22729f
2022-02-10MLECO-2682: CMake and source refactoring.alexander
MLECO-2930: logging macros were extracted from hal.h and used separately around the code. MLECO-2931: arm_math lib introduced, cmsis-dsp removed from top level linkage. MLECO-2915: platform related post-build steps. Change-Id: Id718884e22f262a5c070ded3f3f5d4b048820147 Signed-off-by: alexander <alexander.efremov@arm.com>
2022-02-08MLECO-2873: Object detection usecase follow-upIsabella Gottardi
Change-Id: Ic14e93a50fb7b3f3cfd9497bac1280794cc0fc15 Signed-off-by: Isabella Gottardi <isabella.gottardi@arm.com>
2022-01-27Face detection demo from Emza Visual SenseMichael Levit
Signed-off-by: Michael Levit michaell@emza-vs.com Change-Id: I7958b05b5dbe9a785e0f8a241b716c17a9ca976f
2022-01-25MLECO-2872 Minor improvement to CommonUseCaseUtilsLiam Barry
Replaced overloaded PresentInferenceresults with single function and removed logic to handle arguments which are no longer passed. Change-Id: I745271638fcf78b7121c2a4b95844b752643bac2 Signed-off-by: Liam Barry <liam.barry@arm.com>
2022-01-04MLECO-2835: Remove magic number for ASR-KWSLiam Barry
Replaced ctx.set/get<uint32>(keywordindex) with keyword itself as const std::string& Change-Id: I1811d93548105d6db58e57b88675f9b41e66d914 Signed-off-by: Liam Barry <liam.barry@arm.com>
2021-12-30MLECO-2816: Trivial fix for inference runner output.Kshitij Sisodia
Aligning with output from other use cases, inference runner output now prints the number of inferences as one. Change-Id: Ifc03385a5de86477508fe8c377d481b7140a8429 Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2021-12-24MLECO-2599: Replace DSCNN with MicroNet for KWSKshitij Sisodia
Added SoftMax function to Mathutils to allow MicroNet to output probability as it does not nativelu have this layer. Minor refactoring to accommodate Softmax Calculations Extensive renaming and updating of documentation and resource download script. Added SoftMax function to Mathutils to allow MicroNet to output probability. Change-Id: I7cbbda1024d14b85c9ac1beea7ca8fbffd0b6eb5 Signed-off-by: Liam Barry <liam.barry@arm.com>
2021-12-10MLECO-2684: Standardize LCD behaviourRichard Burton
* LCD display behavior for Run All now matches Run Next * Remove repeated code Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I16706187fd4e7a59dd935783f5bfb8731435f381
2021-12-09 MLECO-2082 Fixes and improvements from OOB21.11Ayaan Masood
-Fixed noise_reduction CMake bug cause inference to fail when non-default mac_units passed to build script -Inference complete message added to noise_reduction LCD -Doc update clarfiy vela.ini config file for compiling to non-default memory modes -QOL improvement by adding a note on how to make path variables permenant when configuring Arm compilers Change-Id: Id798b25638260721d8e48468b7a5942bd802d63b
2021-12-07MLECO-2723: Updating RNNoise to use 512 frame sizeRichard Burton
* CMSIS-DSP acceleration will now be used for FFT in RNNoise pre-processing * PESQ scores tested and similar Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: Ifeebc041f58867909b27c948950e08f8f39ef276
2021-11-25MLECO-2426: Support for new Corstone-300 app note AN552 rev B.Kshitij Sisodia
These changes will limit the use of FPGA internal SRAM from a max of 4MiB to 2MiB and the BRAM from 2MiB to 1MiB. Change-Id: I69c8e695aee26ff4f235bfe83ffd26efbd66f547
2021-11-12MLECO-2507: Address coverity warnings & refactor var namesGeorge Gekov
Change-Id: I90fca833d501bbd4db4fd99903b9ffef161a9a6b Signed-off-by: George Gekov <george.gekov@arm.com>
2021-11-10MLECO-2354 MLECO-2355 MLECO-2356: Moving noise reduction to public repositoryRichard Burton
* Use RNNoise model from PMZ * Add Noise reduction use-case Signed-off-by: Richard burton <richard.burton@arm.com> Change-Id: Ia8cc7ef102e22a5ff8bfbd3833594a4905a66057
2021-10-29MLECO-2512: Minor improvement for helper scripts.Kshitij Sisodia
Python scripts 'build_default.py' and 'set_up_default_resources.py' now allow building for non-default Ethos-U configurations: H32, H64, H256 and Y512. Change-Id: Iefdbf135410396c4dc0be73462644725d4b47910
2021-10-25MLECO-2458 and MLECO-2476 [Fix] VWW IFM quant stepIsabella Gottardi
* Changed image->cc conversion to be similar with preprocessing of img_class and vww models: images are scaled maintaing the aspect ration and then the centre crop of the correct size is taken. * VWW applies input quantization info to the int8 image (prior converted to [0,1] float range). * Changed adult_blur to a image without person. * Fix menu print when selecting a specific ifm to run (Select message was displayed after typing something) Change-Id: Ie6cde7ab4835ea842667b87397458a5d32131df3
2021-10-05MLECO-2395: Allow users to select Ethos-U memory modeIsabella Gottardi
Change-Id: Icf09410f12072e8d7850dd1e540c3243af24ed09
2021-09-24MLECO-2345: Adding dynamic load support for FVPsKshitij Sisodia
With this patch, the generic inference runner use-case can be configured to accept the model tflite file at run-time via the FVP's command line parameters. Same is true for the IFM and the inference results can be dumped out too. NOTE: this change is only for supporting the FVP, the FPGA implementation will not allow additional loading for the changes in this patch to be useful. Change-Id: I1318bd5b0cfb7bb635ced6fe58d22c3e401d2547
2021-09-16MLECO-2082: Adding visual wake word use case21.08Éanna Ó Catháin
MLECO-2083: Refactoring img_class and visual wake word *Added source files for visual wake word *Added tests *Added docs *Added new images for visual wake word demo *Refactored common functions in img_class, visual wake word and other usecases Change-Id: Ibd25854e19a5517f940a8d3086a5d4835fab89e9 Signed-off-by: Éanna Ó Catháin <eanna.ocathain@arm.com>
2021-08-12MLECO-1904: Update to use latest TFLuRichard Burton
* Now uses seperate TFLu github repo * Fixes to align with API changes * Update ASR model ops and re-enable ASR inference tests * Set default release level to release_with_logs Signed-off-by: Richard Burton <richard.burton@arm.com> Change-Id: I57612088985dece1413c5c00a6e442381e07dd91
2021-08-05MLECO-2138: Fix line feeding with GCCGeorge Gekov
Signed-off-by: George Gekov <george.gekov@arm.com> Change-Id: I32c05897085554f469bedc55e4e2800788121c55
2021-08-03MLECO-2051: Work with Corstone-300 + Ethos-U65Cisco Cervellera
Change-Id: I64ab930a1de5210f435f91bed7600a700581946f Signed-off-by: Isabella Gottardi <isabella.gottardi@arm.com> Reviewed-on: https://eu-gerrit-2.euhpc.arm.com/c/ml/ecosystem/ml-embedded-evaluation-kit/+/459126 Tested-by: mlecosys <mlecosys@arm.com> Tested-by: George Gekov <george.gekov@arm.com> Reviewed-by: George Gekov <george.gekov@arm.com> Reviewed-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
2021-07-09MLECO-2036: Fix Vela3 documentation references & update Vela .ini configurationGeorge Gekov
Signed-off-by: George Gekov <george.gekov@arm.com> Change-Id: I92b9ab60974ad266246994deae5833f7f374633d
2021-07-08MLECO-1987: Minor refactoring.alexander
ASRSlidingWindow can be used in other use-cases, thus it was renamed to decouple from ASR. Signed-off-by: alexander <alexander.efremov@arm.com> Change-Id: I2df977e4f18f490a532e0f27e3625b153ca464d7