MLIA-551 Rework remains of AIET architecture

Re-factoring the code base to further merge the old AIET code into MLIA.

- Remove last traces of the backend type 'tool'
- Controlled systems removed, including SSH protocol, controller,
  RunningCommand, locks etc.
- Build command / build dir and deploy functionality removed from
  Applications and Systems
- Moving working_dir()
- Replace module 'output_parser' with new module 'output_consumer' and
  merge Base64 parsing into it
- Change the output consumption to optionally remove (i.e. actually
  consume) lines
- Use Base64 parsing in GenericInferenceOutputParser, replacing the
  regex-based parsing and remove the now unused regex parsing
- Remove AIET reporting
- Pre-install applications by moving them to src/mlia/resources/backends
- Rename aiet-config.json to backend-config.json
- Move tests from tests/mlia/ to tests/
- Adapt unit tests to code changes
- Dependencies removed: paramiko, filelock, psutil
- Fix bug in corstone.py: The wrong resource directory was used which
  broke the functionality to download backends.
- Use f-string formatting.
- Use logging instead of print.

Change-Id: I768bc3bb6b2eda57d219ad01be4a8e0a74167d76

1 files changed, 66 insertions, 0 deletions

diff --git a/src/mlia/backend/output_consumer.py b/src/mlia/backend/output_consumer.py
new file mode 100644
index 0000000..bac4186
--- /dev/null
+++ b/src/mlia/backend/output_consumer.py
@@ -0,0 +1,66 @@
+# SPDX-FileCopyrightText: Copyright 2022, Arm Limited and/or its affiliates.
+# SPDX-License-Identifier: Apache-2.0
+"""Output consumers module."""
+import base64
+import json
+import re
+from typing import List
+from typing import Protocol
+from typing import runtime_checkable
+
+
+@runtime_checkable
+class OutputConsumer(Protocol):
+    """Protocol to consume output."""
+
+    def feed(self, line: str) -> bool:
+        """
+        Feed a new line to be parsed.
+
+        Return True if the line should be removed from the output.
+        """
+
+
+class Base64OutputConsumer(OutputConsumer):
+    """
+    Parser to extract base64-encoded JSON from tagged standard output.
+
+    Example of the tagged output:
+    ```
+        # Encoded JSON: {"test": 1234}
+        <metrics>eyJ0ZXN0IjogMTIzNH0</metrics>
+    ```
+    """
+
+    TAG_NAME = "metrics"
+
+    def __init__(self) -> None:
+        """Set up the regular expression to extract tagged strings."""
+        self._regex = re.compile(rf"<{self.TAG_NAME}>(.*)</{self.TAG_NAME}>")
+        self.parsed_output: List = []
+
+    def feed(self, line: str) -> bool:
+        """
+        Parse the output line and save the decoded output.
+
+        Returns True if the line contains tagged output.
+
+        Example:
+        Using the tagged output from the class docs the parser should collect
+        the following:
+        ```
+            [
+                {"test": 1234}
+            ]
+        ```
+        """
+        res_b64 = self._regex.search(line)
+        if res_b64:
+            res_json = base64.b64decode(res_b64.group(1), validate=True)
+            res = json.loads(res_json)
+            self.parsed_output.append(res)
+            # Remove this line from the output, i.e. consume it, as it
+            # does not contain any human readable content.
+            return True
+
+        return False