MLIA-650 Implement new CLI changes

Breaking change in the CLI and API: Sub-commands "optimization",
"operators", and "performance" were replaced by "check", which
incorporates compatibility and performance checks, and "optimize" which
is used for optimization. "get_advice" API was adapted to these CLI
changes.

API changes:

* Remove previous advice category "all" that would perform all three
  operations (when possible). Replace them with the ability to pass a
  set of the advice categories.
* Update api.get_advice method docstring to reflect new changes.
* Set default advice category to COMPATIBILITY
* Update core.common.AdviceCategory by changing the "OPERATORS" advice
  category to "COMPATIBILITY" and removing "ALL" enum type.
  Update all subsequent methods that previously used "OPERATORS" to use
  "COMPATIBILITY".
* Update core.context.ExecutionContext to have "COMPATIBILITY" as
  default advice_category instead of "ALL".
* Remove api.generate_supported_operators_report and all related
  functions from cli.commands, cli.helpers, cli.main, cli.options,
  core.helpers
* Update tests to reflect new API changes.

CLI changes:

* Update README.md to contain information on the new CLI
* Remove the ability to generate supported operators support from MLIA
  CLI
* Replace `mlia ops` and `mlia perf` with the new `mlia check` command
  that can be used to perform both operations.
* Replace `mlia opt` with the new `mlia optimize` command.
* Replace `--evaluate-on` flag with `--backend` flag
* Replace `--verbose` flag with `--debug` flag (no behaviour change).
* Remove the ability for the user to select MLIA working directory.
  Create and use a temporary directory in /temp instead.
* Change behaviour of `--output` flag to not format the content
  automatically based on file extension anymore. Instead it will simply
  redirect to a file.
* Add the `--json` flag to specfy that the format of the output should
  be json.
* Add command validators that are used to validate inter-dependent
  flags (e.g. backend validation based on target_profile).
* Add support for selecting built-in backends for both `check` and
  `optimize` commands.
* Add new unit tests and update old ones to test the new CLI changes.
* Update RELEASES.md
* Update copyright notice

Change-Id: Ia6340797c7bee3acbbd26601950e5a16ad5602db

1 files changed, 10 insertions, 11 deletions

diff --git a/tests_e2e/test_e2e.py b/tests_e2e/test_e2e.py
index fb40735..26f5d29 100644
--- a/tests_e2e/test_e2e.py
+++ b/tests_e2e/test_e2e.py
@@ -1,4 +1,4 @@
-# SPDX-FileCopyrightText: Copyright 2022, Arm Limited and/or its affiliates.
+# SPDX-FileCopyrightText: Copyright 2022-2023, Arm Limited and/or its affiliates.
 # SPDX-License-Identifier: Apache-2.0
 """End to end tests for MLIA CLI."""
 from __future__ import annotations
@@ -20,7 +20,6 @@ from typing import Iterable
 import pytest
 
 from mlia.cli.config import get_available_backends
-from mlia.cli.config import get_default_backends
 from mlia.cli.main import get_commands
 from mlia.cli.main import get_possible_command_names
 from mlia.cli.main import init_commands
@@ -230,19 +229,19 @@ def check_args(args: list[str], no_skip: bool) -> None:
     """Check the arguments and skip/fail test cases based on that."""
     parser = argparse.ArgumentParser()
     parser.add_argument(
-        "--evaluate-on",
-        help="Backends to use for evaluation (default: %(default)s)",
-        nargs="*",
-        default=get_default_backends(),
+        "--backend",
+        help="Backends to use for evaluation.",
+        nargs="+",
     )
 
     parsed_args, _ = parser.parse_known_args(args)
-    required_backends = set(parsed_args.evaluate_on)
-    available_backends = set(get_available_backends())
-    missing_backends = required_backends.difference(available_backends)
+    if parsed_args.backend:
+        required_backends = set(parsed_args.backend)
+        available_backends = set(get_available_backends())
+        missing_backends = required_backends.difference(available_backends)
 
-    if missing_backends and not no_skip:
-        pytest.skip(f"Missing backend(s): {','.join(missing_backends)}")
+        if missing_backends and not no_skip:
+            pytest.skip(f"Missing backend(s): {','.join(missing_backends)}")
 
 
 def get_execution_definitions() -> Generator[list[str], None, None]: