aboutsummaryrefslogtreecommitdiff
path: root/verif/conformance
AgeCommit message (Collapse)Author
2022-12-15Create MI tests for Activation: SIGMOID, TANHJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I75d6280ecb5219d50c91d14029e90ff3a2f6eb06
2022-12-14Create MI tests for EW Ternary: SELECTJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I1eb4fbadb9117e28f87a36ee828d65d896d834f0
2022-12-13Create MI tests for EW Unary: ABS, CEIL, FLOOR, NEGATEJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I2ee6d4f706958b6261fd41dd245a3d01d3f8cecf
2022-12-13Create MI tests for Reduction: REDUCE_MIN, REDUCE_MAXJames Ward
* Also include test_select improvements Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I306a8ed57975bc429d6cd5a8a24777b889593ddf
2022-12-09Create MI tests for EW Binary: MINIMUM, MAXIMUMJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I6824e30cece291fceaedd727132a6b211762baa9
2022-12-01Fix conformance desc.json contains correct profilesJeremy Johnson
Must seperate conformance generation by profile to stop desc.json being incorrectly overwritten by different profile information. Change-Id: Iead01c9fcc659e48ef1d350a860b03c2b0a05ffa Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
2022-11-21Create MI tests for Data Nodes: CONST, IDENTITYJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I7280b3bf31aa377a6f6af7713627f34eb445e689
2022-11-21Create MI tests for Data Layout: CONCAT, PAD, RESHAPE, REVERSE, SLICE, TILE, ↵James Ward
TRANSPOSE Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I626d9ece0290c5104c9ac42d20be2f9db1e55fa7
2022-11-21Create MI tests for Scatter/Gather: SCATTER, GATHERJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I44c0843fa049546582ca1111795342d5035a329c
2022-11-21Create MI tests for Tensors: ARGMAX, MAX_POOL2DJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I908d88ddf7c52d98ce6d533396b5c439f15750f5
2022-11-19Initial set up of Main Inference conformance test genJeremy Johnson
tosa-verif-build-tests - option for setting FP values range - option for recursively finding tests - change from os.path to Path tosa_verif_result_check - option to supply FP tolerance - output difference and max tolerance on contents mismatch - change from os.path to Path MI conformance - contains examples of AVG_POOL2D and CONV2D tests Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I8e1645cd8f10308604400ea53eef723ca163eed7
2022-10-26Add TILE bool tests & rename CAST/RESCALE testsJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: If9639a94c8e7322d470a1ca97e9e95d821683629
2022-10-13Minor fixes & add FP16 support to refmodel testing and conformance genJeremy Johnson
Improve base inference conformance generation: * Change to target specific dtypes required for conformance tests. * Reduce dimension sizes of ERROR_IF tests. NOTE: Will impact tensor, clamp and all ERROR_IF tests. Add option to change seed on conformance generation for extra testing. Stop creation of convolution tests with negative output dimensions. Improve reporting on failing to allocate tensor due to above issue. Fix runner to correctly pass ref model debug flags. Update reference_model examples. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I992180dcfe265a7d50edfb151c9f38eeaef5c369
2022-08-30Update RESCALE testing to match no rank restrictionsEric Kunze
Matches changes to the specification loosening the rank requirements for the RESCALE operation. Includes removing wrong rank testing for RESCALE, and increasing conformance testing to rank 5 Signed-off-by: Eric Kunze <eric.kunze@arm.com> Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I4e15d4bd8f448e1ec81d9a8bbcd231c286b64a30
2022-08-11Update RESIZE operator in test generator for spec updatesJeremy Johnson
* Add common screen aspect ratios with borders to random pool of tests * Add up/downscaling to random pool Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Iee8e3f5ed6bd5c941816474df20a7fd433646d6b Signed-off-by: James Ward <james.ward@arm.com>
2022-07-14Add profile to all created conformance tests.Jeremy Johnson
Add supported profiles for each test in convert2conformance and tosa_verif_conformance_generator. Enable filtering of profile tests on running in tosa_verif_run_tests. Reorganize arguments in conformance_generator to have more important ones first. Change-Id: Ie6e5b68727adb3c39b04aa482dd6433788f7bcc9 Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
2022-07-12Add conformance generator scriptsJeremy Johnson
Change-Id: I5cb16ea1f47ee454f03a1d5182827e3fd9f49128 Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>