aboutsummaryrefslogtreecommitdiff
path: root/verif
AgeCommit message (Collapse)Author
2021-07-20Add INT8 table operator support to test generator.Jeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I5f01fa589692f7c6d556a4c22a44caec7c906b9d
2021-07-13Make operator tests follow consistent naming schemeMatthew Haddon
* By making the naming scheme consistent for MUL tests (shape_type_perm_shift) we are more easily able to parse parameters. This is the same system used for operators like RESHAPE, where perm0 is the only permutation allowed, but it still included in the test name. * For multiple operators axis and axis value were split by an underscore, Now the form is axisX in line with other parameters. Signed-off-by: Matthew Haddon <matthew.haddon@arm.com> Change-Id: I92e5af6fd1e2b83bdb23ac4a4ab350010aeeeccb
2021-07-13Allow selection of higher rank tests using --target-rankJeremy Johnson
* The default rank range has been increased from 1-4 to 1-6. * Higher ranks often make tests too large so a default_test_rank_range has been included which makes the test generator produce only tests with ranks 1-4. * The user can now specify target-rank up to rank 6 which is allowed for all operators with the default rank range. * The maximum rank allowed (6) stored in TOSA_TENSOR_MAX_RANK variable. * User specified target shapes up to maximum rank are accepted without need for setting target-rank filter. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ie4ca408d329cb1000ce9d3592b2c7d62bf311b3b
2021-07-09Fix bug causing reshape rank not to match test description.Matthew Haddon
* Tests produced now correctly display the rank being reshaped to in the file name. Signed-off-by: Matthew Haddon <matthew.haddon@arm.com> Change-Id: Ic31fce68b6b8bf7aa52686d54752d90d4b7e2242
2021-07-07Fix bug causing identical reshape permutationsMatthew Haddon
* When generating permutations of a reshape operator test there was no check to ensure that the permutation was unique, this patch adds a check to ensure that no two newShape variables are the same. * Added a 'escape_counter' which will break out of while loop if it continues on for too long. Signed-off-by: Matthew Haddon <matthew.haddon@arm.com> Change-Id: I231eb9b546a73431835b5dc899784f69cc22a773
2021-06-28Fix transpose test gen of permutations & rankJeremy Johnson
Change transpose permutation generation to limit to the number of possible permutations that can be created by the shape size or the argument setting which ever is smaller. Also make sure all permutations up to this number are generated rather than randomly skipped due to duplicates. Allow rank 1 transpose tests as the specification allows rank 1. Change-Id: I28ea64c1d819f3af72c97bed43cfe7279c7e2f9c Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
2021-06-24Update to use new serialization_lib API.Kevin Cheng
- Constant tensors are now initialized from embedded u8 array instead from numpy. - Python unit test generator and built-in test hasn't been updated. Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Change-Id: I5cb86f8e5ec8f23fee5dcbf257874a0f204ede04
2021-06-09adding batch dimension to MatMul.Kevin Cheng
Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Change-Id: I83f75dd5beb60fe7ca2d573ea0f81bac4cd62a07
2021-06-04Rewrite model frontend to be json-driven.Kevin Cheng
Change-Id: Iac786eff96183938d2fd11cde9313c6e8e1270a5
2021-05-13Fix typo in DIV unit test generatorKevin Cheng
Change-Id: Id253b62af906a7ffbdbc0d338b6ec92d3795d1c6
2021-05-12Update to v0.22.0Kevin Cheng
- remove identityN and placeholder - add div - update serialization_lib hash - update apply_scale_16() assertion - regenerate examples/ due to serialization_lib change Change-Id: I7183d92bec33697c65adfc07cb8eb89c6882675a
2021-04-30Re-order TOSA unit tests to match the spec orderingJared Smolens
Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Signed-off-by: Jared Smolens <jared.smolens@arm.com> Change-Id: I0ef59cadd2f5097a08abb00d3fc256c556107ee0
2021-04-28Support mixed-precision input tensors for TOSA unit test.Kevin Cheng
Bring CONV2D/DEPTHWISE_CONV2D/TRANSPOSE_CONV2D/FULLY_CONNECTED up running. Other minor fixes: - reference model should bail out if shape is invalid, along with "goto done" cleanup. - cleanup typos/duplicate in tosa_test_gen.py/tosa_serializer.py. - wrong input_zp/output_zp being generated for RESCALE. Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Change-Id: Ic1f3fe0090482bdee8a61508be7c738714191e19
2021-04-27Replace serialization/ and verif/ with MLPlatform's serialization_lib submoduleKevin Cheng
- Remove Usage and Format - Run black on verif/*.py scripts Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Change-Id: Ie81515891eb0039540f614894f4b6b0e0e78ba74
2021-03-04Update DTypes for TOSA ops, test rig fixesJared Smolens
- Updated DTypes and expected failures for TOSA ops, particularly missing int8/int16 tests for Conv, FullyConnected, MatMul - Fixed a bug where unexpected failures were incorrectly categorized as passes Change-Id: I2763626317cedad9f3723f748986bb59a32f2e42 Signed-off-by: Jared Smolens <jared.smolens@arm.com>
2021-02-01Remove AINT8Kevin Cheng
- Updated C and Py serialization libraries, updated licence files - Removed AINT8 from TOSA reference tests Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Signed-off-by: Jared Smolens <jared.smolens@arm.com> Change-Id: I860bfeaad5a075e50f569c8f6861927ebacf1378
2021-01-27TOSA Unit Test updatesJared Smolens
- For TOSA.resize, constrain random OFM dimensions to be >0 to avoid possible div-by-zero - Print generated test names only in verbose mode Change-Id: Ib28457c03eca54b7721a1b1b5ba3ed89c58fd000 Signed-off-by: Jared Smolens <jared.smolens@arm.com>
2020-11-24Update reference model/serialization library to 0.21.0 with unit tests ↵Kevin Cheng
added/updated - update tosa.GATHER - update tosa.RESIZE - add tosa.SCATTER Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Change-Id: I1c3247b831a64e35a85c4044b24c6c29b8e18d25
2020-11-12Implement and add unit tests for MUL and ARITHMETIC_RIGHT_SHIFTKevin Cheng
add .clang-format Add expected failure for RESIZE and RESCALE unit tests Signed-off-by: Kevin Cheng <kevin.cheng@arm.com> Change-Id: I33c8afdc8998e8518f2b0e5fabddd36ce3aa2ee9
2020-10-14Initial checkin of TOSA reference_model and testsEric Kunze
Change-Id: I2f8e7fa63e2ae40203e57d2cc8814bde3b312cb6 Signed-off-by: Eric Kunze <eric.kunze@arm.com>