Age | Commit message (Collapse) | Author |
|
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I82c356681e66bf08e2c106358deb4acbc64a67c8
|
|
This adds a second run of reference model under precise_mode
when test_desc.json contains a "compliance" dictionary which
contains a "mode" entry with value "dot product".
In this second run, abs_mode will be set to true, which causes:
1. evaluation will take absolute values of inputs for these operators:
conv2d, conv3d, depthwise_conv2d, fully_connected,
matmul, transpose_conv2d, fft2d, rfft2d
reduce_sum, avg_pool2d
2. output files will have prefix "bounds_" prepended to them
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I7070ecc7ead2d2ea3375c44663d653c6772b88e0
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I0ef7607f4266296a1204c5cccdb5be36f345b5ba
|
|
Change-Id: I81097ae263a64ee8e35b8bd798598671ac089c3f
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Iad035b31d5e5e83040068e6311501490765bfff7
|
|
This adds --precise_mode=1 option to tosa_referece_model,
which will cause reference model to convert all floating point tensors
to FP64 tensors and compute all operators accordingly.
Also adds optional -p arguments to test runners tosa_verif_run_tests.py
and tosa_verif_framework_compiler_runner.py to run tests in precise mode
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I156055216ad61710096497a8fa1a653be2a602a3
|
|
Operators updated: AVG_POOL2D, MAX_POOL2D, CONV2D, CONV3D,
DEPTHWISE_CONV2D & TRANSPOSE_CONV2D
tosa_verif_build_tests argument --level-8k-sizes used to
allow kernel/stride maximum boundary testing
Fixed bugs in height/width validator function meaning some
esixting avg_pool2d float tests need regening.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I7aeab82d3bd3c49d02d54708f2c9d995cd3cf2df
|
|
Add support for producing scaling 64 tests in RESIZE and make sure
default tests are not generated with scaling greater than 64.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3e99cde7e6bec6ea7854a139c6fc2ed151af5b1e
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I6deb355998ce88714b41eedc8170acbd7875f519
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I5689d7c6b902a319a68fa4628b59e0bcc23aeca4
|
|
Change-Id: I665acac9b5171efd0c5a2b68b516609048f6e187
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
|
|
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Icefa594b25739ebaa331af2352bdcae1aaf81cf5
|
|
Split generation of conformance tests into groups to avoid a change
in existing tests selection
* A standard group is used for the normal/default conformance tests
* An 8k level group covers the extension of testing for 8k level
* Other arbitrary groups can be created and the group names will be
used to tag the tests, so that in the future they could be filtered
Group selection criteria is in a new dictionary
* A default selection config is used for generation groups
* But a different config can be used for a particular generation group
Added parameter sparsity for pad of rank6 and above, and further
parameter sparsity options to test_select to limit number of tests
selected.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ib9f1185c0ae6d0957df2116411c17e958157c6d3
|
|
This allows IF/WHILE serialization to use regions
instead of blocks to serialize nested regions.
For backward compatibility, both region and block
serialization are supported for IF/WHILE ops.
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Icf935561f9f5db38767ff76410bcd36896119395
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I1e9e97ead447295e1252785106931b261df7bcea
|
|
Remove ERRORIF tests for CONST as they do not create valid
negative tests.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ia96b184f34010a452d2c4848b0653514352c751e
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: If3f8c5a1f2dffac36448101959557f86b6ab6c7f
|
|
Also include 0.70.0 draft serialization library
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ibdd3d52ecd39e710e0decb7afb6d5f5fad497e7d
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifce52ef0e082e9e6289938baa6c73a6ebd9ded62
|
|
Was causing the generated set of tests to be too big.
Change-Id: I45292e9317ab93786a1ec4670283385d06d52c0d
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
|
|
Also include the updated serialization library
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I8eb124533dbd00ef0c680fee4892d263c6a1f5ce
|
|
in nearest mode
Note:
- align_corners and half_pixel can both be true in nearest mode for tfl
but not tf
- this is inconsistent between tf and tfl
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ib396f994874904e017e0d696f70370bd51d60161
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I6fa14e9dbe7c0cd21156a5779d68fd473af322f2
|
|
Brings up to date with commonly tested configuration
Change-Id: Id1791f506e6d822d69ee962a9403a7092afeaaf6
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
|
|
Also add input size = 1 in the shape list, and extend scaling to
1x, 2x and 3x, so that the cases of broadcasting, power-of-two
scaling, no-scaling (e.g. 1x1 -> 1x1), scaling accuracy (3x) can
be tested. Since the scalar tensor is tiny, should not noticeably
impact the execution time of the framework test.
Change-Id: Iec53da3cbb60e087077d6e2d8eb205e76e6c1313
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Use rint() instead of round() to get round to nearest even behavior
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I45957be0e863de2207850b023626a7c0ea11e5eb
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: If18fc61514cbc2d31a15ed7dd87147b0d8e69f16
|
|
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: Ifb3ed9c448005d6d53c5d0938b5146003a26e8a3
|
|
* Restricting size of tensors due to expanded values of ofm_depth
Signed-off-by: James Ward <james.ward@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I582d8f0073c2d01244976f8e2e14783b506d8091
|
|
Updated to align with corresponding changes to the
spec.
In addition, some ERROR_IF tests have been updated to
match the checks specified by the spec, including:
PAD, SLICE, TILE, TRANSPOSE.
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: Ie2c5f48e79a5610eb82739170e25057a63dac1d8
|
|
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: I4a49f45aa73044aff5b0a8b3dba58c1f52c1ae21
|
|
Change-Id: I4f967ce2dfb0cb44dc58307170fd9306a0ea1ed5
Signed-off-by: James Ward <james.ward@arm.com>
|
|
* Conformance regen required for tosa-bi: conv2d conv3d depthwise_conv2d transpose_conv2d
* Include bug fix for testGen.makeShape()
* Include json changes to limit size of tests which now have ofm_depth > 1
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: Ic8221b9a742f5737df523997bee7260f4dfcdef3
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I44ad6513fad831ff50fcc5ab801b46a5bf25d0a8
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I2c1e87ec586195f82e97bbc70e4e2bc18cd2cc88
|
|
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: I6c2087c94c2c024aabc2086d40cbca9c719c69dd
|
|
* Add TOSA test coverage
* Add some basic error checking
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: Ib02df7319954a2dcb915e5f5a70699ca398fd483
|
|
Due to change in generator creating different test patterns.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I58224dc117c766b22fccd418f64004aea31905b5
|
|
Includes:
* FFT2d reference implementation
* Basic TOSA tests
Change-Id: Ie79fcb713542345d550ec013646810c1e890e388
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
|
|
"tosa_run_tests" -> "tosa_verif_run_tests"
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: Iff8c4874af1dc3e203e1f49563cfa0fd1f373811
|
|
So they do not overwrite tosa-bi tests, ops affected:
NEGATE, TILE, REDUCE_MIN, REDUCE_MAX, RESIZE, SCATTER, GATHER
Update test-select exclude-patterns to work with ERRORIF tests.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Idb0d26512ce9a48f6d868663a630e343c8785899
|
|
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: I874c87745b929f9808a5e45490042420a57b22f7
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iefd8490d9eedc76d199d36943b87c99e4dd97612
|
|
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: If67f503a1848967bc1671646c3011d055b622c52
|
|
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: I21b8f8139ce069d5fc6bbeabe292e3a44d99fe10
|
|
* Add exclusion regex's to conformance generation
Signed-off-by: James Ward <james.ward@arm.com>
Change-Id: I15bef7451efd5662065060242d35bd7fa3381487
|
|
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: I11a891296a040f4e48187d0d51a4dd2c554805ac
|
|
This fixes framework test generation when the "optimized"
kernel mode option is not selected. As a result, the
optimized RFFT2d kernel is used when generating tests in
the reference kernel mode to prevent "op not found"
errors.
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: Ice18bfa08c46e237e39c99f849622bf99d9b849c
|
|
The result comparison between Tensorflow runtime and the reference
model hasn't been checked as the sign operator is not supported by
the native TFLite runtime. That said, since the generated tosa ops
for tf.sign and tfl.sign is identical, the correctness presumably
can be proved by the result from tf.sign.
Change-Id: I72eb415df7fb6ca4dc9103f9ddc7104b0ba39234
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4d4834260698db75427590c0a8b80cc3c824ef3b
|