Age | Commit message (Collapse) | Author |
|
Dynamic shape model cannot directly run on the refenence model as
the concrete size of tensor is unknown therefore the volume of tensor
is not able to be allocated. Furthemore, the operators also expect
the input model is static-shaped.
This change turns dynamic model to static model prior to execution.
- Add `ifm_dynamic` field into json description to indicate whether
the model has dynamic shape or not.
- Add the shape inference pass into the compilation pipeline, firstly
legalize the dynamic tf/tfl model to dynamic tosa model with unknown
shapes, and then run the shape inference pass with static shapes
input argument to resolve unknown dimensions.
Change-Id: I5d2ffd452becc562dc30546789705bd01dd7a0b0
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
- Found the error for framework test generator when it's not generating
dynamic_shaped tests
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I54bf1422026f7f962d3f6ed0be9bd2e4dade14c5
|
|
- Added a basic infrastructure for allowing generate network with
dynamic_shapes
- Added tests cases for
- batch_to_space
- depth_to_space, space_to_depth
- linear
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ie3f13231a74485df64b852f554cfe65e995f0d03
|
|
Updated to conformance generator to not generate tests with results for
compliance tests.
Updated test runner to run compliance mode version (precise & abs mode)
of reference model to create test results to use against SUT results.
Updated reference model to enable abs_mode on correct desc.json flags.
Updated test checker to support compliance checking using verifier lib.
Seperated color printing from test checker.
Change-Id: I7e2fbfc6883916caa5d94d4ece122c48bf45f530
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Iff77091e4a57f487431ffbf7ac1c89301a153c8b
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I03cb878736ccd7e1f5e1f780d7171949a19a9de2
|
|
The double quotation mark is not always appear in the assembly output
of operations. Remove it to easier capture general printing pattern.
Change-Id: I59301daa07abd905de7259f8ae527a74b1ce5a6c
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Reuse the name deduced from the test run in results.
Also move most string formatting to f strings.
Move path handling to pathlib from os.path
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I44c7786d4b7af44306e218ff49608df35d4521a7
|
|
Name of the test can now come from the json description
rather than inferred from the directory. Old method remains to
keep functionality with older tests
Change-Id: I79f872103ae6a101b5cc799af91c933839f28dfb
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Ib954db4f8f2fd5008e95d5651a6e84a8f5b7161d
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I6fba6907cef0616c18dc461dbb92d2aceb582f6c
|
|
With the following patch merged, the tosa serialization_lib is
able to read u/int8, u/int16 in their native dtypes:
https://review.mlplatform.org/c/tosa/serialization_lib/+/9871
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I5e63fb70b055cc5ee33e7dc26237eef9bedeac30
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Iff31b33b818a181371904915d5477a169513aa2e
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Ib42b867287b83a183a0d0fb1f1eb29974f58fae4
|
|
This patch adds BoradcastTo Op to the tf tests.
Did not add tflite testing because the tf.lite.TFLiteConverter converts
tf.broadcast-to to tfl.mul by 1.
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Icd372e619c318121c19eca87d5716bcd5fbbbb23
|
|
shape_list is global while the custom_shape is only applicable for a
single operator, need to make a copy for the whole shape_list when
dealing with custom_shapes
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I2c5b87cb6fcaa153b0ccfe5827bae814b9cfe2b9
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ie45cc27433f5dbce3fadc90014dc5cc8e36a9950
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ia29c73cb5d0a7f91914e2a94ca52d06f375722e9
|
|
This adds --precise_mode=1 option to tosa_referece_model,
which will cause reference model to convert all floating point tensors
to FP64 tensors and compute all operators accordingly.
Also adds optional -p arguments to test runners tosa_verif_run_tests.py
and tosa_verif_framework_compiler_runner.py to run tests in precise mode
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I156055216ad61710096497a8fa1a653be2a602a3
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I5689d7c6b902a319a68fa4628b59e0bcc23aeca4
|
|
Change-Id: I665acac9b5171efd0c5a2b68b516609048f6e187
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I1e9e97ead447295e1252785106931b261df7bcea
|
|
Was causing the generated set of tests to be too big.
Change-Id: I45292e9317ab93786a1ec4670283385d06d52c0d
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
|
|
in nearest mode
Note:
- align_corners and half_pixel can both be true in nearest mode for tfl
but not tf
- this is inconsistent between tf and tfl
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ib396f994874904e017e0d696f70370bd51d60161
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I6fa14e9dbe7c0cd21156a5779d68fd473af322f2
|
|
Also add input size = 1 in the shape list, and extend scaling to
1x, 2x and 3x, so that the cases of broadcasting, power-of-two
scaling, no-scaling (e.g. 1x1 -> 1x1), scaling accuracy (3x) can
be tested. Since the scalar tensor is tiny, should not noticeably
impact the execution time of the framework test.
Change-Id: Iec53da3cbb60e087077d6e2d8eb205e76e6c1313
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: If18fc61514cbc2d31a15ed7dd87147b0d8e69f16
|
|
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: Ifb3ed9c448005d6d53c5d0938b5146003a26e8a3
|
|
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: I4a49f45aa73044aff5b0a8b3dba58c1f52c1ae21
|
|
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: I11a891296a040f4e48187d0d51a4dd2c554805ac
|
|
This fixes framework test generation when the "optimized"
kernel mode option is not selected. As a result, the
optimized RFFT2d kernel is used when generating tests in
the reference kernel mode to prevent "op not found"
errors.
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: Ice18bfa08c46e237e39c99f849622bf99d9b849c
|
|
The result comparison between Tensorflow runtime and the reference
model hasn't been checked as the sign operator is not supported by
the native TFLite runtime. That said, since the generated tosa ops
for tf.sign and tfl.sign is identical, the correctness presumably
can be proved by the result from tf.sign.
Change-Id: I72eb415df7fb6ca4dc9103f9ddc7104b0ba39234
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Includes:
* RFFT2d reference implementation
* TFLite framework tests
* Basic TOSA tests
* Serialization submodule upgrade with support for FFT/RFFT
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: I2a687e9cf87fb62a26160ea52439ba9830bea36e
|
|
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: I342a162e252c8527d5b318ceaf5f1de70fa5dc34
|
|
Rationale for making this change:
- In the original design, for control flow operators like WhileOp,
child blocks couldn't read the tensor variables (global consts) in the root level block,
this patch added the machanism for child blocks to access their parent
level block's tensors.
- This change also relies on another serialization change on adding
another layer of abtraction called Region:
- Serialization patch: [region] Add TosaSerializationRegion to serialization_lib
- Updated the corresponding python version of the serialization code: TosaSerializerRegion to python version of serialization_lib
- This change also relies on the TOSA MLIR Translator change: Add RegionBuilder to TOSA MLIR Translator
- Added the WhileOp related test cases: While, LSTM, GRU, RNN
- Other related fixes
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I13ae33628ad07e41d248e88652ce1328654694ab
|
|
Although the legalization is currently supported in the TFLite
runtime, the tests were missing from the reference model.
Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: Iae3cd54f145f69a84943867b418063a4d4109d87
|
|
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: Ib894e50f4b869a3f4936885704995a417ea25eef
|
|
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: Icc9b8f6a65ee54ddbb445c3a999ca49401b660c2
|
|
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: I0bccfbe971f64986d71cef5a1d68daa7eb1697c4
|
|
Add a new attribute `rank` to indicate the testing dimension range of
input tensor. Also fix a minor bug in the existing conv3d simulation.
And relax rescale operator in the reference model to support 5-D input.
Change-Id: Ib42fe513831dc83eb7f9af07e011787a6c752704
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Change-Id: I1056f4a3abe9079381fb2c7d02edf11312aba9d6
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Change-Id: Ia681aa0eb1d42fa31a4658badb376f7b32b2e338
Signed-off-by: Eric Kunze <eric.kunze@arm.com>
|
|
Attribute stride and shift are removed, and has new scale and border.
Also add tests in the generator to test tf.resize with all option
combinations.
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If0f330d04395762d2d907863235eda1532f5e1ff
|
|
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I36ea46e79a0ce42c2dbe47c816b5b5572058c0f2
|
|
Update to tosa_verif_framework_generator to produce valid test
ranges for pooling and convolution tests
Fix up test filtering to only filter on test name not output
directory
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifff7e7604a37e8680d7237dc2d85cd806b20e384
|
|
* black needed updating for ImportError of new click version
Change-Id: If8e2d13a09996e331d676af31bf3d3aee9403b4e
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
|
|
- Fixed input shape/expected input shape mismatches
when due to a missing batch dimension.
- Return from run_test() immediately after running compiler
when --no-ref-model is set. This avoids doing result
comparisons on results that were never generated.
- Exit gracefully when no tests are specified instead of
throwing TypeError on iterating NoneType
Signed-off-by: Jared Smolens <jared.smolens@arm.com>
Change-Id: I91d2c24fd60aa1cf8b3755894030ff14f1371ed0
|
|
And fixes in tosa_verif_run_tests:
* support for no-color printing
* stop double printing of error messages on verbose
* differentiate result code pass from results check
Change-Id: I26e957013a8d18f7d3d3691067dfb778008a1eea
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
|