aboutsummaryrefslogtreecommitdiff
path: root/verif
AgeCommit message (Collapse)Author
2023-03-08Prevent generating test case when align_corners and half_pixel are both true ↵Jerry Ge
in nearest mode Note: - align_corners and half_pixel can both be true in nearest mode for tfl but not tf - this is inconsistent between tf and tfl Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: Ib396f994874904e017e0d696f70370bd51d60161
2023-03-03Add framework tests for TFL.Relu0To1OpJerry Ge
Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I6fa14e9dbe7c0cd21156a5779d68fd473af322f2
2023-03-03Refactor resize test builderTatWai Chong
Also add input size = 1 in the shape list, and extend scaling to 1x, 2x and 3x, so that the cases of broadcasting, power-of-two scaling, no-scaling (e.g. 1x1 -> 1x1), scaling accuracy (3x) can be tested. Since the scalar tensor is tiny, should not noticeably impact the execution time of the framework test. Change-Id: Iec53da3cbb60e087077d6e2d8eb205e76e6c1313 Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
2023-03-02Add test case against Add Quantized Int8Jerry Ge
Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: If18fc61514cbc2d31a15ed7dd87147b0d8e69f16
2023-03-02Extend reduce_all to test with tfliteTatWai Chong
Signed-off-by: TatWai Chong <tatwai.chong@arm.com> Change-Id: Ifb3ed9c448005d6d53c5d0938b5146003a26e8a3
2023-03-01CONV2D/CONV3D/DEPTHWISE_CONV2D Test Regen for ofm_depth bugfixJames Ward
* Restricting size of tensors due to expanded values of ofm_depth Signed-off-by: James Ward <james.ward@arm.com> Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I582d8f0073c2d01244976f8e2e14783b506d8091
2023-02-28Update rank limits for SLICE, TILE and TRANSPOSELuke Hutton
Updated to align with corresponding changes to the spec. In addition, some ERROR_IF tests have been updated to match the checks specified by the spec, including: PAD, SLICE, TILE, TRANSPOSE. Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: Ie2c5f48e79a5610eb82739170e25057a63dac1d8
2023-02-24Extend pad tests to include quantized type and explicit pad value.TatWai Chong
Signed-off-by: TatWai Chong <tatwai.chong@arm.com> Change-Id: I4a49f45aa73044aff5b0a8b3dba58c1f52c1ae21
2023-02-22Create MI tests for Tensors: TRANSPOSE_CONV2DJames Ward
Change-Id: I4f967ce2dfb0cb44dc58307170fd9306a0ea1ed5 Signed-off-by: James Ward <james.ward@arm.com>
2023-02-22Bug fixes for max-batch-size/ofm-depthJames Ward
* Conformance regen required for tosa-bi: conv2d conv3d depthwise_conv2d transpose_conv2d * Include bug fix for testGen.makeShape() * Include json changes to limit size of tests which now have ofm_depth > 1 Signed-off-by: James Ward <james.ward@arm.com> Change-Id: Ic8221b9a742f5737df523997bee7260f4dfcdef3
2023-02-22Create MI tests for Tensor: FFT2D & RFFT2DJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I44ad6513fad831ff50fcc5ab801b46a5bf25d0a8
2023-02-22Create MI tests for Tensor: CONV3DJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I2c1e87ec586195f82e97bbc70e4e2bc18cd2cc88
2023-02-22Create MI tests for Tensors: DEPTHWISE_CONV2DJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I6c2087c94c2c024aabc2086d40cbca9c719c69dd
2023-02-22Add tests for INT48 CONST supportLuke Hutton
* Add TOSA test coverage * Add some basic error checking Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: Ib02df7319954a2dcb915e5f5a70699ca398fd483
2023-02-14Select new TFLite SPLIT testsJeremy Johnson
Due to change in generator creating different test patterns. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I58224dc117c766b22fccd418f64004aea31905b5
2023-02-10Add FFT2d to the reference modelLuke Hutton
Includes: * FFT2d reference implementation * Basic TOSA tests Change-Id: Ie79fcb713542345d550ec013646810c1e890e388 Signed-off-by: Luke Hutton <luke.hutton@arm.com>
2023-02-07Adjust ERROR_IF tests generated for tosa-mi profileJeremy Johnson
So they do not overwrite tosa-bi tests, ops affected: NEGATE, TILE, REDUCE_MIN, REDUCE_MAX, RESIZE, SCATTER, GATHER Update test-select exclude-patterns to work with ERRORIF tests. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Idb0d26512ce9a48f6d868663a630e343c8785899
2023-02-06Create MI tests for Tensors: AVG_POOL2D, FULLY_CONNECTED, MATMULJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I874c87745b929f9808a5e45490042420a57b22f7
2023-02-06Create MI tests for Tensor: CONV2DJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Iefd8490d9eedc76d199d36943b87c99e4dd97612
2023-02-02Remove accumulator attributes from all but AVG_POOL2DJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: If67f503a1848967bc1671646c3011d055b622c52
2023-02-02Create MI tests for Reduction: REDUCE_SUM, REDUCE_PRODUCTJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I21b8f8139ce069d5fc6bbeabe292e3a44d99fe10
2023-01-31Create MI tests for Type Conversion: CASTJames Ward
* Add exclusion regex's to conformance generation Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I15bef7451efd5662065060242d35bd7fa3381487
2023-01-30Add framework tests for tfl.atan2Luke Hutton
Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: I11a891296a040f4e48187d0d51a4dd2c554805ac
2023-01-27Add RFFT2d to optimized only kernel listLuke Hutton
This fixes framework test generation when the "optimized" kernel mode option is not selected. As a result, the optimized RFFT2d kernel is used when generating tests in the reference kernel mode to prevent "op not found" errors. Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: Ice18bfa08c46e237e39c99f849622bf99d9b849c
2023-01-27Add framework test for math.signTatWai Chong
The result comparison between Tensorflow runtime and the reference model hasn't been checked as the sign operator is not supported by the native TFLite runtime. That said, since the generated tosa ops for tf.sign and tfl.sign is identical, the correctness presumably can be proved by the result from tf.sign. Change-Id: I72eb415df7fb6ca4dc9103f9ddc7104b0ba39234 Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
2023-01-25Create MI tests for Comparison: EQUAL, GREATER, GREATER_EQUALJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I4d4834260698db75427590c0a8b80cc3c824ef3b
2023-01-25Create MI tests for EW Unary: LOG, RECIPROCAL, RSQRT, EXPJeremy Johnson
Also fix the ERROR_IF conformance test generator to apply correct operator filtering to create the tests. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I5788932e3529ec9386900623b20c22c98e4201b7
2023-01-24Add RFFT2d to the reference modelLuke Hutton
Includes: * RFFT2d reference implementation * TFLite framework tests * Basic TOSA tests * Serialization submodule upgrade with support for FFT/RFFT Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: I2a687e9cf87fb62a26160ea52439ba9830bea36e
2023-01-23Create MI tests for Data Layout: SLICEJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: Ief60ae8fa490ded21aa77726d738565be5f8d91c
2023-01-19Create MI tests for Activation: CLAMP; Data Layout: PADJames Ward
* Existing float attributes now serialized as bytes Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I415276706b9daf0893e3a59189f387f872ff07c2
2023-01-18Add framework tests for tf.sin and tf.cosLuke Hutton
Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: I342a162e252c8527d5b318ceaf5f1de70fa5dc34
2023-01-13Reference model update for control flow operators supportJerry Ge
Rationale for making this change: - In the original design, for control flow operators like WhileOp, child blocks couldn't read the tensor variables (global consts) in the root level block, this patch added the machanism for child blocks to access their parent level block's tensors. - This change also relies on another serialization change on adding another layer of abtraction called Region: - Serialization patch: [region] Add TosaSerializationRegion to serialization_lib - Updated the corresponding python version of the serialization code: TosaSerializerRegion to python version of serialization_lib - This change also relies on the TOSA MLIR Translator change: Add RegionBuilder to TOSA MLIR Translator - Added the WhileOp related test cases: While, LSTM, GRU, RNN - Other related fixes Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I13ae33628ad07e41d248e88652ce1328654694ab
2023-01-04Create MI tests for EW Binary: ADD, SUB, MULJeremy Johnson
Add option to control negative tests dim range to stop ERROR_IF test clashes between profiles. Change-Id: I1f806934480cc32b95e80613c66fecb1e6ff5426 Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
2023-01-04Create MI tests for EW Binary: POWJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I8d478b7bd13559ea37e27f77b05ee5db56c8f9e3
2022-12-15Add extra control flow ERROR_IF testsJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I7276dc686d8d18ba44663b73e35ceca2a1cbaadf
2022-12-15Create MI tests for Image: RESIZEJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I440590fa59433b9ddc1934188f2b34b377129c1f
2022-12-15Create MI tests for Activation: SIGMOID, TANHJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I75d6280ecb5219d50c91d14029e90ff3a2f6eb06
2022-12-14Create MI tests for EW Ternary: SELECTJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I1eb4fbadb9117e28f87a36ee828d65d896d834f0
2022-12-13Create MI tests for EW Unary: ABS, CEIL, FLOOR, NEGATEJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I2ee6d4f706958b6261fd41dd245a3d01d3f8cecf
2022-12-13Create MI tests for Reduction: REDUCE_MIN, REDUCE_MAXJames Ward
* Also include test_select improvements Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I306a8ed57975bc429d6cd5a8a24777b889593ddf
2022-12-09Create MI tests for EW Binary: MINIMUM, MAXIMUMJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I6824e30cece291fceaedd727132a6b211762baa9
2022-12-09Add framework tests for tfl.sin and tfl.cosLuke Hutton
Although the legalization is currently supported in the TFLite runtime, the tests were missing from the reference model. Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: Iae3cd54f145f69a84943867b418063a4d4109d87
2022-12-01Fix conformance desc.json contains correct profilesJeremy Johnson
Must seperate conformance generation by profile to stop desc.json being incorrectly overwritten by different profile information. Change-Id: Iead01c9fcc659e48ef1d350a860b03c2b0a05ffa Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
2022-11-21Create MI tests for Data Nodes: CONST, IDENTITYJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I7280b3bf31aa377a6f6af7713627f34eb445e689
2022-11-21Create MI tests for Data Layout: CONCAT, PAD, RESHAPE, REVERSE, SLICE, TILE, ↵James Ward
TRANSPOSE Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I626d9ece0290c5104c9ac42d20be2f9db1e55fa7
2022-11-21Create MI tests for Scatter/Gather: SCATTER, GATHERJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I44c0843fa049546582ca1111795342d5035a329c
2022-11-21Create MI tests for Tensors: ARGMAX, MAX_POOL2DJames Ward
Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I908d88ddf7c52d98ce6d533396b5c439f15750f5
2022-11-19Initial set up of Main Inference conformance test genJeremy Johnson
tosa-verif-build-tests - option for setting FP values range - option for recursively finding tests - change from os.path to Path tosa_verif_result_check - option to supply FP tolerance - output difference and max tolerance on contents mismatch - change from os.path to Path MI conformance - contains examples of AVG_POOL2D and CONV2D tests Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I8e1645cd8f10308604400ea53eef723ca163eed7
2022-11-11Add framework test for tfl.preluTatWai Chong
Signed-off-by: TatWai Chong <tatwai.chong@arm.com> Change-Id: Ib894e50f4b869a3f4936885704995a417ea25eef
2022-11-09Add BF16 support to reference modelJames Ward
* Upgrade Eigen to 3.4.0 (for bfloat16 support) and add work- arounds for reduce.any() and reduce.all() bugs (introduced between 3.3.7 and 3.4.0) * Truncation to bfloat16 now performed in eval() methods Signed-off-by: James Ward <james.ward@arm.com> Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: If5f5c988d76d3d30790acf3b97081726b89205fe
generated by cgit v1.2.1 (git 2.23.0) at 2024-05-29 19:14:55 +0000