aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
3 daysUpdate main branch version to 1.1.0 draftHEADmainEric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I8c4439189756a4d20cf5395fbbbe4aa6af7873ce
9 daysUpdate version to 1.0.0 draftv1.0.0-rc0v1.00Eric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I6b6a303a475525840a281c7e4e6ecc326c6a1aac
9 daysUpdate float8 header and namespaceWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I75840f6b4ff11a63c4c874f8ded23afb5a71ad55
9 days[reference_model] Remove output_shape from transpose_conv2dSuraj Sudhir
Signed-off-by: Suraj Sudhir <suraj.sudhir@arm.com> Change-Id: Ib2b95e73b226d64c4db5ad1ed22c123e04d7e6f9
10 daysRemove invalid bit calculation from FP32 to FP8Won Jeon
This is a temporary change and waiting for compliance testing code for BF16/FP8. Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I61a548cffedb5f16947cd1029999ccd4ff25a535
10 daysAdd extensions & profiles support to conformance generatorWon Jeon
Support existing conformance profiles to ease transition New combined config tosa_ext_profile_ops_info.json that supports extension selection Signed-off-by: Won Jeon <won.jeon@arm.com> Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ic04696a01d619d191b9c8abc4ef7f4e8b86c52ca
10 daysNon-finite data tag for FP_SPECIAL data gen testsevacha01
Signed-off-by: evacha01 <evan.chandler@arm.com> Change-Id: I21e305dbe4f406e85c6ed3d5b30b5b85dd208825
10 daysUpdate compliance verify checksJeremy Johnson
Cope with large error bounds with small reference values. Change how error bounds of NaN are avoided for ABS_ERRORs. Update SIN/COS compliance to latest spec and use input value as magnitude. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I55aca59e0255e1cfd255b08edb845c3e33ca7eff
10 daysImprove coverage of FP Binary OpsJeremy Johnson
Add Rank 0 tests. Random usage of CONST verus INPUTs for tests. Use new stable random and generator select modes. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I2ab131f6ab80e3061a56cd5b8076225011af652e
10 daysImprove coverage of FP Unary OpsJeremy Johnson
Add Rank 0 tests. Random usage of CONST verus INPUTs for tests. Use new stable random and generator select modes. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I9f5b982fdabc5a5b20f04d797d5f3452902c041e
10 daysImprove coverage of FP Activation OpsJeremy Johnson
Add Rank 0 tests. Random usage of CONST verus INPUTs for tests. Use new stable random and generator select modes. Add "random_const_inputs" supports_for to conformance config. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I5a76c1019514ed8426518b3ea7df5093990c9fbd
10 daysRFFT2D, refmodel. Correct code when size is oneDmitriy Smirnov
When width or height are one then H/2 or W/2 are not integral. Signed-off-by: Dmitriy Smirnov <dmitriy.smirnov@arm.com> Change-Id: I1a849bec7cbb1d55fd5f085ebe58be45ea0b508e
11 daysFix gcc warning of comparison of different signedness integersTatWai Chong
This warning is raised in the integer comparison of `applyClip`. Signed-off-by: TatWai Chong <tatwai.chong@arm.com> Change-Id: If427cb08b8456480898375d8b77302ca7162f737
11 daysCorrect types of int16 and int8 input tensors for testsJeremy Johnson
Fixes input tensors for int16 and int8 tests for MUL, LOGICAL_LEFT/RIGHT_SHIFT, COND_IF, WHILE_LOOP Change tensor generator functions to use type aware randTensor() function. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: If81a783929c29e1fd5e91477dbcdaf79c738f6b0
12 daysFix ARITHMETIC_RIGHT_SHIFT shift tensor type for int 8 & 16Jeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I91f7bc956c3b141e1518098781bbf29577c3fbbc
12 daysSPECIAL data gen mode for FP16 and FP32evacha01
Signed-off-by: evacha01 <evan.chandler@arm.com> Change-Id: I5a9a1c63345bd83ca04bc6c2a99b0ef3612971ee
13 days[ref model] fix const/pad/clamp attribute serializationTai Ly
This changes to use native type serialization and deserialization for pad_const, clamp min_val/max_val and const data attribute values whereby fp16 values are stored as 2 bytes each, fp8 values are stored in 1 byte each, etc. Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: Ia95d320fe8c546ce1d1ccc035d6e9bcaadcc9ca3
2024-04-11[ref_model] Remove assert on bad tensor typeTai Ly
Remove assert statements on bad tensor types and returns nullptr so caller can properly generate return errors. Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I8687ba0c7bc1000e3e7f8a0651a949c3c61c5128
2024-04-11Add rank 0 testing supportJeremy Johnson
Default test range is now rank 0 to 3 instead of 1 to 4 Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ibde66b60b58de9f4a3852a3807c01f8dae61206f
2024-04-09Fix/improve SLICE test generationJeremy Johnson
Only generate valid arguments for slice, improving test generation. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Id2db7bd42773e8d182ad814c4295ea4927a035a8
2024-04-09Generate tests with random combination of const/inputsJeremy Johnson
Override the default input/consts used for each op with biased random combos. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I7a5eb2b01a47248bc0db5a2f930ad2ac52cc0a67
2024-04-08Fix the wrong QMax and QMin type assignment in rescale opTatWai Chong
Signed integer type is used to retain QMax and QMin no matter what the value of `output_unsigned` is, but the value of QMax and QMin are unsigned integer when output_unsigned is true. Also add a handful of arithmetic helpers to align the pseudo code. Change-Id: Ie3cd444a290ddae08884186cd4b349a88acad032 Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
2024-04-08Add support for multi args in tosa_verif_build_testsJeremy Johnson
Now supports shorter "--target-rank 0 1" and the original method of "--target-rank 0 --target-rank 1" Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ia45a168588c6fca4dcd4cbbf526ac49cb0bdf621
2024-04-08Modify Rescale signedness check to look at attributesEric Kunze
Also simplify the check to align the pesudo code structure. Signed-off-by: Eric Kunze <eric.kunze@arm.com> Signed-off-by: TatWai Chong <tatwai.chong@arm.com> Change-Id: I6023046026d2784dedd963b2b4d34a1117d45c23
2024-04-03Make Full Range FP16 tests into extra testsevacha01
Signed-off-by: evacha01 <evan.chandler@arm.com> Change-Id: I8c59ecb5a1fb53d0e9bf64333709f9e3cc908b49
2024-04-02Show actual runtime value of shapeType tensorsJerry Ge
* Enable showing actual runtime shapeType tensor value when the --dump_intermediates=1 flag is on Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: Ibd5aa8aa27505364fbbf9d1addd0bdef0deda885
2024-03-28Update README for conformanceJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I8cd95ed0ae3260eea785e4e0275961534cd1f0c5
2024-03-28Improve PAD coverage for main conformanceJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ia3e0d871525840f26948b45658bba71e75d767ea
2024-03-28Improve CONV2D coverage for conformanceJeremy Johnson
Enable testing of broadcastable bias channel. Change convolution arguments function to calculate workable convolutions by adjusting PAD size as needed for FP and errors. Add --conv-kernel build_tests option to allow different sized convolution kernels Improve coverage with batch size, specific shapes and kernels of 7x7 and 9x9 Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I59bb737f398f4363cc606b24fea7812b2059bc01
2024-03-28Take into account of `output_unsigned` in rescale operationTatWai Chong
Set QMin and QMax based on the value of attribute `output_unsigned`. Change-Id: I7f21f3edd7311295285fb3988b3c800de114777a Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
2024-03-26Add variable tensor fields for test descriptorsJerry Ge
- Add variable_name and variable_file to the desc.json file for writing variable tensors to numpy - Add the key of num_variables in the unit test declaration to specify the number of variable tensors in the graph Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I1109f66ffed52e49dbb14f4a8aca64baa2bea622
2024-03-26Compliance Test Set 3 data fixJeremy Johnson
Make sure the magnitude bias check is not positively biased Update unit tests Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I00a9470b5e3233ad65360400ed312b0a354130f1
2024-03-25Fix missing Pooling ERRORIFsJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I749b1b9fbfa32954d8748a860280c86087c08e7f
2024-03-25Fix framework test generationJerry Ge
- The framework test generation script is broken for some tests because TF2.16 has an issue with Keras 3.0 - Enforce the script to use Keras 2.0 and we also need to run pip install -U tf_keras together with this change Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I519aa89c5d5bacf659a809d9eda456bd83b33527
2024-03-21Fix data range of int ADD/SUB opsJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Iaeed119ff81c8d1363dd26be7468bb53f9d70eae
2024-03-21Reduce WrongRank tests to the minimum neededJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ideeb67ec4b33b9c6922d6765f4b0eb5ca69bdf89
2024-03-20Fix writeVariableTensors error in example runsJerry Ge
- The desc.json file for variable examples are missing the variable_name and variable_file fields - Add those missing fields to silence the error Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: Ia391d308849efd4111aff98500775ad0f3e741ac
2024-03-20Fix missing/broken ERROR_IF testsJeremy Johnson
Fix CONV2D WrongOutputType FP32 & Pad/Stride/DilationSmallerZero issues. Fix PAD WrongInputType. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I57fc57c43e63685e05bf5e3d562c3167411fd57b
2024-03-20[ref model] Add acc_type to Conv OpsTai Ly
This patch implements changes required by the new acc_type field in ConvAttribute and TransposeConvAttribute Signed-off-by: Tai Ly <tai.ly@arm.com> Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ib13dbeec4d8920e0ddbcca02b727e7277f2c8d62
2024-03-19Updated build_tests to support different random generatorsJeremy Johnson
All generator functions now take RNG argument to allow different random number generators, rather than relying on global RNG Default behaviour is the same as before using global RNG Added stable random generation mode * shape rng based on operator, rank and datatype * arguments rng based on operator, shape and datatype * build operands and data rng based on op, shape, datatype and args Add optional stable RNG test generation to conformance_generator Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I5ee4ff85575a81177fd74ed1617e946bfa3a0769
2024-03-17[ref model] Change Clamp and Pad attribute fieldsTai Ly
This implements changes due to ClampAttribute and PadAttribute field changes. Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: Ide01e2a27fe3c1ea7794e7a4b6780b7eae436caf
2024-03-15Add missing FP8 definition and instantiation for FULLY_CONNNECTED opWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I7efc03f16136b2b74f8dfef79a6e7e147c93f4ed
2024-03-13Add quick testing selection defaultJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I5c240eec4385aaa3a6b4bf9533669b91c74c76cf
2024-03-13Fix data gen changes due to new selectJeremy Johnson
Don't sort test lists for original operation to keep original data generation ordering. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I3194b7d50505b422557ef12b72a9699483640c31
2024-03-13Fix REDUCE_SUM compliance test creationJeremy Johnson
Make sure output shape is big enough to perform statistical compliance error checking. Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ia7ed7dd19a6c9cb888363f6cbdf0c6943235e0be
2024-03-12Improved test selection before test generationJeremy Johnson
Add test list output to tosa_verif_build_tests and test list capture to file for tosa_verif_conformance_generator Improve PAD & CONV2D test coverage for tosa-mi conformance Change to use logging for output to hide info from test lists Tweak verbosity levels of tosa_verif_conformance_generator Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: Ic29da5776b02e9ac610db6ee89d0ebfb4994e055
2024-03-12Fix CONV2D WrongOutputType ERRORIF test genJeremy Johnson
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com> Change-Id: I663a92001bf902cdc5327f386b2e896052a816ff
2024-03-07Add INT48 and INT4 datatype support to IDENTITYevacha01
Added support to ref model and testing Signed-off-by: evacha01 <evan.chandler@arm.com> Change-Id: Iece53d07c8986332fdd8f1ce5ed6265349df1b6a
2024-03-07FULL data gen mode for FP16evacha01
Signed-off-by: evacha01 <evan.chandler@arm.com> Change-Id: I81bb322132daf25328a40342edc62d8e1db9edd6
2024-03-06[ref model] Change RescaleOp attrs to inputsTai Ly
This patch implements changes required for RescaleOp's multiplier and shift changing from attributes to inputs Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I178919727e3220c749dad0ebce141e695868fee0