Age | Commit message (Collapse) | Author |
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I5c240eec4385aaa3a6b4bf9533669b91c74c76cf
|
|
Don't sort test lists for original operation to keep original data
generation ordering.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3194b7d50505b422557ef12b72a9699483640c31
|
|
Make sure output shape is big enough to perform statistical
compliance error checking.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ia7ed7dd19a6c9cb888363f6cbdf0c6943235e0be
|
|
Add test list output to tosa_verif_build_tests and test list
capture to file for tosa_verif_conformance_generator
Improve PAD & CONV2D test coverage for tosa-mi conformance
Change to use logging for output to hide info from test lists
Tweak verbosity levels of tosa_verif_conformance_generator
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic29da5776b02e9ac610db6ee89d0ebfb4994e055
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I663a92001bf902cdc5327f386b2e896052a816ff
|
|
Added support to ref model and testing
Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: Iece53d07c8986332fdd8f1ce5ed6265349df1b6a
|
|
Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: I81bb322132daf25328a40342edc62d8e1db9edd6
|
|
This patch implements changes required for RescaleOp's
multiplier and shift changing from attributes to inputs
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I178919727e3220c749dad0ebce141e695868fee0
|
|
Fix problems from ensuring matching op tests.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ib2395110e47c56fea3cf3784a6b872fea7717db7
|
|
- Add Tosa Sin/Cos operators to reference_model
- Add conformances tests
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I3f597ddf5dac2c64d6dd6aa15781b40b8468eaa6
|
|
By always using an exact build_tests filter, to stop
extra operator tests such as add_shape being created
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I0fc4dd04276f9cd24c333e6a5c6b40d27d00e6ea
|
|
Always create the shift as a tensor for all types in testing.
In the reference model, set the shift operand to be available for
all types, but only read in the shift tensor for i32.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: Ia267cbf8b63ca0a9c97b38e8fb4db83eeb8c0538
|
|
This patch adjusts reference model for attribute name changes in
tosa.fb schema, and for obsoleted slice/tile/reshape attributes
also updated examples due to the breaking tosa flatbuffers changes
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I105eb99a4c35f289c5078aed0a7f9cbb6dfe9123
|
|
This patch implements changes needed for resize op's
scale/offset/border changing from attributes to inputs
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I20db0687fad40711f3ded644af51096292dd05b3
|
|
* Int16/UInt16 reference outputs were previously saved to INT32
* Save those in their native dtypes and updated other affected code
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I0c3b7fba096a8cb1ddabef20ad13498b8f46d36f
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I99b70f94aff2ccd4af64875697e124eb60bc5b08
|
|
Move remaining ops from using testArgs to argsDict.
All tvg/build_fcn function interfaces updated.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie886fd931bd74608bda621363100bf8bfd7385e6
|
|
* Add test for invalid accumulator dtype
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I506e2047623372670b82db6e9c0010fa89802851
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I365da379f599e5eca1841e6d299b4005a7b0f082
|
|
Add RELATIVE verify mode for RESIZE.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4fe352579507211dae7a048bf080c24426ce42a2
|
|
Correct ref model to produce imaginery values of zero as specification
indicates at certain output positions.
Fix up precise and abs modes for RFFT2D in ref model to produce correct
results and bounds using abs weights.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I33767e4219a260278f7933f28b1799223a95a3cc
|
|
Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: Ie05f88db15cd07fd5483ab669329d7048bd3349c
|
|
Improve access to DOT_PRODUCT generator index and location for debugging.
Enable multiple result files for compliance and improve output.
Fix up precise and abs modes for FFT2D in ref model to produce correct results
and bounds using abs weights.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ide0c9f9f80397e5f1e07ca30a1036d6014b5784d
|
|
Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: I95b931c032ce16c56ee05caab4dd26ea89557b3c
|
|
The type of both start and size of slice are tosa shape type since
0.90. Update the type of these arguments and its usage in testing.
Change-Id: Iff582982ad55d64a792183c6d46c9266510f924c
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Changed to use pad input of PadOp for testing.
The pad input is now a tensor of tosa.shape type.
moved padding error checking from checkTensorAttributes to eval
modified pad's PadOutputShapeMismatch test generation to avoid
generating output shapes with dimensions <= 0
Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I437c86d9a012903458a648667f6693db67b97d76
|
|
Update serialization_lib to store SHAPE as INT64.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie589cd6670dc79b77df981c81cd7c27b982f20fa
|
|
Update data generator for main compliance values.
Add test generation support.
Fixed test set by including large 65k tests that were missing.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I8668c774e01c17e5d999aadf99c317e2dd893857
|
|
Added DEPTHWISE_CONV2D data generation.
Updated test generation for FP16 and FP32.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I0471d0a1e4e279a27233f4d285082906ceea1bff
|
|
Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: Ib9d0abe0bd8826ca5ac051a5fe6ba18e1ba727f1
|
|
* Int8/UInt8 reference outputs were previously saved to INT32
* Save those in their native dtypes and updated other affected code
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: Id65fc8773150d3c56bc2c72789a6a0d3c78cd363
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Ie80570146601c470a3be7c04a9d6e1016a7c547c
|
|
Also fix the dimension mask out logic that only set batch dimension
to unknown but others won't.
Change-Id: I9e1d2c3bb1d24cba1242103aa2c7609ef0c2c0b3
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Dynamic shape model cannot directly run on the refenence model as
the concrete size of tensor is unknown therefore the volume of tensor
is not able to be allocated. Furthemore, the operators also expect
the input model is static-shaped.
This change turns dynamic model to static model prior to execution.
- Add `ifm_dynamic` field into json description to indicate whether
the model has dynamic shape or not.
- Add the shape inference pass into the compilation pipeline, firstly
legalize the dynamic tf/tfl model to dynamic tosa model with unknown
shapes, and then run the shape inference pass with static shapes
input argument to resolve unknown dimensions.
Change-Id: I5d2ffd452becc562dc30546789705bd01dd7a0b0
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
|
|
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Iaf59472cb32e03a92bad87ae9dba1b7548f20268
|
|
- fixed up reshape conformance tests to use shape input instead of attribute
- fixed up tile conformance tests to use shape input instead of attribute
- fixed output and output rank of dim op
- allow rank 0 and rank 1 tensors for tosa.shape values (for shape = {})
- added initialization of rank 0 const_shape tensors (for shape = {})
- Update conformance tests to use new rescale attributes
Signed-off-by: Tai Ly <tai.ly@arm.com>
Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I6cce0d2a9ab066fe20a2abf9d2cfde3eb3d8c18b
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I7f7449c652844097fec6226bcc32ca765b40bc04
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If08c560eac171124641dac66d7de9d5053db72df
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I7276f2db39e67314c950e972cc1a97b7796dcd18
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I466c1a8cb7c4cb3a8f6f18cf9885e7eb5e9819dd
|
|
Update and fix REDUCE_PRODUCT compliance verify lib support.
Added compliance test generation with data range to not cause infs.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3b3004c6caa80d97e330a6393f435f5270b56e21
|
|
Add lower bound to ABS ERROR checks to allow for cancellation of
small values in error bounds checking.
Re-adjust the error bounds multiplier to match the specification.
Fix up naming of verify library info structs.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3e178c3d7d59fef9c3696178646b23ed2a3ffc61
|
|
- Found the error for framework test generator when it's not generating
dynamic_shaped tests
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I54bf1422026f7f962d3f6ed0be9bd2e4dade14c5
|
|
- Added a basic infrastructure for allowing generate network with
dynamic_shapes
- Added tests cases for
- batch_to_space
- depth_to_space, space_to_depth
- linear
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ie3f13231a74485df64b852f554cfe65e995f0d03
|
|
Test generation changed to only produce static reshape tests
Reference model changed to produce ERROR_IF on inferred shapes
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I92c92a40e7c0e457961bc654630040dff79a750b
|
|
Added indices shuffling and random INT32 support to generate lib
with testing of these new random generator modes
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I058d8b092470228075e8fe69c2ededa639163003
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3555e7216d403d436bf6e39d4b16bb000645c4bb
|
|
Operator coverage restored/improved:
* REDUCE_SUM
* AVG_POOL2D
* FULLY_CONNECTED
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie622b2f97b5c34971fdde5b20df3d616171ac11f
|
|
Support relative desc.json paths in refmodel of just "desc.json".
Catch when generate and verify library paths are None and provide
help in tosa_verif_check_result.
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie52ac399ea002e5fcdcc1eec3d9df6153a778e88
|
|
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Icf04afc7fdae8f506ba4710aaa085d6ea53bb5bf
|