aboutsummaryrefslogtreecommitdiff
path: root/include
AgeCommit message (Collapse)Author
4 daysUpdate cfloat.hHEADmainWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: Ib2ee84ee729125c10870a22f4732811eaa387a3f
5 daysUse native size of Bfloat16 and Float8 for serialization/deserializationWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I0d2075f90988d4fd1139a11b5c154bdd600bb2cd
11 daysUpdate flatbuffer to v24.3.7Tai Ly
Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I9ab0e8ab4e3c37f1dd135b57661b25e18a5df5cb
13 daysUpdate main branch version to 1.1.0 draftEric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I9d1fcfb6fd70548b8c1dce8ea768b631bf87eb39
2024-04-19Change serialization version to 1.0.0 draftv1.0.0-rc0v1.00Eric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: Icbc231ada16eeba38452c2c7cec8e66cf43d3c0e
2024-04-19Update float8 code to support non-saturating modeWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I786aca0a2f137cebd446a3a71c8d6fe186286957
2024-04-18Remove TRANSPOSE_CONV2D out_shape argumentSuraj Sudhir
Change-Id: I1a52c596ea225355fe505f783d875a01023ff63e
2024-04-09[serialization_lib] Remove unused type field from Pad and ClampTai Ly
This patch removes the "type" field from PadAttribute and ClampAttribute because they are unused and unneeded. Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I378291b340ecee86824f25b3887aa4511207db23
2024-04-08Add conversions of U8 to/from BF16 and FP8Tai Ly
Adds type to PadAttribute and ClampAttribute so their pad_const and max_val/min_val can be deserialized according to type Adds conversion functions of U8 arrays to/from BF16/FP8 values Also, refactor and expose TosaSerializer.convertDataToUint8Vec for converting dtype/data to uint8 list for serialization And modify convertDataToUint8Vec to serialize bf16 values into 2 bytes each, and serialize fp8 values into single bytes each. Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I05659e8187c76d359f1cc9f71c8c23cafd0e877f
2024-03-13[serialization_lib] Add acc_type to Conv AttrsTai Ly
This adds acc_type to ConvAttribute and TransposeConvAttribute Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I73bab71b2eb90f6451fadee21d5bed1811ecbfd7
2024-03-11[serialization_lib] Fix Clamp and Pad AttributesTai Ly
This patch implements following changes to attribute fields: - PadAttribute: delete padding field, replace pad_const_int and pad_const_fp fields by pad_const, a field of ubyte array - ClampAttribute: replace min_int, max_int, min_fp and max_fp fields by min_val and max_val, fields of ubyte arrays - RescaleAttribute: delete multiplier and shift fields Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I5b075d29677cffca9ff2292708141d48410e7e72
2024-02-27Update ConvertU8toF16 to save outputs in F16 containersJerry Ge
- If we save FP16 in FP32 containers, it will change byte representation - which causes wrong values after deserialization - Update the code to store F16 values in F16 containers Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I2ddea67471997c596980faea1419422d96bad60d
2024-02-22[serialization_lib] Align to Tosa SpecTai Ly
removed attributes for Reshape, Slice and Tile Ops renamed field accum_dtype to acc_type, renamed then_branch/else_branch to then_graph/else_graph renamed cond_branch/body_branch to cond_graph/body_graph Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I2001f19519987d9e64c18b1f11762f9d3b9be4ec
2024-02-20Add Tosa Sin/Cos to schemaJerry Ge
- Add Tosa Sin/Cos to the serialization_lib schema - Generated related header files with the new schema Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: If424ff2b64538e8ffd5342b6ebb9a022537d5c4c
2024-02-08Change backward compatibility for 0.90.0Won Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I437ca381725248e7bb25e7086b7b43c7f1571fb8
2024-02-06[serialization_lib] Add support for FP8E4M3 and FP8E5M2Won Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: Ife50592890be020b6c6122581eeb2175c8f331e0
2024-02-02Update version to 0.100.0v0.100a0Eric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: Idd444ceb641993e2ed6b647505979ec9d5def796
2024-01-12[serialization_lib] Add tosa shape opsTai Ly
Added tosa shape ops to tosa.fbs also added convert I64 to and from U8 for storing const_shape data values Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I1e938dec7398fbcbe5be657dad65cdd61af5b597
2024-01-03Fix compiler warningsEric Kunze
No functional changes Change-Id: I938fecc941b14c065639e27a110ab1feb7c85ba9 Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2023-11-09Update CustomOp's attribute NamesJerry Ge
- CustomOp's two attribute names have been changed to - domain to domain_name - operator to operator_name Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I382ff2cf98da0487f096938c3693428e91dce386
2023-11-01Add support for local_bound attributeEric Kunze
local_bound is used to determine when fast convolution algorithms can be used in implementing the operation. Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I9970a2544e90a620f46ac4d3d01cec90a15710a9
2023-09-19Add variable_name to tensorsTai Ly
Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: Ia142c8b1a9e0869daefb3eef71100fd0c2a0effc
2023-09-13Update version tags to 0.90 draftEric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I4163390599afbbc93b02e3e72b2fe0f53a0bcf06
2023-09-07Add new signedness attributes to RESCALEEric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I96202b90bff833654735a2f2306eb782d202b6e6
2023-09-06Enable backward compatibilityv0.90a0Jerry Ge
Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I572ae70f8d693c89739ab892a31157235700c3f2
2023-08-23Add is_unranked flag to TensorsTai Ly
This adds a bool field, is_unranked to TosaTensor in tosa.fbs to indicate whether a tensor with shape = {} is an unranked tensor or an 0-D tensor. For older tosa files without this field, the default value is false. Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I86950050b522565509863c483cd3a3c1c50f8f69
2023-08-22[Serialization_lib] Support StatefulOps for TOSAJerry Ge
- Add variable in TosaTensor to schema file - Update TosaSerializationTensor regarding variable change - Rename internal zero_pad() and expose interface as ForceAlignTensorData() Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I36fa64eb0802cb5b8d3564ea7233460ef8c9f539
2023-08-21Add assertion message to avoid warning message for C++14Won Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I95e82ac2d7c6e412f6cda0c9ffb2fb94d25af1d2
2023-08-18[fix] explicitly declare template specialization for readFromNpyFileTatWai Chong
Not all compiler/linker can link the typed call side to the desired type of specialized template function without having explicit declaration in the header file. Dtype mismatch will happen during reading numpy file when wrong caller-callee pair linked. Change-Id: If97c2a12d9cb602e08c8c31e828f85577cf002e6 Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
2023-08-10Add DIM operator to serialization libraryWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: I7c68f94a088e206c99d34d152601cf342bff5541
2023-08-02Simplify overloaded writeToNpyFiles and readFromNpyFilesTatWai Chong
templatize these functions instead to reduce redundant code. Signed-off-by: TatWai Chong <tatwai.chong@arm.com> Change-Id: Ie8b6f7d2b489c3508fea72481ce38f0db6d0c490
2023-07-18Update to use GenTextTai Ly
changed GenerateText to GenText, with reversed return polarity. updated flatbuffer to v23.5.26, and regenerated headers Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: I7278dfe9c7b55b9afbe2329e3058b63a1cdce586
2023-07-05Support reading anydtype into a 32-bit bufferJerry Ge
Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: Ic6b43539fcb2d75c5614d3addccd24a06e9f2a31
2023-06-07Add ERF operator to serialization_libWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: Idc253e51e7a613cfc0c7da653073a71bf0fcb162
2023-06-07Add u8 array to float conversion checkWon Jeon
Signed-off-by: Won Jeon <won.jeon@arm.com> Change-Id: Idfd668b0ce8f8f587e00ca7b03063ce58d789ac4
2023-06-01Update version to 0.80.0 draftEric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: Ie046531ee1d6a3977760aa3f8013f326e7c071f9
2023-05-25Remove draft tag from 0.70 serialization libraryv0.70.0v0.70Eric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: If99d07bdad463346da957b6fa16231f818b86728
2023-05-23Change default value for draft versionEric Kunze
Default draft = True means that a TOSA flatbuffer with no value stored for the draft flag is true. Serialized TOSA with draft = False are release versions. Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I1304292ef83008a61a2a72e03171d00d5fe13442
2023-05-19Support int16, uint16, int8, uint8 types numpy reader/writer for ↵Jerry Ge
serialization_lib Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I287fcda4e895ecfc35083d6cb02140a251c0deb5
2023-05-18Modify TOSA schema to force version to be writtenEric Kunze
Previously if the values were the default, they would not be written to the file Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: Ibdf13d3ce672d3e8f062a7853d65a966ab5b0877
2023-05-12Support updating serialized tensor shape for shape inferenceJerry Ge
Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I44b9fd37e8890bfec02c647857a43bcb6800da80
2023-04-04Add readFromNpyFile and writeToNpyFile for double dataTai Ly
Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: Icc023cbe6aa8843cc37d25e740bc6ce05bb7abb2
2023-03-16Update version to 0.70.0 draftEric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: Ie139b262f7bd5966e72a3535ac2253e13d7b3604
2023-03-08Update version number to 0.60 for releasev0.60.0Eric Kunze
Signed-off-by: Eric Kunze <eric.kunze@arm.com> Change-Id: I2eb93e6e88ee358c9ec9562c3b4d876eb41cc38c
2023-02-27deserialization bug fixTai Ly
Signed-off-by: Tai Ly <tai.ly@arm.com> Change-Id: Ib53f093ce6ae72974193057f7c46edd784753e11
2023-01-23Remove accumulator attributes from all but AVG_POOL2DJames Ward
* Also add missing CustomAttribute.py (flatbuffers generated file) Signed-off-by: James Ward <james.ward@arm.com> Change-Id: Ib71847e03d622995dd86afcb6ec9ed2bc147ee7a
2023-01-18Schema changes for CLAMP, PAD float attributesJames Ward
* Float attributes now serialized as uint8 vectors, but treated as floats at input/output to serialization Signed-off-by: James Ward <james.ward@arm.com> Change-Id: I417b0fabe0ef11fea263fe937b57d49bbfdb00da
2023-01-13Add FFT2d and RFFT2d serialization supportLuke Hutton
Signed-off-by: Luke Hutton <luke.hutton@arm.com> Change-Id: I79b3684ae1cf24e71ec7098ed7db5be5bc2f6fb2
2023-01-04Add attributes to serialization of custom opEric Kunze
Change-Id: I4a1d7675b247efcf34aadd59eac17b966e3705af Signed-off-by: Eric Kunze <eric.kunze@arm.com>
2022-12-15[region] Add TosaSerializationRegion to serialization_libJerry Ge
- Rationale: add this fix to support constants access between multiple blocks by another layer of abstraction called Region - Changes: - flatbuffers schema update, regenerate header files - add TosaSerializationRegion for the handler - other relevant fixes Signed-off-by: Jerry Ge <jerry.ge@arm.com> Change-Id: I4bb72503abfd629ae017d2f905184efbab244aa8