diff options
| author | James Ward <james.ward@arm.com> | 2022-10-19 12:20:31 +0100 |
|---|---|---|
| committer | Jeremy Johnson <jeremy.johnson@arm.com> | 2022-11-09 12:19:51 +0000 |
| commit | 24dbc420aae556649f50e645bd94489dab2cc75a (patch) | |
| tree | 490345da43e9c5bae0f450ba05ffe85874077e0a /reference_model/src/subgraph_traverser.cc | |
| parent | 3b0544c1e7463295c49a48a162ebb9a546326829 (diff) | |
| download | reference_model-24dbc420aae556649f50e645bd94489dab2cc75a.tar.gz | |
Add BF16 support to reference model
* Upgrade Eigen to 3.4.0 (for bfloat16 support) and add work-
arounds for reduce.any() and reduce.all() bugs (introduced
between 3.3.7 and 3.4.0)
* Truncation to bfloat16 now performed in eval() methods
Signed-off-by: James Ward <james.ward@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If5f5c988d76d3d30790acf3b97081726b89205fe
Diffstat (limited to 'reference_model/src/subgraph_traverser.cc')
| -rw-r--r-- | reference_model/src/subgraph_traverser.cc | 11 |
1 files changed, 11 insertions, 0 deletions
diff --git a/reference_model/src/subgraph_traverser.cc b/reference_model/src/subgraph_traverser.cc index ae216d8..112e641 100644 --- a/reference_model/src/subgraph_traverser.cc +++ b/reference_model/src/subgraph_traverser.cc @@ -15,6 +15,7 @@ #include "subgraph_traverser.h" #include "tosa_model_types.h" +#include "arith_util.h" #ifndef SUBGRAPH_ERROR_IF #define SUBGRAPH_ERROR_IF(COND, fmt, ...) \ @@ -403,6 +404,16 @@ int SubgraphTraverser::allocateTensor() tensor->setTensorValueFloat(f16_data.size(), f16_data.data()); } break; + case DType_BF16: + { + std::vector<float> fp32_data; + TosaSerializationHandler::ConvertU8toF32(ts->GetData(), tensor->getElementCount(), fp32_data); + // Ensure valid bfloat16 stored in each float + for (auto f : fp32_data) + ASSERT_MSG(checkValidBFloat(f), "Float value %f not valid bfloat16", f); + tensor->setTensorValueFloat(fp32_data.size(), fp32_data.data()); + } + break; case DType_FP32: { std::vector<float> fp32_data; |