diff options
author | SiCong Li <sicong.li@arm.com> | 2023-01-12 12:54:49 +0000 |
---|---|---|
committer | SiCong Li <sicong.li@arm.com> | 2023-01-20 15:21:31 +0000 |
commit | 5a2bc0169d942f7029d73a3afff1eab18b6f65ef (patch) | |
tree | efa7850199b40109b73b0ee35bb8f57531c983e9 /src/dynamic_fusion/utils/Utils.h | |
parent | a18d85c6d2c0025938c2dc10e553eb82c01922f2 (diff) | |
download | ComputeLibrary-5a2bc0169d942f7029d73a3afff1eab18b6f65ef.tar.gz |
Add Auxiliary tensors
The asssign_memory_descriptors method could not automatically assign
Auxiliary tensors. Therefore changes are made to allow developers to
explicitly mark auxiliary tensors.
However, to avoid ambiguity between auxiliary and "intermediate"
tensors, we solidify the definitions of both:
Intermediate tensors are a strictly topological term. They are defined
as "inner" tensors within a workload, hidden from the user, as opposed
to input and output tensors exposed to the users.
Auxiliary tensors are a subcategory of Intermediate tensors, and are
also about memory allocation. They are intermediate tensors that need
real memory backing.
For more details please see the documentation of MemoryType enum
Rename MemoryType::NoAlloc to MemoryType::Virtual
Partially resolves: COMPMID-5523
Signed-off-by: SiCong Li <sicong.li@arm.com>
Change-Id: Ibde44c2ec1570be9423e0fb38b53bb136ffc36dd
Reviewed-on: https://review.mlplatform.org/c/ml/ComputeLibrary/+/8940
Benchmark: Arm Jenkins <bsgcomp@arm.com>
Tested-by: Arm Jenkins <bsgcomp@arm.com>
Reviewed-by: Gian Marco Iodice <gianmarco.iodice@arm.com>
Reviewed-by: Gunes Bayir <gunes.bayir@arm.com>
Diffstat (limited to 'src/dynamic_fusion/utils/Utils.h')
-rw-r--r-- | src/dynamic_fusion/utils/Utils.h | 12 |
1 files changed, 10 insertions, 2 deletions
diff --git a/src/dynamic_fusion/utils/Utils.h b/src/dynamic_fusion/utils/Utils.h index d317ec7fd6..c9fc2c610f 100644 --- a/src/dynamic_fusion/utils/Utils.h +++ b/src/dynamic_fusion/utils/Utils.h @@ -33,21 +33,29 @@ namespace experimental { namespace dynamic_fusion { -inline bool is_user_tensor(const ITensorInfo *tensor_info) +/** Tensor should have backing memory. @ref MemoryType + */ +inline bool is_alloc_tensor(const ITensorInfo *tensor_info) { return tensor_info->id() > ITensorInfo::invalid_tensor_id; } -inline bool is_intermediate_tensor(const ITensorInfo *tensor_info) +/** Tensor should not have backing memory. @ref MemoryType + */ +inline bool is_noalloc_tensor(const ITensorInfo *tensor_info) { return tensor_info->id() < ITensorInfo::invalid_tensor_id; } +/** @ref ITensorInfo has valid id + */ inline bool is_valid_tensor(const ITensorInfo *tensor_info) { return tensor_info->has_valid_id(); } +/** @ref ITensorInfo has invalid id + */ inline bool is_invalid_tensor(const ITensorInfo *tensor_info) { return !is_valid_tensor(tensor_info); |