diff options
| author | David Mansell <David.Mansell@arm.com> | 2020-08-25 15:02:02 +0100 |
|---|---|---|
| committer | Georgios Pinitas <georgios.pinitas@arm.com> | 2020-09-22 10:13:53 +0000 |
| commit | 9e698d55d861b3a2a2deb9486a75dd541e928705 (patch) | |
| tree | 4f7a25d8af58a5d714971635ad4ba36850cd6d6b /src/core/NEON/kernels/arm_gemm/gemm_int8.cpp | |
| parent | 047c6fcd2ead657ea251a251893767aa90d6bde3 (diff) | |
| download | ComputeLibrary-9e698d55d861b3a2a2deb9486a75dd541e928705.tar.gz | |
COMPMID-3757: (u)int8: Don't select the 16-bit route on A53 for cases with very few rows
Also added 2D version of the 16-bit route, and altered the selection
heuristic so that 2D mode will be used in cases where 1D mode won't
thread well.
Change-Id: I0057fde08456771dc0090ac51f50d82f8bb86044
Signed-off-by: Michele Di Giorgio <michele.digiorgio@arm.com>
Reviewed-on: https://review.mlplatform.org/c/ml/ComputeLibrary/+/3903
Tested-by: Arm Jenkins <bsgcomp@arm.com>
Reviewed-by: SiCong Li <sicong.li@arm.com>
Reviewed-by: Georgios Pinitas <georgios.pinitas@arm.com>
Comments-Addressed: Arm Jenkins <bsgcomp@arm.com>
Diffstat (limited to 'src/core/NEON/kernels/arm_gemm/gemm_int8.cpp')
| -rw-r--r-- | src/core/NEON/kernels/arm_gemm/gemm_int8.cpp | 14 |
1 files changed, 11 insertions, 3 deletions
diff --git a/src/core/NEON/kernels/arm_gemm/gemm_int8.cpp b/src/core/NEON/kernels/arm_gemm/gemm_int8.cpp index bddcc8dab1..147caeefbd 100644 --- a/src/core/NEON/kernels/arm_gemm/gemm_int8.cpp +++ b/src/core/NEON/kernels/arm_gemm/gemm_int8.cpp @@ -122,17 +122,25 @@ static const GemmImplementation<int8_t, int32_t> gemm_s8_methods[] = { [](const GemmArgs &args) { return new GemmInterleaved<gemm_s8_12x8, int8_t, int32_t>(args); } }, { + GemmMethod::GEMM_INTERLEAVED_2D, + "gemm_s16_12x8_2d", + nullptr, + [](const GemmArgs &args) { return args._ci->get_cpu_model() == CPUModel::A53 && args._Msize > 4 && (args._Msize / args._maxthreads) < 8; }, + [](const GemmArgs &args) { return new GemmInterleavedPretransposed2d<gemm_s16_12x8, int8_t, int32_t>(args); }, +}, +{ GemmMethod::GEMM_INTERLEAVED, - "gemm_s16_12x8", + "gemm_s16_12x8_1d", nullptr, - [](const GemmArgs &args) { return args._ci->get_cpu_model() == CPUModel::A53; }, + [](const GemmArgs &args) { return args._ci->get_cpu_model() == CPUModel::A53 && args._Msize > 4; }, [](const GemmArgs &args) { return new GemmInterleaved<gemm_s16_12x8, int8_t, int32_t>(args); }, }, { GemmMethod::GEMM_INTERLEAVED_2D, "gemm_s8_4x4_2d", nullptr, - [](const GemmArgs &args) { return (args._maxthreads >= 8) && (args._Msize >= 8) && (args._Nsize >= 8); }, + [](const GemmArgs &args) { return ((args._maxthreads >= 8) && (args._Msize >= 8) && (args._Nsize >= 8)) || + ((args._Msize / args._maxthreads) < 4); }, [](const GemmArgs &args) { return new GemmInterleavedPretransposed2d<gemm_s8_4x4, int8_t, int32_t>(args); } }, { |