From 770b18e3d2f36f520b824c70a063381156511bb7 Mon Sep 17 00:00:00 2001 From: Eric Kunze Date: Fri, 23 Feb 2024 13:53:41 -0800 Subject: Add a new rationale appendix This appendix attempts to record the rationale for decisions made when modifying the TOSA specification. Signed-off-by: Eric Kunze Change-Id: Ia2332d39c075a53f611665c446566bd89385b9fb --- chapters/appendix_c.adoc | 29 +++++++++++++++++++++++++++++ 1 file changed, 29 insertions(+) create mode 100644 chapters/appendix_c.adoc (limited to 'chapters') diff --git a/chapters/appendix_c.adoc b/chapters/appendix_c.adoc new file mode 100644 index 0000000..9c67849 --- /dev/null +++ b/chapters/appendix_c.adoc @@ -0,0 +1,29 @@ +// +// This confidential and proprietary software may be used only as +// authorised by a licensing agreement from ARM Limited +// (C) COPYRIGHT 2024 ARM Limited +// ALL RIGHTS RESERVED +// The entire notice above must be reproduced on all authorised +// copies and copies may only be made to the extent permitted +// by a licensing agreement from ARM Limited. + +== Appendix C - Rationale + +This appendix documents the rationale behind decisions made while creating the TOSA specification. +Explanations and definitions contained in this appendix are non-normative. + +=== FP8 + +The operators that perform calculations on FP8 data types are limited. +Fewer mantissa bits in FP8 make it inappropriate for use in most elementwise operations such as <>. +Support was also added to the data layout and movement operations on the understanding that no calculations are performed. +Two extensions for the FP8 types were created in order to cover both formats defined by <>. + +=== Transcendental Functions + +In the TOSA specification, a limited number of transcendental operations are supported. +The operators supported are sufficient for common networks while minimizing the number of operations an implementation must support. +Originally, SIGMOID and TANH were added as the common functions used for activations. +ERF was added to support GELU style activation functions. +SIN and COS were added to provide a base level of trigonometric functionality as well as support for Rotary Position Embedding. + -- cgit v1.2.1