Age | Commit message (Collapse) | Author |
|
Adding user argument parameter to invoke() which is passed on to
the inference_begin() and inference_end() callbacks.
Change-Id: I1372767c3a0dbd963aa395911bda7625bc6d6ee4
|
|
Small bugfix to a print in driver
Change-Id: I277a441a9f65c647c338b92af5a908176929102c
|
|
Change error message to LOG_ERR from LOG_DEBUG and simplify
error checks
Remove redundant code in driver
Disable the PMU before enabling power/clock gating
Change-Id: I3092113250c1b165d985194ca2da213622629488
|
|
Remove new line from log messages to allow the log makros to format
the output.
Change-Id: Idc07d0ef1fb77530fa07279ae92b2c964ebb6287
|
|
No functional change as they both evaluate to the same
numerical value.
Change-Id: Ia84c19e08defa63067755389857c967698127d8c
|
|
A continuation of the spring clean/refactor work. Create a
better separation between driver and device(s).
A short summary of what this commit contains:
- Split device and driver
- Simplify and hide the internal device interface
- Remove (broken) abort inference functionality
- Refactoring of structure
- Optimizations and bugfixes
Change-Id: I8988bc5f163f9ea62add2a933e4f100a82cc8d35
|
|
Made a separate header file for logging specific content.
Cleaned up logging messages.
Change-Id: Id329b40977156ca5b954b3a222effaedbc6b2a2c
|
|
Added ethosu_deinit method which calls ethosu_deregister_driver().
Change-Id: I12cb1b07169c06c011a80f66d26451431db3948a
|
|
These changes mostly focus on creating a better structure
for the driver. Creating a better separation between driver
and device(s).
A short summary of what this commit contains:
- Move driver specific defines from device to driver
- Prefix device functions with ethosu_dev
- Remove device specific register access' from driver
- Remove device specific debug/dump functions
- Add function prototypes for weak functions
- Remove legacy ARM_NPU_STUB support
- Rename ethosu_device.c to ethosu_device_u55.c
- Remove redundant irq handler prototype
- Remove (deprecated) hardcoded instance ethosu_drv
- Simplify versioning API
Split driver version and hardware version/information so
that driver version can be queried without a driver instance.
- Improve and simplify logging
Make warning the new default severity level to print and
reduce severity levels to:
err
warning
info
debug
- Add severity prefix to log lines. Error messages print file
and line number, debug messages print function by default.
- Clarify some log messages
- Small optimizations and bugfixes
Change-Id: I2dfbfc3a40d7eca133c82f187f422325e1e6d314
|
|
Removing the ASSERT() makro using assert() instead. assert() is better
controlled with the NDEBUG define.
Using uintptr_t instead of uint32_t * for the NPU base address. This
saves a division by 4 in the register read and write functions.
Change-Id: I65a91fe35dc63666e50bdf7a756ad15b56dc66e9
|
|
The weak linked symbol ethosu_mutex_create() should in the default case
return NULL.
Change-Id: Ia92ba8fb85137dc6d676b4d4ea050c9c14085472
|
|
Add ethosu_inference_begin/end calls to ethosu_invoke_v3.
Change-Id: I52f08ab3e3524d4d8f73d8bca7dc9559438d4857
|
|
NPU driver interface currently have functions which have been stepped
each time a compatibilty breaking changed has been introduced. Old
entrypoints have been redefined with macro to use the latest version
for backwards compatibility. This series of patches will remove any
such functions and macro to unify the interface.
Update: Remove all "_v"-functions and make the latest version the base
entrypoint
Update: Remove all redefine macros to only allow base entrypoint
Note: static inline ethosu_invoke_v2() is kept as it is needed for
tensorflow backwards compatibility. Will be removed in later patches.
Change-Id: Ifa331daab35af24dc29e0d0007096902b8efc319
|
|
Change-Id: I947f52a83cc9352caf45a7b242e5a15fbdedf6e3
|
|
Changed so that power_request bit will be set if ETHOSU_POWER_Q_DISABLE
instead of ETHOSU_CLOCK_Q_DISABLE.
Change-Id: I571ab165f8856ed71f6e932be401312d43e9cca8
|
|
Added: custom_dma bit to config structs
Added: hardware verification check for custom_dma
Change-Id: I31dca56063b3ca773d02f0adf30d21facfd0b80d
|
|
Currently clock request is enabled, which means NPU will
only request clock when working. When NPU is going into idle it will no
longer request clock and thus PMU won't be clocked either, and thus
affect the cycle counter.
Added: enum for request clients (PMU or INFERENCE).
Added: clock_request added to driver struct (bit 0: PMU, bit 1:
INFERENCE) which keeps track of which client requests clock.
Added: power_request added to driver struct (bit 0: PMU, bit 1:
INFERENCE) which keeps track of which client requests power.
Added set_clock_and_power_request(...) updates clock_request and
power_request depending on which client calls it. Sets clock and power
if both PMU and INFERENCE requests it.
Added: Call set_clock_and_power_request(...) from PMU.
Changed: replace ethosu_set_clock_and_power(...) with
set_clock_and_power_request(...) in ethosu_init and ethosu_invoke
Change-Id: Ie7d8aee639d4abbf879b05e9a82035d7c0d40d40
|
|
Modifying mutex and semaphore APIs allowing the driver to create
any number of mutexes and semaphores.
Using semaphore when waiting for interrupt.
Making irq_triggered a member of the driver struct.
Change-Id: Ib0645c9c7c0c029795269ac4b18e6ec29159d0f8
|
|
Allow the IRQ handler to be overridden for test cases that operate
directly on top of the device driver.
Change-Id: Iddf7aec041a3183583e6e4d8521d5a637c379689
|
|
Added: Weak linked symbols for locking if RTOS overrides
Added: Semaphore Producer (release a reserved driver)
Added: Semaphore Consumer (all drivers reserved and waiting for returned driver)
Added: Mutex protect thread sensitive driver access
Added: Weak linked symbols for yielding & resuming thread/task while waiting for IRQ
Added: static inline function of ethosu_invoke_v2(...) for backwards compatibility
Change-Id: If415a73b01b2357b31bb6da86f3038344c4245c6
|
|
---ethosu_driver---
Modified: Declarations for the driver interfaces to support multiNPU (takes *drv)
Added: ethosu_register_driver(...) to allow for a specific NPU driver to be instantiated
Added: ethosu_deregister_Driver(...) to allow for a specific NPU driver to be de-registered
Added: ethosu_reserve_driver(...) to reserve & return the first NPU driver instance available
Added: ethosu_release_driver(...) to release a specific NPU driver instance and make it available again
Added: *registered_drivers - A static linked list of drivers ready be used
---ethosu_pmu---
Modified: Declarations for pmu interfaces to support multiNPU (takes *drv)
---ethosu_device---
Modified: Resolved a circular include dependency (Remove include and add ETHOSU_PMU_NCOUNTERS macro)
Change-Id: Iede41cd41bb0d5d483bd9d929d1b6c9ca5d3c48e
|
|
* Allow driver to run cmdstreams that are compiled
for older arch versions
Change-Id: Ia49fc6c34b118bd91ce24bd0c34d95abc4c25d6a
Signed-off-by: Douglas Troha <douglas.troha@arm.com>
|
|
If NPU power is guaranteed always on parts of driver setup can be omitted to reduce the number of cycles required to setup the NPU drivers.
By enabling dev_power_always_on, the setup cycles are reduced by approx. ~50%. (4462->2238 in prologue, 1167->642 in epilogue)
Change-Id: I56d380c2571fedbc8888fb7c00fce0e4320f7fb7
|
|
Change-Id: I3a8b88fb63aee8a4741ab1ca47bc49c663479e21
|
|
Using a cpu without proper interrupt handling is not really usefull in
this context, so remove that option.
Change-Id: Ie94fd9025c918eef72272e14ad5b0a95ea7dc4a4
|
|
Change-Id: Ia22b2934b4c85e3c480931c8b92608365351a877
|
|
The addition of init_v3 accidentely changed default values for soft
resetting Ethos-U. Restore the default parameters to non-secure, user
mode for init_v1 and init_v2 and also make sure to check return value
from ethosu_soft_reset.
Change-Id: If7377f11ad1db7ff988fdcba03320a54e6e0c0c1
|
|
Change-Id: I8ca309ea4e5885865d5c9cf848500f45f83e08a2
|
|
Implement a weak linked function to handle the data cache.
If the specific device is implementing a data cache the function should
be overriden with device specific implementation of the flush/invalidate
functions to make sure that the cache is properly maintained with
regards to the NPU DMA transaction.
Change-Id: I175644ef37bee62cc77d789d2b7bc3073e72ea5a
|
|
Return error if the fast memory area would be smaller than
the spilling tensor.
Change-Id: Ica89a3a933a3317a346e3479f5209ddc735d1c91
|
|
Storing PMU counters in shadow variables, in case the PMU was powered
off or soft reset.
Change-Id: I64ccf3fb6195f9be2d8315891ec612bb75404885
|
|
The ETHOSU is soft-reset only if the previous job failed or if
the current privilege level is not user or if the current security
level is not secure.
Change-Id: Id10b96058d67805d179ac693537606d55e10379b
|
|
Avoid using NULL to initialize and compare with for integer variables.
Change-Id: I1c370a9bb213dc93db845149d123915273411551
|
|
Avoid casting pointers to integer types larger than the pointer itself,
and let assignement handle the conversion.
Change-Id: Icfd2401617f2cd0fc96c2a6a9ad8d2d8bec94c55
|
|
GCC and armclang uses different uint32_t types which makes it impossible
to use standard format specifiers to satisfy both compilers. Move to
inttypes.h macros to handle it in a portable way.
Change-Id: If85e1148d302b64660af66d8f462efba9ac5d86b
|
|
Change-Id: Ie4186f5ab881d5c13021299404322ff582180d26
|
|
Change-Id: I54a1927fef998bc97f5507f2de9faf7d4a7960f5
|
|
Allow user to define a base pointer offset, if the CPU and the NPU have
address spaces offseted from each other.
Soft reset NPU before every inference.
Added log prints.
Change-Id: I98a746d20dc780fefa23ad68816f5ba2ba2e6c6e
|
|
This includes resetting the Ethos-U and restoring the
previosuly saved PMU configuration (if any).
Change-Id: Id952fb6fef513468952b6a469e857510f8c0214c
|
|
Change-Id: I1145834000ff81d6e497a8fa77bf997478a80372
|
|
Bit [2] in CMD register is used to enable clock off using
clock q-interface and enable the master clock gate. Bit [3] is
used to enable power off using power q-interface.
The clock_q_enable bit is set when putting the Ethos-U into run
state.
The power_q_enable bit is set to 0 when running the command stream
and set to 1 after command stream has finished running.
Change-Id: Id9d1405376508e2af2ec0ddc2ebae8fb6c2f5cba
|
|
* Arch patch versions should be backward compatible
Signed-off-by: Douglas Troha <douglas.troha@arm.com>
Change-Id: I1b0d292d0885af90d5b39f2239e020af9181008b
|
|
Moving the alignment checks for command stream and base addresses
to handle_command_stream(). This is done so that applications which
directly call ethosu_run_command_stream(), and don't have command
stream & base addresses properly aligned can still run the command
stream.
Change-Id: Ie02e9952af027e3017e53ea7217698a33a33b418
|
|
Also check that the command stream address and base address are
aligned to 16 bytes. Return error in case they are not correctly
aligned.
Change-Id: I786d03f403d02d601ee74c53d2dede85b2b0e8a0
|
|
Change-Id: I2e72d26699e07b12b42832b59e23b3083c59d1d8
|
|
Rename CMake log variable. Make logging default off.
Remove CMake setting compile features.
Remove FPGA flag around soft reset.
Change-Id: Ia1f1c314ad19e9e05c59efe1a16d5670f6ec0f69
|
|
Turn the IRQ initialization around, to have the application define the
interrupt handler and expose the driver routine that is to be called
when that happens.
Change-Id: Idbfba1b1d1a1eaf6678ee16e9583c496eb2287ed
|
|
Change-Id: I541862775031c21e6483f26446a29dfe452382ab
|