#include <IRuntime.hpp>

Classes
struct	ExternalProfilingOptions

Public Member Functions
	CreationOptions ()

Public Attributes
std::shared_ptr< IGpuAccTunedParameters >	m_GpuAccTunedParameters

bool	m_EnableGpuProfiling

std::string	m_DynamicBackendsPath

ExternalProfilingOptions	m_ProfilingOptions

std::vector< BackendOptions >	m_BackendOptions

Detailed Description

Definition at line 41 of file IRuntime.hpp.

Constructor & Destructor Documentation

◆ CreationOptions()

CreationOptions ( )

inline

Definition at line 43 of file IRuntime.hpp.

             : m_GpuAccTunedParameters(nullptr)
             , m_EnableGpuProfiling(false)
             , m_DynamicBackendsPath("")
         {}

Member Data Documentation

◆ m_BackendOptions

std::vector<BackendOptions> m_BackendOptions

Pass backend specific options.

For example, to enable GpuAcc tuning add the following m_BackendOption.emplace_back( BackendOptions{"GpuAcc", { {"TuningLevel", 2}, {"TuningFile", filename} } }); Execute representative workloads through the runtime to generate tuning data. The tuning file is written once the runtime is destroyed To execute with the tuning data, start up with just the tuning file specified. m_BackendOption.emplace_back( BackendOptions{"GpuAcc", { {"TuningFile", filename} } }); The following backend options are available: GpuAcc: "TuningLevel" : int [0..3] (0=UseOnly(default) | 1=RapidTuning | 2=NormalTuning | 3=ExhaustiveTuning) "TuningFile" : string [filenameString] "KernelProfilingEnabled" : bool [true | false]

Definition at line 104 of file IRuntime.hpp.

Referenced by BOOST_AUTO_TEST_CASE(), and ClBackendContext::ClBackendContext().

◆ m_DynamicBackendsPath

std::string m_DynamicBackendsPath

Definition at line 58 of file IRuntime.hpp.

Referenced by InferenceModel< IParser, TDataType >::InferenceModel(), main(), Runtime::Runtime(), and RuntimeInvalidOverridePathTestImpl().

◆ m_EnableGpuProfiling

bool m_EnableGpuProfiling

Definition at line 54 of file IRuntime.hpp.

Referenced by ClBackendContext::ClBackendContext(), GetSoftmaxProfilerJson(), InferenceModel< IParser, TDataType >::InferenceModel(), and main().

◆ m_GpuAccTunedParameters

std::shared_ptr<IGpuAccTunedParameters> m_GpuAccTunedParameters

If set, uses the GpuAcc tuned parameters from the given object when executing GPU workloads. It will also be updated with new tuned parameters if it is configured to do so.

Definition at line 51 of file IRuntime.hpp.

Referenced by ClBackendContext::ClBackendContext().