ArmNN
 20.11
IRuntime::CreationOptions Struct Reference

#include <IRuntime.hpp>

Classes

struct  ExternalProfilingOptions
 

Public Member Functions

 CreationOptions ()
 

Public Attributes

std::shared_ptr< IGpuAccTunedParametersm_GpuAccTunedParameters
 If set, uses the GpuAcc tuned parameters from the given object when executing GPU workloads. More...
 
bool m_EnableGpuProfiling
 Setting this flag will allow the user to obtain GPU profiling information from the runtime. More...
 
std::string m_DynamicBackendsPath
 Setting this value will override the paths set by the DYNAMIC_BACKEND_PATHS compiler directive Only a single path is allowed for the override. More...
 
ExternalProfilingOptions m_ProfilingOptions
 
std::vector< BackendOptionsm_BackendOptions
 Pass backend specific options. More...
 

Detailed Description

Definition at line 42 of file IRuntime.hpp.

Constructor & Destructor Documentation

◆ CreationOptions()

CreationOptions ( )
inline

Definition at line 44 of file IRuntime.hpp.

45  : m_GpuAccTunedParameters(nullptr)
46  , m_EnableGpuProfiling(false)
48  {}
std::shared_ptr< IGpuAccTunedParameters > m_GpuAccTunedParameters
If set, uses the GpuAcc tuned parameters from the given object when executing GPU workloads...
Definition: IRuntime.hpp:52
std::string m_DynamicBackendsPath
Setting this value will override the paths set by the DYNAMIC_BACKEND_PATHS compiler directive Only a...
Definition: IRuntime.hpp:59
bool m_EnableGpuProfiling
Setting this flag will allow the user to obtain GPU profiling information from the runtime...
Definition: IRuntime.hpp:55

Member Data Documentation

◆ m_BackendOptions

std::vector<BackendOptions> m_BackendOptions

Pass backend specific options.

For example, to enable GpuAcc tuning add the following

m_BackendOption.emplace_back(
BackendOptions{"GpuAcc",
{
{"TuningLevel", 2},
{"TuningFile", filename}
}
});

Execute representative workloads through the runtime to generate tuning data. The tuning file is written once the runtime is destroyed To execute with the tuning data, start up with just the tuning file specified.

m_BackendOption.emplace_back(
BackendOptions{"GpuAcc",
{
{"TuningFile", filename}
}
});

The following backend options are available: GpuAcc: "TuningLevel" : int [0..3] (0=UseOnly(default) | 1=RapidTuning | 2=NormalTuning | 3=ExhaustiveTuning) "TuningFile" : string [filenameString] "KernelProfilingEnabled" : bool [true | false]

Definition at line 115 of file IRuntime.hpp.

Referenced by BOOST_AUTO_TEST_CASE(), ClBackendContext::ClBackendContext(), and ProgramOptions::ParseOptions().

◆ m_DynamicBackendsPath

std::string m_DynamicBackendsPath

Setting this value will override the paths set by the DYNAMIC_BACKEND_PATHS compiler directive Only a single path is allowed for the override.

Definition at line 59 of file IRuntime.hpp.

Referenced by InferenceModel< IParser, TDataType >::InferenceModel(), main(), ProgramOptions::ParseOptions(), ProgramOptions::ProgramOptions(), Runtime::Runtime(), and RuntimeInvalidOverridePathTestImpl().

◆ m_EnableGpuProfiling

bool m_EnableGpuProfiling

Setting this flag will allow the user to obtain GPU profiling information from the runtime.

Definition at line 55 of file IRuntime.hpp.

Referenced by ClBackendContext::ClBackendContext(), GetSoftmaxProfilerJson(), and InferenceModel< IParser, TDataType >::InferenceModel().

◆ m_GpuAccTunedParameters

std::shared_ptr<IGpuAccTunedParameters> m_GpuAccTunedParameters

If set, uses the GpuAcc tuned parameters from the given object when executing GPU workloads.

It will also be updated with new tuned parameters if it is configured to do so.

Definition at line 52 of file IRuntime.hpp.

Referenced by ClBackendContext::ClBackendContext().

◆ m_ProfilingOptions


The documentation for this struct was generated from the following file: