diff options
Diffstat (limited to '21.02/_build_guide_cross_compilation_8md_source.xhtml')
| -rw-r--r-- | 21.02/_build_guide_cross_compilation_8md_source.xhtml | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/21.02/_build_guide_cross_compilation_8md_source.xhtml b/21.02/_build_guide_cross_compilation_8md_source.xhtml index b9096316a4..16b8c03ee4 100644 --- a/21.02/_build_guide_cross_compilation_8md_source.xhtml +++ b/21.02/_build_guide_cross_compilation_8md_source.xhtml @@ -98,13 +98,13 @@ $(document).ready(function(){initNavTree('_build_guide_cross_compilation_8md.xht <div class="title">BuildGuideCrossCompilation.md</div> </div> </div><!--header--> <div class="contents"> -<a href="_build_guide_cross_compilation_8md.xhtml">Go to the documentation of this file.</a><div class="fragment"><div class="line"><a name="l00001"></a><span class="lineno"> 1</span> # How to Cross-Compile Arm NN on x86_64 for arm64</div><div class="line"><a name="l00002"></a><span class="lineno"> 2</span> </div><div class="line"><a name="l00003"></a><span class="lineno"> 3</span> - [Introduction](#introduction)</div><div class="line"><a name="l00004"></a><span class="lineno"> 4</span> - [Cross-compiling ToolChain](#cross-compiling-toolchain)</div><div class="line"><a name="l00005"></a><span class="lineno"> 5</span> - [Build and install Google's Protobuf library](#build-and-install-google-s-protobuf-library)</div><div class="line"><a name="l00006"></a><span class="lineno"> 6</span> - [Build Caffe for x86_64](#build-caffe-for-x86-64)</div><div class="line"><a name="l00007"></a><span class="lineno"> 7</span> - [Build Boost library for arm64](#build-boost-library-for-arm64)</div><div class="line"><a name="l00008"></a><span class="lineno"> 8</span> - [Build Compute Library](#build-compute-library)</div><div class="line"><a name="l00009"></a><span class="lineno"> 9</span> - [Build Tensorflow](#build-tensorflow)</div><div class="line"><a name="l00010"></a><span class="lineno"> 10</span> - [Build Flatbuffer](#build-flatbuffer)</div><div class="line"><a name="l00011"></a><span class="lineno"> 11</span> - [Build Onnx](#build-onnx)</div><div class="line"><a name="l00012"></a><span class="lineno"> 12</span> - [Build TfLite](#build-tflite)</div><div class="line"><a name="l00013"></a><span class="lineno"> 13</span> - [Build Arm NN](#build-armnn)</div><div class="line"><a name="l00014"></a><span class="lineno"> 14</span> - [Build Standalone Sample Dynamic Backend](#build-standalone-sample-dynamic-backend)</div><div class="line"><a name="l00015"></a><span class="lineno"> 15</span> - [Run Unit Tests](#run-unit-tests)</div><div class="line"><a name="l00016"></a><span class="lineno"> 16</span> - [Troubleshooting and Errors:](#troubleshooting-and-errors-)</div><div class="line"><a name="l00017"></a><span class="lineno"> 17</span> </div><div class="line"><a name="l00018"></a><span class="lineno"> 18</span> </div><div class="line"><a name="l00019"></a><span class="lineno"> 19</span> ## Introduction</div><div class="line"><a name="l00020"></a><span class="lineno"> 20</span> These are the step by step instructions on Cross-Compiling Arm NN under an x86_64 system to target an Arm64 system. This build flow has been tested with Ubuntu 16.04.</div><div class="line"><a name="l00021"></a><span class="lineno"> 21</span> The instructions show how to build the Arm NN core library and the Boost, Protobuf, Caffe, Tensorflow, Tflite, Flatbuffer and Compute Libraries for compilation.</div><div class="line"><a name="l00022"></a><span class="lineno"> 22</span> </div><div class="line"><a name="l00023"></a><span class="lineno"> 23</span> #####Note: We are currently in the process of removing boost as a dependency to Arm NN. This process is finished for everything apart from our unit tests. This means you don't need boost to build and use Arm NN but you need it to execute our unit tests. Boost will soon be removed from Arm NN entirely. We also are deprecating support for Caffe and Tensorflow parsers in 21.02. This will be removed in 21.05. </div><div class="line"><a name="l00024"></a><span class="lineno"> 24</span> </div><div class="line"><a name="l00025"></a><span class="lineno"> 25</span> ## Cross-compiling ToolChain</div><div class="line"><a name="l00026"></a><span class="lineno"> 26</span> * Install the standard cross-compilation libraries for arm64:</div><div class="line"><a name="l00027"></a><span class="lineno"> 27</span> ```</div><div class="line"><a name="l00028"></a><span class="lineno"> 28</span> sudo apt install crossbuild-essential-arm64</div><div class="line"><a name="l00029"></a><span class="lineno"> 29</span> ```</div><div class="line"><a name="l00030"></a><span class="lineno"> 30</span> </div><div class="line"><a name="l00031"></a><span class="lineno"> 31</span> ## Build and install Google's Protobuf library</div><div class="line"><a name="l00032"></a><span class="lineno"> 32</span> </div><div class="line"><a name="l00033"></a><span class="lineno"> 33</span> We support protobuf version 3.12.0</div><div class="line"><a name="l00034"></a><span class="lineno"> 34</span> * Get protobuf from here: https://github.com/protocolbuffers/protobuf : </div><div class="line"><a name="l00035"></a><span class="lineno"> 35</span> ```bash</div><div class="line"><a name="l00036"></a><span class="lineno"> 36</span> git clone -b v3.12.0 https://github.com/google/protobuf.git protobuf</div><div class="line"><a name="l00037"></a><span class="lineno"> 37</span> cd protobuf</div><div class="line"><a name="l00038"></a><span class="lineno"> 38</span> git submodule update --init --recursive</div><div class="line"><a name="l00039"></a><span class="lineno"> 39</span> ./autogen</div><div class="line"><a name="l00040"></a><span class="lineno"> 40</span> ```</div><div class="line"><a name="l00041"></a><span class="lineno"> 41</span> * Build a native (x86_64) version of the protobuf libraries and compiler (protoc):</div><div class="line"><a name="l00042"></a><span class="lineno"> 42</span>  (Requires cUrl, autoconf, llibtool, and other build dependencies if not previously installed: sudo apt install curl autoconf libtool build-essential g++)</div><div class="line"><a name="l00043"></a><span class="lineno"> 43</span> ```</div><div class="line"><a name="l00044"></a><span class="lineno"> 44</span> mkdir x86_64_build</div><div class="line"><a name="l00045"></a><span class="lineno"> 45</span> cd x86_64_build</div><div class="line"><a name="l00046"></a><span class="lineno"> 46</span> ../configure --prefix=$HOME/armnn-devenv/google/x86_64_pb_install</div><div class="line"><a name="l00047"></a><span class="lineno"> 47</span> make install -j16</div><div class="line"><a name="l00048"></a><span class="lineno"> 48</span> cd ..</div><div class="line"><a name="l00049"></a><span class="lineno"> 49</span> ```</div><div class="line"><a name="l00050"></a><span class="lineno"> 50</span> * Build the arm64 version of the protobuf libraries:</div><div class="line"><a name="l00051"></a><span class="lineno"> 51</span> ```</div><div class="line"><a name="l00052"></a><span class="lineno"> 52</span> mkdir arm64_build</div><div class="line"><a name="l00053"></a><span class="lineno"> 53</span> cd arm64_build</div><div class="line"><a name="l00054"></a><span class="lineno"> 54</span> export CC=aarch64-linux-gnu-gcc \</div><div class="line"><a name="l00055"></a><span class="lineno"> 55</span> export CXX=aarch64-linux-gnu-g++ \</div><div class="line"><a name="l00056"></a><span class="lineno"> 56</span> ../configure --host=aarch64-linux \</div><div class="line"><a name="l00057"></a><span class="lineno"> 57</span> --prefix=$HOME/armnn-devenv/google/arm64_pb_install \</div><div class="line"><a name="l00058"></a><span class="lineno"> 58</span> --with-protoc=$HOME/armnn-devenv/google/x86_64_pb_install/bin/protoc</div><div class="line"><a name="l00059"></a><span class="lineno"> 59</span> make install -j16</div><div class="line"><a name="l00060"></a><span class="lineno"> 60</span> cd ..</div><div class="line"><a name="l00061"></a><span class="lineno"> 61</span> ```</div><div class="line"><a name="l00062"></a><span class="lineno"> 62</span> </div><div class="line"><a name="l00063"></a><span class="lineno"> 63</span> ## Build Caffe for x86_64</div><div class="line"><a name="l00064"></a><span class="lineno"> 64</span> * Ubuntu 16.04 installation. These steps are taken from the full Caffe installation documentation at: http://caffe.berkeleyvision.org/install_apt.html</div><div class="line"><a name="l00065"></a><span class="lineno"> 65</span> * Install dependencies:</div><div class="line"><a name="l00066"></a><span class="lineno"> 66</span> ```bash</div><div class="line"><a name="l00067"></a><span class="lineno"> 67</span> sudo apt-get install libleveldb-dev libsnappy-dev libopencv-dev libhdf5-serial-dev</div><div class="line"><a name="l00068"></a><span class="lineno"> 68</span> sudo apt-get install --no-install-recommends libboost-all-dev</div><div class="line"><a name="l00069"></a><span class="lineno"> 69</span> sudo apt-get install libgflags-dev libgoogle-glog-dev liblmdb-dev</div><div class="line"><a name="l00070"></a><span class="lineno"> 70</span> sudo apt-get install libopenblas-dev</div><div class="line"><a name="l00071"></a><span class="lineno"> 71</span> sudo apt-get install libatlas-base-dev</div><div class="line"><a name="l00072"></a><span class="lineno"> 72</span> ```</div><div class="line"><a name="l00073"></a><span class="lineno"> 73</span> * Download Caffe from: https://github.com/BVLC/caffe. We have tested using tag 1.0</div><div class="line"><a name="l00074"></a><span class="lineno"> 74</span> ```bash</div><div class="line"><a name="l00075"></a><span class="lineno"> 75</span> git clone https://github.com/BVLC/caffe.git</div><div class="line"><a name="l00076"></a><span class="lineno"> 76</span> cd caffe</div><div class="line"><a name="l00077"></a><span class="lineno"> 77</span> git checkout eeebdab16155d34ff8f5f42137da7df4d1c7eab0</div><div class="line"><a name="l00078"></a><span class="lineno"> 78</span> cp Makefile.config.example Makefile.config</div><div class="line"><a name="l00079"></a><span class="lineno"> 79</span> ```</div><div class="line"><a name="l00080"></a><span class="lineno"> 80</span> * Adjust Makefile.config as necessary for your environment, for example:</div><div class="line"><a name="l00081"></a><span class="lineno"> 81</span> ```</div><div class="line"><a name="l00082"></a><span class="lineno"> 82</span> #CPU only version:</div><div class="line"><a name="l00083"></a><span class="lineno"> 83</span> CPU_ONLY := 1</div><div class="line"><a name="l00084"></a><span class="lineno"> 84</span> </div><div class="line"><a name="l00085"></a><span class="lineno"> 85</span> #Add hdf5 and protobuf include and library directories (Replace $HOME with explicit /home/username dir):</div><div class="line"><a name="l00086"></a><span class="lineno"> 86</span> INCLUDE_DIRS := $(PYTHON_INCLUDE) /usr/local/include /usr/include/hdf5/serial/ $HOME/armnn-devenv/google/x86_64_pb_install/include/</div><div class="line"><a name="l00087"></a><span class="lineno"> 87</span> LIBRARY_DIRS := $(PYTHON_LIB) /usr/local/lib /usr/lib /usr/lib/x86_64-linux-gnu/hdf5/serial/ $HOME/armnn-devenv/google/x86_64_pb_install/lib/</div><div class="line"><a name="l00088"></a><span class="lineno"> 88</span> ```</div><div class="line"><a name="l00089"></a><span class="lineno"> 89</span> * Setup environment:</div><div class="line"><a name="l00090"></a><span class="lineno"> 90</span> ```bash</div><div class="line"><a name="l00091"></a><span class="lineno"> 91</span> export PATH=$HOME/armnn-devenv/google/x86_64_pb_install/bin/:$PATH</div><div class="line"><a name="l00092"></a><span class="lineno"> 92</span> export LD_LIBRARY_PATH=$HOME/armnn-devenv/google/x86_64_pb_install/lib/:$LD_LIBRARY_PATH</div><div class="line"><a name="l00093"></a><span class="lineno"> 93</span> ```</div><div class="line"><a name="l00094"></a><span class="lineno"> 94</span> * Compilation with Make:</div><div class="line"><a name="l00095"></a><span class="lineno"> 95</span> ```bash</div><div class="line"><a name="l00096"></a><span class="lineno"> 96</span> make all</div><div class="line"><a name="l00097"></a><span class="lineno"> 97</span> make test</div><div class="line"><a name="l00098"></a><span class="lineno"> 98</span> make runtest</div><div class="line"><a name="l00099"></a><span class="lineno"> 99</span> # These should all run without errors</div><div class="line"><a name="l00100"></a><span class="lineno"> 100</span> ```</div><div class="line"><a name="l00101"></a><span class="lineno"> 101</span> </div><div class="line"><a name="l00102"></a><span class="lineno"> 102</span> * caffe.pb.h and caffe.pb.cc will be needed when building Arm NN's Caffe Parser</div><div class="line"><a name="l00103"></a><span class="lineno"> 103</span> </div><div class="line"><a name="l00104"></a><span class="lineno"> 104</span> ## Build Boost library for arm64</div><div class="line"><a name="l00105"></a><span class="lineno"> 105</span> * Build Boost library for arm64</div><div class="line"><a name="l00106"></a><span class="lineno"> 106</span>  Download Boost version 1.64 from http://www.boost.org/doc/libs/1_64_0/more/getting_started/unix-variants.html</div><div class="line"><a name="l00107"></a><span class="lineno"> 107</span>  Using any version of Boost greater than 1.64 will fail to build Arm NN, due to different dependency issues.</div><div class="line"><a name="l00108"></a><span class="lineno"> 108</span> ```bash</div><div class="line"><a name="l00109"></a><span class="lineno"> 109</span> tar -zxvf boost_1_64_0.tar.gz</div><div class="line"><a name="l00110"></a><span class="lineno"> 110</span> cd boost_1_64_0</div><div class="line"><a name="l00111"></a><span class="lineno"> 111</span> echo "using gcc : arm : aarch64-linux-gnu-g++ ;" > user_config.jam</div><div class="line"><a name="l00112"></a><span class="lineno"> 112</span> ./bootstrap.sh --prefix=$HOME/armnn-devenv/boost_arm64_install</div><div class="line"><a name="l00113"></a><span class="lineno"> 113</span> ./b2 install toolset=gcc-arm link=static cxxflags=-fPIC --with-test --with-log --with-program_options -j32 --user-config=user_config.jam</div><div class="line"><a name="l00114"></a><span class="lineno"> 114</span> ```</div><div class="line"><a name="l00115"></a><span class="lineno"> 115</span> </div><div class="line"><a name="l00116"></a><span class="lineno"> 116</span> ## Build Compute Library</div><div class="line"><a name="l00117"></a><span class="lineno"> 117</span> * Building the Arm Compute Library:</div><div class="line"><a name="l00118"></a><span class="lineno"> 118</span> ```bash</div><div class="line"><a name="l00119"></a><span class="lineno"> 119</span> git clone https://github.com/ARM-software/ComputeLibrary.git</div><div class="line"><a name="l00120"></a><span class="lineno"> 120</span> cd ComputeLibrary/</div><div class="line"><a name="l00121"></a><span class="lineno"> 121</span> git checkout <branch_name></div><div class="line"><a name="l00122"></a><span class="lineno"> 122</span> git pull</div><div class="line"><a name="l00123"></a><span class="lineno"> 123</span> scons arch=arm64-v8a neon=1 opencl=1 embed_kernels=1 extra_cxx_flags="-fPIC" -j4 internal_only=0</div><div class="line"><a name="l00124"></a><span class="lineno"> 124</span> ```</div><div class="line"><a name="l00125"></a><span class="lineno"> 125</span> </div><div class="line"><a name="l00126"></a><span class="lineno"> 126</span> For example, if you want to checkout release branch of 20.02:</div><div class="line"><a name="l00127"></a><span class="lineno"> 127</span> ```bash</div><div class="line"><a name="l00128"></a><span class="lineno"> 128</span> git checkout branches/arm_compute_20_02</div><div class="line"><a name="l00129"></a><span class="lineno"> 129</span> git pull</div><div class="line"><a name="l00130"></a><span class="lineno"> 130</span> ```</div><div class="line"><a name="l00131"></a><span class="lineno"> 131</span> </div><div class="line"><a name="l00132"></a><span class="lineno"> 132</span> ## Build Tensorflow</div><div class="line"><a name="l00133"></a><span class="lineno"> 133</span> * Building Tensorflow version 2.3.1:</div><div class="line"><a name="l00134"></a><span class="lineno"> 134</span> ```bash</div><div class="line"><a name="l00135"></a><span class="lineno"> 135</span> git clone https://github.com/tensorflow/tensorflow.git</div><div class="line"><a name="l00136"></a><span class="lineno"> 136</span> cd tensorflow/</div><div class="line"><a name="l00137"></a><span class="lineno"> 137</span> git checkout fcc4b966f1265f466e82617020af93670141b009</div><div class="line"><a name="l00138"></a><span class="lineno"> 138</span> ../armnn/scripts/generate_tensorflow_protobuf.sh ../tensorflow-protobuf ../google/x86_64_pb_install</div><div class="line"><a name="l00139"></a><span class="lineno"> 139</span> ```</div><div class="line"><a name="l00140"></a><span class="lineno"> 140</span> </div><div class="line"><a name="l00141"></a><span class="lineno"> 141</span> ## Build Flatbuffer</div><div class="line"><a name="l00142"></a><span class="lineno"> 142</span> * Building Flatbuffer version 1.12.0</div><div class="line"><a name="l00143"></a><span class="lineno"> 143</span> ```bash</div><div class="line"><a name="l00144"></a><span class="lineno"> 144</span> wget -O flatbuffers-1.12.0.tar.gz https://github.com/google/flatbuffers/archive/v1.12.0.tar.gz</div><div class="line"><a name="l00145"></a><span class="lineno"> 145</span> tar xf flatbuffers-1.12.0.tar.gz</div><div class="line"><a name="l00146"></a><span class="lineno"> 146</span> cd flatbuffers-1.12.0</div><div class="line"><a name="l00147"></a><span class="lineno"> 147</span> rm -f CMakeCache.txt</div><div class="line"><a name="l00148"></a><span class="lineno"> 148</span> mkdir build</div><div class="line"><a name="l00149"></a><span class="lineno"> 149</span> cd build</div><div class="line"><a name="l00150"></a><span class="lineno"> 150</span> cmake .. -DFLATBUFFERS_BUILD_FLATC=1 \</div><div class="line"><a name="l00151"></a><span class="lineno"> 151</span>  -DCMAKE_INSTALL_PREFIX:PATH=$HOME/armnn-devenv/flatbuffers \</div><div class="line"><a name="l00152"></a><span class="lineno"> 152</span>  -DFLATBUFFERS_BUILD_TESTS=0</div><div class="line"><a name="l00153"></a><span class="lineno"> 153</span> make all install</div><div class="line"><a name="l00154"></a><span class="lineno"> 154</span> ```</div><div class="line"><a name="l00155"></a><span class="lineno"> 155</span> </div><div class="line"><a name="l00156"></a><span class="lineno"> 156</span> * Build arm64 version of flatbuffer</div><div class="line"><a name="l00157"></a><span class="lineno"> 157</span> ```bash</div><div class="line"><a name="l00158"></a><span class="lineno"> 158</span> mkdir build-arm64</div><div class="line"><a name="l00159"></a><span class="lineno"> 159</span> cd build-arm64</div><div class="line"><a name="l00160"></a><span class="lineno"> 160</span> # Add -fPIC to allow us to use the libraries in shared objects.</div><div class="line"><a name="l00161"></a><span class="lineno"> 161</span> CXXFLAGS="-fPIC" cmake .. -DCMAKE_C_COMPILER=/usr/bin/aarch64-linux-gnu-gcc \</div><div class="line"><a name="l00162"></a><span class="lineno"> 162</span>  -DCMAKE_CXX_COMPILER=/usr/bin/aarch64-linux-gnu-g++ \</div><div class="line"><a name="l00163"></a><span class="lineno"> 163</span>  -DFLATBUFFERS_BUILD_FLATC=1 \</div><div class="line"><a name="l00164"></a><span class="lineno"> 164</span>  -DCMAKE_INSTALL_PREFIX:PATH=$HOME/armnn-devenv/flatbuffers-arm64 \</div><div class="line"><a name="l00165"></a><span class="lineno"> 165</span>  -DFLATBUFFERS_BUILD_TESTS=0</div><div class="line"><a name="l00166"></a><span class="lineno"> 166</span> make all install</div><div class="line"><a name="l00167"></a><span class="lineno"> 167</span> ```</div><div class="line"><a name="l00168"></a><span class="lineno"> 168</span> </div><div class="line"><a name="l00169"></a><span class="lineno"> 169</span> ## Build Onnx</div><div class="line"><a name="l00170"></a><span class="lineno"> 170</span> * Building Onnx</div><div class="line"><a name="l00171"></a><span class="lineno"> 171</span> ```bash</div><div class="line"><a name="l00172"></a><span class="lineno"> 172</span> git clone https://github.com/onnx/onnx.git</div><div class="line"><a name="l00173"></a><span class="lineno"> 173</span> cd onnx</div><div class="line"><a name="l00174"></a><span class="lineno"> 174</span> git fetch https://github.com/onnx/onnx.git 553df22c67bee5f0fe6599cff60f1afc6748c635 && git checkout FETCH_HEAD</div><div class="line"><a name="l00175"></a><span class="lineno"> 175</span> export LD_LIBRARY_PATH=$HOME/armnn-devenv/google/x86_64_pb_install/lib:$LD_LIBRARY_PATH</div><div class="line"><a name="l00176"></a><span class="lineno"> 176</span> $HOME/armnn-devenv/google/x86_64_pb_install/bin/protoc onnx/onnx.proto --proto_path=. --proto_path=../google/x86_64_pb_install/include --cpp_out $HOME/armnn-devenv/onnx</div><div class="line"><a name="l00177"></a><span class="lineno"> 177</span> ```</div><div class="line"><a name="l00178"></a><span class="lineno"> 178</span> </div><div class="line"><a name="l00179"></a><span class="lineno"> 179</span> ## Build TfLite</div><div class="line"><a name="l00180"></a><span class="lineno"> 180</span> * Building TfLite</div><div class="line"><a name="l00181"></a><span class="lineno"> 181</span> ```bash</div><div class="line"><a name="l00182"></a><span class="lineno"> 182</span> mkdir tflite</div><div class="line"><a name="l00183"></a><span class="lineno"> 183</span> cd tflite</div><div class="line"><a name="l00184"></a><span class="lineno"> 184</span> cp ../tensorflow/tensorflow/lite/schema/schema.fbs .</div><div class="line"><a name="l00185"></a><span class="lineno"> 185</span> ../flatbuffers-1.12.0/build/flatc -c --gen-object-api --reflect-types --reflect-names schema.fbs</div><div class="line"><a name="l00186"></a><span class="lineno"> 186</span> ```</div><div class="line"><a name="l00187"></a><span class="lineno"> 187</span> </div><div class="line"><a name="l00188"></a><span class="lineno"> 188</span> ## Build Arm NN</div><div class="line"><a name="l00189"></a><span class="lineno"> 189</span> * Compile Arm NN for arm64:</div><div class="line"><a name="l00190"></a><span class="lineno"> 190</span> ```bash</div><div class="line"><a name="l00191"></a><span class="lineno"> 191</span> git clone https://github.com/ARM-software/armnn.git</div><div class="line"><a name="l00192"></a><span class="lineno"> 192</span> cd armnn</div><div class="line"><a name="l00193"></a><span class="lineno"> 193</span> git checkout <branch_name></div><div class="line"><a name="l00194"></a><span class="lineno"> 194</span> git pull</div><div class="line"><a name="l00195"></a><span class="lineno"> 195</span> mkdir build</div><div class="line"><a name="l00196"></a><span class="lineno"> 196</span> cd build</div><div class="line"><a name="l00197"></a><span class="lineno"> 197</span> ```</div><div class="line"><a name="l00198"></a><span class="lineno"> 198</span> </div><div class="line"><a name="l00199"></a><span class="lineno"> 199</span> For example, if you want to checkout release branch of 20.02:</div><div class="line"><a name="l00200"></a><span class="lineno"> 200</span> ```bash</div><div class="line"><a name="l00201"></a><span class="lineno"> 201</span> git checkout branches/armnn_20_02</div><div class="line"><a name="l00202"></a><span class="lineno"> 202</span> git pull</div><div class="line"><a name="l00203"></a><span class="lineno"> 203</span> ```</div><div class="line"><a name="l00204"></a><span class="lineno"> 204</span> </div><div class="line"><a name="l00205"></a><span class="lineno"> 205</span> * Use CMake to configure your build environment, update the following script and run it from the armnn/build directory to set up the Arm NN build:</div><div class="line"><a name="l00206"></a><span class="lineno"> 206</span> ```bash</div><div class="line"><a name="l00207"></a><span class="lineno"> 207</span> #!/bin/bash</div><div class="line"><a name="l00208"></a><span class="lineno"> 208</span> export CXX=aarch64-linux-gnu-g++ \</div><div class="line"><a name="l00209"></a><span class="lineno"> 209</span> export CC=aarch64-linux-gnu-gcc \</div><div class="line"><a name="l00210"></a><span class="lineno"> 210</span> cmake .. \</div><div class="line"><a name="l00211"></a><span class="lineno"> 211</span> -DARMCOMPUTE_ROOT=$HOME/armnn-devenv/ComputeLibrary \</div><div class="line"><a name="l00212"></a><span class="lineno"> 212</span> -DARMCOMPUTE_BUILD_DIR=$HOME/armnn-devenv/ComputeLibrary/build/ \</div><div class="line"><a name="l00213"></a><span class="lineno"> 213</span> -DBOOST_ROOT=$HOME/armnn-devenv/boost_arm64_install/ \</div><div class="line"><a name="l00214"></a><span class="lineno"> 214</span> -DARMCOMPUTENEON=1 -DARMCOMPUTECL=1 -DARMNNREF=1 \</div><div class="line"><a name="l00215"></a><span class="lineno"> 215</span> -DCAFFE_GENERATED_SOURCES=$HOME/armnn-devenv/caffe/build/src \</div><div class="line"><a name="l00216"></a><span class="lineno"> 216</span> -DBUILD_CAFFE_PARSER=1 \</div><div class="line"><a name="l00217"></a><span class="lineno"> 217</span> -DONNX_GENERATED_SOURCES=$HOME/armnn-devenv/onnx \</div><div class="line"><a name="l00218"></a><span class="lineno"> 218</span> -DBUILD_ONNX_PARSER=1 \</div><div class="line"><a name="l00219"></a><span class="lineno"> 219</span> -DTF_GENERATED_SOURCES=$HOME/armnn-devenv/tensorflow-protobuf \</div><div class="line"><a name="l00220"></a><span class="lineno"> 220</span> -DBUILD_TF_PARSER=1 \</div><div class="line"><a name="l00221"></a><span class="lineno"> 221</span> -DBUILD_TF_LITE_PARSER=1 \</div><div class="line"><a name="l00222"></a><span class="lineno"> 222</span> -DTF_LITE_GENERATED_PATH=$HOME/armnn-devenv/tflite \</div><div class="line"><a name="l00223"></a><span class="lineno"> 223</span> -DFLATBUFFERS_ROOT=$HOME/armnn-devenv/flatbuffers-arm64 \</div><div class="line"><a name="l00224"></a><span class="lineno"> 224</span> -DFLATC_DIR=$HOME/armnn-devenv/flatbuffers-1.12.0/build \</div><div class="line"><a name="l00225"></a><span class="lineno"> 225</span> -DPROTOBUF_ROOT=$HOME/armnn-devenv/google/x86_64_pb_install \</div><div class="line"><a name="l00226"></a><span class="lineno"> 226</span> -DPROTOBUF_ROOT=$HOME/armnn-devenv/google/x86_64_pb_install/ \</div><div class="line"><a name="l00227"></a><span class="lineno"> 227</span> -DPROTOBUF_LIBRARY_DEBUG=$HOME/armnn-devenv/google/arm64_pb_install/lib/libprotobuf.so.24.0.0 \</div><div class="line"><a name="l00228"></a><span class="lineno"> 228</span> -DPROTOBUF_LIBRARY_RELEASE=$HOME/armnn-devenv/google/arm64_pb_install/lib/libprotobuf.so.24.0.0</div><div class="line"><a name="l00229"></a><span class="lineno"> 229</span> ```</div><div class="line"><a name="l00230"></a><span class="lineno"> 230</span> </div><div class="line"><a name="l00231"></a><span class="lineno"> 231</span> * If you want to include standalone sample dynamic backend tests, add the argument to enable the tests and the dynamic backend path to the CMake command:</div><div class="line"><a name="l00232"></a><span class="lineno"> 232</span> ```bash</div><div class="line"><a name="l00233"></a><span class="lineno"> 233</span> -DSAMPLE_DYNAMIC_BACKEND=1 \</div><div class="line"><a name="l00234"></a><span class="lineno"> 234</span> -DDYNAMIC_BACKEND_PATHS=$SAMPLE_DYNAMIC_BACKEND_PATH</div><div class="line"><a name="l00235"></a><span class="lineno"> 235</span> ```</div><div class="line"><a name="l00236"></a><span class="lineno"> 236</span> * Run the build</div><div class="line"><a name="l00237"></a><span class="lineno"> 237</span> ```bash</div><div class="line"><a name="l00238"></a><span class="lineno"> 238</span> make -j32</div><div class="line"><a name="l00239"></a><span class="lineno"> 239</span> ```</div><div class="line"><a name="l00240"></a><span class="lineno"> 240</span> </div><div class="line"><a name="l00241"></a><span class="lineno"> 241</span> ## Build Standalone Sample Dynamic Backend</div><div class="line"><a name="l00242"></a><span class="lineno"> 242</span> * The sample dynamic backend is located in armnn/src/dynamic/sample</div><div class="line"><a name="l00243"></a><span class="lineno"> 243</span> ```bash</div><div class="line"><a name="l00244"></a><span class="lineno"> 244</span> mkdir build</div><div class="line"><a name="l00245"></a><span class="lineno"> 245</span> cd build</div><div class="line"><a name="l00246"></a><span class="lineno"> 246</span> ```</div><div class="line"><a name="l00247"></a><span class="lineno"> 247</span> </div><div class="line"><a name="l00248"></a><span class="lineno"> 248</span> * Use CMake to configure your build environment, update the following script and run it from the armnn/src/dynamic/sample/build directory to set up the Arm NN build:</div><div class="line"><a name="l00249"></a><span class="lineno"> 249</span> ```bash</div><div class="line"><a name="l00250"></a><span class="lineno"> 250</span> #!/bin/bash</div><div class="line"><a name="l00251"></a><span class="lineno"> 251</span> export CXX=aarch64-linux-gnu-g++ \</div><div class="line"><a name="l00252"></a><span class="lineno"> 252</span> export CC=aarch64-linux-gnu-gcc \</div><div class="line"><a name="l00253"></a><span class="lineno"> 253</span> cmake .. \</div><div class="line"><a name="l00254"></a><span class="lineno"> 254</span> -DCMAKE_CXX_FLAGS=--std=c++14 \</div><div class="line"><a name="l00255"></a><span class="lineno"> 255</span> -DBOOST_ROOT=$HOME/armnn-devenv/boost_arm64_install/ \</div><div class="line"><a name="l00256"></a><span class="lineno"> 256</span> -DBoost_SYSTEM_LIBRARY=$HOME/armnn-devenv/boost_arm64_install/lib/libboost_system.a \</div><div class="line"><a name="l00257"></a><span class="lineno"> 257</span> -DARMNN_PATH=$HOME/armnn-devenv/armnn/build/libarmnn.so</div><div class="line"><a name="l00258"></a><span class="lineno"> 258</span> ```</div><div class="line"><a name="l00259"></a><span class="lineno"> 259</span> </div><div class="line"><a name="l00260"></a><span class="lineno"> 260</span> * Run the build</div><div class="line"><a name="l00261"></a><span class="lineno"> 261</span> ```bash</div><div class="line"><a name="l00262"></a><span class="lineno"> 262</span> make</div><div class="line"><a name="l00263"></a><span class="lineno"> 263</span> ```</div><div class="line"><a name="l00264"></a><span class="lineno"> 264</span> </div><div class="line"><a name="l00265"></a><span class="lineno"> 265</span> ## Run Unit Tests</div><div class="line"><a name="l00266"></a><span class="lineno"> 266</span> * Copy the build folder to an arm64 linux machine</div><div class="line"><a name="l00267"></a><span class="lineno"> 267</span> * Copy the libprotobuf.so.15.0.1 library file to the build folder</div><div class="line"><a name="l00268"></a><span class="lineno"> 268</span> * If you enable the standalone sample dynamic tests, also copy libArm_SampleDynamic_backend.so library file to the folder specified as $SAMPLE_DYNAMIC_BACKEND_PATH when you build Arm NN </div><div class="line"><a name="l00269"></a><span class="lineno"> 269</span> * cd to the build folder on your arm64 machine and set your LD_LIBRARY_PATH to its current location:</div><div class="line"><a name="l00270"></a><span class="lineno"> 270</span> </div><div class="line"><a name="l00271"></a><span class="lineno"> 271</span> ```bash</div><div class="line"><a name="l00272"></a><span class="lineno"> 272</span> cd build/</div><div class="line"><a name="l00273"></a><span class="lineno"> 273</span> export LD_LIBRARY_PATH=<current_working_directory></div><div class="line"><a name="l00274"></a><span class="lineno"> 274</span> ```</div><div class="line"><a name="l00275"></a><span class="lineno"> 275</span> </div><div class="line"><a name="l00276"></a><span class="lineno"> 276</span> * Create a symbolic link to libprotobuf.so.24.0.0:</div><div class="line"><a name="l00277"></a><span class="lineno"> 277</span> </div><div class="line"><a name="l00278"></a><span class="lineno"> 278</span> ```bash</div><div class="line"><a name="l00279"></a><span class="lineno"> 279</span> ln -s libprotobuf.so.24.0.0 ./libprotobuf.so.24</div><div class="line"><a name="l00280"></a><span class="lineno"> 280</span> ```</div><div class="line"><a name="l00281"></a><span class="lineno"> 281</span> </div><div class="line"><a name="l00282"></a><span class="lineno"> 282</span> * Run the UnitTests:</div><div class="line"><a name="l00283"></a><span class="lineno"> 283</span> </div><div class="line"><a name="l00284"></a><span class="lineno"> 284</span> ```bash</div><div class="line"><a name="l00285"></a><span class="lineno"> 285</span> ./UnitTests</div><div class="line"><a name="l00286"></a><span class="lineno"> 286</span> Running 567 test cases...</div><div class="line"><a name="l00287"></a><span class="lineno"> 287</span> </div><div class="line"><a name="l00288"></a><span class="lineno"> 288</span> *** No errors detected</div><div class="line"><a name="l00289"></a><span class="lineno"> 289</span> ```</div><div class="line"><a name="l00290"></a><span class="lineno"> 290</span> </div><div class="line"><a name="l00291"></a><span class="lineno"> 291</span> ## Troubleshooting and Errors:</div><div class="line"><a name="l00292"></a><span class="lineno"> 292</span> ### Error adding symbols: File in wrong format</div><div class="line"><a name="l00293"></a><span class="lineno"> 293</span> * When building Arm NN:</div><div class="line"><a name="l00294"></a><span class="lineno"> 294</span> ```bash</div><div class="line"><a name="l00295"></a><span class="lineno"> 295</span> /usr/local/lib/libboost_log.a: error adding symbols: File in wrong format</div><div class="line"><a name="l00296"></a><span class="lineno"> 296</span> collect2: error: ld returned 1 exit status</div><div class="line"><a name="l00297"></a><span class="lineno"> 297</span> CMakeFiles/armnn.dir/build.make:4028: recipe for target 'libarmnn.so' failed</div><div class="line"><a name="l00298"></a><span class="lineno"> 298</span> make[2]: *** [libarmnn.so] Error 1</div><div class="line"><a name="l00299"></a><span class="lineno"> 299</span> CMakeFiles/Makefile2:105: recipe for target 'CMakeFiles/armnn.dir/all' failed</div><div class="line"><a name="l00300"></a><span class="lineno"> 300</span> make[1]: *** [CMakeFiles/armnn.dir/all] Error 2</div><div class="line"><a name="l00301"></a><span class="lineno"> 301</span> Makefile:127: recipe for target 'all' failed</div><div class="line"><a name="l00302"></a><span class="lineno"> 302</span> make: *** [all] Error 2</div><div class="line"><a name="l00303"></a><span class="lineno"> 303</span> ```</div><div class="line"><a name="l00304"></a><span class="lineno"> 304</span> * Boost libraries are not compiled for the correct architecture, try recompiling for arm64</div><div class="line"><a name="l00305"></a><span class="lineno"> 305</span> <br><br></div><div class="line"><a name="l00306"></a><span class="lineno"> 306</span> </div><div class="line"><a name="l00307"></a><span class="lineno"> 307</span> ### Virtual memory exhausted</div><div class="line"><a name="l00308"></a><span class="lineno"> 308</span> * When compiling the boost libraries:</div><div class="line"><a name="l00309"></a><span class="lineno"> 309</span> ```bash</div><div class="line"><a name="l00310"></a><span class="lineno"> 310</span> virtual memory exhausted: Cannot allocate memory</div><div class="line"><a name="l00311"></a><span class="lineno"> 311</span> ```</div><div class="line"><a name="l00312"></a><span class="lineno"> 312</span> * Not enough memory available to compile. Increase the amount of RAM or swap space available.</div><div class="line"><a name="l00313"></a><span class="lineno"> 313</span> <br><br></div><div class="line"><a name="l00314"></a><span class="lineno"> 314</span> </div><div class="line"><a name="l00315"></a><span class="lineno"> 315</span> ### Unrecognized command line option '-m64'</div><div class="line"><a name="l00316"></a><span class="lineno"> 316</span> * When compiling the boost libraries:</div><div class="line"><a name="l00317"></a><span class="lineno"> 317</span> ```bash</div><div class="line"><a name="l00318"></a><span class="lineno"> 318</span> aarch64-linux-gnu-g++: error: unrecognized command line option ‘-m64’</div><div class="line"><a name="l00319"></a><span class="lineno"> 319</span> ```</div><div class="line"><a name="l00320"></a><span class="lineno"> 320</span> * Clean the boost library directory before trying to build with a different architecture:</div><div class="line"><a name="l00321"></a><span class="lineno"> 321</span> ```bash</div><div class="line"><a name="l00322"></a><span class="lineno"> 322</span> sudo ./b2 clean</div><div class="line"><a name="l00323"></a><span class="lineno"> 323</span> ```</div><div class="line"><a name="l00324"></a><span class="lineno"> 324</span> * It should show the following for arm64:</div><div class="line"><a name="l00325"></a><span class="lineno"> 325</span> ```bash</div><div class="line"><a name="l00326"></a><span class="lineno"> 326</span> - 32-bit : no</div><div class="line"><a name="l00327"></a><span class="lineno"> 327</span> - 64-bit : yes</div><div class="line"><a name="l00328"></a><span class="lineno"> 328</span> - arm : yes</div><div class="line"><a name="l00329"></a><span class="lineno"> 329</span> ```</div><div class="line"><a name="l00330"></a><span class="lineno"> 330</span> <br><br></div><div class="line"><a name="l00331"></a><span class="lineno"> 331</span> </div><div class="line"><a name="l00332"></a><span class="lineno"> 332</span> ### Missing libz.so.1</div><div class="line"><a name="l00333"></a><span class="lineno"> 333</span> * When compiling armNN:</div><div class="line"><a name="l00334"></a><span class="lineno"> 334</span> ```bash</div><div class="line"><a name="l00335"></a><span class="lineno"> 335</span> /usr/lib/gcc-cross/aarch64-linux-gnu/5/../../../../aarch64-linux-gnu/bin/ld: warning: libz.so.1, needed by /home/<username>/armNN/usr/lib64/libprotobuf.so.24.0.0, not found (try using -rpath or -rpath-link)</div><div class="line"><a name="l00336"></a><span class="lineno"> 336</span> ```</div><div class="line"><a name="l00337"></a><span class="lineno"> 337</span> </div><div class="line"><a name="l00338"></a><span class="lineno"> 338</span> * Missing arm64 libraries for libz.so.1, these can be added by adding a second architecture to dpkg and explicitly installing them:</div><div class="line"><a name="l00339"></a><span class="lineno"> 339</span> ```bash</div><div class="line"><a name="l00340"></a><span class="lineno"> 340</span> sudo dpkg --add-architecture arm64</div><div class="line"><a name="l00341"></a><span class="lineno"> 341</span> sudo apt-get install zlib1g:arm64</div><div class="line"><a name="l00342"></a><span class="lineno"> 342</span> sudo apt-get update</div><div class="line"><a name="l00343"></a><span class="lineno"> 343</span> sudo ldconfig</div><div class="line"><a name="l00344"></a><span class="lineno"> 344</span> ```</div><div class="line"><a name="l00345"></a><span class="lineno"> 345</span> * If apt-get update returns 404 errors for arm64 repos refer to section 5 below.</div><div class="line"><a name="l00346"></a><span class="lineno"> 346</span> * Alternatively the missing arm64 version of libz.so.1 can be downloaded and installed from a .deb package here:</div><div class="line"><a name="l00347"></a><span class="lineno"> 347</span>  https://launchpad.net/ubuntu/wily/arm64/zlib1g/1:1.2.8.dfsg-2ubuntu4</div><div class="line"><a name="l00348"></a><span class="lineno"> 348</span> ```bash</div><div class="line"><a name="l00349"></a><span class="lineno"> 349</span> sudo dpkg -i zlib1g_1.2.8.dfsg-2ubuntu4_arm64.deb</div><div class="line"><a name="l00350"></a><span class="lineno"> 350</span> ```</div><div class="line"><a name="l00351"></a><span class="lineno"> 351</span> <br><br></div><div class="line"><a name="l00352"></a><span class="lineno"> 352</span> </div><div class="line"><a name="l00353"></a><span class="lineno"> 353</span> ### Unable to install arm64 packages after adding arm64 architecture</div><div class="line"><a name="l00354"></a><span class="lineno"> 354</span> * Using sudo apt-get update should add all of the required repos for arm64 but if it does not or you are getting 404 errors the following instructions can be used to add the repos manually:</div><div class="line"><a name="l00355"></a><span class="lineno"> 355</span> * From stackoverflow:</div><div class="line"><a name="l00356"></a><span class="lineno"> 356</span> https://askubuntu.com/questions/430705/how-to-use-apt-get-to-download-multi-arch-library/430718</div><div class="line"><a name="l00357"></a><span class="lineno"> 357</span> * Open /etc/apt/sources.list with your preferred text editor.</div><div class="line"><a name="l00358"></a><span class="lineno"> 358</span> </div><div class="line"><a name="l00359"></a><span class="lineno"> 359</span> * Mark all the current (default) repos as \[arch=<current_os_arch>], e.g.</div><div class="line"><a name="l00360"></a><span class="lineno"> 360</span> ```bash</div><div class="line"><a name="l00361"></a><span class="lineno"> 361</span> deb [arch=amd64] http://archive.ubuntu.com/ubuntu/ xenial main restricted</div><div class="line"><a name="l00362"></a><span class="lineno"> 362</span> ```</div><div class="line"><a name="l00363"></a><span class="lineno"> 363</span> * Then add the following:</div><div class="line"><a name="l00364"></a><span class="lineno"> 364</span> ```bash</div><div class="line"><a name="l00365"></a><span class="lineno"> 365</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial main restricted</div><div class="line"><a name="l00366"></a><span class="lineno"> 366</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-updates main restricted</div><div class="line"><a name="l00367"></a><span class="lineno"> 367</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial universe</div><div class="line"><a name="l00368"></a><span class="lineno"> 368</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-updates universe</div><div class="line"><a name="l00369"></a><span class="lineno"> 369</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial multiverse</div><div class="line"><a name="l00370"></a><span class="lineno"> 370</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-updates multiverse</div><div class="line"><a name="l00371"></a><span class="lineno"> 371</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-backports main restricted universe multiverse</div><div class="line"><a name="l00372"></a><span class="lineno"> 372</span> ```</div><div class="line"><a name="l00373"></a><span class="lineno"> 373</span> * Update and install again:</div><div class="line"><a name="l00374"></a><span class="lineno"> 374</span> ```bash</div><div class="line"><a name="l00375"></a><span class="lineno"> 375</span> sudo apt-get install zlib1g:arm64</div><div class="line"><a name="l00376"></a><span class="lineno"> 376</span> sudo apt-get update</div><div class="line"><a name="l00377"></a><span class="lineno"> 377</span> sudo ldconfig</div><div class="line"><a name="l00378"></a><span class="lineno"> 378</span> ```</div><div class="line"><a name="l00379"></a><span class="lineno"> 379</span> <br><br></div><div class="line"><a name="l00380"></a><span class="lineno"> 380</span> </div><div class="line"><a name="l00381"></a><span class="lineno"> 381</span> ### Undefined references to google::protobuf:: functions</div><div class="line"><a name="l00382"></a><span class="lineno"> 382</span> * When compiling Arm NN there are multiple errors of the following type:</div><div class="line"><a name="l00383"></a><span class="lineno"> 383</span> ```</div><div class="line"><a name="l00384"></a><span class="lineno"> 384</span> libarmnnCaffeParser.so: undefined reference to `google::protobuf:*</div><div class="line"><a name="l00385"></a><span class="lineno"> 385</span> ```</div><div class="line"><a name="l00386"></a><span class="lineno"> 386</span> * Missing or out of date protobuf compilation libraries.</div><div class="line"><a name="l00387"></a><span class="lineno"> 387</span>  Use the command 'protoc --version' to check which version of protobuf is available (version 3.12.0 is required).</div><div class="line"><a name="l00388"></a><span class="lineno"> 388</span>  Follow the instructions above to install protobuf 3.12.0</div><div class="line"><a name="l00389"></a><span class="lineno"> 389</span>  Note this will require you to recompile Caffe for x86_64</div><div class="line"><a name="l00390"></a><span class="lineno"> 390</span> <br><br></div><div class="line"><a name="l00391"></a><span class="lineno"> 391</span> </div><div class="line"><a name="l00392"></a><span class="lineno"> 392</span> ### Errors on strict-aliasing rules when compiling the Compute Library</div><div class="line"><a name="l00393"></a><span class="lineno"> 393</span> * When compiling the Compute Library there are multiple errors on strict-aliasing rules:</div><div class="line"><a name="l00394"></a><span class="lineno"> 394</span>  ```</div><div class="line"><a name="l00395"></a><span class="lineno"> 395</span> cc1plus: error: unrecognized command line option ‘-Wno-implicit-fallthrough’ [-Werror]</div><div class="line"><a name="l00396"></a><span class="lineno"> 396</span>  ```</div><div class="line"><a name="l00397"></a><span class="lineno"> 397</span> * Add Werror=0 to the scons command:</div><div class="line"><a name="l00398"></a><span class="lineno"> 398</span> ```</div><div class="line"><a name="l00399"></a><span class="lineno"> 399</span> scons arch=arm64-v8a neon=1 opencl=1 embed_kernels=1 extra_cxx_flags="-fPIC" -j8 internal_only=0 Werror=0</div><div class="line"><a name="l00400"></a><span class="lineno"> 400</span> ```</div></div><!-- fragment --></div><!-- contents --> +<a href="_build_guide_cross_compilation_8md.xhtml">Go to the documentation of this file.</a><div class="fragment"><div class="line"><a name="l00001"></a><span class="lineno"> 1</span> # How to Cross-Compile Arm NN on x86_64 for arm64</div><div class="line"><a name="l00002"></a><span class="lineno"> 2</span> </div><div class="line"><a name="l00003"></a><span class="lineno"> 3</span> - [Introduction](#introduction)</div><div class="line"><a name="l00004"></a><span class="lineno"> 4</span> - [Cross-compiling ToolChain](#cross-compiling-toolchain)</div><div class="line"><a name="l00005"></a><span class="lineno"> 5</span> - [Build and install Google's Protobuf library](#build-and-install-google-s-protobuf-library)</div><div class="line"><a name="l00006"></a><span class="lineno"> 6</span> - [Build Caffe for x86_64](#build-caffe-for-x86-64)</div><div class="line"><a name="l00007"></a><span class="lineno"> 7</span> - [Build Boost library for arm64](#build-boost-library-for-arm64)</div><div class="line"><a name="l00008"></a><span class="lineno"> 8</span> - [Build Compute Library](#build-compute-library)</div><div class="line"><a name="l00009"></a><span class="lineno"> 9</span> - [Download ArmNN](#download-armnn)</div><div class="line"><a name="l00010"></a><span class="lineno"> 10</span> - [Build Tensorflow](#build-tensorflow)</div><div class="line"><a name="l00011"></a><span class="lineno"> 11</span> - [Build Flatbuffer](#build-flatbuffer)</div><div class="line"><a name="l00012"></a><span class="lineno"> 12</span> - [Build Onnx](#build-onnx)</div><div class="line"><a name="l00013"></a><span class="lineno"> 13</span> - [Build TfLite](#build-tflite)</div><div class="line"><a name="l00014"></a><span class="lineno"> 14</span> - [Build Arm NN](#build-armnn)</div><div class="line"><a name="l00015"></a><span class="lineno"> 15</span> - [Build Standalone Sample Dynamic Backend](#build-standalone-sample-dynamic-backend)</div><div class="line"><a name="l00016"></a><span class="lineno"> 16</span> - [Run Unit Tests](#run-unit-tests)</div><div class="line"><a name="l00017"></a><span class="lineno"> 17</span> - [Troubleshooting and Errors:](#troubleshooting-and-errors-)</div><div class="line"><a name="l00018"></a><span class="lineno"> 18</span> </div><div class="line"><a name="l00019"></a><span class="lineno"> 19</span> </div><div class="line"><a name="l00020"></a><span class="lineno"> 20</span> ## Introduction</div><div class="line"><a name="l00021"></a><span class="lineno"> 21</span> These are the step by step instructions on Cross-Compiling Arm NN under an x86_64 system to target an Arm64 system. This build flow has been tested with Ubuntu 16.04.</div><div class="line"><a name="l00022"></a><span class="lineno"> 22</span> The instructions assume you are using a bash shell and show how to build the Arm NN core library, Boost, Protobuf, Caffe, Tensorflow, Tflite, Flatbuffer and Compute Libraries.</div><div class="line"><a name="l00023"></a><span class="lineno"> 23</span> Start by creating a directory to contain all components:</div><div class="line"><a name="l00024"></a><span class="lineno"> 24</span> </div><div class="line"><a name="l00025"></a><span class="lineno"> 25</span> '''</div><div class="line"><a name="l00026"></a><span class="lineno"> 26</span> mkdir $HOME/armnn-devenv</div><div class="line"><a name="l00027"></a><span class="lineno"> 27</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00028"></a><span class="lineno"> 28</span> '''</div><div class="line"><a name="l00029"></a><span class="lineno"> 29</span> </div><div class="line"><a name="l00030"></a><span class="lineno"> 30</span> #####Note: We are currently in the process of removing boost as a dependency to Arm NN. This process is finished for everything apart from our unit tests. This means you don't need boost to build and use Arm NN but you need it to execute our unit tests. Boost will soon be removed from Arm NN entirely. We also are deprecating support for Caffe and Tensorflow parsers in 21.02. This will be removed in 21.05. </div><div class="line"><a name="l00031"></a><span class="lineno"> 31</span> </div><div class="line"><a name="l00032"></a><span class="lineno"> 32</span> ## Cross-compiling ToolChain</div><div class="line"><a name="l00033"></a><span class="lineno"> 33</span> * Install the standard cross-compilation libraries for arm64:</div><div class="line"><a name="l00034"></a><span class="lineno"> 34</span> ```</div><div class="line"><a name="l00035"></a><span class="lineno"> 35</span> sudo apt install crossbuild-essential-arm64</div><div class="line"><a name="l00036"></a><span class="lineno"> 36</span> ```</div><div class="line"><a name="l00037"></a><span class="lineno"> 37</span> </div><div class="line"><a name="l00038"></a><span class="lineno"> 38</span> ## Build and install Google's Protobuf library</div><div class="line"><a name="l00039"></a><span class="lineno"> 39</span> </div><div class="line"><a name="l00040"></a><span class="lineno"> 40</span> We support protobuf version 3.12.0</div><div class="line"><a name="l00041"></a><span class="lineno"> 41</span> * Get protobuf from here: https://github.com/protocolbuffers/protobuf : </div><div class="line"><a name="l00042"></a><span class="lineno"> 42</span> ```bash</div><div class="line"><a name="l00043"></a><span class="lineno"> 43</span> git clone -b v3.12.0 https://github.com/google/protobuf.git protobuf</div><div class="line"><a name="l00044"></a><span class="lineno"> 44</span> cd protobuf</div><div class="line"><a name="l00045"></a><span class="lineno"> 45</span> git submodule update --init --recursive</div><div class="line"><a name="l00046"></a><span class="lineno"> 46</span> ./autogen.sh</div><div class="line"><a name="l00047"></a><span class="lineno"> 47</span> ```</div><div class="line"><a name="l00048"></a><span class="lineno"> 48</span> * Build a native (x86_64) version of the protobuf libraries and compiler (protoc):</div><div class="line"><a name="l00049"></a><span class="lineno"> 49</span>  (Requires cUrl, autoconf, llibtool, and other build dependencies if not previously installed: sudo apt install curl autoconf libtool build-essential g++)</div><div class="line"><a name="l00050"></a><span class="lineno"> 50</span> ```</div><div class="line"><a name="l00051"></a><span class="lineno"> 51</span> mkdir x86_64_build</div><div class="line"><a name="l00052"></a><span class="lineno"> 52</span> cd x86_64_build</div><div class="line"><a name="l00053"></a><span class="lineno"> 53</span> ../configure --prefix=$HOME/armnn-devenv/google/x86_64_pb_install</div><div class="line"><a name="l00054"></a><span class="lineno"> 54</span> make install -j16</div><div class="line"><a name="l00055"></a><span class="lineno"> 55</span> cd ..</div><div class="line"><a name="l00056"></a><span class="lineno"> 56</span> ```</div><div class="line"><a name="l00057"></a><span class="lineno"> 57</span> * Build the arm64 version of the protobuf libraries:</div><div class="line"><a name="l00058"></a><span class="lineno"> 58</span> ```</div><div class="line"><a name="l00059"></a><span class="lineno"> 59</span> mkdir arm64_build</div><div class="line"><a name="l00060"></a><span class="lineno"> 60</span> cd arm64_build</div><div class="line"><a name="l00061"></a><span class="lineno"> 61</span> CC=aarch64-linux-gnu-gcc \</div><div class="line"><a name="l00062"></a><span class="lineno"> 62</span> CXX=aarch64-linux-gnu-g++ \</div><div class="line"><a name="l00063"></a><span class="lineno"> 63</span> ../configure --host=aarch64-linux \</div><div class="line"><a name="l00064"></a><span class="lineno"> 64</span> --prefix=$HOME/armnn-devenv/google/arm64_pb_install \</div><div class="line"><a name="l00065"></a><span class="lineno"> 65</span> --with-protoc=$HOME/armnn-devenv/google/x86_64_pb_install/bin/protoc</div><div class="line"><a name="l00066"></a><span class="lineno"> 66</span> make install -j16</div><div class="line"><a name="l00067"></a><span class="lineno"> 67</span> cd ..</div><div class="line"><a name="l00068"></a><span class="lineno"> 68</span> ```</div><div class="line"><a name="l00069"></a><span class="lineno"> 69</span> </div><div class="line"><a name="l00070"></a><span class="lineno"> 70</span> ## Build Caffe for x86_64</div><div class="line"><a name="l00071"></a><span class="lineno"> 71</span> * Ubuntu 16.04 installation. These steps are taken from the full Caffe installation documentation at: http://caffe.berkeleyvision.org/install_apt.html</div><div class="line"><a name="l00072"></a><span class="lineno"> 72</span> * Install dependencies:</div><div class="line"><a name="l00073"></a><span class="lineno"> 73</span> ```bash</div><div class="line"><a name="l00074"></a><span class="lineno"> 74</span> sudo apt-get install libleveldb-dev libsnappy-dev libopencv-dev libhdf5-serial-dev</div><div class="line"><a name="l00075"></a><span class="lineno"> 75</span> sudo apt-get install --no-install-recommends libboost-all-dev</div><div class="line"><a name="l00076"></a><span class="lineno"> 76</span> sudo apt-get install libgflags-dev libgoogle-glog-dev liblmdb-dev</div><div class="line"><a name="l00077"></a><span class="lineno"> 77</span> sudo apt-get install libopenblas-dev</div><div class="line"><a name="l00078"></a><span class="lineno"> 78</span> sudo apt-get install libatlas-base-dev</div><div class="line"><a name="l00079"></a><span class="lineno"> 79</span> ```</div><div class="line"><a name="l00080"></a><span class="lineno"> 80</span> * Download Caffe from: https://github.com/BVLC/caffe. We have tested using tag 1.0</div><div class="line"><a name="l00081"></a><span class="lineno"> 81</span> ```bash</div><div class="line"><a name="l00082"></a><span class="lineno"> 82</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00083"></a><span class="lineno"> 83</span> git clone https://github.com/BVLC/caffe.git</div><div class="line"><a name="l00084"></a><span class="lineno"> 84</span> cd caffe</div><div class="line"><a name="l00085"></a><span class="lineno"> 85</span> git checkout eeebdab16155d34ff8f5f42137da7df4d1c7eab0</div><div class="line"><a name="l00086"></a><span class="lineno"> 86</span> cp Makefile.config.example Makefile.config</div><div class="line"><a name="l00087"></a><span class="lineno"> 87</span> ```</div><div class="line"><a name="l00088"></a><span class="lineno"> 88</span> * Adjust Makefile.config as necessary for your environment, for example:</div><div class="line"><a name="l00089"></a><span class="lineno"> 89</span> ```</div><div class="line"><a name="l00090"></a><span class="lineno"> 90</span> #CPU only version:</div><div class="line"><a name="l00091"></a><span class="lineno"> 91</span> CPU_ONLY := 1</div><div class="line"><a name="l00092"></a><span class="lineno"> 92</span> </div><div class="line"><a name="l00093"></a><span class="lineno"> 93</span> #Add hdf5 and protobuf include and library directories (Replace $HOME with explicit /home/username dir):</div><div class="line"><a name="l00094"></a><span class="lineno"> 94</span> INCLUDE_DIRS := $(PYTHON_INCLUDE) /usr/local/include /usr/include/hdf5/serial/ $(HOME)/armnn-devenv/google/x86_64_pb_install/include/</div><div class="line"><a name="l00095"></a><span class="lineno"> 95</span> LIBRARY_DIRS := $(PYTHON_LIB) /usr/local/lib /usr/lib /usr/lib/x86_64-linux-gnu/hdf5/serial/ $(HOME)/armnn-devenv/google/x86_64_pb_install/lib/</div><div class="line"><a name="l00096"></a><span class="lineno"> 96</span> ```</div><div class="line"><a name="l00097"></a><span class="lineno"> 97</span> * Setup environment:</div><div class="line"><a name="l00098"></a><span class="lineno"> 98</span> ```bash</div><div class="line"><a name="l00099"></a><span class="lineno"> 99</span> export PATH=$HOME/armnn-devenv/google/x86_64_pb_install/bin/:$PATH</div><div class="line"><a name="l00100"></a><span class="lineno"> 100</span> export LD_LIBRARY_PATH=$HOME/armnn-devenv/google/x86_64_pb_install/lib/:$LD_LIBRARY_PATH</div><div class="line"><a name="l00101"></a><span class="lineno"> 101</span> ```</div><div class="line"><a name="l00102"></a><span class="lineno"> 102</span> * Compilation with Make:</div><div class="line"><a name="l00103"></a><span class="lineno"> 103</span> ```bash</div><div class="line"><a name="l00104"></a><span class="lineno"> 104</span> make all</div><div class="line"><a name="l00105"></a><span class="lineno"> 105</span> make test</div><div class="line"><a name="l00106"></a><span class="lineno"> 106</span> make runtest</div><div class="line"><a name="l00107"></a><span class="lineno"> 107</span> # These should all run without errors</div><div class="line"><a name="l00108"></a><span class="lineno"> 108</span> ```</div><div class="line"><a name="l00109"></a><span class="lineno"> 109</span> </div><div class="line"><a name="l00110"></a><span class="lineno"> 110</span> * caffe.pb.h and caffe.pb.cc will be needed when building Arm NN's Caffe Parser</div><div class="line"><a name="l00111"></a><span class="lineno"> 111</span> </div><div class="line"><a name="l00112"></a><span class="lineno"> 112</span> ## Build Boost library for arm64</div><div class="line"><a name="l00113"></a><span class="lineno"> 113</span> * Build Boost library for arm64</div><div class="line"><a name="l00114"></a><span class="lineno"> 114</span>  Download Boost version 1.64 from http://www.boost.org/doc/libs/1_64_0/more/getting_started/unix-variants.html</div><div class="line"><a name="l00115"></a><span class="lineno"> 115</span>  Using any version of Boost greater than 1.64 will fail to build Arm NN, due to different dependency issues.</div><div class="line"><a name="l00116"></a><span class="lineno"> 116</span> ```bash</div><div class="line"><a name="l00117"></a><span class="lineno"> 117</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00118"></a><span class="lineno"> 118</span> tar -zxvf boost_1_64_0.tar.gz</div><div class="line"><a name="l00119"></a><span class="lineno"> 119</span> cd boost_1_64_0</div><div class="line"><a name="l00120"></a><span class="lineno"> 120</span> echo "using gcc : arm : aarch64-linux-gnu-g++ ;" > user_config.jam</div><div class="line"><a name="l00121"></a><span class="lineno"> 121</span> ./bootstrap.sh --prefix=$HOME/armnn-devenv/boost_arm64_install</div><div class="line"><a name="l00122"></a><span class="lineno"> 122</span> ./b2 install toolset=gcc-arm link=static cxxflags=-fPIC --with-test --with-log --with-program_options -j32 --user-config=user_config.jam</div><div class="line"><a name="l00123"></a><span class="lineno"> 123</span> ```</div><div class="line"><a name="l00124"></a><span class="lineno"> 124</span> </div><div class="line"><a name="l00125"></a><span class="lineno"> 125</span> ## Build Compute Library</div><div class="line"><a name="l00126"></a><span class="lineno"> 126</span> * Building the Arm Compute Library:</div><div class="line"><a name="l00127"></a><span class="lineno"> 127</span> ```bash</div><div class="line"><a name="l00128"></a><span class="lineno"> 128</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00129"></a><span class="lineno"> 129</span> git clone https://github.com/ARM-software/ComputeLibrary.git</div><div class="line"><a name="l00130"></a><span class="lineno"> 130</span> cd ComputeLibrary/</div><div class="line"><a name="l00131"></a><span class="lineno"> 131</span> git checkout <tag_name></div><div class="line"><a name="l00132"></a><span class="lineno"> 132</span> scons arch=arm64-v8a neon=1 opencl=1 embed_kernels=1 extra_cxx_flags="-fPIC" -j4 internal_only=0</div><div class="line"><a name="l00133"></a><span class="lineno"> 133</span> ```</div><div class="line"><a name="l00134"></a><span class="lineno"> 134</span> </div><div class="line"><a name="l00135"></a><span class="lineno"> 135</span> For example, if you want to checkout release tag of 21.02:</div><div class="line"><a name="l00136"></a><span class="lineno"> 136</span> ```bash</div><div class="line"><a name="l00137"></a><span class="lineno"> 137</span> git checkout v21.02</div><div class="line"><a name="l00138"></a><span class="lineno"> 138</span> ```</div><div class="line"><a name="l00139"></a><span class="lineno"> 139</span> </div><div class="line"><a name="l00140"></a><span class="lineno"> 140</span> ## Download ArmNN</div><div class="line"><a name="l00141"></a><span class="lineno"> 141</span> </div><div class="line"><a name="l00142"></a><span class="lineno"> 142</span> ```bash</div><div class="line"><a name="l00143"></a><span class="lineno"> 143</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00144"></a><span class="lineno"> 144</span> git clone https://github.com/ARM-software/armnn.git</div><div class="line"><a name="l00145"></a><span class="lineno"> 145</span> cd armnn</div><div class="line"><a name="l00146"></a><span class="lineno"> 146</span> git checkout <branch_name></div><div class="line"><a name="l00147"></a><span class="lineno"> 147</span> git pull</div><div class="line"><a name="l00148"></a><span class="lineno"> 148</span> ```</div><div class="line"><a name="l00149"></a><span class="lineno"> 149</span> </div><div class="line"><a name="l00150"></a><span class="lineno"> 150</span> For example, if you want to checkout release branch of 21.02:</div><div class="line"><a name="l00151"></a><span class="lineno"> 151</span> ```bash</div><div class="line"><a name="l00152"></a><span class="lineno"> 152</span> git checkout branches/armnn_21_02</div><div class="line"><a name="l00153"></a><span class="lineno"> 153</span> git pull</div><div class="line"><a name="l00154"></a><span class="lineno"> 154</span> ```</div><div class="line"><a name="l00155"></a><span class="lineno"> 155</span> </div><div class="line"><a name="l00156"></a><span class="lineno"> 156</span> ## Build Tensorflow</div><div class="line"><a name="l00157"></a><span class="lineno"> 157</span> * Building Tensorflow version 2.3.1:</div><div class="line"><a name="l00158"></a><span class="lineno"> 158</span> ```bash</div><div class="line"><a name="l00159"></a><span class="lineno"> 159</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00160"></a><span class="lineno"> 160</span> git clone https://github.com/tensorflow/tensorflow.git</div><div class="line"><a name="l00161"></a><span class="lineno"> 161</span> cd tensorflow/</div><div class="line"><a name="l00162"></a><span class="lineno"> 162</span> git checkout fcc4b966f1265f466e82617020af93670141b009</div><div class="line"><a name="l00163"></a><span class="lineno"> 163</span> ../armnn/scripts/generate_tensorflow_protobuf.sh ../tensorflow-protobuf ../google/x86_64_pb_install</div><div class="line"><a name="l00164"></a><span class="lineno"> 164</span> ```</div><div class="line"><a name="l00165"></a><span class="lineno"> 165</span> </div><div class="line"><a name="l00166"></a><span class="lineno"> 166</span> ## Build Flatbuffer</div><div class="line"><a name="l00167"></a><span class="lineno"> 167</span> * Building Flatbuffer version 1.12.0</div><div class="line"><a name="l00168"></a><span class="lineno"> 168</span> ```bash</div><div class="line"><a name="l00169"></a><span class="lineno"> 169</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00170"></a><span class="lineno"> 170</span> wget -O flatbuffers-1.12.0.tar.gz https://github.com/google/flatbuffers/archive/v1.12.0.tar.gz</div><div class="line"><a name="l00171"></a><span class="lineno"> 171</span> tar xf flatbuffers-1.12.0.tar.gz</div><div class="line"><a name="l00172"></a><span class="lineno"> 172</span> cd flatbuffers-1.12.0</div><div class="line"><a name="l00173"></a><span class="lineno"> 173</span> rm -f CMakeCache.txt</div><div class="line"><a name="l00174"></a><span class="lineno"> 174</span> mkdir build</div><div class="line"><a name="l00175"></a><span class="lineno"> 175</span> cd build</div><div class="line"><a name="l00176"></a><span class="lineno"> 176</span> cmake .. -DFLATBUFFERS_BUILD_FLATC=1 \</div><div class="line"><a name="l00177"></a><span class="lineno"> 177</span>  -DCMAKE_INSTALL_PREFIX:PATH=$HOME/armnn-devenv/flatbuffers \</div><div class="line"><a name="l00178"></a><span class="lineno"> 178</span>  -DFLATBUFFERS_BUILD_TESTS=0</div><div class="line"><a name="l00179"></a><span class="lineno"> 179</span> make all install</div><div class="line"><a name="l00180"></a><span class="lineno"> 180</span> ```</div><div class="line"><a name="l00181"></a><span class="lineno"> 181</span> </div><div class="line"><a name="l00182"></a><span class="lineno"> 182</span> * Build arm64 version of flatbuffer</div><div class="line"><a name="l00183"></a><span class="lineno"> 183</span> ```bash</div><div class="line"><a name="l00184"></a><span class="lineno"> 184</span> cd ..</div><div class="line"><a name="l00185"></a><span class="lineno"> 185</span> mkdir build-arm64</div><div class="line"><a name="l00186"></a><span class="lineno"> 186</span> cd build-arm64</div><div class="line"><a name="l00187"></a><span class="lineno"> 187</span> # Add -fPIC to allow us to use the libraries in shared objects.</div><div class="line"><a name="l00188"></a><span class="lineno"> 188</span> CXXFLAGS="-fPIC" cmake .. -DCMAKE_C_COMPILER=/usr/bin/aarch64-linux-gnu-gcc \</div><div class="line"><a name="l00189"></a><span class="lineno"> 189</span>  -DCMAKE_CXX_COMPILER=/usr/bin/aarch64-linux-gnu-g++ \</div><div class="line"><a name="l00190"></a><span class="lineno"> 190</span>  -DFLATBUFFERS_BUILD_FLATC=1 \</div><div class="line"><a name="l00191"></a><span class="lineno"> 191</span>  -DCMAKE_INSTALL_PREFIX:PATH=$HOME/armnn-devenv/flatbuffers-arm64 \</div><div class="line"><a name="l00192"></a><span class="lineno"> 192</span>  -DFLATBUFFERS_BUILD_TESTS=0</div><div class="line"><a name="l00193"></a><span class="lineno"> 193</span> make all install</div><div class="line"><a name="l00194"></a><span class="lineno"> 194</span> ```</div><div class="line"><a name="l00195"></a><span class="lineno"> 195</span> </div><div class="line"><a name="l00196"></a><span class="lineno"> 196</span> ## Build Onnx</div><div class="line"><a name="l00197"></a><span class="lineno"> 197</span> * Building Onnx</div><div class="line"><a name="l00198"></a><span class="lineno"> 198</span> ```bash</div><div class="line"><a name="l00199"></a><span class="lineno"> 199</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00200"></a><span class="lineno"> 200</span> git clone https://github.com/onnx/onnx.git</div><div class="line"><a name="l00201"></a><span class="lineno"> 201</span> cd onnx</div><div class="line"><a name="l00202"></a><span class="lineno"> 202</span> git fetch https://github.com/onnx/onnx.git 553df22c67bee5f0fe6599cff60f1afc6748c635 && git checkout FETCH_HEAD</div><div class="line"><a name="l00203"></a><span class="lineno"> 203</span> LD_LIBRARY_PATH=$HOME/armnn-devenv/google/x86_64_pb_install/lib:$LD_LIBRARY_PATH \</div><div class="line"><a name="l00204"></a><span class="lineno"> 204</span> $HOME/armnn-devenv/google/x86_64_pb_install/bin/protoc \</div><div class="line"><a name="l00205"></a><span class="lineno"> 205</span> onnx/onnx.proto --proto_path=. --proto_path=../google/x86_64_pb_install/include --cpp_out $HOME/armnn-devenv/onnx</div><div class="line"><a name="l00206"></a><span class="lineno"> 206</span> ```</div><div class="line"><a name="l00207"></a><span class="lineno"> 207</span> </div><div class="line"><a name="l00208"></a><span class="lineno"> 208</span> ## Build TfLite</div><div class="line"><a name="l00209"></a><span class="lineno"> 209</span> * Building TfLite</div><div class="line"><a name="l00210"></a><span class="lineno"> 210</span> ```bash</div><div class="line"><a name="l00211"></a><span class="lineno"> 211</span> cd $HOME/armnn-devenv</div><div class="line"><a name="l00212"></a><span class="lineno"> 212</span> mkdir tflite</div><div class="line"><a name="l00213"></a><span class="lineno"> 213</span> cd tflite</div><div class="line"><a name="l00214"></a><span class="lineno"> 214</span> cp ../tensorflow/tensorflow/lite/schema/schema.fbs .</div><div class="line"><a name="l00215"></a><span class="lineno"> 215</span> ../flatbuffers-1.12.0/build/flatc -c --gen-object-api --reflect-types --reflect-names schema.fbs</div><div class="line"><a name="l00216"></a><span class="lineno"> 216</span> ```</div><div class="line"><a name="l00217"></a><span class="lineno"> 217</span> </div><div class="line"><a name="l00218"></a><span class="lineno"> 218</span> ## Build Arm NN</div><div class="line"><a name="l00219"></a><span class="lineno"> 219</span> * Compile Arm NN for arm64:</div><div class="line"><a name="l00220"></a><span class="lineno"> 220</span> ```bash</div><div class="line"><a name="l00221"></a><span class="lineno"> 221</span> cd $HOME/armnn-devenv/armnn</div><div class="line"><a name="l00222"></a><span class="lineno"> 222</span> mkdir build</div><div class="line"><a name="l00223"></a><span class="lineno"> 223</span> cd build</div><div class="line"><a name="l00224"></a><span class="lineno"> 224</span> ```</div><div class="line"><a name="l00225"></a><span class="lineno"> 225</span> </div><div class="line"><a name="l00226"></a><span class="lineno"> 226</span> * Use CMake to configure your build environment, update the following script and run it from the armnn/build directory to set up the Arm NN build:</div><div class="line"><a name="l00227"></a><span class="lineno"> 227</span> ```bash</div><div class="line"><a name="l00228"></a><span class="lineno"> 228</span> #!/bin/bash</div><div class="line"><a name="l00229"></a><span class="lineno"> 229</span> CXX=aarch64-linux-gnu-g++ CC=aarch64-linux-gnu-gcc cmake .. \</div><div class="line"><a name="l00230"></a><span class="lineno"> 230</span> -DARMCOMPUTE_ROOT=$HOME/armnn-devenv/ComputeLibrary \</div><div class="line"><a name="l00231"></a><span class="lineno"> 231</span> -DARMCOMPUTE_BUILD_DIR=$HOME/armnn-devenv/ComputeLibrary/build/ \</div><div class="line"><a name="l00232"></a><span class="lineno"> 232</span> -DBOOST_ROOT=$HOME/armnn-devenv/boost_arm64_install/ \</div><div class="line"><a name="l00233"></a><span class="lineno"> 233</span> -DARMCOMPUTENEON=1 -DARMCOMPUTECL=1 -DARMNNREF=1 \</div><div class="line"><a name="l00234"></a><span class="lineno"> 234</span> -DCAFFE_GENERATED_SOURCES=$HOME/armnn-devenv/caffe/build/src \</div><div class="line"><a name="l00235"></a><span class="lineno"> 235</span> -DBUILD_CAFFE_PARSER=1 \</div><div class="line"><a name="l00236"></a><span class="lineno"> 236</span> -DONNX_GENERATED_SOURCES=$HOME/armnn-devenv/onnx \</div><div class="line"><a name="l00237"></a><span class="lineno"> 237</span> -DBUILD_ONNX_PARSER=1 \</div><div class="line"><a name="l00238"></a><span class="lineno"> 238</span> -DTF_GENERATED_SOURCES=$HOME/armnn-devenv/tensorflow-protobuf \</div><div class="line"><a name="l00239"></a><span class="lineno"> 239</span> -DBUILD_TF_PARSER=1 \</div><div class="line"><a name="l00240"></a><span class="lineno"> 240</span> -DBUILD_TF_LITE_PARSER=1 \</div><div class="line"><a name="l00241"></a><span class="lineno"> 241</span> -DTF_LITE_GENERATED_PATH=$HOME/armnn-devenv/tflite \</div><div class="line"><a name="l00242"></a><span class="lineno"> 242</span> -DFLATBUFFERS_ROOT=$HOME/armnn-devenv/flatbuffers-arm64 \</div><div class="line"><a name="l00243"></a><span class="lineno"> 243</span> -DFLATC_DIR=$HOME/armnn-devenv/flatbuffers-1.12.0/build \</div><div class="line"><a name="l00244"></a><span class="lineno"> 244</span> -DPROTOBUF_ROOT=$HOME/armnn-devenv/google/x86_64_pb_install \</div><div class="line"><a name="l00245"></a><span class="lineno"> 245</span> -DPROTOBUF_ROOT=$HOME/armnn-devenv/google/x86_64_pb_install/ \</div><div class="line"><a name="l00246"></a><span class="lineno"> 246</span> -DPROTOBUF_LIBRARY_DEBUG=$HOME/armnn-devenv/google/arm64_pb_install/lib/libprotobuf.so.23.0.0 \</div><div class="line"><a name="l00247"></a><span class="lineno"> 247</span> -DPROTOBUF_LIBRARY_RELEASE=$HOME/armnn-devenv/google/arm64_pb_install/lib/libprotobuf.so.23.0.0</div><div class="line"><a name="l00248"></a><span class="lineno"> 248</span> ```</div><div class="line"><a name="l00249"></a><span class="lineno"> 249</span> </div><div class="line"><a name="l00250"></a><span class="lineno"> 250</span> * If you want to include standalone sample dynamic backend tests, add the argument to enable the tests and the dynamic backend path to the CMake command:</div><div class="line"><a name="l00251"></a><span class="lineno"> 251</span> ```bash</div><div class="line"><a name="l00252"></a><span class="lineno"> 252</span> -DSAMPLE_DYNAMIC_BACKEND=1 \</div><div class="line"><a name="l00253"></a><span class="lineno"> 253</span> -DDYNAMIC_BACKEND_PATHS=$SAMPLE_DYNAMIC_BACKEND_PATH</div><div class="line"><a name="l00254"></a><span class="lineno"> 254</span> ```</div><div class="line"><a name="l00255"></a><span class="lineno"> 255</span> * Run the build</div><div class="line"><a name="l00256"></a><span class="lineno"> 256</span> ```bash</div><div class="line"><a name="l00257"></a><span class="lineno"> 257</span> make -j32</div><div class="line"><a name="l00258"></a><span class="lineno"> 258</span> ```</div><div class="line"><a name="l00259"></a><span class="lineno"> 259</span> </div><div class="line"><a name="l00260"></a><span class="lineno"> 260</span> ## Build Standalone Sample Dynamic Backend</div><div class="line"><a name="l00261"></a><span class="lineno"> 261</span> * The sample dynamic backend is located in armnn/src/dynamic/sample</div><div class="line"><a name="l00262"></a><span class="lineno"> 262</span> ```bash</div><div class="line"><a name="l00263"></a><span class="lineno"> 263</span> cd $HOME/armnn-devenv/armnn/src/dynamic/sample</div><div class="line"><a name="l00264"></a><span class="lineno"> 264</span> mkdir build</div><div class="line"><a name="l00265"></a><span class="lineno"> 265</span> cd build</div><div class="line"><a name="l00266"></a><span class="lineno"> 266</span> ```</div><div class="line"><a name="l00267"></a><span class="lineno"> 267</span> </div><div class="line"><a name="l00268"></a><span class="lineno"> 268</span> * Use CMake to configure your build environment, update the following script and run it from the armnn/src/dynamic/sample/build directory to set up the Arm NN build:</div><div class="line"><a name="l00269"></a><span class="lineno"> 269</span> ```bash</div><div class="line"><a name="l00270"></a><span class="lineno"> 270</span> #!/bin/bash</div><div class="line"><a name="l00271"></a><span class="lineno"> 271</span> CXX=aarch64-linux-gnu-g++ CC=aarch64-linux-gnu-gcc cmake .. \</div><div class="line"><a name="l00272"></a><span class="lineno"> 272</span> -DCMAKE_CXX_FLAGS=--std=c++14 \</div><div class="line"><a name="l00273"></a><span class="lineno"> 273</span> -DARMNN_PATH=$HOME/armnn-devenv/armnn/build/libarmnn.so</div><div class="line"><a name="l00274"></a><span class="lineno"> 274</span> ```</div><div class="line"><a name="l00275"></a><span class="lineno"> 275</span> </div><div class="line"><a name="l00276"></a><span class="lineno"> 276</span> * Run the build</div><div class="line"><a name="l00277"></a><span class="lineno"> 277</span> ```bash</div><div class="line"><a name="l00278"></a><span class="lineno"> 278</span> make</div><div class="line"><a name="l00279"></a><span class="lineno"> 279</span> ```</div><div class="line"><a name="l00280"></a><span class="lineno"> 280</span> </div><div class="line"><a name="l00281"></a><span class="lineno"> 281</span> ## Run Unit Tests</div><div class="line"><a name="l00282"></a><span class="lineno"> 282</span> * Copy the build folder to an arm64 linux machine</div><div class="line"><a name="l00283"></a><span class="lineno"> 283</span> * Copy the libprotobuf.so.23.0.0 library file to the build folder</div><div class="line"><a name="l00284"></a><span class="lineno"> 284</span> * If you enable the standalone sample dynamic tests, also copy libArm_SampleDynamic_backend.so library file to the folder specified as $SAMPLE_DYNAMIC_BACKEND_PATH when you build Arm NN </div><div class="line"><a name="l00285"></a><span class="lineno"> 285</span> * cd to the build folder on your arm64 machine and set your LD_LIBRARY_PATH to its current location:</div><div class="line"><a name="l00286"></a><span class="lineno"> 286</span> </div><div class="line"><a name="l00287"></a><span class="lineno"> 287</span> ```bash</div><div class="line"><a name="l00288"></a><span class="lineno"> 288</span> cd build/</div><div class="line"><a name="l00289"></a><span class="lineno"> 289</span> ```</div><div class="line"><a name="l00290"></a><span class="lineno"> 290</span> </div><div class="line"><a name="l00291"></a><span class="lineno"> 291</span> * Create a symbolic link to libprotobuf.so.24.0.0:</div><div class="line"><a name="l00292"></a><span class="lineno"> 292</span> </div><div class="line"><a name="l00293"></a><span class="lineno"> 293</span> ```bash</div><div class="line"><a name="l00294"></a><span class="lineno"> 294</span> ln -s libprotobuf.so.23.0.0 ./libprotobuf.so.23</div><div class="line"><a name="l00295"></a><span class="lineno"> 295</span> ```</div><div class="line"><a name="l00296"></a><span class="lineno"> 296</span> </div><div class="line"><a name="l00297"></a><span class="lineno"> 297</span> * Run the UnitTests:</div><div class="line"><a name="l00298"></a><span class="lineno"> 298</span> </div><div class="line"><a name="l00299"></a><span class="lineno"> 299</span> ```bash</div><div class="line"><a name="l00300"></a><span class="lineno"> 300</span> LD_LIBRARY_PATH=./:$LD_LIBRARY_PATH ./UnitTests</div><div class="line"><a name="l00301"></a><span class="lineno"> 301</span> Running 4493 test cases...</div><div class="line"><a name="l00302"></a><span class="lineno"> 302</span> </div><div class="line"><a name="l00303"></a><span class="lineno"> 303</span> *** No errors detected</div><div class="line"><a name="l00304"></a><span class="lineno"> 304</span> ```</div><div class="line"><a name="l00305"></a><span class="lineno"> 305</span> </div><div class="line"><a name="l00306"></a><span class="lineno"> 306</span> ## Troubleshooting and Errors:</div><div class="line"><a name="l00307"></a><span class="lineno"> 307</span> ### Error adding symbols: File in wrong format</div><div class="line"><a name="l00308"></a><span class="lineno"> 308</span> * When building Arm NN:</div><div class="line"><a name="l00309"></a><span class="lineno"> 309</span> ```bash</div><div class="line"><a name="l00310"></a><span class="lineno"> 310</span> /usr/local/lib/libboost_log.a: error adding symbols: File in wrong format</div><div class="line"><a name="l00311"></a><span class="lineno"> 311</span> collect2: error: ld returned 1 exit status</div><div class="line"><a name="l00312"></a><span class="lineno"> 312</span> CMakeFiles/armnn.dir/build.make:4028: recipe for target 'libarmnn.so' failed</div><div class="line"><a name="l00313"></a><span class="lineno"> 313</span> make[2]: *** [libarmnn.so] Error 1</div><div class="line"><a name="l00314"></a><span class="lineno"> 314</span> CMakeFiles/Makefile2:105: recipe for target 'CMakeFiles/armnn.dir/all' failed</div><div class="line"><a name="l00315"></a><span class="lineno"> 315</span> make[1]: *** [CMakeFiles/armnn.dir/all] Error 2</div><div class="line"><a name="l00316"></a><span class="lineno"> 316</span> Makefile:127: recipe for target 'all' failed</div><div class="line"><a name="l00317"></a><span class="lineno"> 317</span> make: *** [all] Error 2</div><div class="line"><a name="l00318"></a><span class="lineno"> 318</span> ```</div><div class="line"><a name="l00319"></a><span class="lineno"> 319</span> * Boost libraries are not compiled for the correct architecture, try recompiling for arm64</div><div class="line"><a name="l00320"></a><span class="lineno"> 320</span> <br><br></div><div class="line"><a name="l00321"></a><span class="lineno"> 321</span> </div><div class="line"><a name="l00322"></a><span class="lineno"> 322</span> ### Virtual memory exhausted</div><div class="line"><a name="l00323"></a><span class="lineno"> 323</span> * When compiling the boost libraries:</div><div class="line"><a name="l00324"></a><span class="lineno"> 324</span> ```bash</div><div class="line"><a name="l00325"></a><span class="lineno"> 325</span> virtual memory exhausted: Cannot allocate memory</div><div class="line"><a name="l00326"></a><span class="lineno"> 326</span> ```</div><div class="line"><a name="l00327"></a><span class="lineno"> 327</span> * Not enough memory available to compile. Increase the amount of RAM or swap space available.</div><div class="line"><a name="l00328"></a><span class="lineno"> 328</span> <br><br></div><div class="line"><a name="l00329"></a><span class="lineno"> 329</span> </div><div class="line"><a name="l00330"></a><span class="lineno"> 330</span> ### Unrecognized command line option '-m64'</div><div class="line"><a name="l00331"></a><span class="lineno"> 331</span> * When compiling the boost libraries:</div><div class="line"><a name="l00332"></a><span class="lineno"> 332</span> ```bash</div><div class="line"><a name="l00333"></a><span class="lineno"> 333</span> aarch64-linux-gnu-g++: error: unrecognized command line option ‘-m64’</div><div class="line"><a name="l00334"></a><span class="lineno"> 334</span> ```</div><div class="line"><a name="l00335"></a><span class="lineno"> 335</span> * Clean the boost library directory before trying to build with a different architecture:</div><div class="line"><a name="l00336"></a><span class="lineno"> 336</span> ```bash</div><div class="line"><a name="l00337"></a><span class="lineno"> 337</span> sudo ./b2 clean</div><div class="line"><a name="l00338"></a><span class="lineno"> 338</span> ```</div><div class="line"><a name="l00339"></a><span class="lineno"> 339</span> * It should show the following for arm64:</div><div class="line"><a name="l00340"></a><span class="lineno"> 340</span> ```bash</div><div class="line"><a name="l00341"></a><span class="lineno"> 341</span> - 32-bit : no</div><div class="line"><a name="l00342"></a><span class="lineno"> 342</span> - 64-bit : yes</div><div class="line"><a name="l00343"></a><span class="lineno"> 343</span> - arm : yes</div><div class="line"><a name="l00344"></a><span class="lineno"> 344</span> ```</div><div class="line"><a name="l00345"></a><span class="lineno"> 345</span> <br><br></div><div class="line"><a name="l00346"></a><span class="lineno"> 346</span> </div><div class="line"><a name="l00347"></a><span class="lineno"> 347</span> ### Missing libz.so.1</div><div class="line"><a name="l00348"></a><span class="lineno"> 348</span> * When compiling armNN:</div><div class="line"><a name="l00349"></a><span class="lineno"> 349</span> ```bash</div><div class="line"><a name="l00350"></a><span class="lineno"> 350</span> /usr/lib/gcc-cross/aarch64-linux-gnu/5/../../../../aarch64-linux-gnu/bin/ld: warning: libz.so.1, needed by /home/<username>/armNN/usr/lib64/libprotobuf.so.24.0.0, not found (try using -rpath or -rpath-link)</div><div class="line"><a name="l00351"></a><span class="lineno"> 351</span> ```</div><div class="line"><a name="l00352"></a><span class="lineno"> 352</span> </div><div class="line"><a name="l00353"></a><span class="lineno"> 353</span> * Missing arm64 libraries for libz.so.1, these can be added by adding a second architecture to dpkg and explicitly installing them:</div><div class="line"><a name="l00354"></a><span class="lineno"> 354</span> ```bash</div><div class="line"><a name="l00355"></a><span class="lineno"> 355</span> sudo dpkg --add-architecture arm64</div><div class="line"><a name="l00356"></a><span class="lineno"> 356</span> sudo apt-get install zlib1g:arm64</div><div class="line"><a name="l00357"></a><span class="lineno"> 357</span> sudo apt-get update</div><div class="line"><a name="l00358"></a><span class="lineno"> 358</span> sudo ldconfig</div><div class="line"><a name="l00359"></a><span class="lineno"> 359</span> ```</div><div class="line"><a name="l00360"></a><span class="lineno"> 360</span> * If apt-get update returns 404 errors for arm64 repos refer to section 5 below.</div><div class="line"><a name="l00361"></a><span class="lineno"> 361</span> * Alternatively the missing arm64 version of libz.so.1 can be downloaded and installed from a .deb package here:</div><div class="line"><a name="l00362"></a><span class="lineno"> 362</span>  https://launchpad.net/ubuntu/wily/arm64/zlib1g/1:1.2.8.dfsg-2ubuntu4</div><div class="line"><a name="l00363"></a><span class="lineno"> 363</span> ```bash</div><div class="line"><a name="l00364"></a><span class="lineno"> 364</span> sudo dpkg -i zlib1g_1.2.8.dfsg-2ubuntu4_arm64.deb</div><div class="line"><a name="l00365"></a><span class="lineno"> 365</span> ```</div><div class="line"><a name="l00366"></a><span class="lineno"> 366</span> <br><br></div><div class="line"><a name="l00367"></a><span class="lineno"> 367</span> </div><div class="line"><a name="l00368"></a><span class="lineno"> 368</span> ### Unable to install arm64 packages after adding arm64 architecture</div><div class="line"><a name="l00369"></a><span class="lineno"> 369</span> * Using sudo apt-get update should add all of the required repos for arm64 but if it does not or you are getting 404 errors the following instructions can be used to add the repos manually:</div><div class="line"><a name="l00370"></a><span class="lineno"> 370</span> * From stackoverflow:</div><div class="line"><a name="l00371"></a><span class="lineno"> 371</span> https://askubuntu.com/questions/430705/how-to-use-apt-get-to-download-multi-arch-library/430718</div><div class="line"><a name="l00372"></a><span class="lineno"> 372</span> * Open /etc/apt/sources.list with your preferred text editor.</div><div class="line"><a name="l00373"></a><span class="lineno"> 373</span> </div><div class="line"><a name="l00374"></a><span class="lineno"> 374</span> * Mark all the current (default) repos as \[arch=<current_os_arch>], e.g.</div><div class="line"><a name="l00375"></a><span class="lineno"> 375</span> ```bash</div><div class="line"><a name="l00376"></a><span class="lineno"> 376</span> deb [arch=amd64] http://archive.ubuntu.com/ubuntu/ xenial main restricted</div><div class="line"><a name="l00377"></a><span class="lineno"> 377</span> ```</div><div class="line"><a name="l00378"></a><span class="lineno"> 378</span> * Then add the following:</div><div class="line"><a name="l00379"></a><span class="lineno"> 379</span> ```bash</div><div class="line"><a name="l00380"></a><span class="lineno"> 380</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial main restricted</div><div class="line"><a name="l00381"></a><span class="lineno"> 381</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-updates main restricted</div><div class="line"><a name="l00382"></a><span class="lineno"> 382</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial universe</div><div class="line"><a name="l00383"></a><span class="lineno"> 383</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-updates universe</div><div class="line"><a name="l00384"></a><span class="lineno"> 384</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial multiverse</div><div class="line"><a name="l00385"></a><span class="lineno"> 385</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-updates multiverse</div><div class="line"><a name="l00386"></a><span class="lineno"> 386</span> deb [arch=arm64] http://ports.ubuntu.com/ xenial-backports main restricted universe multiverse</div><div class="line"><a name="l00387"></a><span class="lineno"> 387</span> ```</div><div class="line"><a name="l00388"></a><span class="lineno"> 388</span> * Update and install again:</div><div class="line"><a name="l00389"></a><span class="lineno"> 389</span> ```bash</div><div class="line"><a name="l00390"></a><span class="lineno"> 390</span> sudo apt-get install zlib1g:arm64</div><div class="line"><a name="l00391"></a><span class="lineno"> 391</span> sudo apt-get update</div><div class="line"><a name="l00392"></a><span class="lineno"> 392</span> sudo ldconfig</div><div class="line"><a name="l00393"></a><span class="lineno"> 393</span> ```</div><div class="line"><a name="l00394"></a><span class="lineno"> 394</span> <br><br></div><div class="line"><a name="l00395"></a><span class="lineno"> 395</span> </div><div class="line"><a name="l00396"></a><span class="lineno"> 396</span> ### Undefined references to google::protobuf:: functions</div><div class="line"><a name="l00397"></a><span class="lineno"> 397</span> * When compiling Arm NN there are multiple errors of the following type:</div><div class="line"><a name="l00398"></a><span class="lineno"> 398</span> ```</div><div class="line"><a name="l00399"></a><span class="lineno"> 399</span> libarmnnCaffeParser.so: undefined reference to `google::protobuf:*</div><div class="line"><a name="l00400"></a><span class="lineno"> 400</span> ```</div><div class="line"><a name="l00401"></a><span class="lineno"> 401</span> * Missing or out of date protobuf compilation libraries.</div><div class="line"><a name="l00402"></a><span class="lineno"> 402</span>  Use the command 'protoc --version' to check which version of protobuf is available (version 3.12.0 is required).</div><div class="line"><a name="l00403"></a><span class="lineno"> 403</span>  Follow the instructions above to install protobuf 3.12.0</div><div class="line"><a name="l00404"></a><span class="lineno"> 404</span>  Note this will require you to recompile Caffe for x86_64</div><div class="line"><a name="l00405"></a><span class="lineno"> 405</span> <br><br></div><div class="line"><a name="l00406"></a><span class="lineno"> 406</span> </div><div class="line"><a name="l00407"></a><span class="lineno"> 407</span> ### Errors on strict-aliasing rules when compiling the Compute Library</div><div class="line"><a name="l00408"></a><span class="lineno"> 408</span> * When compiling the Compute Library there are multiple errors on strict-aliasing rules:</div><div class="line"><a name="l00409"></a><span class="lineno"> 409</span>  ```</div><div class="line"><a name="l00410"></a><span class="lineno"> 410</span> cc1plus: error: unrecognized command line option ‘-Wno-implicit-fallthrough’ [-Werror]</div><div class="line"><a name="l00411"></a><span class="lineno"> 411</span>  ```</div><div class="line"><a name="l00412"></a><span class="lineno"> 412</span> * Add Werror=0 to the scons command:</div><div class="line"><a name="l00413"></a><span class="lineno"> 413</span> ```</div><div class="line"><a name="l00414"></a><span class="lineno"> 414</span> scons arch=arm64-v8a neon=1 opencl=1 embed_kernels=1 extra_cxx_flags="-fPIC" -j8 internal_only=0 Werror=0</div><div class="line"><a name="l00415"></a><span class="lineno"> 415</span> ```</div></div><!-- fragment --></div><!-- contents --> </div><!-- doc-content --> <!-- start footer part --> <div id="nav-path" class="navpath"><!-- id is needed for treeview function! --> <ul> <li class="navelem"><a class="el" href="_build_guide_cross_compilation_8md.xhtml">BuildGuideCrossCompilation.md</a></li> - <li class="footer">Generated on Thu Feb 25 2021 17:27:28 for ArmNN by + <li class="footer">Generated on Fri Mar 19 2021 15:25:36 for ArmNN by <a href="http://www.doxygen.org/index.html"> <img class="footer" src="doxygen.png" alt="doxygen"/></a> 1.8.13 </li> </ul> |