Deployment of trained model on to Edge requires lot more care and hard work. Following sub systems configuration is given for IoT Edge. In this,  Android phone working as IoT device, It will work well for small size model.  Deploying  huge model on to Android phone might create challenges and may not work well if reduce model size to fit in Android phone .  

CNN model based inference engine is coded in C++ and C.  To make a library by using  inference engine code, there is a need to have NDK also installed in Android studio. In the following installation of Android studio and also installation of NDK are  given in detail. Following is installed in Ubuntu 18.04 x86 machine.