Please take a look at this guide to learn how to implement custom layers in caffe https://docs.openvinotoolkit.org/latest/_docs_MO_DG_prepare_model_customize_model_optimizer_Extending_Model_Optimizer_with_New_Primitives.html
Dear Nandanan, Kiran,
And here is additional info. This forum post I wrote is a little dated but many customers have been successful with it. Just redirect the 2018 dldt github links to 2019.
Hope it helps,