Hardware aware Dynamic Inference Technology