Energy Efficient, High Performance AI Acceleration from Edge to Cloud