System Software for Machine Learning at the Edge