When Considering New Hardware Ideas, Build Complete ML Systems