On-device Contextual AI: Challenges and Opportunities