When Do We Need to Teach the Machine?