The term “black boxes” is used when the inner workings of an AI system are not transparent or understandable. Educators should exercise caution with “black boxes”, as it’s essential to understand how an AI system is evaluating or influencing students.
How to Explain This in Class
Black boxes are like mystery robots. We know they can do smart things, but we don’t really know how they do it or why they make certain choices.