Specialist AI Testing Ct AI · Free Practice Question Medium
Question 1
8.1 A tech company is developing a self-learning AI for a smart home system that adapts to user habits for energy efficiency. They encounter challenges due to the AI making unexpected changes.
Which scenario best illustrates an appropriate testing strategy to address this issue?
-
A
The company relies solely on initial requirements and constraints, without designing new tests, assuming the AI will adapt correctly.
-
B
The company creates dynamic tests that adapt based on observed AI behavior changes and continuously monitors for unexpected system adaptations.
-
C
The company runs the same set of static tests repeatedly, expecting them to be sufficient for all AI adaptations.
-
D
The company only tests the AI when it shows signs of malfunction, assuming regular behavior does not require testing.
Reveal correct answer
Correct answer: B
Explanation
Scenario B illustrates an effective testing strategy for dealing with unexpected changes in a self-learning AI system. By creating dynamic tests that adapt based on observed AI behavior, the company can ensure the system's performance remains reliable despite any unforeseen changes. Continuous monitoring allows for the timely detection and analysis of these changes. Scenario A overlooks the need for new tests, while Scenario C relies on static tests that may become irrelevant. Scenario D is reactive and insufficient for maintaining robust AI performance
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
