Quality Assurance for AI: An Inevitable Tradeoff

How do you ensure #quality of a #service which uses #AI for #personalization? #QA in that case is all about risk management. pic.twitter.com/IdKcY5noBL
— ivanjureta (@ivanjureta) January 31, 2018
The short answer: careers that reward creative problem solving in domains with scarce knowledge. Let’s unpack that.
Just like l’art pour l’art, or art for the sake of art was the bohemian creed in the 19th century, it looks like there’s an “AI for the sake of AI” creed now when building general-purpose AI systems based on Large Language Models. Let’s say that the aim for a sustainable business are happy, paying,…
A pluripotent information system is an open and distributed information system that (i) automatically adapts at runtime to changing operating conditions, and (ii) satisfies both the requirements anticipated at development time, and those unanticipated before but relevant at runtime. Engineering pluripotency into an information system therefore responds to two recurring critical issues: (i) the need…
Are decision problems and design problems related? Is one part of the other? Or is the relationship different? In a decision problem, there are, roughly speaking options and an objective, and the problem is to select the one option that best satisfies the objective. (There are other things in a decision problem, such as preferences…
The less data there is, or the lower quality the data that is available, the more difficult it is to build AI based on statistical learning. For scarce data domains, the only way to design AI is to elicit knowledge from experts, design rules that represent that knowledge, parameterize them so that they apply to…
In a Service-Oriented System (SOS), service requesters specify tasks that need to be executed and the quality levels to meet, whereas service providers advertise their services’ capabilities and the quality levels they can reach. Service selectors then match to the relevant tasks, the candidate services that can perform these tasks to the most desirable quality…