Andrew Freed

Andrew is a technical lead in the IBM Watson development organization. He has worked at IBM since 2003. Andrew has several developer-focused articles on developerWorks and has filed over 70 patents. After work, Andrew enjoys spending time with his two sons.

Cognitive System Testing: So, I don’t need to unit test my cognitive system?

Unit testing is still the foundation of testing a cognitive system and is critical for verifying that each of the system components is working correctly. The simple fact of the matter is that building good unit tests for a cognitive system is not that different from building unit tests for any other kind of software...  Continue reading Cognitive System Testing: So, I don’t need to unit test my cognitive system?

Cognitive system testing: Overall system accuracy testing

As described in previous posts, cognitive systems are probabilistic, non-deterministic systems, which will never achieve 100% accuracy. (After all – what is the accuracy of a human expert, the best alternate cognitive system?) Even though we don’t expect to achieve 100% accuracy, we still need to measure the accuracy of our system and verify that...  Continue reading Cognitive system testing: Overall system accuracy testing

Cognitive system testing: Testing at the beginning with ingestion verification test

A cognitive system is only as good as the data loaded into the system. Loading data into a cognitive system is often referred to as an “ingestion” phase. Some systems do a single large ingestion, some do continuous ingestion, and some do a “rip and replace” series of ingestions (where ingestion n is deployed, ingestion...  Continue reading Cognitive system testing: Testing at the beginning with ingestion verification test