Chapter 1 - Introduction to AI
Definition of AI and AI Effect
Narrow, General and Super AI
AI-Based and Conventional Systems
AI Development Frameworks
Hardware for AI-Based Systems
Contracts for AI as a Service
Introduction to Pre-Trained Models
Risks of using Pre-Trained Models and Transfer Learning
Standards, Regulations and AI
Chapter 2 - Quality Characteristics for AI-Based Systems
Flexibility and Adaptability
Side Effects and Reward Hacking
Transparency, Interpretability and Explainability
Chapter 3 - Machine Learning (ML) – Overview
Factors Involved in ML Algorithm Selection
Overfitting and Underfitting
Chapter 4 - ML Data
Data Preparation as Part of the ML Workflow
Challenges in Data Preparation
Hands-On Exercise: Data Preparation for ML
Training, Validation and Test Datasets in the ML Workflow
Data Quality and its Effect on the ML Model
Data Labelling for Supervised Learning
Approaches to Data Labelling
Mislabeled Data in Datasets
Chapter 5 - ML Functional Performance Metrics
Additional ML Functional Performance Metrics for Classification, Regression and Clustering
Limitations of ML Functional Performance Metrics
Selecting ML Functional Performance Metrics
Chapter 6 - ML Neural Networks and Testing
Coverage Measures for Neural Networks
Chapter 7 - Testing AI-Based Systems Overview
Specification of AI-Based Systems
Test Levels for AI-Based Systems
Component Integration Testing
Test Data for Testing AI-based Systems
Testing for Automation Bias in AI-Based Systems
Documenting an AI Component
Testing for Concept Drift
Selecting a Test Approach for an ML System
Chapter 8 - Testing AI-Specific Quality Characteristics;
Challenges Testing Self-Learning Systems
Testing Autonomous AI-Based Systems
Testing for Algorithmic, Sample and Inappropriate Bias
Challenges Testing Probabilistic and Non-Deterministic AI-Based Systems
Challenges Testing Complex AI-Based Systems
Testing the Transparency, Interpretability and Explainability of AI-Based Systems
Test Oracles for AI-Based Systems
Test Objectives and Acceptance Criteria
Chapter 9 - Methods and Techniques for the Testing of AI-Based Systems
Adversarial Attacks and Data Poisoning
Hands-On Exercise: Pairwise Testing
Experience-Based Testing of AI-Based Systems
Selecting Test Techniques for AI-Based Systems
Chapter 10 - Test Environments for AI-Based Systems
Test Environments for AI-Based Systems
Virtual Test Environments for Testing AI-Based Systems
Chapter 11 - Using AI for Testing
AI Technologies for Testing
Hands-On Exercise: The Use of AI in Testing
Using AI to Analyze Reported Defects
Using AI for Test Case Generation
Using AI for the Optimization of Regression Test Suites
Using AI for Defect Prediction
Hands-On Exercise: Build a Defect Prediction System
Using AI for Testing User Interfaces
Using AI to Test Through the Graphical User Interface (GUI)