Jesus A. Gonzalez
January 21, 2020
We say that a computational program LEARNS from EXPERIENCE E with respect to a class of TASKS T and PRECISION P, if its precision with respect to task T, and measure P, improves with experience E. (Tom Mitchell)
Think again about the Design of a learning system
The learning task consists on finding a hypothesis h identical to the objective concept c from the set of instances X.
Inductive learning algorithms can only guarantee that h adjusts to c over for the training data
If we don’t have more information, we assume that the best hypothesis for unseen instances, is that hypothesis that best adjusts to the observed data in the training set
Finding a most specific hypothesis
\[Consistent(h, D) = (\forall \langle x, c(x) \rangle \in D) \; h(x) = c(x)\]
\[VS_{H,D} = \{h \in H | Consistent(h, D)\}\]