Review Note

Last Update: 10/08/2023 02:57 PM

Current Deck: EEN100: Theory and exercises

New Card (Unpublished)

Currently Published Content


Front
Back

No published tags.

Pending Suggestions


Field Change Suggestions:
Loss function and population loss
Suppose data is generated as \(z \sim P_{\mathcal Z}\) on \(\mathcal Z = \mathcal X \times \mathcal Y\).

Assess a learning rule \(h\) determined by some algorithm on \(\mathcal S\) with loss function \(\ell: \mathcal H \times \mathcal Z \to \mathbb R_+\).

Ex: 0-1 loss \(\ell(h,z) = \boldsymbol{1}_{h(x) = y}\) or quadratic loss \(\ell(h,z) = (h(x) - y)^2\).

Population loss is the true error over the population \(L_{P_{\mathcal Z}} = \mathbb{E}_{Z \sim P_{\mathcal Z}}[\ell(h,Z)]\)