For the mean, we proceed by computing the expected value of the Taylor expansion:

This shows that evaluating the model at the mean input is an approximation of the mean output.