On the (non-)differentiability of the optimal value function when the optimal solution is unique

We present examples of a parameterized optimization problem, with a continuous objective function differentiable with respect to the parameter, that admits a unique optimal solution, but whose optimal value function is not differentiable. We also show independence of Danskin's and Milgrom and Segal's envelope theorems.