Loss landscapes for different fine-tuning strategies, evaluated on the metal-poor regime of [Fe/H] (79 stars). The first row shows three-dimensional surfaces, and the second row shows two-dimensional contours of the logarithmic MSE loss, plotted as a function of perturbations around the pretrained model parameters along two random directions. The minimum losses are indicated in the color bar of the two-dimensional contours.