Several Earth system components are at a high risk of undergoing rapid, irreversible qualitative changes or “tipping” with increasing climate warming. It is therefore necessary to investigate the feasibility of arresting or even reversing the crossing of tipping thresholds. Here, we study feedback control of an idealized energy balance model (EBM) for Earth’s climate, which exhibits a “small icecap” instability responsible for a rapid transition to an ice-free climate under increasing greenhouse gas forcing. We develop an optimal control strategy for the EBM under different forcing scenarios to reverse sea-ice loss while minimizing costs. Control is achievable for this system, but the cost nearly quadruples once the system tips. While thermal inertia may delay tipping, leading to an overshoot of the critical forcing threshold, this leeway comes with a steep rise in requisite control once tipping occurs. Additionally, we find that the optimal control is localized in the polar region.