The technical characteristics of direct heating electric boilers, regenerative electric boilers, quantum energy boilers, and air heat pumps are analyzed, and the heating costs are compared. The result shows that regenerative electric boilers are equipped with heat storage devices, which can change the electricity consumption characteristics of heating users and reduce the cost of heating power. However, the configuration of heat storage devices is closely related to the peak and valley electricity price policy. Setting a heating peak and valley electricity price policy can guide the load to use more electricity during the period of new energy generation and improve the grid’s ability to absorb electricity. The research results can provide a reference for clean heating in northern China.