Electrification of Heat trial data

The final reports for the Electrification of Heat trial were published last Thursday. The results indicated an average SPF H4 of only 2.81 across 428 heat pumps.

Full reports and data available here:
https://es.catapult.org.uk/report/electrification-of-heat-summary-reports-and-datasets/

This performance at current price cap electricity and gas rates will result in a cost of heat of 24.5 p/kWh / 2.81 = 8.72 p/kWh. An 85% efficiency boiler with gas at 6.24 p/kWh will cost 7.34 p/kWh to run. This unfortunately indicates that there are a lot of heat pumps out there that are costing more to run than gas (about 19% more on average based on price cap rates).

We know from the work we are doing here and with good installers around the country that much better results are possible and shouldn’t be that hard to achieve on a wider basis. The average performance on HeatpumpMonitor.org for 48 systems is currently running at an SPF H4 of 4.0. Enough to give a saving of 17% vs gas.

Why are we seeing such a big difference in performance between these larger trials and HeatpumpMonitor.org results?

The team behind the trial have done a great job of making all the data from the trial available as open data, including detailed 2 minute data on flow and return temperatures, room temperature, outside temperature, electric consumption and heat output. Everything we need in fact to populate the standard emoncms MyHeatpump dashboard!

With this data we can actually see exactly what is going on. E.g system EOH0567 (Dashboard):

That’s a lot of short cycling and the flow temperature control is all over the place! :smile: There’s lots of examples like this and worse in the data, very high flow temps, poor modulation, oversizing etc. There’s probably a lot of potential for improvement with simple weather compensation curve adjustment.

I’ve started uploading all of the Electrification of Heat systems to a dedicated website, with a directory similar to HeatpumpMonitor (currently a simple list). I’ve only uploaded the first batch of 186 systems so far, I will be uploading the rest over the next few days. I still need to sort through a few issues on the upload for a few systems and I need to check a couple of things with the study authors in terms of accounting for hybrid boiler heat, some of the systems appear inconsistent in where this heat is accounted for.

Here’s the work in progress website so far (open on a wide screen, not mobile):

https://eoh.heatpumpmonitor.org/

Please feel free to comment below with reflections on particular systems as you explore the data. It would be good to add a way to add comments on systems to the site so that we can keep track of any analysis we come up with. I think there’s a real opportunity here to feedback to the organisations that were involved in running the trial what needs to be improved in terms of heat pump design and installation guidance to help the industry learn and improve results in future.

Nothing beats looking at the detailed data for an in-depth understanding of what is leading to these low average SPF trial results!

20 Likes

Good work, @TrystanLea

This doesn’t surprise me. Not a single one of my friends who have had heat pumps installed was the slightest bit interested in what makes them tick or optimising them (“fit and forget”). Few had been shown by their installers that they could do more than just programme their roomstat. In fact many were actively discouraged from touching things (my own installer included :upside_down_face:).

Dare I suggest that the folk on this forum are almost by definition more interested in HP optimisation, so are much more likely to get better results.

12 Likes

That’s a good point and will likely be part of it! This also reflects a few conversations I’ve had with installers who have had push back from customers when trying to design to lower flow temps (complaints about radiators being too large). Though that’s complicated by over-estimated heat loss calcs.

There’s probably an opportunity to highlight more clearly the potential savings from running a well configured low temp system. E.g based on 10,000 kWh a year and price cap electric the difference between SPF 2.8 and 4.0 is a running cost of £872 vs £612 = £260/year. Or at cheaper agile tariff rates maybe more like £190/year saving.

2 Likes

The study has information on install cost as well, which look fairly average as install costs go, seems like there should be enough in there for a good performance install:

Hi Trystan,

One thing I find a lot from people I speak to about heat pumps is an inability to understand that water doesn’t need to be hot to provide enough heat.

However much you try to explain, they just can’t accept that water flowing at 30c can provide enough heat to keep a house warm.

We are so used to radiators that are often too hot to touch with gas and oil boilers, I can understand why it is a difficult concept to grasp for many people.

I suspect many heat pumps are, and will be, installed where the owners just feel compelled to replicate their old fossil fuelled heating system.

I have also heard reports from some owners where they are so alarmed by the initial electricity use at the start of a heating cycle that they try to limit the use, so scared by how much it is going to cost them.

It will be very difficult for some people to convert, we are used to heating systems where the cost is largely determined by how long the heating source is operating for. The efficiency is pretty much fixed so the only variables are how long it is on for and how hot the home is.

Heat pumps are so complicated and offer a large variation in heat output per unit of energy consumed. And then you have the lottery of did you get the correct heat pump?

The installers need to improve, many are very good but some aren’t.

It is also a problem when your heat pump is installed way before you ever need to use it in anger.

A summer install results in a leap into the dark when you eventually need to use the heating, long after the installers are gone!

8 Likes

Thanks @matt-drummer, all good points!

1 Like

If the heat monitoring equipment is still active (I assume it hasn’t been removed), perhaps it would be worth the Government looking at remediation measures for the heat pumps that were installed.

Many people reading this will know what is likely to be wrong with the installations, and why they are performing badly. But formalising that knowledge, with a large-scale revisiting and repair trial - with monitoring - would cement that knowledge.

3 Likes

@John_Ewbank yes agreed, there are at least a few people here who have linked the EoH monitoring up to HeatpumpMonitor.org who have done their own remediation. It would be interesting to compare the early data collected during the trial with the more recent data after optimisations…

Not sure if the original monitoring is still active, I think the data collection end at least may have been turned off even though the hardware is still in place.

1 Like

Issue example: System EOH0184 seems to have either a configuration issue with the hot water cycle or perhaps the hot water sensor has fallen out of the pocket? This issue persisted right to the end of the monitoring period. See: Dashboard link

I’ve added heat pump make, model, size and first half of postcode, Im quite surprised that a lot of these are Vaillant Arotherms, there’s lots of Mitsi Ecodan’s and Daikins too of course… but poorly performing Arotherms!?

https://eoh.heatpumpmonitor.org/

3 Likes

There are a few examples of systems on there that seem to have the metering mis-configured but where the results have still been included in the overall SPF analysis. Il try and make a list of the ones I find.

  • EOH0258: Apparent SPF 2.75, which on the face of it checks out in terms of the energy totals here. A quick glance however at the daily data indicates something is wrong and zooming in to the power view quickly uncovers some real oddities e.g

Some data missing from the middle of this system http://167.71.135.140/emoncms/app/view?name=EOH0184&readkey=b445ba22271a2d06d5ae1943de514517&mode=power&start=1644033600&end=1649599200

1 Like

I think that one is not so bad, the heat meter comes back and the cumulative heat kWh reading still looks ok, it’s shared out the heat evenly across the days but the total is probably fine

1 Like

Given my experience as a landlord, I don’t believe we can assume many people even know the difference between a thermostat and a on/off switch. The standard control systems are not designed to give standard people good results. It unbelievable that most people will be able to adjust a weather compensation curve, so it needs to be automatically.

It also uncommon for a GasSave person to leave a boiler with a sensible radator flow temperature, so we can’t trust the “expert” trades people to correctly setup systems. Letting agent staff often consider that bleeding radiators needs a visits from a plumber, thankfully I now self manage so can explain to my tenants how to it over the phone.

I can’t even predict if my next tenant will want 25/7 heat or just a few hours of heat for a few evenings each week! Hence I would not consider a heatpump for any of my rental properties. But am in the process of including a heatpump in work to our own home.

1 Like

What a treasure trove. Lots of really high flow temperatures on some of the Vaillants. I can’t imagine anyone needing 50+°C on a 7°C day,.but that’s how you get a crappy SCOP. Unfortunately there’s some really bad intermittent data quality on some of these. It’s going to be interesting to see whether some patterns emerge.

4 Likes

EOH0218 (10 kW Arotherm plus, like my own):

What is going on with the DHW cycles? Is this a continous legionella cycle every day? I wouldn’t even know how to coax this behaviour out of my system.

It’s configured to approximately 45°C flow temperature at -6°C outside, and get’s a COP around 2.3-2.5 in that range. That appears roughly consistent with the datasheet. Here’s a continuous segment at ~2°C outside temperature and 38°C flow. COP of around 3.6, also roughly in line with the datasheet.

Sifting through this data with the MyHeatpump app is a breeze. This is the perfect showcase on what a powerful and genuinely useful system you developed!

3 Likes

Thanks @Andre_K none of this would be half as powerful without yours and others involvement and contributions here on this forum and using the data. I’m glad the app and related software is working well! Credit to @Timbones as well for the feature to share the particular data view of interest, that’s made the ease at which we can match the EoH selection window and examples here so much faster and easier to access!

That’s another great example! That’s probably the result of the hot water cylinder temperature sensor having fallen out, looks like it managed a few weeks at the start without the issue?

3 Likes

I would guess that either the DHW daily set-point is set to 70C, or the cylinder temp probe has fallen out or not properly connected. Either of these scenarios would result in the HP trying to heat the tank, but never achieving the set point.

With decent monitoring and potentially some AI, it would be so easy to spot these issues and alert the user.

1 Like

EOH0432: 7kW Vaillant Arotherm+ Very high curve setting with room temperature cut off?

EOH0464: 7kW Vaillant Arotherm+ It’s 8C outside and the flow temperature is going up to 54C with lots of off time inbetween. Drop the curve, improve SPF :slight_smile:

EOH0571: 7kW Vaillant Arotherm+ To high a curve, not enough system volume/radiator area/zoned? - high hot water to space heat proportion?

EOH0501: 7kW Vaillant Arotherm+ Interesting example of running a heat pump like a gas boiler, early morning peak and evening peak, 55C for peak period May 21st:

1 Like

EOH0470: The best performing 11kw Ecodan (picked as closest to mine) had a decent first winter (COP 3.7) yet the second winter was awful (2.8).

Note how much less heat is produced in that second winter, never reaching 90 kWh per day. Wonder if the occupants were cold.

Is the SPF on the dashboard only calculated from the first year?

1 Like