HeatpumpMonitor.org flagging monitoring errors

It’s been on my list for a while to implement a way to flag and hide systems with monitoring errors on HeatpumpMonitor. Some have raised concerns about data quality seeing systems listed with issues such as heat output when the compressor is off due to temperature sensor offset errors or defrost energy not being taken into account. It’s clearly important that the data on HeatpumpMonitor can be relied upon to accurately reflect the real system performance.

This hasnt been that much of an issue yet as all of the systems listed in the top spots do not have these issues but it would become more of an issue if a system with significant measurement errors did occupy a top spot and so it’s good to get ahead of this issue. It can be more of an issue when making comparisons on particular brands e.g Daikin where there are more systems using heatpump integration as the data source.

At the same time we do not want to discourage contributions that use heat pump integration and even systems with measurement errors still provide useful data on a whole range of system attributes such as system control/cycling/modulation.

Those of us with experience in looking through the data can identify common measurement issues and can take this into account when comparing systems but it’s less straightforward for newcomers to the site.

I noted that we wanted to look at this issue in the recent HeatpumpMonitor.org next steps post:

and have since implemented a first pass at this feature, systems with flagged metering errors are now hidden but can be enabled from the ‘show systems with’ box:

Selecting only the systems flagged with metering errors, we can see a little yellow exclamation mark, hover over the mark to see a note about what errors were identified.

it’s also possible to select the node field and show it in the table for quick reference:

Not including defrost energy does not have that much of an effect on long term COP figures, it usually results in a 0.1 COP difference e.g it might list 4.1 rather than 4.0.

Temperature sensor offset error is more significant. Here’s a good example, the small DT error here is resulting in a suggested heat output of 385W when the compressor has clearly been off for some time.
The COP in window of 4.79 drops to 4.43 without this heat contribution:

I’m not 100% sure that I’ve got this feature quite right yet. Should we flag systems that do not include defrost energy differently to those with temperature sensor offset errors perhaps? Perhaps a yellow flag for defrosts and orange for temperature sensor offset errors? Is it fair to hide systems on the main list which do not include defrosts or is a flag icon fine?

1 Like

I feel defrost energy should be captured next to the other options for what the metering includes, as it is specific to how the metering is set up rather than an error in the the measured heat like for sensors:

image

1 Like

Thanks for prompting the discussions. Its a tricky challenge and depends on what the long term aim of heat pump monitor is.

If it’s direct comparison between systems and focused on COP the data quality and variation becomes more important.

If it’s to enable users to ask better questions and understand opportunities for learning / adapting then understanding why the data is different is more important.

In reality both data quality and context are important.

Personally I would favour including data but with flags and perhaps a brief description of the possible impact of the error somewhere. There is such a wide variation in systems that I think making the variations visible is really helpful. Then individual users can ask better questions and make their own judgment with advice from the forum that’s available.

1 Like

Agreed with both points, quality and learning both important, learning perhaps slightly more so.

Il try and implement two flag settings, yellow for not including defrosts and orange for temperature offset errors. We can try having these systems visible by default with an easy option to hide them with the system selection tool and review the result?

Thanks @TrystanLea - any advice on dealing with my own system error welcome! It’s important to me to understand the limitations of data and keep trying to improve it!

I’m confused on what defrost energy is, are we talking backup heaters or something else?

This is when the heat pump runs in reverse, cooling the house a little to warm up the outside unit to melt the ice that has accumulated on the coils. So, negative heat is produced during the defrost. Some of this heat is recovered when the system resumes heating again.

Thanks Tim. For quite a few of the 13 systems with metering errors I can see that negative energy is included when checking the box for “Show cooling / defrosts”, for example Ken Bones’ system in Basingstoke:

Link:
https://emoncms.org/app/view?name=MyHeatpump&readkey=8556f35f36e52bd7e3772816e6b9cb41

Am I missing something?

This one is flagged for a different reason, not defrost energy:

Oh of course. How about the Speak to the Geek system in Port Talbot?
https://unpraying-ape-8145.dataplicity.io/app/view?name=ASHP&readkey=82af8f22985d47049461f3fbbc16632a

Same issue. See system details page: https://heatpumpmonitor.org/system/view?id=117

I could have sworn it mentioned lacking defrost data. Thanks for the clarification Tim.