Missing data

Emoncms
1

Hello,

I have 3 Emon TX and one Heat pump running and now a new Raspberry with the latest SD image for local logging.

The values from the 3 TX coming in correct.
Only the values from the Heat pump are not all there. I am missing about 50 % off the data.
The EmonESP reports; Emoncms, connection NO with sometimes short YES
and MQTT connection NO

When I set the EmonESP to send the data to emoncms.org then all the values coming in and the EmonESP signals connection YES.

I try now for several days’ different settings, searching the forum but no result. Load the latest image for the Pi new but getting frustrated.
Can anyone give me some tips?

2

emonESP - one for @glyn.hudson.

3

pi@emonpi:~ $ tail /var/log/emoncms/emoncms.log
2020-10-06 11:43:59.144|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:43:59.222|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:43:59.297|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:43:59.374|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:43:59.462|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:44:09.475|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:44:09.551|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:44:09.625|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:44:10.180|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-06 11:44:10.265|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
pi@emonpi:~ $

What does this mean?

4

i make a new SD whith the latest image but the same result.

What wonders me is that even when i give in “sudo service emonhub stop” the part off the data from my EmonESP (heatpump) is coming in.

What is lost is the values from the Mbus.

Setting the EmonESP to send to emoncms.org everything is OK.

5

pi@emonpi:~ $ tail /var/log/emoncms/emoncms.log
2020-10-12 21:05:02.498|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-12 21:05:02.528|ERROR|index.php|Not Authenticated|config/getemonhublog
2020-10-12 21:05:02.682|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-12 21:05:02.753|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-12 21:05:02.834|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-12 21:05:02.919|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
2020-10-12 21:05:03.565|ERROR|index.php|Not Authenticated|config/getemonhublog
2020-10-12 21:05:04.541|ERROR|index.php|Not Authenticated|config/getemonhublog
2020-10-12 21:05:06.531|ERROR|index.php|Not Authenticated|config/getemonhublog
2020-10-12 21:05:08.534|ERROR|index.php|Not Authenticated|config/getemonhublog
pi@emonpi:~ $

6

is there anyone who can help me.

my heatpump emonESP connect in seconds emoncms.org

but when i give in my emonpi for logging local i see only12 off the 22 inputs

7

Sorry, this really is one for @glyn.hudson but he appears to be AWOL. You could try emailing the shop if recently bought - [email protected]

8

@Frans which version of emonESP are you running on the heatpump monitor? did you update the firmware recently? Are you using a hostname or an ip address for the local MQTT server?

9

Thanks for your reply,

now i see its version 2.3.1 that is running.
Can i update by just pushing Firmware upload

10

Thanks @Frans, had this been running fine with the previous pi?

Have you tried a factory reset on the heat pump monitor EmonESP and re-entering all the details?
The MQTT port should be 1883, sometimes that can be incorrect. Are you using a hostname or an ip-address?

You could try updating the firmware, you will need to do this with a USB to UART uploader as the firmware upload feature doesn’t work on older versions. Im yet to make the switch to the very latest version (3.1.1) so if you still get problems it might be worth trying 3.0.0 Release v3.0.0 | Merge of timer branch · openenergymonitor/EmonESP · GitHub.

Did you upload the firmware initially or did we do it for you in the shop?

11

Hello Trystan, Hello Trystan,
It has works for a long time but stops.
Then I did a factory reset and reload the HeatpumpMonitor Firmware.
Now I reload the ESP Firmware whit your script 3.0.0.

(took me some time, I could get PlatformIO working, giving errors in the libraries, Arduino need long time to compiling and then I could not load the SPIFFS, it could not find esptools.py.
Then I tried esptool and your pre-compiled files. Whit that I succeed.
Now it works again but the same result.
To emoncms.org all the 22 values coming in. On the local Raspi I only get 8 inputs.
It says by Emoncms connection YES but only when it is sending.
For the MQTT it stays by connection No
I tried whit IP and hostname. I check the MQTT port whit the number on the EmonPi.
The Emoncms log gives a long list like;
2020-10-16 16:07:15.944|ERROR|input_controller.php|{“success”: false, “message”: “Format error: csv value is not numeric”} for User: 1
Is there something wrong on my Atmega 328 firmware ?

12

Hello @Frans, could you connect the USB to UART cable to the ESP module and monitor the serial output? Perhaps copy a section of what you see here? Is there any pattern in terms of which 8 values are coming in to emoncms.org? are the 8 values definitely from the heatpump monitor?

13

here are the values coming from the HP

13:13:05.573 → ,KSflowrate:4319,KSHeat:3300,KSflowT:43.36,KSreturnT:40.36,KSdeltaT:3.00,PulseIRDA:123625

13:13:16.076 → Msg:31651,OEMct1:1179,OEMct2:1384,OEMct3:1380,OEMtotaal:3943

13:13:16.122 → ,OEMct1Wh:0,OEMct2Wh:0,OEMct3Wh:0

13:13:16.122 → ,powerpuls:8062.06

13:13:16.122 → ,powerpuls_kWh:123.635

13:13:16.122 → ,T797:27.19,T650:27.25

13:13:16.122 → ,KSflowrate:4314,KSHeat:14800,KSflowT:43.36,KSreturnT:40.36,KSdeltaT:3.00,PulseIRDA:123635

13:13:26.635 → Msg:31652,OEMct1:1207,OEMct2:1395,OEMct3:1399,OEMtotaal:4001

13:13:26.635 → ,OEMct1Wh:0,OEMct2Wh:0,OEMct3Wh:0

13:13:26.682 → ,powerpuls:4642.41

13:13:26.682 → ,powerpuls_kWh:123.646

13:13:26.682 → ,T797:27.12,T650:27.25

13:13:26.682 → ,KSflowrate:4314,KSHeat:14800,KSflowT:43.25,KSreturnT:40.40,KSdeltaT:2.85,PulseIRDA:123646

this how they come in when i set them to send to emoncms.org

Msg 12s 31826

OEMct1 12s 28

OEMct2 12s 39

OEMct3 12s 40

OEMtotaal 12s 107

psent 12s 24140

psuccess 12s 4037

freeram 12s 24136

1 12s NULL

OEMct1Wh 12s 0

OEMct2Wh 12s 0

OEMct3Wh 12s 0

powerpuls 12s 28.71

powerpuls_kWh 12s 124.7

T797 12s 27.44

T650 12s 26.81

KSflowrate 12s 0

KSHeat 12s 0

KSflowT 12s 42.14

KSreturnT 12s 40.81

KSdeltaT 12s 1.33

PulseIRDA 12s 124655

Powered by OpenEnergyMonitor.org

on my local emonpi is get;

Msg 5s 31857

OEMct1 5s 1217

OEMct2 5s 1383

OEMct3 5s 1390

OEMtotaal 5s 3990

psent 5s 24322

psuccess 5s 4212

freeram 5s 28624

ulseIRDA n/a NULL

g 20 mins 31744

sg 19 mins 31747

1 20 mins 43

RDA 20 hrs 97753

eIRDA 2.9 days 33423

IRDA 36 hrs 74235

DA 25 hrs 90897

KSreturnT 25 hrs 40.81

KSdeltaT 25 hrs 3.21

PulseIRDA 25 hrs 90339

A 11 hrs 107278

Powered by OpenEnergyMonitor.org | low-write 10.2.6

I hope you can do something whit this.

14

For future reference, when posting code, logs or bash output, please put in 3 ‘backticks’ (found at the top left of the keyboard normally) on a line on their own, then the code, log etc., then 3 more backticks on a line following the code.

    ```
    code
    ```

If it is something like php you can add a language identifier that after the first 3 backticks so ```php

It makes it much easier to read.

15

Thanks @Frans interesting, looks like the local emonpi is seeing a lot of partial input names in comparison with emoncms.org.

The input:

seems a bit strange, not sure where that is coming from. It looks like you have modified the firmware for the heatpump board as the input names are not all familiar?

Do you have a copy of your code? and the name of the original firmware it was based on? I could try and compare changes here and see if anything jumps out at me…

16

copy_HP_schets.ino (15.3 KB) mbus.ino (5.2 KB)

Thans for your help again

I did use the Mbus file and HeatpumpMonitor_AutoTemp_MultiPage

My Kampstrup is another type then the one used by OEM. I modified the script so it works for me. That all thanks to your help like we disgust December 2017.

I did always get some times strange unknowing values but had no problems whit that.

17

Hello Frans

There where a couple of minor things in there that might be causing the issue, I think you can call println (new line) once at the end of the key:value string rather than at multiple points. There was a couple of points where brackets and indentation didnt make sense, not sure if that was affecting the issue…

Here’s my edited version:

HP_schets_edited_trystan.zip (6.0 KB)

18

Hello Trystan,

Thanks for your help. It succeeds.

Sorry but I am not a programmer and do these thing by Trial-and-error.

I load your script and I directly cot al the values good in my Emoncms local.

The EmonESP tells in the smartplug 3590 “Emoncms connection :yes “

The MQTT stays on connection: no

What wonders me is that in the Emonhub I only see the values coming from the RFM2Pi. I set these also on sending to Emoncms.org.

Still it is function now.

Regards, Frans

1 Like