My Emoncms server rejects EmonHUB data

Lycle_Park · 17 January 2019 05:34

I setup my Emoncms server and getting MQTT data from emonHUB.
also my emonpi send to emoncms.org at same time.
emoncms.org receives data without problem, but my emon.kr server rejects data with below error message.
“WARNING emon send failure: wanted ‘ok’ but got ‘{“success”: false, “message”: “Error: Reached the maximal allowed number of diferent NodeIds, limit is 32. Node ‘109’ was ignored.”}’”

why emonhub sends below big data per one time only to my server?
2019-01-17 13:18:40,296 INFO emon sending: http://emon.kr/emoncms/input/bulk.json?apikey=E-M-O-N-C-M-S-A-P-I-K-E-Y&data=[[1547690345.675071,109,-14372,2363,16695,-21792,-9876,1471,18721,-31439,-19348,32174,-29178,20548,3339,11470,-21024,-15411,26165,-40,-4904,11959,-23790,32696,-21239,-15411,-64],[1547690345.788043,10,36,0,0,0,192.84,300,300,300,300,300,300,1,0,-69],[1547690345.910139,9,-39,0,0,0,225.18,300,300,300,300,300,300,1,0,-89],[1547690346.343586,8,230,10,8,0,213.17000000000002,16,300,300,300,300,300,0,-72],[1547690348.091549,5,0,0,0,224.11,23.8,0,0,0,0,0,0],[1547690353.177938,5,0,0,0,222.95000000000002,23.8,0,0,0,0,0,0],[1547690353.491865,10,42,0,0,0,192.88,300,300,300,300,300,300,1,0,-74],[1547690353.610366,9,-39,0,0,0,225.21,300,300,300,300,300,300,1,0,-90],[1547690354.241656,8,232,12,6,0,213.13,16,300,300,300,300,300,0,-72],[1547690358.070616,5,0,0,0,221.39000000000001,23.8,0,0,0,0,0,0],[1547690361.35551,10,37,0,0,0,192.78,300,300,300,300,300,300,1,0,-74],[1547690361.488673,9,-40,0,0,0,224.89000000000001,300,300,300,300,300,300,1,0,-89],[1547690363.126129,5,0,0,0,223.27,23.8,0,0,0,0,0,0],[1547690363.239118,8,229,16,7,0,212.98000000000002,16,300,300,300,300,300,0,-71],[1547690368.077502,5,0,0,0,223.31,23.8,0,0,0,0,0,0],[1547690369.294693,10,38,0,0,0,192.70000000000002,300,300,300,300,300,300,1,0,-73],[1547690369.408676,9,-45,0,0,0,225.57,300,300,300,300,300,300,1,0,-89],[1547690370.128541,8,230,16,11,0,213,16,300,300,300,300,300,0,-72],[1547690373.083173,5,0,0,0,223.15,23.8,0,0,0,0,0,0],[1547690378.167673,5,0,0,0,223.1,23.8,0,0,0,0,0,0],[1547690378.289877,10,38,0,0,0,192.46,300,300,300,300,300,300,1,0,-74],[1547690378.412299,8,226,16,9,0,212.68,16,300,300,300,300,300,0,-71],[1547690383.14214,5,0,0,0,222.22,23.8,0,0,0,0,0,0],[1547690385.108809,10,36,0,0,0,192.65,300,300,300,300,300,300,1,0,-67],[1547690385.221918,9,-42,0,0,0,224.84,300,300,300,300,300,300,1,0,-87],[1547690386.046148,8,224,19,4,0,212.72,16,300,300,300,300,300,0,-71],[1547690388.089144,5,0,0,0,222.9,23.8,0,0,0,0,0,0],[1547690393.113206,5,0,0,0,222.51,23.8,0,0,0,0,0,0],[1547690393.237617,10,37,0,0,0,192.51,300,300,300,300,300,300,1,0,-67],[1547690394.05946,8,226,21,7,0,212.76,16,300,300,300,300,300,0,-72],[1547690398.085933,5,0,0,0,222.67000000000002,23.8,0,0,0,0,0,0],[1547690400.907617,10,39,0,0,0,192.89000000000001,300,300,300,300,300,300,1,0,-65],[1547690401.12129,9,-43,0,0,0,225.22,300,300,300,300,300,300,1,0,-91],[1547690401.938852,8,226,19,7,0,213.03,16,300,300,300,300,300,0,-69],[1547690403.172814,5,0,0,0,222.39000000000001,23.8,0,0,0,0,0,0],[1547690408.169868,5,0,0,0,222.58,23.8,0,0,0,0,0,0],[1547690408.781303,10,38,0,0,0,191.94,300,300,300,300,300,300,1,0,-70],[1547690408.891634,9,-39,0,0,0,224.84,300,300,300,300,300,300,1,0,-89],[1547690409.927164,8,226,696,323,0,212.16,16,300,300,300,300,300,0,-69],[1547690413.091031,5,0,0,0,221.64000000000001,23.8,0,0,0,0,0,0],[1547690416.716892,10,39,0,0,0,191.8,300,300,300,300,300,300,1,0,-69],[1547690416.830102,9,-38,0,0,0,224.67000000000002,300,300,300,300,300,300,1,0,-88],[1547690418.15349,5,0,0,0,222.47,23.8,0,0,0,0,0,0],[1547690418.266829,8,225,690,321,0,211.9,16,300,300,300,300,300,0,-70],[1547690423.097105,5,0,0,0,222.45000000000002,23.8,0,0,0,0,0,0],[1547690424.6107,10,39,0,0,0,191.9,300,300,300,300,300,300,1,0,-70],[1547690424.717513,9,-44,0,0,0,224.08,300,300,300,300,300,300,1,0,-90],[1547690425.841633,8,226,688,322,0,212.11,16,300,300,300,300,300,0,-70],[1547690428.162183,5,0,0,0,223.35,23.8,0,0,0,0,0,0],[1547690433.09717,5,0,0,0,223.5,23.8,0,0,0,0,0,0],[1547690433.223183,10,45,0,0,0,192.91,300,300,300,300,300,300,1,0,-71],[1547690433.844292,8,225,24,12,0,213.1,16,300,300,300,300,300,0,-71],[1547690438.135613,5,0,0,0,222.82,23.8,0,0,0,0,0,0],[1547690440.467738,10,41,0,0,0,192.84,300,300,300,300,300,300,1,0,-64],[1547690440.59163,9,-44,0,0,0,225.34,300,300,300,300,300,300,1,0,-88],[1547690441.740207,8,224,-24,-12,0,213.24,16,300,300,300,300,300,0,-69],[1547690443.17436,5,0,0,0,222.68,23.8,0,0,0,0,0,0],[1547690448.176331,5,0,0,0,223.46,23.8,0,0,0,0,0,0],[1547690448.288745,10,39,0,0,0,192.79,300,300,300,300,300,300,1,0,-70],[1547690448.402212,9,-42,0,0,0,225.25,300,300,300,300,300,300,1,0,-90],[1547690449.743723,8,224,-27,-13,0,213.03,16,300,300,300,300,300,0,-71],[1547690453.137271,5,0,0,0,223.43,23.8,0,0,0,0,0,0],[1547690456.151908,10,37,0,0,0,192.59,300,300,300,300,300,300,1,0,-73],[1547690456.366463,9,-43,0,0,0,224.83,300,300,300,300,300,300,1,0,-89],[1547690458.102781,5,0,0,0,223.01,23.8,0,0,0,0,0,0],[1547690458.225996,8,224,-26,-13,0,212.9,16,300,300,300,300,300,0,-70],[1547690463.172325,5,0,0,0,222.29,23.8,0,0,0,0,0,0],[1547690464.091219,10,41,0,0,0,192.37,300,300,300,300,300,300,1,0,-71],[1547690464.209611,9,-46,0,0,0,224.54,300,300,300,300,300,300,1,0,-90],[1547690465.640544,8,222,-18,-9,0,212.52,16,300,300,300,300,300,0,-69],[1547690468.125588,5,0,0,0,222.81,23.900000000000002,0,0,0,0,0,0],[1547690471.992035,10,39,0,0,0,192.29,300,300,300,300,300,300,1,0,-70],[1547690472.112199,9,-40,0,0,0,224.49,300,300,300,300,300,300,1,0,-90],[1547690473.132349,5,0,0,0,222.8,23.900000000000002,0,0,0,0,0,0],[1547690473.573882,8,222,-23,-11,0,212.55,16,300,300,300,300,300,0,-73],[1547690478.211263,5,0,0,0,223.69,23.900000000000002,0,0,0,0,0,0],[1547690479.865836,10,38,0,0,0,192.48000000000002,300,300,300,300,300,300,1,0,-68],[1547690479.97919,9,-45,0,0,0,225.29,300,300,300,300,300,300,1,0,-91],[1547690481.522974,8,224,-22,-10,0,212.72,16,300,300,300,300,300,0,-72],[1547690483.149707,5,0,0,0,223.03,23.900000000000002,0,0,0,0,0,0],[1547690488.211461,5,0,0,0,223.04,23.900000000000002,0,0,0,0,0,0],[1547690488.333097,10,41,0,0,0,192.61,300,300,300,300,300,300,1,0,-68],[1547690489.550774,8,222,-23,-12,0,212.75,16,300,300,300,300,300,0,-72],[1547690493.174248,5,0,0,0,223.33,23.900000000000002,0,0,0,0,0,0],[1547690495.698781,10,42,0,0,0,192.70000000000002,300,300,300,300,300,300,1,0,-67],[1547690495.818977,9,-41,0,0,0,225.62,300,300,300,300,300,300,1,0,-89],[1547690498.18143,5,0,0,0,223.36,23.900000000000002,0,0,0,0,0,0],[1547690498.295604,8,225,-23,-12,0,212.99,16,300,300,300,300,300,0,-72],[1547690503.127749,5,0,0,0,223.21,23.900000000000002,0,0,0,0,0,0],[1547690503.542519,10,41,0,0,0,192.07,300,300,300,300,300,300,1,0,-68],[1547690505.463023,8,222,648,303,0,212.15,16,300,300,300,300,300,0,-72],[1547690508.195661,5,0,0,0,222.67000000000002,23.900000000000002,0,0,0,0,0,0],[1547690511.461374,10,47,0,0,0,192.04,300,300,300,300,300,300,1,0,-68],[1547690511.574264,9,-47,0,0,0,224.13,300,300,300,300,300,300,1,0,-90],[1547690513.195264,5,0,0,0,222.81,23.900000000000002,0,0,0,0,0,0],[1547690513.408766,8,225,651,304,0,212.52,16,300,300,300,300,300,0,-72],[1547690518.145544,5,0,0,0,222.82,23.900000000000002,0,0,0,0,0,0],[1547690519.370209,10,47,0,0,0,192.23000000000002,300,300,300,300,300,300,1,0,-68],[1547690519.584062,9,-47,0,0,0,225.11,300,300,300,300,300,300,1,0,-92],[1547690521.346062,8,224,649,305,0,212.76,16,300,300,300,300,300,0,-71]]&sentat=1547698720

Greebo · 17 January 2019 05:57

Can you post a copy of your emonhub config file?
Please use 3 x back-tick (```) characters on a separate line before and after the file to ensure it gets formatted correctly in your post.

Lycle_Park · 17 January 2019 07:21

Below is my config file.

#######################################################################
#######################      emonhub.conf     #########################
#######################################################################
### emonHub configuration file, for info see documentation:
### https://github.com/openenergymonitor/emonhub/blob/emon-pi/conf/emonhub.conf
#######################################################################
#######################    emonHub  settings    #######################
#######################################################################

[hub]
### loglevel must be one of DEBUG, INFO, WARNING, ERROR, and CRITICAL
loglevel = DEBUG
### Uncomment this to also send to syslog
# use_syslog = yes
#######################################################################
#######################       Interfacers       #######################
#######################################################################

[interfacers]
### This interfacer manages the RFM12Pi/RFM69Pi/emonPi module
[[RFM2Pi]]
    Type = EmonHubJeeInterfacer
    [[[init_settings]]]
        com_port = /dev/ttyAMA0
        com_baud = 38400                        # 9600 for old RFM12Pi
    [[[runtimesettings]]]
        pubchannels = ToEmonCMS,
        subchannels = ToRFM12,
        nodeoffset = 0 
        //group = 210
        group = 50
        frequency = 433
        baseid = 5                              # emonPi / emonBase nodeID
        calibration = 230V                      # (UK/EU: 230V, US: 110V)
#        quiet = true                            # Disable quiet mode (default enabled) to enable RF packet debugging, show packets which fail crc
        quiet = false                            # Disable quiet mode (default enabled) to enable RF packet debugging, show packets which fail crc
        # interval =  0                         # Interval to transmit time to emonGLCD (seconds)
        
[[MQTT]]
    Type = EmonHubMqttInterfacer
    [[[init_settings]]]
        mqtt_host = 127.0.0.1
        mqtt_port = 1883
        mqtt_user = emonpi
        mqtt_passwd = emonpimqtt2016

    [[[runtimesettings]]]
        pubchannels = ToRFM12,
        subchannels = ToEmonCMS,

        # emonhub/rx/10/values format
        # Use with emoncms Nodes module
        node_format_enable = 1
        node_format_basetopic = emonhub/

        # emon/emontx/power1 format - use with Emoncms MQTT input
        # http://github.com/emoncms/emoncms/blob/master/docs/RaspberryPi/MQTT.md
        nodevar_format_enable = 1
        nodevar_format_basetopic = emon/

[[emoncms.org]]
    Type = EmonHubEmoncmsHTTPInterfacer
    [[[init_settings]]]
    [[[runtimesettings]]]
        pubchannels = ToRFM12,
        subchannels = ToEmonCMS,
        url = http://emoncms.org
        apikey =
        senddata = 1                    # Enable sending data to Emoncms.org
        sendstatus = 1                  # Enable sending WAN IP to Emoncms.org MyIP > https://emoncms.org/myip/list
        sendinterval= 30                # Bulk send interval to Emoncms.org in seconds

[[emon]]
    Type = EmonHubEmoncmsHTTPInterfacer
    [[[init_settings]]]
    [[[runtimesettings]]]
        pubchannels = ToRFM12,
        subchannels = ToEmonCMS,
        url = http://emon.kr/emoncms
        apikey =

        senddata = 1                    # Enable sending data to Emoncms.org
        sendstatus = 1                  # Enable sending WAN IP to Emoncms.org MyIP > https://emoncms.org/myip/list
        sendinterval= 30                # Bulk send interval to Emoncms.org in seconds

#######################################################################
#######################          Nodes          #######################
#######################################################################

[nodes]

## See config user guide: https://github.com/openenergymonitor/emonhub/blob/emon-pi/conf/emonhub.conf

[[4]]
    nodename = 4
    [[[rx]]]
        names = power1,power2,power1pluspower2,vrms,t1,t2,t3,t4,t5,t6,pulsecount
        datacodes = h, h, h, h, h, h, h, h, h, h, L
        scales = 1,1,1,0.01,0.1,0.1,0.1,0.1,0.1,0.1,1
        units = W,W,W,V,C,C,C,C,C,C,p

[[5]]
#    nodename = emonpi
    nodename = 5
    [[[rx]]]
        names = power1,power2,power1pluspower2,vrms,t1,t2,t3,t4,t5,t6,pulsecount
        datacodes = h, h, h, h, h, h, h, h, h, h, L
        scales = 1,1,1,0.01,0.1,0.1,0.1,0.1,0.1,0.1,1
#        scales = 1,1,1,0.017,0.1,0.1,0.1,0.1,0.1,0.1,1
        units = W,W,W,V,C,C,C,C,C,C,p

[[6]]
    nodename = emontxshield
    [[[rx]]]
       names = power1, power2, power3, power4, vrms
       datacode = h
       scales = 1,1,1,1,0.01
       units =W,W,W,W,V

[[7]]
   nodename = 7
   [[[rx]]]
      names = power1, power2, power3, power4, vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
      datacodes = h,h,h,h,h,h,h,h,h,h,h,L
      scales = 1,1,1,1,0.01,0.1,0.1, 0.1,0.1,0.1,0.1,1
#      scales = 1,1,1,1,0.0152,0.1,0.1, 0.1,0.1,0.1,0.1,1
      units =W,W,W,W,V,C,C,C,C,C,C,p

[[8]]
    nodename = 8
    [[[rx]]]
       names = power1, power2, power3, power4, vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
       datacodes = h,h,h,h,h,h,h,h,h,h,h,L
       scales = 1,1,1,1,0.01,0.1,0.1, 0.1,0.1,0.1,0.1,1
#3 phase 160A CT, 380V input
#       scales = 6.516,6.516,6.516,6.516,0.0173,0.1,0.1, 0.1,0.1,0.1,0.1,1
       units =W,W,W,W,V,C,C,C,C,C,C,p

[[9]]
   nodename = 9
   [[[rx]]]
      names = power1, power2, power3, power4, vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
      datacode = h
      scales = 1,1,1,1,0.01,0.1,0.1, 0.1,0.1,0.1,0.1,1
      units =W,W,W,W,V,C,C,C,C,C,C,p

[[10]]
    nodename = 10
    [[[rx]]]
       names = power1, power2, power3, power4, vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
       datacode = h
       scales = 1,1,1,1,0.01,0.1,0.1, 0.1,0.1,0.1,0.1,1
       units =W,W,W,W,V,C,C,C,C,C,C,p

[[11]]
    nodename = 3phase
    [[[rx]]]
       names = powerL1, powerL2, powerL3, power4, Vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
       datacodes = h,h,h,h,h,h,h,h,h,h,h,L
       scales = 1,1,1,1,0.01,0.1,0.1,0.1,0.1,0.1,0.1,1
       units =W,W,W,W,V,C,C,C,C,C,C,p
       
[[12]]
    nodename = 3phase2
    [[[rx]]]
       names = powerL1, powerL2, powerL3, power4, Vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
       datacodes = h,h,h,h,h,h,h,h,h,h,h,L
       scales = 1,1,1,1,0.01,0.1,0.1,0.1,0.1,0.1,0.1,1
       units =W,W,W,W,V,C,C,C,C,C,C,p

[[13]]
    nodename = 3phase3
    [[[rx]]]
       names = powerL1, powerL2, powerL3, power4, Vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
       datacodes = h,h,h,h,h,h,h,h,h,h,h,L
       scales = 1,1,1,1,0.01,0.1,0.1,0.1,0.1,0.1,0.1,1
       units =W,W,W,W,V,C,C,C,C,C,C,p

[[14]]
    nodename = 3phase4
    [[[rx]]]
       names = powerL1, powerL2, powerL3, power4, Vrms, temp1, temp2, temp3, temp4, temp5, temp6, pulse
       datacodes = h,h,h,h,h,h,h,h,h,h,h,L
       scales = 1,1,1,1,0.01,0.1,0.1,0.1,0.1,0.1,0.1,1
       units =W,W,W,W,V,C,C,C,C,C,C,p

[[19]]
   nodename = emonth1
   [[[rx]]]
      names = temperature, external temperature, humidity, battery
      datacode = h
      scales = 0.1,0.1,0.1,0.1
      units = C,C,%,V

[[20]]
   nodename = emonth2
   [[[rx]]]
      names = temperature, external temperature, humidity, battery
      datacode = h
      scales = 0.1,0.1,0.1,0.1
      units = C,C,%,V

[[21]]
   nodename = emonth3
   [[[rx]]]
      names = temperature, external temperature, humidity, battery
      datacode = h
      scales = 0.1,0.1,0.1,0.1
      units = C,C,%,V

[[22]]
   nodename = emonth4
   [[[rx]]]
      names = temperature, external temperature, humidity, battery
      datacode = h
      scales = 0.1,0.1,0.1,0.1
      units = C,C,%,V

[[23]]
    nodename = emonth5
    [[[rx]]]
       names = temperature, external temperature, humidity, battery, pulsecount
       datacodes = h,h,h,h,L
       scales = 0.1,0.1,0.1,0.1,1
       units = C,C,%,V,p

[[24]]
    nodename = emonth6
    [[[rx]]]
       names = temperature, external temperature, humidity, battery, pulsecount
       datacodes = h,h,h,h,L
       scales = 0.1,0.1,0.1,0.1,1
       units = C,C,%,V,p

[[25]]
    nodename = emonth7
    [[[rx]]]
       names = temperature, external temperature, humidity, battery, pulsecount
       datacodes = h,h,h,h,L
       scales = 0.1,0.1,0.1,0.1,1
       units = C,C,%,V,p

[[26]]
    nodename = emonth8
    [[[rx]]]
       names = temperature, external temperature, humidity, battery, pulsecount
       datacodes = h,h,h,h,L
       scales = 0.1,0.1,0.1,0.1,1
       units = C,C,%,V,p

TrystanLea · 17 January 2019 08:36

Hello @Lycle_Park

Emoncms has a default limit on the maximum number of allowed nodes and I see you have the error in your log:

You can increase this limit in /var/www/emoncms/settings.php e.g:

https://github.com/emoncms/emoncms/blob/master/default.settings.php#L77

Lycle_Park · 17 January 2019 09:01

Thanks, when below value changes, emoncms accepts the data.
$max_node_id_limit = 64;