Emonhub keeps dropping out and needs restarting

Hi Everyone,

I have recently tried setting up a monitoring system for our factory. I wanted to start with a basic 3 phase energy monitor which showed the staff how much we are using to make them more aware of what leaving a machine on costs. We currently use around £300-400 a day.

I’m getting getting good readings but after an hour or so I get an error on the /var/log/emoncms/emoncms.log which then repeats every 30 seconds until I restart the emonhub.

Server Information

Server Information

Services

  • emonhub :- Active Running

  • emoncms_mqtt :- Active Running

  • feedwriter :- Active Running - sleep 100s 851 feed points pending write

  • service-runner :- Active Running

  • emonPiLCD :- Failed Failed

  • redis-server :- Active Running

  • mosquitto :- Active Running

  • demandshaper :- Active Running

Emoncms

Server

  • OS :- Linux 5.10.17-v7l+
  • Host :- emonpi | emonpi | (192.168.1.234)
  • Date :- 2022-03-31 10:44:12 BST
  • Uptime :- 10:44:12 up 16 days, 19:09, 1 user, load average: 0.13, 0.20, 0.09

Memory

  • RAM :- Used: 22.59%
    • Total :- 854.53 MB
    • Used :- 193.04 MB
    • Free :- 661.48 MB
  • Swap :- Used: 0.00%
    • Total :- 100 MB
    • Used :- 0 B
    • Free :- 100 MB
      Write Load Period

Disk

  • / :- Used: 49.42%
    • Total :- 4.07 GB
    • Used :- 2.01 GB
    • Free :- 1.86 GB
    • Write Load :- 876 B/s (5 days 23 hours 2 mins)
  • /boot :- Used: 18.90%
    • Total :- 252.05 MB
    • Used :- 47.65 MB
    • Free :- 204.4 MB
    • Write Load :- 0 B/s (5 days 23 hours 2 mins)
  • /var/opt/emoncms :- Used: 0.42%
    • Total :- 9.84 GB
    • Used :- 42.41 MB
    • Free :- 9.3 GB
    • Write Load :- 58.16 B/s (5 days 23 hours 2 mins)
  • /var/log :- Used: 24.40%
    • Total :- 50 MB
    • Used :- 12.2 MB
    • Free :- 37.8 MB
    • Write Load :- n/a

HTTP

  • Server :- Apache/2.4.38 (Raspbian) HTTP/1.1 CGI/1.1 80

MySQL

  • Version :- 5.5.5-10.3.29-MariaDB-0+deb10u1
  • Host :- 127.0.0.1 (127.0.0.1)
  • Date :- 2022-03-31 10:44:12 (UTC 01:00‌​)
  • Stats :- Uptime: 1452398 Threads: 13 Questions: 1699623 Slow queries: 0 Opens: 50 Flush tables: 1 Open tables: 40 Queries per second avg: 1.170

Redis

  • Version :-
    • Redis Server :- 5.0.3
    • PHP Redis :- 5.3.4
  • Host :- localhost:6379
  • Size :- 170 keys (761.45K)
  • Uptime :- 16 days

MQTT Server

  • Version :- Mosquitto 1.5.7
  • Host :- localhost:1883 (127.0.0.1)

PHP

  • Version :- 7.3.29-1~deb10u1 (Zend Version 3.3.29)
  • Modules :- apache2handlercalendar Core ctype curl date dom v20031129exif fileinfo filter ftp gd gettext hash iconv json v1.7.0libxml mbstring mosquitto v0.4.0mysqli mysqlnd vmysqlnd 5.0.12-dev - 20150407 - $Id: 7cc7cc96e675f6d72e5cf0f267f48e167c2abb23 $openssl pcre PDO pdo_mysql Phar posix readline redis v5.3.4Reflection session shmop SimpleXML sockets sodium SPL standard sysvmsg sysvsem sysvshm tokenizer wddx xml xmlreader xmlwriter xsl Zend OPcache zlib
Client Information

Client Information

HTTP

  • Browser :- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.82 Safari/537.36
  • Language :- en-GB,en-US;q=0.9,en;q=0.8

Window

  • Size :- 1903 x 969

Screen

  • Resolution :- 1920 x 1080
<details><summary>LAST ENTRIES ON THE LOG FILE</summary><br />
2022-03-31 08:03:00.043|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:03:30.148|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:04:00.247|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:04:30.361|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:05:00.459|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:05:30.558|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:56:54.279|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:57:24.405|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:57:54.497|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:58:24.584|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:58:54.673|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:59:24.766|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 08:59:54.891|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:00:25.007|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:00:55.102|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:01:25.196|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:01:55.286|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:02:25.379|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:02:55.472|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:03:25.570|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:03:55.688|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:04:25.786|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:04:55.885|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:05:25.982|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1<br />
2022-03-31 09:05:56.093|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1</details><br />

This is the emonhub log before and after the restart.

2022-03-30 06:20:22,279 DEBUG    emoncmsorg Buffer size: 8549
2022-03-30 06:20:22,284 INFO     emoncmsorg sending: http://localhost/emoncms/input/bulk.json? data=[[1648572047.7453237,11,256.54,255.6,257.43,-404,-95.12,5.84,2.889,3.623,3.847,0.206,0.55,0.1,0.01],[1648572052.8674855,11,256.31,255.79,257.52,-409.76,-93,-199.31,2.868,3.591,3.086,0.191,0.56,0.1,0.25],[1648572058.0896118,11,256.37,255.98,257.54,-389.82,-90.42,-188.63,2.87,3.588,2.96,0.204,0.53,0.1,0.25],[1648572063.410853,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.193,NaN,NaN,NaN],[1648572068.9351869,11,256.61,255.75,257.61,-397.54,-100.63,-178.39,2.89,3.611,2.989,0.197,0.54,0.11,0.23],[1648572074.1575587,11,256.14,255.9,257.52,-379.43,-94.87,-169.37,2.787,3.614,3.017,0.206,0.53,0.1,0.22],[1648572079.3802354,11,256.9,255.85,257.53,-403.67,-97.94,-183.21,2.829,3.562,3.089,0.205,0.56,0.11,0.23],[1648572084.702337,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.196,NaN,NaN,NaN],[1648572089.925219,11,256.6,255.53,257.22,-416.37,-92.53,-174.3,2.915,3.856,3.119,0.189,0.56,0.09,0.22],[1648572094.9467957,11,256.58,256.11,257.5,-389.46,-84.61,-184.31,2.8,3.962,3.007,0.195,0.54,0.08,0.24],[1648572100.1704621,11,256.65,255.62,257.58,-396.92,-97.31,-172.36,2.852,3.954,3.025,0.196,0.54,0.1,0.22],[1648572105.3939476,11,256.05,255.49,257.13,-409.04,-98.79,-221.28,2.9,3.958,2.848,0.208,0.55,0.1,0.3],[1648572110.6170843,11,256.25,255.62,257.1,-380.52,-108.03,-36.75,2.824,4.008,3.618,0.204,0.53,0.11,0.04],[1648572115.8386872,11,256.14,255.57,257.34,-363.11,-91.45,-225.83,2.728,3.971,2.844,0.201,0.52,0.09,0.31],[1648572121.160932,11,256.48,255.52,257.34,-379.98,-99.53,-230.39,2.85,3.991,2.873,0.198,0.52,0.1,0.31],[1648572126.7840643,11,256.05,255.53,257.31,-370.67,-107.63,-215.4,2.82,4.051,2.816,0.203,0.51,0.1,0.3],[1648572132.0061994,11,255.79,255.48,257.02,-377.5,-109.7,-207.56,2.8,3.983,2.945,0.192,0.53,0.11,0.27],[1648572137.2264848,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.195,NaN,NaN,NaN],[1648572142.24893,11,256.22,255.48,256.9,-344.5,-106.09,-292.98,2.687,3.939,2.585,0.198,0.5,0.11,0.44],[1648572147.271995,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.199,NaN,NaN,NaN],[1648572153.0054877,11,256.59,255.51,257.3,-359.1,-104.4,-100,2.743,3.929,2.863,0.194,0.51,0.1,0.14],[1648572158.636167,11,256.11,255.28,256.9,-375.65,-100.6,-227.88,2.801,3.948,2.45,0.185,0.52,0.1,0.36],[1648572164.1655068,11,255.62,255.97,257.41,-357.63,-106.68,-231.66,2.782,3.963,2.451,0.191,0.5,0.11,0.37],[1648572169.6919894,11,256.13,255.27,257.03,-355.12,-99.82,-236.7,2.753,3.931,2.498,0.195,0.5,0.1,0.37],[1648572175.4215539,11,256.22,255.48,257.38,-353.59,-95.59,-234.23,2.8,3.946,2.456,0.208,0.49,0.09,0.37],[1648572180.9485283,11,256.55,255.84,257.27,-373.12,-106.07,-237.98,2.769,3.931,2.49,0.194,0.53,0.11,0.37],[1648572186.2773647,11,255.92,255.49,257.18,-372.57,-104.78,-239.5,2.866,3.944,2.495,0.194,0.51,0.1,0.37],[1648572191.9046,11,255.38,254.91,256.68,-344.19,-99.49,-235.09,2.757,3.978,2.462,0.19,0.49,0.1,0.37],[1648572197.03038,11,255.41,254.8,256.47,-366.86,-103.3,-232.63,2.814,3.926,2.509,0.2,0.51,0.1,0.36],[1648572202.2624478,11,255.96,256.04,257.41,-356.65,-99.12,-245.58,2.777,3.914,2.475,0.192,0.5,0.1,0.39],[1648572207.8909123,11,255.81,254.48,256.57,-341.23,-103.99,-223.58,2.672,3.908,2.482,0.201,0.5,0.1,0.35],[1648572213.5178845,11,256.08,255.62,257.17,-334.56,-92.26,-240.9,2.736,3.845,2.473,0.197,0.48,0.09,0.38],[1648572218.7435298,11,255.86,255.54,257.07,-334.32,-100.53,-28.42,2.705,3.871,2.946,0.208,0.48,0.1,0.04],[1648572223.9709466,11,256.68,255.28,257.06,-311.03,-87.58,-214.67,2.693,3.789,2.576,0.202,0.45,0.09,0.32],[1648572229.1968186,11,255.76,255.59,257.24,-304.68,-95.9,-205.69,2.681,3.835,2.392,0.194,0.44,0.1,0.33],[1648572234.4257905,11,254.98,254.7,256.44,-318.76,-94.97,-192.43,2.679,3.747,2.559,0.198,0.47,0.1,0.29],[1648572239.451392,11,255.38,255.03,256.52,-284.46,-91.43,-194.37,2.672,3.816,2.424,0.209,0.42,0.09,0.31],[1648572244.6767664,11,255.03,254.95,256.31,-311.92,-84.99,-181.63,2.696,3.719,2.467,0.189,0.45,0.09,0.29],[1648572249.7022047,11,255.11,254.49,255.98,-284.32,-91.46,-184.91,2.647,3.72,2.47,0.206,0.42,0.1,0.29],[1648572254.9264362,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.2,NaN,NaN,NaN],[1648572260.3540974,11,256.1,255.5,256.93,-265.43,-85.08,-186.67,2.629,3.647,2.479,0.199,0.39,0.09,0.29],[1648572265.6827374,11,254.92,254.42,256.24,-293.52,-93.64,-183,2.593,3.67,2.488,0.207,0.44,0.1,0.29],[1648572271.3095393,11,255.62,254.72,256.85,-276.73,-78.66,-192.02,2.638,3.709,2.464,0.2,0.41,0.08,0.3],[1648572276.5326514,11,255.64,255.02,256.82,-275.66,-79.99,-176.33,2.655,3.622,2.544,0.2,0.41,0.09,0.27],[1648572281.764948,11,256.42,255.71,257.07,-294.49,-89.72,-231.19,2.7,3.692,2.39,0.195,0.43,0.1,0.38],[1648572287.39384,11,255.11,254.82,256.29,-285.14,-88.44,-37.4,2.595,3.639,2.974,0.201,0.43,0.1,0.05],[1648572292.8225977,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.198,NaN,NaN,NaN],[1648572298.0518417,11,255.9,255.51,257.04,-286.03,-82.28,-219.02,2.653,3.663,2.377,0.197,0.42,0.09,0.36],[1648572303.2792826,11,254.42,254.61,255.93,-268.38,-88.85,-219.86,2.679,3.676,2.439,0.195,0.39,0.09,0.35],[1648572308.6061275,11,255.19,255.57,256.71,-269.25,-66.31,-235.79,2.596,3.668,2.358,0.194,0.41,0.07,0.39],[1648572313.8349104,11,256.74,255.55,257.36,-280.29,-88.86,-231.2,2.653,3.621,2.523,0.201,0.41,0.1,0.36],[1648572319.4615762,11,255.79,255.5,257.13,-266.94,-87.83,-44.4,2.596,3.67,2.815,0.194,0.4,0.09,0.06],[1648572324.6875858,11,256.5,255.27,256.94,-269.39,-84.58,-233.17,2.599,3.609,2.473,0.198,0.4,0.09,0.37],[1648572330.318117,11,255.85,255.45,257.15,-266.89,-82.84,-226.19,2.667,3.605,2.405,0.185,0.39,0.09,0.37],[1648572335.3411295,11,254.88,254.87,256.53,-271.68,-82.91,-222.01,2.619,3.635,2.42,0.192,0.41,0.09,0.36],[1648572341.0717876,11,255.86,254.79,256.24,-232.81,-75.6,-166.84,2.531,3.601,2.473,0.202,0.36,0.08,0.26],[1648572346.3985543,11,256.01,255.2,256.76,-261.65,-70.82,-172.66,2.577,3.576,2.479,0.201,0.4,0.08,0.27],[1648572351.524529,11,255.7,254.76,256.34,-261.69,-75.86,-165.49,2.583,3.628,2.433,0.201,0.4,0.08,0.27],[1648572357.153516,11,254.79,254.94,256.56,-252.13,-76.35,22.72,2.606,3.559,3.183,0.194,0.38,0.08,0.03],[1648572362.2851162,11,256.48,255.99,257.13,-252.31,-71.1,-163.88,2.587,3.594,2.348,0.204,0.38,0.08,0.27],[1648572368.1188173,11,255.84,254.63,256.5,-259.46,-79.16,-162.03,2.52,3.51,2.571,0.186,0.4,0.09,0.25],[1648572373.345644,11,256.67,255.5,257.14,-247.56,-77.79,-155.29,2.606,3.606,2.371,0.187,0.37,0.08,0.25],[1648572378.9718664,11,256.16,255.1,256.74,-204.17,-75.76,-154.31,2.517,3.476,2.566,0.195,0.32,0.09,0.23],[1648572383.9993434,11,255.8,255.16,256.42,-242.25,-69.37,-145.14,2.629,3.495,2.429,0.187,0.36,0.08,0.23],[1648572389.2286956,11,256.06,254.85,256.99,-182.37,-85.71,-153.63,2.514,3.496,2.474,0.208,0.28,0.1,0.24],[1648572394.4561224,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.204,NaN,NaN,NaN],[1648572399.883752,11,255.48,255.32,256.43,-229.6,-70.13,48.8,2.575,3.451,3.162,0.193,0.35,0.08,0.06],[1648572405.2087212,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.204,NaN,NaN,NaN],[1648572410.8403215,11,255.67,254.7,256.48,-223.38,-69.99,-135.3,2.584,3.398,2.477,0.199,0.34,0.08,0.21],[1648572416.0669658,11,255.41,254.77,256.3,-229.45,-67.87,-137.42,2.528,3.433,2.457,0.197,0.36,0.08,0.22],[1648572421.292883,11,256.37,255.19,256.96,-206.51,-68.19,-134.95,2.525,3.404,2.516,0.202,0.32,0.08,0.21],[1648572426.4226642,11,254.66,255.18,256.5,-207.75,-70.27,-125.72,2.531,3.453,2.431,0.193,0.32,0.08,0.2],[1648572431.6486812,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.209,NaN,NaN,NaN],[1648572437.3782823,11,255.33,254.74,256.25,-191.34,-57.13,-112.78,2.557,3.329,2.42,0.196,0.29,0.07,0.18],[1648572442.5069342,11,255.82,255.17,256.47,-180.66,-56.46,-107.46,2.498,3.318,2.476,0.201,0.28,0.07,0.17],[1648572447.8335342,11,255.55,255.35,256.41,-177.7,-64.67,-96.77,2.538,3.265,2.532,0.191,0.27,0.08,0.15],[1648572453.5666373,11,255.56,254.33,256.27,-145.11,-54.6,-83.26,2.451,3.275,2.459,0.201,0.23,0.07,0.13],[1648572459.2947195,11,255.67,255.45,256.8,-146.72,-53.74,-82.52,2.506,3.134,2.556,0.206,0.23,0.07,0.13],[1648572464.3205469,11,255.5,255.15,256.36,-142.57,-49.33,-67.24,2.493,3.148,2.458,0.19,0.22,0.06,0.11],[1648572469.5463686,11,256.81,255.59,256.96,-136.75,-52.19,-344.95,2.502,3.087,2.75,0.197,0.21,0.07,0.49],[1648572475.1772814,11,255.13,255.13,256.7,-87.67,-44.86,-535.08,2.428,3.074,3.388,0.189,0.14,0.06,0.62],[1648572480.3016722,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.192,NaN,NaN,NaN],[1648572485.5298169,11,256.18,255.47,256.95,-78.38,-41.92,-523.57,2.411,3.008,3.327,0.2,0.13,0.05,0.61],[1648572490.6552694,11,256.09,255.18,256.79,-103.88,-46.9,-513.29,2.477,3.001,3.295,0.191,0.16,0.06,0.61],[1648572495.9824324,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.202,NaN,NaN,NaN],[1648572501.2105746,11,255.97,255.57,257.07,-88.19,-38.83,-515.59,2.425,2.899,3.371,0.2,0.14,0.05,0.6],[1648572506.4373035,11,256.55,255.18,257.07,-71.57,-30.17,-310.16,2.436,2.981,2.534,0.193,0.11,0.04,0.48],[1648572511.5609913,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.188,NaN,NaN,NaN],[1648572516.890247,11,255.66,255.35,257.29,-57.9,-35.42,-487.35,2.382,2.94,3.163,0.2,0.1,0.05,0.6],[1648572522.5176249,11,255.84,255.26,257.06,-51.1,-35.09,-478.17,2.415,2.772,3.247,0.196,0.08,0.05,0.57],[1648572528.2469883,11,256.36,255.16,257.01,-50.14,-38.56,-415.55,2.42,2.897,2.839,0.188,0.08,0.05,0.57],[1648572533.3818142,11,256.16,255.45,256.94,-18.41,-20.82,-419.75,2.359,2.719,2.942,0.198,0.03,0.03,0.56],[1648572538.6078448,11,255.61,255.26,256.85,-26.56,-19.56,-215.08,2.383,2.737,2.411,0.197,0.04,0.03,0.35],[1648572543.8336701,11,256.44,255.5,257.14,-19.93,-19.46,-392.76,2.425,2.682,2.806,0.196,0.03,0.03,0.54],[1648572549.3639104,11,256.42,255.08,257.12,28.09,-9.74,-400.18,2.429,2.648,2.811,0.188,0.05,0.01,0.55],[1648572554.5913334,11,255.72,255.37,256.94,3.23,-8.62,-391.57,2.505,2.56,2.804,0.193,0.01,0.01,0.54],[1648572560.3219674,11,256.42,255.41,257.06,17.9,-7.07,-369.45,2.474,2.586,2.657,0.197,0.03,0.01,0.54],[1648572565.5476692,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.201,NaN,NaN,NaN],[1648572570.7770174,11,256.22,255.29,256.96,24.98,-19.04,-175.06,2.507,2.661,2.196,0.191,0.04,0.03,0.31],[1648572576.1019363,11,256.45,255.52,257.23,34.72,-11.31,-367.43,2.495,2.476,2.77,0.201,0.05,0.02,0.52]]&sentat=1648617622&apikey=E-M-O-N-C-M-S-A-P-I-K-E-Y
2022-03-30 06:20:22,314 WARNING  emoncmsorg send failure: wanted 'ok' but got '<br />
<b>Warning</b>:  count(): Parameter must be an array or an object that implements Countable in <b>/var/www/emoncms/Modules/input/input_methods.php</b> on line <b>216</b><br />
{"success": false, "message": "Format error, json string supplied is not valid"}'
2022-03-30 06:20:25,055 DEBUG    SerialDirect 10835 NEW FRAME : 11 253.35 252.77 254.15 1188.68 1826.44 -102.98 5.052 7.498 5.343 0.197 0.93 0.96 0.08
2022-03-30 06:20:25,056 DEBUG    SerialDirect 10835 Timestamp : 1648617625.055087
2022-03-30 06:20:25,056 DEBUG    SerialDirect 10835 From Node : 11
2022-03-30 06:20:25,057 DEBUG    SerialDirect 10835    Values : [253.35, 252.77, 254.15, 1188.68, 1826.44, -102.98, 5.052, 7.498, 5.343, 0.197, 0.93, 0.96, 0.08]
2022-03-30 06:20:25,057 DEBUG    SerialDirect 10835 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:20:25,057 DEBUG    SerialDirect 10835 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:20:30,280 DEBUG    SerialDirect 10836 NEW FRAME : 11 252.37 252.26 253.77 1178.99 1811.68 -100.46 5.035 7.472 5.358 0.192 0.93 0.96 0.07
2022-03-30 06:20:30,281 DEBUG    SerialDirect 10836 Timestamp : 1648617630.280524
2022-03-30 06:20:30,282 DEBUG    SerialDirect 10836 From Node : 11
2022-03-30 06:20:30,282 DEBUG    SerialDirect 10836    Values : [252.37, 252.26, 253.77, 1178.99, 1811.68, -100.46, 5.035, 7.472, 5.358, 0.192, 0.93, 0.96, 0.07]
2022-03-30 06:20:30,283 DEBUG    SerialDirect 10836 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:20:30,283 DEBUG    SerialDirect 10836 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:20:35,507 DEBUG    SerialDirect 10837 NEW FRAME : 11 252.96 252.07 253.53 1178.02 1807.19 -97.01 5.022 7.460 5.372 0.198 0.93 0.96 0.07
2022-03-30 06:20:35,508 DEBUG    SerialDirect 10837 Timestamp : 1648617635.507628
2022-03-30 06:20:35,509 DEBUG    SerialDirect 10837 From Node : 11
2022-03-30 06:20:35,509 DEBUG    SerialDirect 10837    Values : [252.96, 252.07, 253.53, 1178.02, 1807.19, -97.01, 5.022, 7.46, 5.372, 0.198, 0.93, 0.96, 0.07]
2022-03-30 06:20:35,510 DEBUG    SerialDirect 10837 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:20:35,510 DEBUG    SerialDirect 10837 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:20:40,735 DEBUG    SerialDirect 10838 NEW FRAME : 11 253.52 252.84 254.20 1168.07 1806.95 -98.32 4.967 7.442 5.355 0.211 0.93 0.96 0.07
2022-03-30 06:20:40,736 DEBUG    SerialDirect 10838 Timestamp : 1648617640.735302
2022-03-30 06:20:40,736 DEBUG    SerialDirect 10838 From Node : 11
2022-03-30 06:20:40,737 DEBUG    SerialDirect 10838    Values : [253.52, 252.84, 254.2, 1168.07, 1806.95, -98.32, 4.967, 7.442, 5.355, 0.211, 0.93, 0.96, 0.07]
2022-03-30 06:20:40,737 DEBUG    SerialDirect 10838 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:20:40,738 DEBUG    SerialDirect 10838 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:20:46,356 DEBUG    SerialDirect 10839 NEW FRAME : 11 252.84 252.16 253.46 1180.69 1791.19 -99.97 5.031 7.410 5.356 0.204 0.93 0.96 0.07
2022-03-30 06:20:46,356 DEBUG    SerialDirect 10839 Timestamp : 1648617646.356355
2022-03-30 06:20:46,357 DEBUG    SerialDirect 10839 From Node : 11
2022-03-30 06:20:46,357 DEBUG    SerialDirect 10839    Values : [252.84, 252.16, 253.46, 1180.69, 1791.19, -99.97, 5.031, 7.41, 5.356, 0.204, 0.93, 0.96, 0.07]
2022-03-30 06:20:46,357 DEBUG    SerialDirect 10839 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:20:46,357 DEBUG    SerialDirect 10839 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:20:51,989 DEBUG    SerialDirect 10840 NEW FRAME : 11 253.58 252.44 254.03 1177.34 1783.01 -101.55 4.980 7.370 5.305 0.192 0.93 0.96 0.08
2022-03-30 06:20:51,990 DEBUG    SerialDirect 10840 Timestamp : 1648617651.989702
2022-03-30 06:20:51,991 DEBUG    SerialDirect 10840 From Node : 11
2022-03-30 06:20:51,991 DEBUG    SerialDirect 10840    Values : [253.58, 252.44, 254.03, 1177.34, 1783.01, -101.55, 4.98, 7.37, 5.305, 0.192, 0.93, 0.96, 0.08]
2022-03-30 06:20:51,992 DEBUG    SerialDirect 10840 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:20:51,992 DEBUG    SerialDirect 10840 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:20:52,113 DEBUG    MainThread Signal 15 received.
2022-03-30 06:20:52,184 INFO     MainThread Exiting hub...
2022-03-30 06:20:52,275 INFO     MainThread Exit completed
2022-03-30 06:20:53,218 INFO     MainThread EmonHub emonHub (emon-pi variant) v2.2.6
2022-03-30 06:20:53,218 INFO     MainThread Opening hub...
2022-03-30 06:20:53,219 INFO     MainThread Logging level set to DEBUG
2022-03-30 06:20:53,219 INFO     MainThread Creating EmonHubSerialInterfacer 'SerialDirect'
2022-03-30 06:20:53,220 DEBUG    MainThread Opening serial port: /dev/ttyAMA0 @ 38400 bits/s
2022-03-30 06:20:53,220 DEBUG    MainThread Setting SerialDirect pubchannels: ['ToEmonCMS']
2022-03-30 06:20:53,221 INFO     MainThread Creating EmonHubEmoncmsHTTPInterfacer 'emoncmsorg'
2022-03-30 06:20:53,221 DEBUG    MainThread Setting emoncmsorg subchannels: ['ToEmonCMS']
2022-03-30 06:20:53,222 INFO     MainThread Setting emoncmsorg apikey: set
2022-03-30 06:20:53,222 INFO     MainThread Setting emoncmsorg url: http://localhost/emoncms
2022-03-30 06:20:53,222 INFO     MainThread Setting emoncmsorg senddata: 1
2022-03-30 06:20:53,222 INFO     MainThread Setting emoncmsorg sendstatus: 1
2022-03-30 06:20:57,639 DEBUG    SerialDirect 1 NEW FRAME : 11 252.95 251.78 253.53 1161.43 1779.92 -101.34 4.955 7.389 5.348 0.198 0.93 0.96 0.07
2022-03-30 06:20:57,640 DEBUG    SerialDirect 1 Timestamp : 1648617657.638978
2022-03-30 06:20:57,640 DEBUG    SerialDirect 1 From Node : 11
2022-03-30 06:20:57,640 DEBUG    SerialDirect 1    Values : [252.95, 251.78, 253.53, 1161.43, 1779.92, -101.34, 4.955, 7.389, 5.348, 0.198, 0.93, 0.96, 0.07]
2022-03-30 06:20:57,641 DEBUG    SerialDirect 1 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:20:57,641 DEBUG    SerialDirect 1 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:20:57,832 DEBUG    emoncmsorg Buffer size: 1
2022-03-30 06:20:57,833 INFO     emoncmsorg sending: http://localhost/emoncms/input/bulk.json? data=[[1648617657.638978,11,252.95,251.78,253.53,1161.43,1779.92,-101.34,4.955,7.389,5.348,0.198,0.93,0.96,0.07]]&sentat=1648617657&apikey=E-M-O-N-C-M-S-A-P-I-K-E-Y
2022-03-30 06:20:57,936 DEBUG    emoncmsorg acknowledged receipt with 'ok' from http://localhost/emoncms
2022-03-30 06:21:02,862 DEBUG    SerialDirect 2 NEW FRAME : 11 253.59 252.64 254.23 1172.10 1784.83 325.00 5.000 7.385 8.148 0.195 0.92 0.96 0.16
2022-03-30 06:21:02,864 DEBUG    SerialDirect 2 Timestamp : 1648617662.862781
2022-03-30 06:21:02,864 DEBUG    SerialDirect 2 From Node : 11
2022-03-30 06:21:02,864 DEBUG    SerialDirect 2    Values : [253.59, 252.64, 254.23, 1172.1, 1784.83, 325, 5, 7.385, 8.148, 0.195, 0.92, 0.96, 0.16]
2022-03-30 06:21:02,865 DEBUG    SerialDirect 2 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:21:02,865 DEBUG    SerialDirect 2 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:21:08,086 DEBUG    SerialDirect 3 NEW FRAME : 11 253.35 252.59 254.13 1161.48 1776.44 322.76 4.943 7.353 8.145 0.197 0.93 0.96 0.16
2022-03-30 06:21:08,087 DEBUG    SerialDirect 3 Timestamp : 1648617668.086312
2022-03-30 06:21:08,087 DEBUG    SerialDirect 3 From Node : 11
2022-03-30 06:21:08,088 DEBUG    SerialDirect 3    Values : [253.35, 252.59, 254.13, 1161.48, 1776.44, 322.76, 4.943, 7.353, 8.145, 0.197, 0.93, 0.96, 0.16]
2022-03-30 06:21:08,088 DEBUG    SerialDirect 3 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:21:08,089 DEBUG    SerialDirect 3 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:21:13,308 DEBUG    SerialDirect 4 NEW FRAME : 11 252.35 251.51 253.30 1166.25 1760.94 318.06 4.984 7.330 8.160 0.193 0.93 0.96 0.15
2022-03-30 06:21:13,309 DEBUG    SerialDirect 4 Timestamp : 1648617673.308200
2022-03-30 06:21:13,309 DEBUG    SerialDirect 4 From Node : 11
2022-03-30 06:21:13,310 DEBUG    SerialDirect 4    Values : [252.35, 251.51, 253.3, 1166.25, 1760.94, 318.06, 4.984, 7.33, 8.16, 0.193, 0.93, 0.96, 0.15]
2022-03-30 06:21:13,310 DEBUG    SerialDirect 4 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:21:13,311 DEBUG    SerialDirect 4 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:21:18,532 DEBUG    SerialDirect 5 NEW FRAME : 11 252.30 251.54 253.14 1150.21 1756.98 323.37 4.959 7.320 8.155 0.220 0.92 0.95 0.16
2022-03-30 06:21:18,533 DEBUG    SerialDirect 5 Timestamp : 1648617678.532565
2022-03-30 06:21:18,533 DEBUG    SerialDirect 5 From Node : 11
2022-03-30 06:21:18,533 DEBUG    SerialDirect 5    Values : [252.3, 251.54, 253.14, 1150.21, 1756.98, 323.37, 4.959, 7.32, 8.155, 0.22, 0.92, 0.95, 0.16]
2022-03-30 06:21:18,533 DEBUG    SerialDirect 5 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:21:18,534 DEBUG    SerialDirect 5 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:21:23,649 DEBUG    SerialDirect 6 NEW FRAME : 11 253.26 252.52 253.87 1193.31 1762.90 316.65 5.093 7.304 8.105 0.199 0.93 0.96 0.15
2022-03-30 06:21:23,650 DEBUG    SerialDirect 6 Timestamp : 1648617683.649433
2022-03-30 06:21:23,650 DEBUG    SerialDirect 6 From Node : 11
2022-03-30 06:21:23,650 DEBUG    SerialDirect 6    Values : [253.26, 252.52, 253.87, 1193.31, 1762.9, 316.65, 5.093, 7.304, 8.105, 0.199, 0.93, 0.96, 0.15]
2022-03-30 06:21:23,650 DEBUG    SerialDirect 6 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:21:23,650 DEBUG    SerialDirect 6 Sent to channel(end)' : ToEmonCMS
2022-03-30 06:21:27,996 DEBUG    emoncmsorg Buffer size: 5
2022-03-30 06:21:27,998 INFO     emoncmsorg sending: http://localhost/emoncms/input/bulk.json? data=[[1648617662.8627813,11,253.59,252.64,254.23,1172.1,1784.83,325,5,7.385,8.148,0.195,0.92,0.96,0.16],[1648617668.0863118,11,253.35,252.59,254.13,1161.48,1776.44,322.76,4.943,7.353,8.145,0.197,0.93,0.96,0.16],[1648617673.3082004,11,252.35,251.51,253.3,1166.25,1760.94,318.06,4.984,7.33,8.16,0.193,0.93,0.96,0.15],[1648617678.5325654,11,252.3,251.54,253.14,1150.21,1756.98,323.37,4.959,7.32,8.155,0.22,0.92,0.95,0.16],[1648617683.6494327,11,253.26,252.52,253.87,1193.31,1762.9,316.65,5.093,7.304,8.105,0.199,0.93,0.96,0.15]]&sentat=1648617687&apikey=E-M-O-N-C-M-S-A-P-I-K-E-Y
2022-03-30 06:21:28,203 DEBUG    emoncmsorg acknowledged receipt with 'ok' from http://localhost/emoncms
2022-03-30 06:21:28,868 DEBUG    SerialDirect 7 NEW FRAME : 11 253.06 252.33 253.89 1164.02 1775.00 333.50 4.987 7.363 8.141 0.213 0.92 0.96 0.16
2022-03-30 06:21:28,869 DEBUG    SerialDirect 7 Timestamp : 1648617688.868627
2022-03-30 06:21:28,870 DEBUG    SerialDirect 7 From Node : 11
2022-03-30 06:21:28,870 DEBUG    SerialDirect 7    Values : [253.06, 252.33, 253.89, 1164.02, 1775, 333.5, 4.987, 7.363, 8.141, 0.213, 0.92, 0.96, 0.16]
2022-03-30 06:21:28,870 DEBUG    SerialDirect 7 Sent to channel(start)' : ToEmonCMS
2022-03-30 06:21:28,871 DEBUG    SerialDirect 7 Sent to channel(end)' : ToEmonCMS

any advice on changes i need to make so that this can be rectified so it doesn’t need restarting after a NaN value. Thanks in advance for any suggestions as my coding knowledge is fairly basic.

That’s very odd.
Just a couple of comments -
The emoncmsorg sending http calls are very long. Not sure if that has something to do with it.
Then there is this -
[1648572084.702337,11,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,0.196,NaN,NaN,NaN]
in the data. I would guess that’s the issue, I’ve had issues with sending non-numeric data to EmonHub before.
Where’s this data coming from?

What hardware are you using? It looks like an something connected via a serial link?

That looks like it lost network connectivity and buffered the data for emoncms.

[edit]
BTW, those 2 sets of timestamps don’t match - be useful if the logs were from the same period.

It is the start of the error period that is interesting, what happened before to cause the issue.