Requested feed does not exist - Dashboard is empty and feed page stuck in Loading

Hi guys. I am having some weird issue with my emoncms feeds page. Before I proceed a bit of an intro to my configuration.

I have the raspberry pi 3 connected to 3 victron devices via serial to usb cable. I setup emonhub with the appropriate interfacer config and all that works fine. The RPi is based on the latest stable emonsd image.

I also created an emoncms instance on my VPS and pointed emonhub to put data to this emoncms instance installed to the cloud. All was well with the world and I had no issue.

2 days ago while trying to install a graph module on my emoncms installed in the cloud. I did a git pull in the emoncms web root directory which I believe pulled in the latest emoncms files from git. The graph module installed fine without any issues.

However yesterday I started noticing my dashboard was devoid of any data whatsoever. The feed/list page is also stuck in loading. Weirdly though. The dashboard works fine from my android device with chome browser (I run Kubuntu on my laptop with chromium) but the feeds page also does not load on the phone…

Below are some log/ debug outputs and also some information about my version of emoncms

Server Information

Server Information
Emoncms Version 9.8.31 : 2018.06.21
Modules Administration : App v1.1.0 : Dashboard v1.2.0 : EventProcesses : Feed : Graph v1.2.0 : Input : CoreProcess : Schedule : Time : User : Visualisation
Server OS Linux 4.15.13-x86_64-linode106
Host martians.com.ng martians.com.ng (178.79.152.229)
Date 2018-07-05 07:10:07 UTC
Uptime 07:10:07 up 42 days, 22:04, 2 users, load average: 0.00, 0.00, 0.00
HTTP Server Johnny Walker HTTP/1.1 CGI/1.1 80
MySQL Version 5.7.22-0ubuntu0.16.04.1-log
Host localhost (127.0.0.1)
Date 2018-07-05 07:10:07 (UTC 00:00‌​)
Stats Uptime: 3708293 Threads: 1 Questions: 36345856 Slow queries: 0 Opens: 54082 Flush tables: 1 Open tables: 416 Queries per second avg: 9.801
Redis Version 3.0.6
Host localhost:6379 (127.0.0.1)
Size 138 keys (448.34K)
Uptime 31 days
Memory RAM Used: 38.07% Total: 1.94 GB Used: 756.79 MB Free: 1.2 GB
Swap Used: 25.29% Total: 512 MB Used: 129.5 MB Free: 382.5 MB
Disk Mount Stats
/ Used: 65.49% Total: 22.56 GB Used: 14.77 GB Free: 7.1 GB
/run/cgmanager/fs Used: 0.00% Total: 100 KB Used: 0 B Free: 100 KB
PHP Version 7.0.30-0ubuntu0.16.04.1 (Zend Version 3.0.0)
Modules apache2handler : apcu v5.1.3 : calendar v7.0.30-0ubuntu0.16.04.1 : Core v7.0.30-0ubuntu0.16.04.1 : ctype v7.0.30-0ubuntu0.16.04.1 : curl v7.0.30-0ubuntu0.16.04.1 : date v7.0.30-0ubuntu0.16.04.1 : dom v20031129 : exif v7.0.30-0ubuntu0.16.04.1 : fileinfo v1.0.5 : filter v7.0.30-0ubuntu0.16.04.1 : ftp v7.0.30-0ubuntu0.16.04.1 : gd v7.0.30-0ubuntu0.16.04.1 : gettext v7.0.30-0ubuntu0.16.04.1 : hash v1.0 : iconv v7.0.30-0ubuntu0.16.04.1 : json v1.4.0 : libxml v7.0.30-0ubuntu0.16.04.1 : mbstring v7.0.30-0ubuntu0.16.04.1 : mcrypt v7.0.30-0ubuntu0.16.04.1 : mysqli v7.0.30-0ubuntu0.16.04.1 : mysqlnd vmysqlnd 5.0.12-dev - 20150407 - $Id: b5c5906d452ec590732a93b051f3827e02749b83 $ : openssl v7.0.30-0ubuntu0.16.04.1 : pcre v7.0.30-0ubuntu0.16.04.1 : PDO v7.0.30-0ubuntu0.16.04.1 : pdo_mysql v7.0.30-0ubuntu0.16.04.1 : Phar v2.0.2 : posix v7.0.30-0ubuntu0.16.04.1 : readline v7.0.30-0ubuntu0.16.04.1 : redis v4.0.2 : Reflection v7.0.30-0ubuntu0.16.04.1 : session v7.0.30-0ubuntu0.16.04.1 : shmop v7.0.30-0ubuntu0.16.04.1 : SimpleXML v7.0.30-0ubuntu0.16.04.1 : sockets v7.0.30-0ubuntu0.16.04.1 : SPL v7.0.30-0ubuntu0.16.04.1 : standard v7.0.30-0ubuntu0.16.04.1 : sysvmsg v7.0.30-0ubuntu0.16.04.1 : sysvsem v7.0.30-0ubuntu0.16.04.1 : sysvshm v7.0.30-0ubuntu0.16.04.1 : tokenizer v7.0.30-0ubuntu0.16.04.1 : wddx v7.0.30-0ubuntu0.16.04.1 : xml v7.0.30-0ubuntu0.16.04.1 : xmlreader v7.0.30-0ubuntu0.16.04.1 : xmlwriter v7.0.30-0ubuntu0.16.04.1 : xsl v7.0.30-0ubuntu0.16.04.1 : Zend OPcache v7.0.30-0ubuntu0.16.04.1 : zlib v7.0.30-0ubuntu0.16.04.1

Client Information
HTTP Browser Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/66.0.3359.181 Chrome/66.0.3359.181 Safari/537.36
Screen Resolution 1366 x 768
Window Size 1351 x 637

/var/log/emoncms.log

2018-07-02 20:01:58.102|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-02 20:01:58.517|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 00:57:25.617|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 06:39:44.738|ERROR|input_controller.php|{"success": false, "message": "Format error, json string supplied is not valid"} for User: 1
2018-07-03 06:55:54.065|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 06:55:55.041|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 09:29:01.640|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 11:56:59.051|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 11:56:59.230|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 12:39:24.870|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 13:07:33.288|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-03 13:07:34.762|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 07:42:56.760|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 07:42:57.482|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 08:03:03.243|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 08:03:03.438|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 08:08:30.819|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 08:08:31.924|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 22:42:35.843|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-04 22:42:38.596|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-05 02:43:41.765|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=3
2018-07-05 06:21:34.827|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=0

emoncms feed json file seems to load fine http://energy.bobby.com.ng/feed/list.json

when I load the feed page with developer tools on chromium I get the following

table.js:143 Uncaught TypeError: Cannot read property 'draw' of undefined
    at Object.draw_row (table.js:143)
    at Object.draw_internal (table.js:94)
    at Object.draw (table.js:38)
    at Object.success (list:482)
    at j (jquery-1.11.3.min.js:2)
    at Object.fireWith [as resolveWith] (jquery-1.11.3.min.js:2)
    at x (jquery-1.11.3.min.js:5)
    at XMLHttpRequest.b (jquery-1.11.3.min.js:5)
draw_row @ table.js:143
draw_internal @ table.js:94
draw @ table.js:38
success @ list:482
j @ jquery-1.11.3.min.js:2
fireWith @ jquery-1.11.3.min.js:2
x @ jquery-1.11.3.min.js:5
b @ jquery-1.11.3.min.js:5
process_ui.js:23 contextid=0
process_ui.js:24 contextprocesslist=
table.js:143 Uncaught TypeError: Cannot read property 'draw' of undefined
    at Object.draw_row (table.js:143)
    at Object.draw_internal (table.js:94)
    at Object.draw (table.js:38)
    at Object.initprogress (process_ui.js:795)
    at Object.success (process_ui.js:727)
    at j (jquery-1.11.3.min.js:2)
    at Object.fireWith [as resolveWith] (jquery-1.11.3.min.js:2)
    at x (jquery-1.11.3.min.js:5)
    at XMLHttpRequest.b (jquery-1.11.3.min.js:5)
draw_row @ table.js:143
draw_internal @ table.js:94
draw @ table.js:38
initprogress @ process_ui.js:795
success @ process_ui.js:727
j @ jquery-1.11.3.min.js:2
fireWith @ jquery-1.11.3.min.js:2
x @ jquery-1.11.3.min.js:5
b @ jquery-1.11.3.min.js:5
4table.js:143 Uncaught TypeError: Cannot read property 'draw' of undefined
    at Object.draw_row (table.js:143)
    at Object.draw_internal (table.js:94)
    at Object.draw (table.js:38)
    at Object.success (list:482)
    at j (jquery-1.11.3.min.js:2)
    at Object.fireWith [as resolveWith] (jquery-1.11.3.min.js:2)
    at x (jquery-1.11.3.min.js:5)
    at XMLHttpRequest.b (jquery-1.11.3.min.js:5)
draw_row @ table.js:143
draw_internal @ table.js:94
draw @ table.js:38
success @ list:482
j @ jquery-1.11.3.min.js:2
fireWith @ jquery-1.11.3.min.js:2
x @ jquery-1.11.3.min.js:5
b @ jquery-1.11.3.min.js:5
20table.js:143 Uncaught TypeError: Cannot read property 'draw' of undefined
    at Object.draw_row (table.js:143)
    at Object.draw_internal (table.js:94)
    at Object.draw (table.js:38)
    at Object.success (list:482)
    at j (jquery-1.11.3.min.js:2)
    at Object.fireWith [as resolveWith] (jquery-1.11.3.min.js:2)
    at x (jquery-1.11.3.min.js:5)
    at XMLHttpRequest.b (jquery-1.11.3.min.js:5)
11table.js:143 Uncaught TypeError: Cannot read property 'draw' of undefined
    at Object.draw_row (table.js:143)
    at Object.draw_internal (table.js:94)
    at Object.draw (table.js:38)
    at Object.success (list:482)
    at j (jquery-1.11.3.min.js:2)
    at Object.fireWith [as resolveWith] (jquery-1.11.3.min.js:2)
    at x (jquery-1.11.3.min.js:5)
    at XMLHttpRequest.b (jquery-1.11.3.min.js:5)
draw_row @ table.js:143
draw_internal @ table.js:94
draw @ table.js:38
success @ list:482
j @ jquery-1.11.3.min.js:2
fireWith @ jquery-1.11.3.min.js:2
x @ jquery-1.11.3.min.js:5
b @ jquery-1.11.3.min.js:5
XMLHttpRequest.send (async)
send @ jquery-1.11.3.min.js:5
ajax @ jquery-1.11.3.min.js:5
update @ list:474

what I have done and checked

Time stamp on the emoncms and emonpi are the same. The node page loads fine and the nodes are updated every 22 seconds and the values are as it should be. Again athough the feed page does not load on my mobile phone, the dashboard and all the values works fine on the phone browser.

What could be wrong with the emoncms. Could the latest update from git have broken something?

It seems for some reasons, emoncms is requesting for a feedid that does not or never existed. could this be as a result of update I ran? I don’t know much about emoncms internal working or programming for that matter, but it seems emoncms tries to load feeds are don’t exist and is thus through that error. I can recreate the error if I try to view the value of feed through json. valid feed values are displayed but when I trying to view feeds with id1 or 0. it throws up the request feed does not exit error.

Did you run a database update?

The more I look at this the more it is obvious that something is seriously broken since I ran the git pull on the emoncms web directory. I just noticed that I can not even create dashboard entries for existing or even new dashbaords… and it is looking more and more that I have to recreate emoncms from scratch!

I think documentation for installing new modules should remove the requirement for updating emoncms via gitpull or better still add a caveat so the user knows the implication. gitpull updates emoncms files to the latest from git… however there is a recommended for upgrading emoncms which requires backing up database and some directories/files all of which I did not do because I followed the documentation for module installation to the letter.

I did.

Don’t get too hasty, it is likely something that can be fixed (though outside my knowledge area) especially as the mobile works. The database is likely to be fine (they are actually just files).

Yes updating can be a little fraught. As with any system a backup is always a good idea :slightly_smiling_face:.

Have you tried building a new dashboard and visualization?
Is your logging set to ‘INFO’? If not that may give you some more information.

Can you run this command from the command line git -C /var/www/emoncms/ status (with the right path) which will confirm the branch you are on.

One of the beauties of Git is that you can roll back if necessary though I would not know what the best way of doing this is.

status
On branch stable
Your branch is up-to-date with ‘origin/stable’.

Thanks for that suggestion. I now have the following in the emoncms log file

eed_model.php|insert_data() feedid=61 updatetime=1530781654 feedtime=1530781654 value=-45.777 arg=
2018-07-05 09:07:44.043|INFO|PHPFina.php|post() id=61 timestamp=1530781654 value=-45.777 padding=
2018-07-05 09:07:44.044|INFO|feed_model.php|insert_data() feedid=62 updatetime=1530781654 feedtime=1530781654 value=26.385 arg=
2018-07-05 09:07:44.044|INFO|PHPFina.php|post() id=62 timestamp=1530781654 value=26.385 padding=
2018-07-05 09:07:44.044|INFO|feed_model.php|insert_data() feedid=63 updatetime=1530781654 feedtime=1530781654 value=5.041 arg=
2018-07-05 09:07:44.044|INFO|PHPFina.php|post() id=63 timestamp=1530781654 value=5.041 padding=
2018-07-05 09:07:44.044|INFO|feed_model.php|insert_data() feedid=64 updatetime=1530781654 feedtime=1530781654 value=-57.312 arg=
2018-07-05 09:07:44.044|INFO|PHPFina.php|post() id=64 timestamp=1530781654 value=-57.312 padding=
2018-07-05 09:07:44.045|INFO|feed_model.php|insert_data() feedid=65 updatetime=1530781654 feedtime=1530781654 value=-88.284 arg=
2018-07-05 09:07:44.045|INFO|PHPFina.php|post() id=65 timestamp=1530781654 value=-88.284 padding=
2018-07-05 09:07:44.045|INFO|feed_model.php|insert_data() feedid=89 updatetime=1530781654 feedtime=1530781654 value=58963 arg=
2018-07-05 09:07:44.045|INFO|PHPFina.php|post() id=89 timestamp=1530781654 value=58963 padding=
2018-07-05 09:07:44.046|INFO|feed_model.php|insert_data() feedid=90 updatetime=1530781654 feedtime=1530781654 value=16.378611111111 arg=
2018-07-05 09:07:44.046|INFO|PHPFina.php|post() id=90 timestamp=1530781654 value=16.378611111111 padding=
2018-07-05 09:07:44.046|INFO|feed_model.php|insert_data() feedid=66 updatetime=1530781654 feedtime=1530781654 value=133 arg=
2018-07-05 09:07:44.046|INFO|PHPFina.php|post() id=66 timestamp=1530781654 value=133 padding=
2018-07-05 09:07:44.049|INFO|feed_model.php|insert_data() feedid=34 updatetime=1530781654 feedtime=1530781654 value=26.85 arg=
2018-07-05 09:07:44.049|INFO|PHPFina.php|post() id=34 timestamp=1530781654 value=26.85 padding=
2018-07-05 09:07:44.049|INFO|feed_model.php|insert_data() feedid=35 updatetime=1530781654 feedtime=1530781654 value=56 arg=
2018-07-05 09:07:44.049|INFO|PHPFina.php|post() id=35 timestamp=1530781654 value=56 padding=
2018-07-05 09:07:44.050|INFO|feed_model.php|insert_data() feedid=42 updatetime=1530781654 feedtime=1530781654 value=311 arg=
2018-07-05 09:07:44.050|INFO|PHPFina.php|post() id=42 timestamp=1530781654 value=311 padding=
2018-07-05 09:07:44.050|INFO|feed_model.php|insert_data() feedid=43 updatetime=1530781654 feedtime=1530781654 value=11.2 arg=
2018-07-05 09:07:44.050|INFO|PHPFina.php|post() id=43 timestamp=1530781654 value=11.2 padding=
2018-07-05 09:07:44.050|INFO|feed_model.php|insert_data() feedid=44 updatetime=1530781654 feedtime=1530781654 value=20 arg=
2018-07-05 09:07:44.051|INFO|PHPFina.php|post() id=44 timestamp=1530781654 value=20 padding=
2018-07-05 09:07:44.051|INFO|feed_model.php|insert_data() feedid=45 updatetime=1530781654 feedtime=1530781654 value=99038 arg=
2018-07-05 09:07:44.051|INFO|PHPFina.php|post() id=45 timestamp=1530781654 value=99038 padding=
2018-07-05 09:07:44.051|INFO|feed_model.php|insert_data() feedid=47 updatetime=1530781654 feedtime=1530781654 value=155533 arg=
2018-07-05 09:07:44.051|INFO|PHPFina.php|post() id=47 timestamp=1530781654 value=155533 padding=
2018-07-05 09:07:44.052|INFO|feed_model.php|insert_data() feedid=50 updatetime=1530781654 feedtime=1530781654 value=0.53 arg=
2018-07-05 09:07:44.052|INFO|PHPFina.php|post() id=50 timestamp=1530781654 value=0.53 padding=
2018-07-05 09:07:44.052|INFO|feed_model.php|insert_data() feedid=105 updatetime=1530781654 feedtime=1530781654 value=371.68998413086 arg=join
2018-07-05 09:07:44.052|INFO|PHPFina.php|post() id=105 timestamp=1530781654 value=371.68998413086 padding=join
2018-07-05 09:07:44.052|INFO|feed_model.php|insert_data() feedid=51 updatetime=1530781654 feedtime=1530781654 value=365 arg=
2018-07-05 09:07:44.052|INFO|PHPFina.php|post() id=51 timestamp=1530781654 value=365 padding=
2018-07-05 09:07:44.053|INFO|feed_model.php|insert_data() feedid=52 updatetime=1530781654 feedtime=1530781654 value=687 arg=
2018-07-05 09:07:44.053|INFO|PHPFina.php|post() id=52 timestamp=1530781654 value=687 padding=
2018-07-05 09:07:44.053|INFO|feed_model.php|insert_data() feedid=53 updatetime=1530781654 feedtime=1530781654 value=690 arg=
2018-07-05 09:07:44.053|INFO|PHPFina.php|post() id=53 timestamp=1530781654 value=690 padding=
2018-07-05 09:07:44.053|INFO|feed_model.php|insert_data() feedid=54 updatetime=1530781654 feedtime=1530781654 value=1268 arg=
2018-07-05 09:07:44.053|INFO|PHPFina.php|post() id=54 timestamp=1530781654 value=1268 padding=
2018-07-05 09:07:44.053|INFO|feed_model.php|insert_data() feedid=98 updatetime=1530781654 feedtime=1530781654 value=3 arg=
2018-07-05 09:07:44.053|INFO|PHPFiwa.php|PHPFiwa:post id=98 timestamp=1530781654 value=3
2018-07-05 09:07:44.054|INFO|feed_model.php|insert_data() feedid=55 updatetime=1530781654 feedtime=1530781654 value=117 arg=
2018-07-05 09:07:44.054|INFO|PHPTimeSeries.php|PHPTimeSeries:post feedid=55 time=1530781654 value=117

Yes. I tried building a new dashboard but I am unable to create entries or objects because those are missing for the toolbox. I am able to create visualisation though

besides the occasional feed does not exist which comes up once every 2 3 hours. Everything from the logs seems fine. Yet my dashboard is empty of any data or values and the feeds page is completely broken and stuck in loading.

I feel the upgrade broke something. I just can’t figure out what. I really should never have followed the documentation for module installation blindly.

On my phone. I have a strong feeling the mobile works because it has some data cached from before the update to emomcms was done. A friend confirmed the dashboard does not work on his phone. I also doubt a roll back would work but it is something I won’t mind giving a try.

Hi

You may need to do a git pull in some of the sub directories of emoncms. I had a display problem recently and went through all the directories under Modules and did a git pull on each. Some were up to date but some updated. This solved my problem. A git pull in /var/www/emoncms does not update everything.

Regards

Ian

1 Like

This makes a lot of sense. I will try it and update this page once I am on a pc

There is an update script in the useful scripts repository. It will update all the different Modules that are not included as part of the core - just check the hardcoded path.

That was it!.. I went to the different modules and did a git pull… The issue was from an outdated dashboard module which was updated with a git pull. All is well with the world again :smiley: Thanks.

1 Like

Thanks for the tip. It is a keeper.

How do I mark this thread as solved?

Dashboard is at Emoncms - dashboard view in case anyone wants to confirm. I can confirm it works on my computer and the feed list is now also working fine

Click on the ellipsis ( … ) below the reply that solved the problem, then click on the Tick.

Looks like it’s working OK. I clicked the D/W/M buttons on your graphs and they updated straightaway. Everything else was updating at regular intervals.

Nice looking dash, BTW.

1 Like

Thanks :relaxed:

Did an upgrade on my good old pi2 with a new emonsd … it went rather well and I even could get the backup in but I think I have the same issue

30

pi@emonpi:/var/log $ tail -f emoncms.log 
2019-03-11 09:03:34.517|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=5
2019-03-11 09:04:34.528|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=5
2019-03-11 09:05:34.524|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=5
2019-03-11 09:06:34.542|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=5
2019-03-11 09:07:34.566|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=5
2019-03-11 09:08:34.575|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=5
2019-03-11 09:09:34.584|WARN|feed_model.php|Feed model: Requested feed does not exist feedid=2

the solution seems to be a git pull … ooookkk heu can a nice person write down the correct command before I blow up the full stuff please ?? :grin:

I tried the useful scripts but that didn’t give any change … except that it is loading data and pushing it to a remote emoncms … just that error when I go to inputs or feeds page.

thanks a lot