Local emoncms processes and feeds lost after change to a process - Help please

CDuffy · 2017-09-26T19:47:57.180Z

Hi Paul,

What do I need to do to get the follow to format prettily? I presume that you’re tidying it up for me?

pi@emonpi(ro):var$ ls -la /var/lib/php*
total 16
drwxr-xr-x  4 root root 4096 Jan 26  2016 .
drwxr-xr-x 41 root root 4096 Oct 30  2016 ..
drwxr-xr-x  5 root root 4096 Jan 26  2016 modules
drwx-wx-wt  2 root root 4096 Oct 30  2016 sessions
pi@emonpi(ro):var$

pb66 · 2017-09-26T20:05:37.529Z

CDuffy:

What do I need to do to get the follow to format prettily? I presume that you’re tidying it up for me?

use 3 back ticks like so

```

on the lines before and after the text.

I expected to see an out put like so

pi@raspberrypi:~ $ ls -la /var/lib/php*
/var/lib/phpfina:
total 8
drwxr-xr-x 2 www-data root 4096 Sep 25 11:13 .
drwxr-xr-x 5 www-data root 4096 Sep 25 11:13 ..

/var/lib/phpfiwa:
total 8
drwxr-xr-x 2 www-data root 4096 Sep 25 11:13 .
drwxr-xr-x 5 www-data root 4096 Sep 25 11:13 ..

/var/lib/phptimeseries:
total 8
drwxr-xr-x 2 www-data root 4096 Sep 25 11:13 .
drwxr-xr-x 5 www-data root 4096 Sep 25 11:13 ..

where are your data folders supposed to be? what are the paths set in /var/www/emoncms/settings.php eg

https://github.com/emoncms/emoncms/blob/master/default.settings.php#L57-L64

[EDIT}

Ahhh! ok problem solved, they are in a different location on an emonPi

github.com

emoncms/emoncms/blob/master/default.emonpi.settings.php#L58-L65


      
              'datadir' => '/home/pi/data/phpfina/'
          ),
          'phptimeseries'=>array(
              'datadir' => '/home/pi/data/phptimeseries/'
          ),
          'cassandra'=>array(
              'keyspace' => 'emoncms'
          )

So the command should actually be

ls -la /home/pi/data/php*

we’ll get there eventually perhaps…

CDuffy · 2017-09-26T20:21:22.529Z

pi@emonpi(ro):~$ ls -la /home/pi/data/php*
/home/pi/data/phpfina:
total 62323
drwxr-xr-x 2 www-data root        1024 Sep 25 08:00 .
drwxrwxrwx 9 pi       pi          1024 Sep 26 12:32 ..
-rw-r--r-- 1 www-data www-data 5639624 Sep 26 20:19 10.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 15:55 10.meta
-rw-r--r-- 1 www-data www-data 5639624 Sep 26 20:19 11.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 15:55 11.meta
-rw-r--r-- 1 www-data www-data 5639624 Sep 26 20:19 12.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 15:55 12.meta
-rw-r--r-- 1 www-data www-data 5635860 Sep 26 20:19 13.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 18:32 13.meta
-rw-r--r-- 1 www-data www-data 5635856 Sep 26 20:19 14.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 18:32 14.meta
-rw-r--r-- 1 www-data www-data 5398236 Sep 26 20:19 17.dat
-rw-r--r-- 1 www-data www-data      16 Apr 23 15:33 17.meta
-rw-r--r-- 1 www-data www-data 5398236 Sep 26 20:19 18.dat
-rw-r--r-- 1 www-data www-data      16 Apr 23 15:33 18.meta
-rw-r--r-- 1 www-data www-data 1555160 Sep 26 20:19 19.dat
-rw-r--r-- 1 www-data www-data      16 Aug 12 20:21 19.meta
-rw-r--r-- 1 www-data www-data 1555160 Sep 26 20:19 20.dat
-rw-r--r-- 1 www-data www-data      16 Aug 12 20:21 20.meta
-rw-r--r-- 1 www-data www-data 1554876 Sep 26 20:19 21.dat
-rw-r--r-- 1 www-data www-data      16 Aug 12 20:33 21.meta
-rw-r--r-- 1 www-data www-data 1554876 Sep 26 20:19 22.dat
-rw-r--r-- 1 www-data www-data      16 Aug 12 20:33 22.meta
-rw-r--r-- 1 www-data www-data 1399628 Sep 26 20:19 30.dat
-rw-r--r-- 1 www-data www-data      16 Aug 17 08:21 30.meta
-rw-r--r-- 1 www-data www-data 5639664 Sep 26 20:19 7.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 15:54 7.meta
-rw-r--r-- 1 www-data www-data 5639664 Sep 26 20:19 8.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 15:54 8.meta
-rw-r--r-- 1 www-data www-data 5639624 Sep 26 20:19 9.dat
-rw-r--r-- 1 www-data www-data      16 Apr 16 15:55 9.meta

/home/pi/data/phptimeseries:
total 9
drwxr-xr-x 2 www-data root     1024 Aug 17 08:44 .
drwxrwxrwx 9 pi       pi       1024 Sep 26 12:32 ..
-rw-r--r-- 1 www-data www-data  369 Sep 26 07:25 feed_24.MYD
-rw-r--r-- 1 www-data www-data  369 Sep 26 07:25 feed_25.MYD
-rw-r--r-- 1 www-data www-data  369 Sep 26 07:25 feed_26.MYD
-rw-r--r-- 1 www-data www-data  369 Sep 26 07:25 feed_27.MYD
-rw-r--r-- 1 www-data www-data  369 Sep 26 07:25 feed_28.MYD
-rw-r--r-- 1 www-data www-data  369 Sep 26 07:25 feed_29.MYD
-rw-r--r-- 1 www-data www-data  369 Sep 26 07:25 feed_31.MYD
pi@emonpi(ro):~$

pb66 · 2017-09-26T21:12:15.447Z

Well that looks in order, the feeds are all there in both the mysql feed table and in the data folders, and the permissions/ownership is right.

One more thing to try since the feeds apparently cannot be found hence the “does not exist or was deleted” messgae, when you recently updated, was that to remedy this or do you suspect it may be the trigger?

Did you need to replace the settings.php? If yes, did you copy default.settings.php or default.emonpi.settings.php?

Either way can you confirm your emoncms is looking for the feed data in the right place ie are the paths in your emoncms/settings.php still like so?

github.com

emoncms/emoncms/blob/master/default.emonpi.settings.php#L58-L65

    
      
              'datadir' => '/home/pi/data/phpfina/'
          ),
          'phptimeseries'=>array(
              'datadir' => '/home/pi/data/phptimeseries/'
          ),
          'cassandra'=>array(
              'keyspace' => 'emoncms'
          )

TrystanLea · 2017-09-26T21:21:30.524Z

Looks like mysql input, feeds table and feed data are all ok. Is your emoncms feed list showing blank?

Could you try

emoncms/feed/list.json

My hunch is that there is something amiss in the redis cache of the feed list data at this point…
A redis flush might sort it, or it may thow an error if redis is not updating correctly.

Worth checking the settings.php though as @pb66 suggested

CDuffy · 2017-09-26T21:50:58.528Z

I’ve never (knowingly) changed the settings.php (I bought the emontx and emonhub and used the GUI to config them)
I ran a diff between a “default.emonpi.settings.php” and “settings.php” in /var/www/emoncms and it showed no changes

The settings are as displayed in Paul’s quote.

However, I only have a phpfina and phptimeseries in /home/pi/data. Should I create a phpfiwa dir with the same perms as the other two?

pi@emonpi(ro):data$ ls -ld /home/pi/data/phpfiwa/ /home/pi/data/phpfina/ /home/pi/data/phptimeseries/
ls: cannot access /home/pi/data/phpfiwa/: No such file or directory
drwxr-xr-x 2 www-data root 1024 Sep 25 08:00 /home/pi/data/phpfina/
drwxr-xr-x 2 www-data root 1024 Aug 17 08:44 /home/pi/data/phptimeseries/
pi@emonpi(ro):data$

I’ve left the emoncms/feed/list.json running for 5+ minutes and Firefox still only shows me the swirling loading icon and nothing else.

I found another one of your comments suggesting “redis-cli flushall”, is that the correct command here as well?

pb66 · 2017-09-26T22:14:18.115Z

phpfiwa is being phased out AFAIK so the lack of a folder would only be a concern if you had old feeds to import or you wanted to go against the flow and enable the disabled phpfiwa feed engine in emoncms.

The spinner on the feeds page is an issue, is there any info if you hit F12 in your browser? (actually I’m not sure if dev tools is F12 in Firefox)

@TrystanLea has just helped find a issue with a input table on the No Inputs and /var/log full within 1h of boot thread, perhaps you could do the same checks focusing on the feed table.

sudo redis-cli flushall

is worth trying, the same can also be done from within emoncms on the admin page, there is a flush button on the right of the redis section.

[EDIT] Actually, since you can query your input and feed table from the command line it looks like your mysql tables are ok, hopefully @TrystanLea will have a further ideas if flushing redis doesn’t work.

CDuffy · 2017-09-27T21:44:24.775Z

Sorry, busy day with work.

Thanks for the pointers @pb66 and @TrystanLea

To answer a previous question, I ran the update in August to see what extra little goodies you had added.

I ran the redis-cli flushall, and no noticeable change.

I took a look at /var/log/apache2/error.log and found a load of segmentation fault messages. I tried opening emoncms/feed/list.json and, you see an apache2 chew up 90+% of a core for 40 seconds before the seg fault, after 10 attempts the browser shows a “The connection was reset” message:

[Wed Sep 27 21:06:06.907388 2017] [core:notice] [pid 27805] AH00052: child pid 32687 exit signal Segmentation fault (11)
[Wed Sep 27 21:06:46.952675 2017] [core:notice] [pid 27805] AH00052: child pid 564 exit signal Segmentation fault (11)
[Wed Sep 27 21:07:25.996931 2017] [core:notice] [pid 27805] AH00052: child pid 857 exit signal Segmentation fault (11)
[Wed Sep 27 21:08:05.041286 2017] [core:notice] [pid 27805] AH00052: child pid 1225 exit signal Segmentation fault (11)
[Wed Sep 27 21:08:45.084883 2017] [core:notice] [pid 27805] AH00052: child pid 1494 exit signal Segmentation fault (11)
[Wed Sep 27 21:09:25.130797 2017] [core:notice] [pid 27805] AH00052: child pid 4565 exit signal Segmentation fault (11)
[Wed Sep 27 21:10:04.174141 2017] [core:notice] [pid 27805] AH00052: child pid 4841 exit signal Segmentation fault (11)
[Wed Sep 27 21:10:44.224615 2017] [core:notice] [pid 27805] AH00052: child pid 5162 exit signal Segmentation fault (11)
[Wed Sep 27 21:11:23.265853 2017] [core:notice] [pid 27805] AH00052: child pid 5447 exit signal Segmentation fault (11)
[Wed Sep 27 21:12:02.306225 2017] [core:notice] [pid 27805] AH00052: child pid 5740 exit signal Segmentation fault (11)

I’m very much beyond my domain of knowledge, but tried changing the Apache log level up until I got to trace8 and nothing looks to be too out of whack (to an untrained eye):

[Wed Sep 27 21:31:21.057983 2017] [core:info] [pid 15750] AH00096: removed PID file /var/run/apache2/apache2.pid (pid=15750)
[Wed Sep 27 21:31:21.058074 2017] [mpm_prefork:notice] [pid 15750] AH00169: caught SIGTERM, shutting down
[Wed Sep 27 21:31:22.828072 2017] [core:trace4] [pid 16693] mpm_common.c(534): mpm child 16697 (gen 0/slot 0) started
[Wed Sep 27 21:31:22.831762 2017] [core:trace4] [pid 16693] mpm_common.c(534): mpm child 16698 (gen 0/slot 1) started
[Wed Sep 27 21:31:22.835568 2017] [core:trace4] [pid 16693] mpm_common.c(534): mpm child 16699 (gen 0/slot 2) started
[Wed Sep 27 21:31:22.839605 2017] [core:trace4] [pid 16693] mpm_common.c(534): mpm child 16700 (gen 0/slot 3) started
[Wed Sep 27 21:31:22.843728 2017] [core:trace4] [pid 16693] mpm_common.c(534): mpm child 16701 (gen 0/slot 4) started
[Wed Sep 27 21:31:22.843846 2017] [mpm_prefork:notice] [pid 16693] AH00163: Apache/2.4.10 (Raspbian) configured -- resuming norma            l operations
[Wed Sep 27 21:31:22.843884 2017] [mpm_prefork:info] [pid 16693] AH00164: Server built: Sep 17 2016 16:40:43
[Wed Sep 27 21:31:22.843923 2017] [core:notice] [pid 16693] AH00094: Command line: '/usr/sbin/apache2'
[Wed Sep 27 21:31:22.843970 2017] [mpm_prefork:debug] [pid 16693] prefork.c(995): AH00165: Accept mutex: fcntl (default: sysvsem)
[Wed Sep 27 21:31:32.574542 2017] [core:trace5] [pid 16697] protocol.c(618): [client 192.168.1.30:55542] Request received from client: GET /emoncms/feed/list.json HTTP/1.1
[Wed Sep 27 21:31:32.575003 2017] [http:trace4] [pid 16697] http_request.c(301): [client 192.168.1.30:55542] Headers received from client:
[Wed Sep 27 21:31:32.575040 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   Host: 192.168.1.22
[Wed Sep 27 21:31:32.575065 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:55.0) Gecko/20100101 Firefox/55.0
[Wed Sep 27 21:31:32.575090 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
[Wed Sep 27 21:31:32.575114 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   Accept-Language: en-GB,en;q=0.5
[Wed Sep 27 21:31:32.575136 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   Accept-Encoding: gzip, deflate
[Wed Sep 27 21:31:32.575202 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   Cookie: PHPSESSID=550go7bgnjdsiu551a37k4oet1; EMONCMS_REMEMBERME=1%7C72609e42afc0ea3a2e4c23ad22851c3b
[Wed Sep 27 21:31:32.575228 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   DNT: 1
[Wed Sep 27 21:31:32.575250 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   Connection: keep-alive
[Wed Sep 27 21:31:32.575271 2017] [http:trace4] [pid 16697] http_request.c(305): [client 192.168.1.30:55542]   Upgrade-Insecure-Requests: 1
[Wed Sep 27 21:31:32.580619 2017] [setenvif:trace2] [pid 16697] mod_setenvif.c(622): [client 192.168.1.30:55542] Setting HTTP_AUTHORIZATION
[Wed Sep 27 21:31:32.580703 2017] [authz_core:debug] [pid 16697] mod_authz_core.c(809): [client 192.168.1.30:55542] AH01626: authorization result of Require all granted: granted
[Wed Sep 27 21:31:32.580732 2017] [authz_core:debug] [pid 16697] mod_authz_core.c(809): [client 192.168.1.30:55542] AH01626: authorization result of <RequireAny>: granted
[Wed Sep 27 21:31:32.580774 2017] [core:trace3] [pid 16697] request.c(293): [client 192.168.1.30:55542] request authorized without authentication by access_checker_ex hook: /emoncms/feed/list.json
[Wed Sep 27 21:31:32.580852 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] add path info postfix: /var/www/html/emoncms/feed -> /var/www/html/emoncms/feed/list.json
[Wed Sep 27 21:31:32.580899 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] strip per-dir prefix: /var/www/html/emoncms/feed/list.json -> feed/list.json
[Wed Sep 27 21:31:32.580934 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] applying pattern '^(.*)$' to uri 'feed/list.json'
[Wed Sep 27 21:31:32.581005 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/var/www/html/emoncms/feed' pattern='!-f' => matched
[Wed Sep 27 21:31:32.581062 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/var/www/html/emoncms/feed' pattern='!-d' => matched
[Wed Sep 27 21:31:32.581117 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/var/www/html/emoncms/feed' pattern='!-s' => matched
[Wed Sep 27 21:31:32.581167 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/emoncms/feed/list.json' pattern='!=/favicon.ico' => matched
[Wed Sep 27 21:31:32.581208 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/emoncms/feed/list.json' pattern='!=/robots.txt' => matched
[Wed Sep 27 21:31:32.581259 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/emoncms/feed/list.json' pattern='!^/?docs.*$' => matched
[Wed Sep 27 21:31:32.581352 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/emoncms/feed/list.json' pattern='!^/?Lib.*$' => matched
[Wed Sep 27 21:31:32.581419 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/emoncms/feed/list.json' pattern='!^/?Modules.*$' => matched
[Wed Sep 27 21:31:32.581479 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/emoncms/feed/list.json' pattern='!^/?scripts.*$' => matched
[Wed Sep 27 21:31:32.581523 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='/emoncms/feed/list.json' pattern='!^/?Theme.*$' => matched
[Wed Sep 27 21:31:32.581606 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] RewriteCond: input='' pattern='![45]0[0-9]' => matched
[Wed Sep 27 21:31:32.581660 2017] [rewrite:trace2] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] rewrite 'feed/list.json' -> 'index.php?q=feed/list.json'
[Wed Sep 27 21:31:32.581825 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] split uri=index.php?q=feed/list.json -> uri=index.php, args=q=feed/list.json
[Wed Sep 27 21:31:32.581863 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] add per-dir prefix: index.php -> /var/www/html/emoncms/index.php
[Wed Sep 27 21:31:32.581913 2017] [rewrite:trace2] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] strip document_root prefix: /var/www/html/emoncms/index.php -> /emoncms/index.php
[Wed Sep 27 21:31:32.581950 2017] [rewrite:trace1] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76a42058/initial] [perdir /var/www/html/emoncms/] internal redirect with /emoncms/index.php [INTERNAL REDIRECT]
[Wed Sep 27 21:31:32.582769 2017] [setenvif:trace2] [pid 16697] mod_setenvif.c(622): [client 192.168.1.30:55542] Setting HTTP_AUTHORIZATION
[Wed Sep 27 21:31:32.582866 2017] [authz_core:debug] [pid 16697] mod_authz_core.c(809): [client 192.168.1.30:55542] AH01626: authorization result of Require all granted: granted
[Wed Sep 27 21:31:32.582895 2017] [authz_core:debug] [pid 16697] mod_authz_core.c(809): [client 192.168.1.30:55542] AH01626: authorization result of <RequireAny>: granted
[Wed Sep 27 21:31:32.582918 2017] [core:trace3] [pid 16697] request.c(293): [client 192.168.1.30:55542] request authorized without authentication by access_checker_ex hook: /emoncms/index.php
[Wed Sep 27 21:31:32.582983 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76224cf0/initial/redir#1] [perdir /var/www/html/emoncms/] strip per-dir prefix: /var/www/html/emoncms/index.php -> index.php
[Wed Sep 27 21:31:32.583050 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76224cf0/initial/redir#1] [perdir /var/www/html/emoncms/] applying pattern '^(.*)$' to uri 'index.php'
[Wed Sep 27 21:31:32.583141 2017] [rewrite:trace4] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76224cf0/initial/redir#1] [perdir /var/www/html/emoncms/] RewriteCond: input='/var/www/html/emoncms/index.php' pattern='!-f' => not-matched
[Wed Sep 27 21:31:32.583184 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76224cf0/initial/redir#1] [perdir /var/www/html/emoncms/] strip per-dir prefix: /var/www/html/emoncms/index.php -> index.php
[Wed Sep 27 21:31:32.583230 2017] [rewrite:trace3] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76224cf0/initial/redir#1] [perdir /var/www/html/emoncms/] applying pattern '(^|/)\\.' to uri 'index.php'
[Wed Sep 27 21:31:32.583282 2017] [rewrite:trace1] [pid 16697] mod_rewrite.c(475): [client 192.168.1.30:55542] 192.168.1.30 - - [192.168.1.22/sid#758c7cc8][rid#76224cf0/initial/redir#1] [perdir /var/www/html/emoncms/] pass through /var/www/html/emoncms/index.php
[Wed Sep 27 21:31:32.859061 2017] [core:trace4] [pid 16693] mpm_common.c(534): mpm child 16780 (gen 0/slot 5) started
[Wed Sep 27 21:32:12.896959 2017] [core:notice] [pid 16693] AH00052: child pid 16697 exit signal Segmentation fault (11)
[Wed Sep 27 21:32:12.897110 2017] [core:trace4] [pid 16693] mpm_common.c(534): mpm child 16697 (gen 0/slot 0) exited

This is the first time I’m delving into the processes and working of emoncms and am NOT clear on what works and where, hence appreciate all your help and guidance. But also apologise for the potentially daft questions etc

Paul · 2017-09-27T22:11:42.907Z

This is identical to the problem that I encountered prior to this post.
The error messages were the same, and after failing to resolve, I resorted to an earlier backup, only to meet the same segmentation problem again a week later, so I eventually re-formatted and rebuilt my system in raspbian stretch.

So, yes this appears to be an issue rather than a glitch.

Paul

pb66 · 2017-09-27T22:18:28.840Z

Can you show us s screen dump of the admin page

pb66 · 2017-09-27T22:20:07.892Z

Can you recall what version php-redis you had then Paul?

Paul · 2017-09-27T22:23:41.931Z

Not precisely, but definitely php5.?.?

pb66 · 2017-09-27T22:26:22.115Z

No not PHP but the php-redis module, it would be between 2.2.5 and 3.1.3.

It appears as “redis” in the last section on the admin page.

Paul · 2017-09-27T22:43:57.108Z

Aahh sorry, no, afraid not, but I assume it would be the current ‘apt’ version available in the jessie repo, as I update fairly regularly.
I assume v2.2.5-1

Paul

pb66 · 2017-09-27T23:05:41.084Z

Segmentstion faults was the reason v2.2.7 was downloaded from git rather than using v2.2.5 deb package.

With PHP 5.x you must be using 2.2.7 or 2.2.8 or 3.1.3>. PHP 7 must be 3.0.0 >.there has been alot of change this year so i would recommrnd staying up to date using PECL currently 3.1.4 for both PHP versions.

https://pecl.php.net/package/redis

See Php-Redis 3.1.1?

CDuffy · 2017-09-28T06:41:23.414Z

Looking through Paul Reed’s problems, I’m conscious that mine was working well until I added an additional process onto a virtual feed and that’s when I started to see spining loaders etc. Hence was going to focus on reverting that change first.

In particular this feed:

mysql> select * from feeds;
+----+----------------------+--------+--------------+------+-------+----------+--------+---------+--------+----------------------+
| id | name                 | userid | tag          | time | value | datatype | public | size    | engine | processList          |
+----+----------------------+--------+--------------+------+-------+----------+--------+---------+--------+----------------------+
...
| 47 | Inp Exp Daily Delta  |      1 | Virtual      | NULL |  NULL |        2 |      0 |       0 |      7 | 53:24,56:25,30:47    |
+----+----------------------+--------+--------------+------+-------+----------+--------+---------+--------+----------------------+
24 rows in set (0.00 sec)

I cannot access any of this via the browser, hence would it be as simple as removing the last entry from that feed, i.e. 53:24,56:25,30:47 becomes 53:24,56:25?

[EDIT]
I haven’t done any SQL since Uni, would the following be appropriate?

UPDATE feeds SET processList='53:24,56:25' WHERE id=47

And this is the server info from my Admin page:

image1029×741 32.5 KB

image1034×389 24.6 KB

Paul · 2017-09-28T08:26:39.802Z

Clive, when you say that you ‘can’t access any of this via the browser’. Are you finding same as I did, that you can no longer open phpmyadmin to check & edit MYSQL?

CDuffy · 2017-09-28T08:49:09.018Z

Hi Paul,

I’m a real early starter to the emoncms side of things, but used to be a UNIX admin, hence am happy with the OS aspects, but less so with the MySQL and app aspects.

Until now I’ve only ever managed the feeds via the emoncms feeds web page, but ever since this problem started, this page never appears, hence the interest in an alternate route.

I’ve not installed phpmyadmin, and am more than happy to NOT tinker with the DB too much!

Is the change to that one field sufficient to change that process list? Or would I need to do something in addition?

CDuffy · 2017-09-28T12:56:08.982Z

Hi @Paul @TrystanLea @pb66,

The crisis has now been resolved.

I removed the newly added process from the virtual feed (3rd from this list 53:24,56:25,30:47), but still had problems loading the feeds page, I stopped Apache, ran redis-cli flushall and restarted Apache and could then load the page.

The last updates to the feeds being 30 hrs out of date, hence I clutched at a straw and restarted emonhub - no change.

I then rebooted the emonhub and the feeds now work correctly and the solar with divert app shows me current data, but understandably with a 30hr gap.

I really appreciate your time, effort and patience with me and this problem.

When I came across OEM project it looked to be a fantastic and highly configurable monitoring product, I’ve been really happy with my deployment. In addition, the support and info within these community pages are fantastic.

Thank you again,
Clive.

Paul · 2017-09-28T15:17:28.380Z

That’s good news, pleased you are back up and working.

Paul