After update to 9.9.0 process list all unavaiblable

nuno_faria1 · 2018-10-20T10:51:07.992Z

hi,
after updating to the new 9.9.0 i got all process lsit unavailabe
message that apears is nodule missing ?
logging is still going, but i got the error. What did i missed ?
selfhosted on raspberry

pb66 · 2018-10-20T11:18:57.960Z

Apparently similar issue on Github

github.com/emoncms/emoncms

Input Process Stopped working after EmonPi Update

opened 05:47AM - 20 Oct 18 UTC

closed 01:42AM - 21 Oct 18 UTC

Paulf007

System Info: <details><summary>Server Information</summary><pre> | | | | | …--- | --- | --- | |Emoncms|Version|low-write 9.9.0 ||Modules|Administration : App v1.2.0 : Backup v1.1.5 : EmonHub Config v1.0.0 : Dashboard v1.3.1 : Device v1.1.1 : EventProcesses : Feed : Graph v1.2.1 : Input : Postprocess v1.0.0 : CoreProcess : Schedule : Network Setup v1.0.0 : sync : Time : User : Visualisation : WiFi v1.3.0 ||Git URL|https://github.com/emoncms/emoncms.git ||Git Branch|* stable ||Buffer|<span id="bufferused">loading...</span> ||Writer|Daemon is running with sleep 60s |Server|OS|Linux 4.9.35-v7+ ||Host|emonpi emonpi (192.168.8.114) ||Date|2018-10-20 07:40:22 SAST ||Uptime| 07:40:22 up 16 min, 0 users, load average: 0.93, 0.78, 0.51 |HTTP|Server|Apache/2.4.10 (Raspbian) HTTP/1.1 CGI/1.1 80 |MySQL|Version|5.5.57-0+deb8u1 ||Host|127.0.0.1 (127.0.0.1) ||Date|2018-10-20 07:40:22 (UTC 02:00‌) ||Stats|Uptime: 970 Threads: 5 Questions: 34042 Slow queries: 0 Opens: 93 Flush tables: 1 Open tables: 86 Queries per second avg: 35.094 |Redis|Version|2.8.17 ||Host|localhost:6379 (127.0.0.1) ||Size|<span id="redisused">145 keys (509.54K)</span> ||Uptime|0 days |MQTT|Version|1.4.14 ||Host|localhost:1883 (127.0.0.1) |Pi|Model|Raspberry Pi 3 Model B Rev 1.2 - 1 GB (Sony UK) ||SoC|Broadcom BCM2835 ||Serial num.|C5891ABA ||Temperature|CPU: 49.39°C - GPU: 48.3'C ||Release|emonSD-26Oct17 ||File-system|Current: read-only - Set root file-system temporarily to read-write, (default read-only) |Memory|RAM|Used: 33.25% Total: 970.93 MB Used: 322.82 MB Free: 648.11 MB |Disk|Mount|Stats ||/|Used: 67.07% Total: 3.33 GB Used: 2.23 GB Free: 957.8 MB ||/boot|Used: 36.36% Total: 59.95 MB Used: 21.8 MB Free: 38.15 MB ||/home/pi/data|Used: 13.06% Total: 968.33 MB Used: 126.5 MB Free: 791.84 MB |PHP|Version|5.6.37-0+deb8u1 (Zend Version 2.6.0) ||Modules|apache2handler : bcmath : bz2 : calendar : Core v5.6.37-0+deb8u1 : ctype : curl : date v5.6.37-0+deb8u1 : dba : dio v0.0.4RC4 : dom v20031129 : ereg : exif v1.4 $Id: cad29b729548e4206f0697710cc9e177f26fdff3 $ : fileinfo v1.0.5 : filter v0.11.0 : ftp : gd : gettext : hash v1.0 : iconv : json v1.3.6 : libxml : mbstring : mcrypt : mhash : mosquitto v0.3.0 : mysql v1.0 : mysqli v0.1 : openssl : pcre : PDO v1.0.4dev : pdo_mysql v1.0.2 : pdo_pgsql v1.0.2 : pdo_sqlite v1.0.1 : pgsql : Phar v2.0.2 : posix : readline v5.6.37-0+deb8u1 : redis v2.2.7 : Reflection v$Id: 5f15287237d5f78d75b19c26915aa7bd83dee8b8 $ : session : shmop : SimpleXML v0.1 : soap : sockets : SPL v0.2 : sqlite3 v0.7-dev : standard v5.6.37-0+deb8u1 : sysvmsg : sysvsem : sysvshm : tokenizer v0.1 : wddx : xml : xmlreader v0.1 : xmlwriter v0.1 : Zend OPcache v7.0.6-devFE : zip v1.12.5 : zlib v2.0 </pre></details> <details><summary>Client Information</summary><pre> | | | | | --- | --- | --- | |HTTP|Browser|Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36 |Screen|Resolution|1680 x 1050 |Window|Size|1848 x 954 </pre></details> Issue: I did upgrade via the Admin console of EmonPi. After the update the "Input Process" stopped working. The data that is sent to emon is comming through (Via node red and the Emon Node) but it is no longer been processed. See screen shots ![2018-10-20_073958](https://user-images.githubusercontent.com/24200183/47251938-feee7700-d43b-11e8-86e8-929074ec0b9f.png) ![2018-10-20_073941](https://user-images.githubusercontent.com/24200183/47251939-feee7700-d43b-11e8-8b1c-e46fdafcba61.png) ![2018-10-20_074013](https://user-images.githubusercontent.com/24200183/47251940-ff870d80-d43b-11e8-84f4-a9daf997aa65.png) I can also not add an process as it seems missing. Looking at the console on the admin page if I attempt to upgrade emonpi again I get the following Starting emonPi Update > via service-runner-update.sh Service Runner update script V1.1.1 EUID: 1000 Argument: emonpi Sat 20 Oct 07:46:12 SAST 2018 ############################################################# emonSD version: emonSD-26Oct17 ERROR: emonSD base image old or undefined...update will not continue See latest verson: https://github.com/openenergymonitor/emonpi/wiki/emonSD-pre-built-SD-card-Download-&-Change-Log Stopping update Is there a way to fix this?

TrystanLea · 2018-10-20T13:16:59.292Z

Hello @nuno_faria1, did you run database update? Can you share a screenshot of what you see, do you see any errors in your browsers web console log?

nuno_faria1 · 2018-10-20T14:41:08.966Z

strugling to insert image.
i did run database update. nothing to update…

error950×641 37.1 KB

thats what i got…
i am a new user, can only post one image…

Bill.Thomson · 2018-10-20T15:00:40.113Z

nuno_faria1:

i am a new user, can only post one image…

Hi Nuno,

I’ve bumped your user acount up a notch. You should be able to upload multiple pictures now.

nuno_faria1 · 2018-10-20T15:19:30.153Z

error21605×909 146 KB

dont see any errors… anything else which i should use to debug ?

Paul_F_Prinsloo · 2018-10-20T15:42:43.343Z

I seem to have the same problem , is there any update on this?

System Info:

Server Information


Emoncms	Version	low-write 9.9.0
	Modules	Administration : App v1.2.0 : Backup v1.1.5 : EmonHub Config v1.0.0 : Dashboard v1.3.1 : Device v1.1.1 : EventProcesses : Feed : Graph v1.2.1 : Input : Postprocess v1.0.0 : CoreProcess : Schedule : Network Setup v1.0.0 : sync : Time : User : Visualisation : WiFi v1.3.0
	Git URL	GitHub - emoncms/emoncms: Web-app for processing, logging and visualising energy, temperature and other environmental data
	Git Branch	* stable
	Buffer	loading…
	Writer	Daemon is running with sleep 60s
Server	OS	Linux 4.9.35-v7+
	Host	emonpi emonpi (192.168.8.114)
	Date	2018-10-20 07:40:22 SAST
	Uptime	07:40:22 up 16 min, 0 users, load average: 0.93, 0.78, 0.51
HTTP	Server	Apache/2.4.10 (Raspbian) HTTP/1.1 CGI/1.1 80
MySQL	Version	5.5.57-0+deb8u1
	Host	127.0.0.1 (127.0.0.1)
	Date	2018-10-20 07:40:22 (UTC 02:00‌)
	Stats	Uptime: 970 Threads: 5 Questions: 34042 Slow queries: 0 Opens: 93 Flush tables: 1 Open tables: 86 Queries per second avg: 35.094
Redis	Version	2.8.17
	Host	localhost:6379 (127.0.0.1)
	Size	145 keys (509.54K)
	Uptime	0 days
MQTT	Version	1.4.14
	Host	localhost:1883 (127.0.0.1)
Pi	Model	Raspberry Pi 3 Model B Rev 1.2 - 1 GB (Sony UK)
	SoC	Broadcom BCM2835
	Serial num.	C5891ABA
	Temperature	CPU: 49.39°C - GPU: 48.3’C
	Release	emonSD-26Oct17
	File-system	Current: read-only - Set root file-system temporarily to read-write, (default read-only)
Memory	RAM	Used: 33.25% Total: 970.93 MB Used: 322.82 MB Free: 648.11 MB
Disk	Mount	Stats
	/	Used: 67.07% Total: 3.33 GB Used: 2.23 GB Free: 957.8 MB
	/boot	Used: 36.36% Total: 59.95 MB Used: 21.8 MB Free: 38.15 MB
	/home/pi/data	Used: 13.06% Total: 968.33 MB Used: 126.5 MB Free: 791.84 MB
PHP	Version	5.6.37-0+deb8u1 (Zend Version 2.6.0)
	Modules	apache2handler : bcmath : bz2 : calendar : Core v5.6.37-0+deb8u1 : ctype : curl : date v5.6.37-0+deb8u1 : dba : dio v0.0.4RC4 : dom v20031129 : ereg : exif vId: cad29b729548e4206f0697710cc9e177f26fdff : fileinfo v1.0.5 : filter v0.11.0 : ftp : gd : gettext : hash v1.0 : iconv : json v1.3.6 : libxml : mbstring : mcrypt : mhash : mosquitto v0.3.0 : mysql v1.0 : mysqli v0.1 : openssl : pcre : PDO v1.0.4dev : pdo_mysql v1.0.2 : pdo_pgsql v1.0.2 : pdo_sqlite v1.0.1 : pgsql : Phar v2.0.2 : posix : readline v5.6.37-0+deb8u1 : redis v2.2.7 : Reflection v$Id: 5f15287237d5f78d75b19c26915aa7bd83dee8b : session : shmop : SimpleXML v0.1 : soap : sockets : SPL v0.2 : sqlite3 v0.7-dev : standard v5.6.37-0+deb8u1 : sysvmsg : sysvsem : sysvshm : tokenizer v0.1 : wddx : xml : xmlreader v0.1 : xmlwriter v0.1 : Zend OPcache v7.0.6-devFE : zip v1.12.5 : zlib v2.0

Client Information












HTTP
Browser
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36


Screen
Resolution
1680 x 1050


Window
Size
1848 x 954

Issue:
I did upgrade via the Admin console of EmonPi. After the update the “Input Process” stopped working.
The data that is sent to emon is comming through (Via node red and the Emon Node) but it is no longer been processed.
See screen shots

2018-10-20_0739581673×290 21 KB

2018-10-20_0739411396×271 21.9 KB

I can also not add an process as it seems missing.
Looking at the console on the admin page if I attempt to upgrade emonpi again I get the following

Starting emonPi Update >
via service-runner-update.sh
Service Runner update script V1.1.1
EUID: 1000
Argument: emonpi
Sat 20 Oct 07:46:12 SAST 2018
#############################################################

emonSD version: emonSD-26Oct17

ERROR: emonSD base image old or undefined…update will not continue
See latest verson: emonSD pre built SD card Download & Change Log · openenergymonitor/emonpi Wiki · GitHub
Stopping update

Is there a way to fix this?

pb66 · 2018-10-20T17:09:46.597Z

Paul_F_Prinsloo:

Is there a way to fix this?

It seems support for the emonSD-26Oct17 was (accidentally?) dropped in a recent commit

github.com/openenergymonitor/emonpi

fix emonSD versions

committed 04:54PM - 17 Oct 18 UTC

glynhudson

+2 -2

I’ve submitted PR’s for this version to be reintroduced but even once those fixes are in place, you won’t be able to pull them in as support for your image has been temporally removed so the update won’t run to pull in the fixes.

A work around is to edit the version file to a supported version so the update will run and then change it back so as not to cause any further confusion caused by reporting the wrong base image.

If you ssh in and run the following from the command line

rpi-rw
sudo mv /boot/emonSD-26Oct17 /boot/emonSD-13Jun18

you should then be able to update as usual and then after ALL the updates are done (ie update now and then again when the fix to the versions is merged by @glyn.hudson )

rpi-rw
sudo mv /boot/emonSD-13Jun18 /boot/emonSD-26Oct17

you could then try running the update again just to be sure all is hunky-dory.

As for your original “processing” issue, I’m afraid I haven’t a clue, but it’s worth asking, have you tried clearing the browser cache? (ctrl-f5)

borpin · 2018-10-20T20:05:21.280Z

pb66:

If you ssh in

Good job it is enabled… GRD (for the youngsters amongst you, Grinning Running Ducking)…

TrystanLea · 2018-10-20T20:53:12.792Z

I realise the code to force a browser refresh of cached content on the input and feed list pages was not included. I have added this in now (including updating stable) Force browser cache reload by TrystanLea · Pull Request #1077 · emoncms/emoncms · GitHub to help avoid the need for a manual clearing of browser cache.

Thanks also for your fix @pb66. I have merged both in. For those who have pressed update in the intervening time and who see:

ERROR: emonSD base image old or undefined…update will not continue

a manual fix is required unfortunately as @pb66 explained. Perhaps the preferable fix is to update the emonpi repository rather than changing the base image file?

rpi-rw
cd emonpi
git pull

Paul · 2018-10-20T21:12:50.547Z

until 8am Monday 22nd Oct

Bill.Thomson · 2018-10-20T22:44:58.218Z

borpin:

for the youngsters amongst you, Grinning Running Ducking)…

Or those of us on the other side of the pond…

glyn.hudson · 2018-10-21T00:01:06.630Z

Thanks so much for the fix @pb66. I’m very sorry for causing this hassle, totally my fault. I’ve created a new thread to make clear the steps required to fix this issue for any users effected:

emonSD-26Oct17 ERROR: emonSD base image old or undefined…update will not continue emonSD

Any users running emonSD-26Oct17 who updated their emonPi / emonSD / emonBase between 17th October and 21st October 2018 will see this error in the emonPi update log “ERROR: emonSD base image old or undefined…update will not continue” This error was caused by accidentally removing update script support for the emonSD-26Oct17. This issue has now been fixed thanks to @pb66. It’s now safe to go ahead and update. However, any users who triggered an update between 17th October and 21st October 201…

glyn.hudson · 2018-10-21T00:06:46.893Z

A fix for the Process List Unavailable issue submitted by @TrystanLea has now been merged into the Emoccms core stable branch and released under V9.9.2.

github.com/emoncms/emoncms

force browser cache reload

committed 08:33PM - 20 Oct 18 UTC

+7 -5

Re-running emonPi update or a manual git pull on the Emoncms core should fix the issue. Alternatively manually clearing the browser cache should fix the issue by forcing the browser to load the updated resources.

Apologies for the hassle, thanks for the support.

glyn.hudson · 2018-10-21T00:13:21.806Z

borpin:

Good job it is enabled… GRD (for the youngsters amongst you, Grinning Running Ducking)…

Is this comment directed towards our recent efforts to increase security by disabling SSH? If you have any comments to make please voice them in the thread

emonPi SSH disabled by default emonPi

For the emonSD release emonSD-30Oct18 (based on Stretch) SSH will be disabled by default for increased security. SSH can be enabled by either: The standard Raspbian way: adding a txt file in /boot called ssh I see this being the preferred method of emonBase users where the SD card is easily accessible. A USB keyboard and HDMI monitor can also be used to create the file if no SD card reader is available. Press and hold the emonPi LCD button for 5s This would be the preferred method for em…

For the record enabling SSH would only require a 5-second press-and-hold of the push button the emonPi. In my opinion, 5 seconds of a users time is a small inconvenience for the significantly increased security.

Paul_F_Prinsloo · 2018-10-21T03:04:06.355Z

pb66:

As for your original “processing” issue, I’m afraid I haven’t a clue, but it’s worth asking, have you tried clearing the browser cache? (ctrl-f5)

This sorted my problem , Ill remember in future to check this first. Thanks !

nuno_faria1 · 2018-10-21T10:07:44.923Z

thanks for the support. should also remember the ctrl-f5 browser refresh.
its working after updating to 9.9.2

borpin · 2018-10-21T10:10:12.063Z

glyn.hudson:

Is this comment directed towards our recent efforts to increase security by disabling SSH? If you have any comments to make please voice them in the thread

Oh @glyn.hudson, did you not get the GRD bit???

glyn.hudson:

For the record enabling SSH would only require a 5-second press-and-hold of the push button the emonPi. In my opinion, 5 seconds of a users time is a small inconvenience for the significantly increased security.

Once enabled, does it stay enabled?

glyn.hudson · 2018-10-21T15:53:19.725Z

borpin:

Once enabled, does it stay enabled?

I’ve answered on the thread:

emonPi SSH disabled by default emonPi

Correct, when SSH is enabled via a long press of the LCD push button the user is presented with the default password and prompted to change it. It’s presumed that since the user chose to enable SSH they would change the default password as prompted to their own secure password. If a user did wish to disable SSH it’s just matter of running: sudo update-rc.d ssh disable sudo invoke-rc.d ssh stop Leaving SSH enabled is not insecure as long as it’s got a strong unique password. It would be possib…