Updating system libraries used by emoncms

Paul · 2018-01-17T23:04:44.943Z

Should we still be mentioning php5 when the current installation guide is for Stretch, which specifies php7.0?
Users should be building systems from current standards, not archives.

Paul, please feel free to update the current build guide.

Paul

borpin · 2018-01-18T08:21:15.273Z

I’d go further than this and suggest a script that took out the guesswork, checked for PHP versions and created the right links.

Am I right in thinking that this is also better a better method if you are using a stack that is not Apache? i.e. works for all stacks?

Could also have a small script for the MQTT libraries as well.

I’d suggest, it may well be easier to maintain a script, than keeping the install guides correct. This may well get more of a chore as the Stretch v Jessie questions arise as folk start to migrate.

All I’d ask is that the script’s commands run at the same level the script is run at. I tend to use DietPi which has a root login as default so scripts with a liberal sprinkling of ‘sudo’ are a pest!

Paul · 2018-01-18T10:22:57.299Z

Summarizing the suggested changes so far (so they don’t get forgotten/overlooked!)

Remove dio installation from build guide
Change the way in which redis is referenced
Change the way in which Mosquitto is referenced
Consider the development of a install script
Consider changing the way in which Mosquitto is specified - discussed, and agreed that Mosquitto-alpha should continue to be specified in the build guide.

Paul

borpin · 2018-01-18T10:32:44.851Z

Paul:

Summarizing the suggested changes so far (so they don’t get forgotten/overlooked!)

Can we add “Update the method the Mosquitto libraries are referenced”. Looks to me this is the same issue.

Also, “Changing the mosquitto library” as that was where this thread started

borpin · 2018-01-18T10:34:46.481Z

Paul:

Consider the development of a update script

I was thinking of an install script rather than an update script as updating is likely to be a little more fraught!

Paul · 2018-01-18T10:40:50.236Z

borpin:

Also, “Changing the mosquitto library” as that was where this thread started

I thought the decisions was that the current Mosquitto command pulled the latest version anyway - so no need to change. Or have I mis-read.

Paul

borpin · 2018-01-18T10:43:17.637Z

Paul:

I thought the decisions was that the current Mosquitto library pulled the latest version anyway - so no need to change. Or have I mis-read.

I wasn’t sure if that was more by luck than judgement. Be worth adding in as a positive ‘leave it alone’ rather than implied (just for the record as it were).

Paul · 2018-01-18T10:49:25.449Z

Well how about changing;
sudo pecl install Mosquitto-alpha
to
sudo pecl install Mosquitto
…and let PECL decide the version?

Any thoughts @pb66 Paul & @glyn.hudson .

Paul

pb66 · 2018-01-18T12:38:41.781Z

Paul:

Well how about changing;

sudo pecl install Mosquitto-alpha

to

sudo pecl install Mosquitto

…and let PECL decide the version?

Unfortunately that won’t work

pb66:

By specifying -alpha it defines the acceptable release level deemed acceptable as “alpha”, ie any stable, beta or alpha releases are allowed, the default unless overridden in this way is “stable”. Since there has not yet been a release tagged as “stable” we have to use a -alpha or -beta suffix otherwise the install will fail, stating there is no stable release available.

So whilst there may arguably be some benefit in using mosquitto-beta to avoid potentially buggy “alpha” releases, I don’t think any change is needed except to be mindful that we may not all be running the same version when debugging and to possibly include checking for upgrades once in a while rather than just blindly sticking with whatever was the release at the time of initial install, just in case it goes to a “stable” release.

Paul:

Should we still be mentioning php5 when the current installation guide is for Stretch, which specifies php7.0?

Good question, I would say not IF the guide was truly a “Stretch” guide rather than a “Raspberry Pi 3 Raspbian Stretch for emonBases only” guide, by that I mean it should not exist in a Raspberry Pi folder, it should not reference the Pi user or user folder and there should be no mention of any thing to do with the serial port or the config.txt etc, after all there is actually no connection between emoncms (which is the topic of the guide) and the serial port configuration, that should be in a separate emonhub guide, linked from here. I would guess that oncw you remove the pre-built emonSD users, there are possibly less users installing emonHub or to a device with a serial port than not.

There really is no reason this same guide (or potentially, script) couldn’t be used for Debian, Ubuntu or probably even DietPi too, hopefully any Debian9 (aka Stretch) based distro, even shared hosting if commented well. Plus clearly separating the LAMP section from the install emoncms section (probably within the same guide) would also provide an easier guide for users to follow even when installing emoncms alongside an existing setup.

glyn.hudson · 2018-01-18T16:30:22.519Z

Paul:

Is everybody in agreement that we remove the dio module from the installation guide?

pb66:

Can we please start installing the extensions using the provided mechanism rather than manually creating multiple text files?

Yes, I’ve updated the install guides:

github.com/emoncms/emoncms

remove php dio

committed 04:30PM - 18 Jan 18 UTC

glynhudson

+2 -7

not used any more

github.com/emoncms/emoncms

setup guide: remove dio,. install php extensions correctly

committed 04:47PM - 18 Jan 18 UTC

glynhudson

+31 -36

pb66:

Regards the redis extension, we have discussed that in some depth elsewhere, but using the install guide will fetch the latest version, only the emonSD image needs further discussion as there are 3 install methods used on that image and it has historically been fixed at v2.2.8.

I’m assuming you mean v2.2.7? Here is the current emonSD build guide setups:

Note: at time of writing the version of php5-redis included in the Raspbian Jessie sources (2.2.5-1) caused Apache to crash (segmentation errors in Apache error log). Installing the latest stable version (2.2.7) of php5-redis from github fixed the issue. This step probably won’t be required in the future when the updated version of php5-redis makes it’s way into the sources. The check the version in the sources: sudo apt-cache show php5-redis

git clone --branch 2.2.7 https://github.com/phpredis/phpredis
cd phpredis
(check the version we are about to install:)
cat php_redis.h | grep VERSION
phpize
./configure
sudo make
sudo make install

Is there any change log for php-reds? What is the current recommended stable version? I’m happy to test newer versions and consider updating emonSD if there are any relevant fixes.

pb66:

whilst there may arguably be some benefit in using mosquitto-beta to avoid potentially buggy “alpha” releases

This is a good idea. I will change ‘alpha’ > ‘beta’ in in the emonSD build guide. I would prefer to use as stable versions as possible.

github.com/openenergymonitor/emonpi

use beta mosquitto version

committed 04:58PM - 18 Jan 18 UTC

glynhudson

+1 -1

pb66 · 2018-01-18T17:01:32.389Z

That commit also removes installing the swiftmailer module and that’s the “linux install guide” which isn’t the current mainstream guide,

~~it needs changing at emoncms/docs/RaspberryPi at master · emoncms/emoncms · GitHub~~ [edit - removed as @glyn.hudson did this whilst I was writing]

and possibly at emoncms/jessie.md at master · emoncms/emoncms · GitHub too.

I have also noticed that the emonSD build guide in the emonPi/docs folder points to the stretch version not the jessie version since, most likely because the emoncms/docs/raspberrypi/readme.md got switched out from jessie to stretch, that needs editing to point to the jessie guide.

glyn.hudson · 2018-01-18T17:03:32.699Z

pb66:

I have also noticed that the emonSD build guide in the emonPi/docs folder points to the stretch version not the jessie version since, most likely because the emoncms/docs/raspberrypi/readme.md got switched out from jessie to stretch, that needs editing to point to the jessie guide.

Where is this? Please link to the relevant line. I can’t see reference to Stretch in the emonSD build guide

glyn.hudson · 2018-01-18T17:08:25.178Z

pb66:

Regards the redis extension, we have discussed that in some depth elsewhere, but using the install guide will fetch the latest version, only the emonSD image needs further discussion as there are 3 install methods used on that image and it has historically been fixed at v2.2.8.

I have been using redis v3.1.4 for several months without an issue and now upgraded to 3.1.6 without any obvious issues yet, however I am using php7 on Stretch not am emonSD image so it needs testing for php5.

Can you remember which old thread discussed upgrading php-redis? I’ll give it a go and setup a test.

pb66 · 2018-01-18T17:17:58.064Z

glyn.hudson:

I’m assuming you mean v2.2.7?

yeah, sorry I did, v2.2.8 was/is the latest stable/tested “php5” vision that we could update to prior to the release of a stable php5/php7 common release.

glyn.hudson:

Is there any change log for php-reds? What is the current recommended stable version? I’m happy to test newer versions and consider updating emonSD if there are any relevant fixes.

https://pecl.php.net/package-changelog.php?package=redis&release=3.1.6

I would recommend testing the latest stable version (currently 3.1.6) by installing without defining a version (or beta/alpha) sudo pecl install redis and then work back if that doesn’t work.

I have tested 3.1.4 for months on php7 and upgraded to 3.1.6 without any issues (yet?) but as for php5, I am running 3.1.3 on a RPi server with heavy traffic and have not noticed any anomalies, but this is a backup “2nd set of data” server that rarely gets looked at. pre 3.1.3 versions (post v3) had some issues with rounding precision on php5 that were resolved in 3.1.3.

pb66 · 2018-01-18T17:19:52.195Z

glyn.hudson:

Can you remember which old thread discussed upgrading php-redis? I’ll give it a go and setup a test.

Is it Php-Redis 3.1.1?

pb66 · 2018-01-18T17:24:52.483Z

glyn.hudson:

Where is this? Please link to the relevant line. I can’t see reference to Stretch in the emonSD build guide

Just below the install-emoncms-core section header it says “Follow Emoncms Raspberry Pi Raspbian Jessie install guide” and links to the stretch guide indirectly using the emoncms/docs/rasperrypi/readme.md url.

pb66 · 2018-01-18T17:40:02.207Z

pb66:

That commit also removes installing the swiftmailer module

…and the redis module too

It also seems to have an unresolved merge conflict

**For Ubuntu 14.04**:

<<<<<<< HEAD
    sudo apt-get install apache2 mysql-server mysql-client php5 libapache2-mod-php5 php5-mysql php5-curl php-pear php5-dev php5-mcrypt php5-json git-core redis-server build-essential ufw ntp

on 16.04:
=======
    sudo apt-get install apache2 mysql-server mysql-client php5 libapache2-mod-php5 php5-mysql php5-curl php-pear php5-dev php5-mcrypt php5-json git-core redis-server build-essential ufw ntp -y

**For Ubuntu 16.04**:
>>>>>>> 2c38b02253e3edc8fbb18582f970946dbeac5830

`sudo apt-get install apache2 mysql-server mysql-client php libapache2-mod-php php-mysql php-curl php-pear php-dev php-mcrypt php-json git-core redis-server build-essential ufw ntp -y`

Paul · 2018-01-18T20:00:51.149Z

@glyn.hudson - there is now also a merge conflict in MQTT.md too.

Paul

merge608×576 22.4 KB

glyn.hudson · 2018-01-27T21:42:50.059Z

Oh dear, very sorry about this. Thanks so much for fixing.

Paul · 2018-04-06T19:41:29.590Z

Paul:

Well lets ask the question! - Mosquitto-alpha · Issue #84 · mgdm/Mosquitto-PHP · GitHub

It looks as though mosquitto-php is going to get updated…

github.com/mgdm/Mosquitto-PHP

Mosquitto-alpha

opened 10:10AM - 16 Jan 18 UTC

Paul-Reed

I see that your README.md still suggests users use (PECL) Mosquitto-alpha instea…d of the latest version (v0.4.0?), is this purely because the read-me has not been updated, or are there other reasons to use Mosquitto-alpha in preference. ie, should the README now read `pecl install Mosquitto` which I assume would install the latest?