Emoncms.org Maintenance (4pm UK time, 4th September)

I will be upgrading the emoncms.org server’s at around 4pm UK time today. All being well the process should not take too long.

The user interface will be in read-only mode during this period, it will still be possible to login, view feeds, graphs, dashboards and apps but it wont be possible to change configuration such as adding or changing input processing configurations and adding new feeds.

Data posted from devices will be stored in temporary queues to avoid data loss. You may notice the last updated time increase but there’s no need to check your device, the data will still be being received by the server, it will just be that queue processing has been paused.

I will update this thread as the upgrade progresses.

  • Emoncms.org ui in read only mode
  • Update process has started.
  • Input queue processing services have been paused

You will notice feed last update times getting longer, this is fine, data is currently being queued.

Phew, that’s why everything looks stuck at this end.

Panic over!!! :laughing:

1 Like

:joy:

So far so good.

Queues are working through slowly now, looks like about 46 mins until everything catches up:

1 Like

The input processing queue is now back to normal.

Remaining in user interface read only mode for a bit longer.

1 Like

:tada: Full switch over to new upgraded server complete!

:white_check_mark: User interface write access enabled again.

Note: the server IP address has now changed from 109.169.55.159 to 78.129.241.20. It looks like 96% of devices posting to emoncms.org have automatically transferred to the new IP address but there are as has always been the case in the past some stragglers..

emoncms_sync: I’ve had to restart the emoncms_sync process on two emonPi systems that I’ve checked, there seems to be an issue there. A quick restart seems to fix.

2 Likes

A couple of users have highlighted dashboard charset issues. I should have a solution for these tomorrow. If anyone finds charset issues elsewhere outside of dashboards please let me know.

@TrystanLea Trystan - Following the update I’m getting an error when I try and load the solar app - screen shot below. When I close the error box, the app still doesn’t load - it just shows the rotating loading symbol.

Jez

1 Like

Thanks @Jez is the error still present for you now? I’ve set it to force a browser cache reload on related javascript.

@TrystanLea- Yes, Solar App now working OK - great stuff :+1:

Jez

@TrystanLea - very impressive that the design allows for the upgrade and just queues the data to be loaded after the upgrade. Congrats!

3 Likes

Thanks @borpin A lot of work behind the scenes to make that part seamless!

The charset issue should now be fixed for dashboard content at least.

1 Like

We’ve got one ongoing known issue with data not being received from users using solar/battery software http://www.multisibcontrol.net/ to upload data to emoncms.org. If anyone using this software can provide any debug info that would be very useful, I’ve emailed the software authors.

There was also an issue that’s now been fixed with inputs that had a leading white space before input names, due to the way the custom json decoder in emoncms was handling white spaces in the json data. Emoncms.org now trims these white spaces and existing inputs have been fixed to match this change.

I can see that this issue is also present in the standard emoncms code and I will post a fix and update about this in due course. Essentially https://github.com/emoncms/emoncms/blob/master/Modules/input/input_methods.php#L332 needs to be followed by:

$name = trim($name);

The implications of that change however will cause duplicate inputs where inputs had a leading white space previously. This is likely the main reason for a lot of the duplicate input issues we’ve had over the years as data is passed to emoncms sometimes with and sometimes without leading white spaces.

The easiest solution in the mean time to get around it is to post data using parameter fulljson= rather than data= or json=.

1 Like

I’ve lost some data since this change. My emoncms has some inputs from MQTT (this is an ESPAltherma running on an m5stack). These feeds have not updated since the change. I’ve restarted both systems but the feeds aren’t updating.

Any ideas please?

Hello @scanfer , did you set the SSL fingerprint manually on the ESPAltherma?. @boydo just reminded me of this as it’s affected a couple of his devices. I’m looking into it.

Hi Trystan, I don’t think I came across an SSL fingerprint. Unless you mean the MQTT credentials?

I’m using the default (emonpi,emonpimqtt2016)

The upload to emoncms.org is via HTTP, there must be some HTTP settings somewhere?

Ah yes, the settings are in setup.h ISTR.

I’ll have to investigate further when I get some time at home, thanks for the pointer.

What exactly am I looking for?