Backup/ download data

ChrisJD · 2022-02-01T08:14:54.030Z

I’m not sure I understand the backup process. I have run it, and now have the .tar file. I had expected that this would include the data, but I seem to be wrong.
I can download individual feeds, though there seems to be quite a low cap on file size.
I was simply wanting to back up, and possible analyse, the entirety of my data
Chris

borpin · 2022-02-01T16:16:27.248Z

ChrisJD:

I had expected that this would include the data

When you ran the backup, you will have seen a load of log output such as

phpfina/73.meta
phpfina/34.meta
phpfina/7.dat

These hold the data (and meta info), but in a way that analysing outside of EmonCMS is very difficult.

shallowal · 2022-02-05T02:42:41.744Z

Perhaps you could try this utility:

Python based Emoncms backup utility

Python based Emoncms backup utility Emoncms

I’ve put together a small python based backup utility for emoncms, to make downloading feeds from emoncms.org or any remote emoncms server without importing into a local installation of emoncms a bit easier. The tool also includes a script for converting the downloaded phpfina and phptimeseries binary data into CSV data. This is much faster and more efficient than using the emoncms CSV export api to download all feeds. It’s also desgined to make it relatively easy to download multiple emoncms a…

EnergyX · 2022-02-06T01:40:23.806Z

I thought I had a solution, but it didn’t work. A partial solution is to download all feeds on the node at once. Then at least you can download, say, 6 months at a time for everything.