Upload historical feed data to emoncms.org - user guide?

I recently changed the input/feed house_power for the mysolarpv app after discovering the original input maxed out at ~5kW due to a current clamp limitation. The mysolarpv app is now happily reporting >5kW house_power but I have lost all my data prior to 1st June 2024. As a trial I downloaded 1 days csv data (31st May 2024 00:00:00 to 23:59:59 from the original feed, but I cannot upload it to the new feed using the Import Data button. I get all the right indications regarding format of the pasted csv data, but no data shows in the mysolarpv app for the 31st May. Is there a user guide somewhere, I am doing something wrong. How many lines of csv data can you paste into the upload window?

1 Like

Hello @porboynz

Just tested here with 52,000 lines and that worked fine, that’s enough for 1 year at 10mins interval. That’s fine for 6 days at 10s. 8640 lines per day. I think the upload limit is set by the PHP max file upload size.

The CSV data should look like this:

1686312000, 1737.0
1686355200, 71.0
1686398400, 83.0
1686441600, 68.0
1686484800, 87.0
1686528000, 71.0
1686571200, 92.0
1686614400, 156.0

Thank you for looking at this @TrystanLea. My csv export data looks like this when copied from excel, missing the comma deliminator and the xxx.0 in your example.
1717070400 473
1717070410 473
1717070420 474
1717070430 469
1717070440 472
1717070450 471
1717070460 472
1717070470 471
1717070480 471
1717070490 467

I tried opening the csv export file in Word and copying, but its missing the xxx.0 which I assume is required and the spacing looks troubling? (carriage returns)
1717070400, 473

1717070410, 473

1717070420, 474

1717070430, 469

1717070440, 472

1717070450, 471

1717070460, 472

1717070470, 471

1717070480, 471

1717070490, 467

Importing 10sec data 1 day at a time is impractical if I wanted 12 months historical data, but I am interested in solving this import challenge.

I have been copying the tab separated values from excel and then doing a string replace in a text editor, but I’d be happy to look at auto detection of tab or comma to simplify this.

Is this a local emoncms install or emoncms.org that you are using?

I am using emoncms.org. Ideally the exported data should be in a format that can be directly imported. I tried using a text editor as you suggested to get the format correct as below, but still nothing showing for the 31st May 2024.
1717070400, 473.0
1717070410, 473.0
1717070420, 474.0
1717070430, 469.0
1717070440, 472.0
1717070450, 471.0
1717070460, 472.0
1717070470, 471.0
1717070480, 471.0
1717070490, 467.0
Thanks for the suggestions so far.