From PHPFina to CSV?

[Kmcyth (Kevin Senami)]

Hi everybody,

I have questions regarding data saving format : there is something I do not seem to grasp.
I have an emonBase and three emonTh and I currently log every temperature using the PHPFina engine :
Is there a way to automatically produce CSV files of the logged feeds ? Or better yet, is it possible to convert fina generated files to .csv ?

I could use node-RED but it seems an heavy implementation and a quite redundant one.

Something is bothering me because I had the feeling that this was a simple task and that I should not be alone with this use case, still I have not found any detailed answer on the subject.
Moreover it feels like everything is already implemented : from the interface I can manually export a .csv file containing all inputs of a feed. Would it be possible to automate this ?

Any thought, advice or recommendation on the subject ?

Thanks guys, have a nice day.

[Jon (Jon Murphy)]

Kevin -

There is not a automated CSV export that I know of. But you might be able to create one with this info:

Convert phptimeseries to text

For information - The emoncms.org GUI export uses calls of form (Taken from comments in the code) // Export multiple feeds on the same csv // http://emoncms.org/feed/csvexport.json?ids=1,3,4,5,6,7,8,157,156,169&start=1450137600&end=1450224000&interval=10&timeformat=1 To ‘see’ what export URLs are for you, complete the fields on the export form, disconnect your network (Flight mode on my laptop) and click [Export]. It will fail leaving the URL displayed.

or maybe this:

Access data files & convert to csv

John - Below is a PHP program to grab data from a phpfina file and send it to a csv file. You’ll need to change these two lines to meet your needs: $dir = "/home/pi/data/phpfina/"; $outputDir = "/home/pi/data/"; to run it, type in the command with the feed number: $ php export_phpfina_feed_to_csv_v4.php nnn FYI - a 2MB phpfina .dat file will become a 16MB csv file. Download the csv file via putty and then open with MS Excel.   #!/usr/bin/php <?php $time_start = microtime(true); // Direc…

[Kmcyth (Kevin Senami)]

Thank you for the provided answer.

I am quite unfamiliar with PHP : do you have any idea of what would be the best approach to use this PHP program and where should I use it ?
In the mean time I will dig some PHP documentation but if you already have further insights to provide and some time to spare for my question, it would be really helpful.

Thanks again

[Jon (Jon Murphy)]

Hi Kevin - I can give you instructions as they apply to an emonPi. Would that help?

I don’t own an emonbase and I’m not sure I understand the differences. And I am just learning PHP also. Hopefully someone else more proficient can help also!

Keep in mind the CSV created will be stored on the emonbase.

[Bill.Thomson]

@Jon

I’m not sure I understand the differences

Hi Jon,

An emonPi is essentially a RasPi 3 paired with a cut-down emonTx and a digital display.
An emonBase is a RasPi paired with an optional UHF RF module.

The emonPi’s internal “emonTx” has only two inputs vice the four inputs on a “standalone” emonTx.

[Jon (Jon Murphy)]

does it use the same emonSD image?

[pb66 (Paul)]

Yes, for the purpose of this topic there is no difference, only the user values, feeds and processing etc will be different, the structure, SW versions etc should all be the same.

[Jon (Jon Murphy)]

@Kmcyth

I am quite unfamiliar with PHP : do you have any idea of what would be the best approach to use this PHP program and where should I use it ?

Kevin,

Here is a step-by-step guide to use this PHP program:

1. Copy the php program to the /home/pi/data directory of the emonbase.

2. Pick a phpfina test feed and take note of the Feed ID number. Try running the PHP progrmam by entering the following command for Feed ID 1:

php /home/pi/data/export_phpfina_feed_to_csv_v4.php 1

3. If all works as expected, it will create the file:

/home/pi/data/feed_1.csv

FYI - a 2MB phpfina .dat file will become a 12 to 16 MB csv file and will take about 28 seconds to convert to csv.

[Kmcyth (Kevin Senami)]

Great, it works like a charm, thanks !