Hi, I made a data logger for some Bee Hives and due to the location no internet access is available. The data is in CSV format. I can format it any way to make use of the Emoncms API. The road block I am hitting is how to get the data into Emoncms, I did see some talk on the forum regarding Curl, P…

Followup: it appears that none of this works with emonCMS.org – it is silently failing at present on all API requests that include a time= or an offset= argument. Here’s a more more extensive bulk upload script – I’ve included a function to repeatedly upload a random 1-10 value at a specified inter…

Ok, So a bit of an update. After struggling with Curl, I found python to be better and after a crash course I have come up with a py script which will post the contents of a text file, did a test with 5 api calls. My main question now is what are the restrictions on posting data/ being kind to the…

Hi, I’m still playing with this kind of thing at the moment. With it being a self hosted install, its kind of hardware dependent. At the moment, I’m importing data points in 5000 at a time, and its taking 2 hours to do a month. However, this is doing a full process list as well as if the data wa…

Thanks Jimmy. I’m posting to emoncms.org and am only doing api calls like https://emncms.org/input.json?&nodeid=10 with UNIX time and csv values. Python was as complicated as my abilities would extend to. :confused: I would be interested in uploading by php if I could get my head around the code a…

Hi Jimmy, just wondering fi you would be prepared to share your method/ script for uploading 5000 points. My python script is working but as I have no error handling (a bit beyond me :persevere:) at random intervals it seems to be refused a connection from emoncms.org . Then I have to start it from w…

Hi Paul, Not a problem, for the most part this worked, looks as though the time went a bit funky on my solar feed for some reason. So it’s not imported from April 2016 onwards, but that’s nothing to do with the script. I’m away from my scripts at the moment, but around 9ish I’ll be there so will u…

Hi Again, Right so I am around my scripts now. Mine all used mysql to pull the old data out, and then push it back in, however this concept will work with a csv with a few alterations. What information is it you have that you are wanting to input and what is its current format? Looking at what yo…

Hi, I have written a quick script, attached emoncmsCSVImporter.php.txt (2.7 KB) , at the moment it has the provision to take in the three parameters “Unix time”, “Temperature”, and “Humidity”. The script is fully documented, so you can change it as you need to. Generally speaking I prefer to run…

Hi jimmy. Thanks heaps. I did have some luck with the bulk api, but after reading you php script and pretty well understanding it including changing it to suit my needs I think it will fit my needs perfectly. I appreciate your help and sharing your code, the older I get the more I seem to learn. …

Hi, Yes you will need curl installed, I cheat on Linux when installing it as I install php5-curl so it pulls all of the dependencies at once. If you have emoncms running on a windows machine and Linux on another, you could just have the script and your CSV files on the Linux one posting to the win…

This was failing for me with PHP Notice: Undefined offset. For some reason beyond my limited PHP comprehension, the script was reading a blank final line even though my CSV didn’t have one. Also, it wasn’t executing the final sendChunk. Here’s my modified version of the script with those issues …