Emoncms, store data in mysql ! possible!?

Daoudi_imad · 5 July 2018 16:12

Hi,

How i can to store my EMONCMS data in Mysql?

As you see, I always have just the latest value that changes in my database. But I want to store all the values in MySQL.

Thank you for your help.

pb66 · 5 July 2018 16:24

yes it is possible if you are not running a low-write version.

Take a look in your settings.php and ensure the mysql line is commented out, it works the oposite way to what you expect, this list is to HIDE unused feed engines

github.com

emoncms/emoncms/blob/9.8.31/default.emonpi.settings.php#L39

    
      
                                    'basetopic'=> 'emon'
                                    );
          
          

          
//4 #### Engine settings
              $feed_settings = array(
                  // Supported engines. Uncommented engines will not be available for user to create a new feed using it. Existing feeds with a hidden engine still work.
                  // Place a ',' as the first character on all uncommented engines lines but first.
                  // If using emoncms in low-write mode, ensure that PHPFIWA is disabled by removing the leading //, from the PHPFIWA entry
                  'engines_hidden'=>array(
                      Engine::MYSQL,           // 0  Mysql traditional
                      //Engine::MYSQLMEMORY,   // 8  Mysql with MEMORY tables on RAM. All data is lost on shutdown
                      //Engine::PHPTIMESERIES, // 2
                      //Engine::PHPFINA,       // 5
                      Engine::PHPFIWA,         // 6  PHPFIWA disabled for compatibility with Low-write mode
                      Engine::CASSANDRA        // 10 Apache Cassandra disabled by default for emonpi, enable if you wish to use
                  ),
          
          
        // Redis Low-write mode
                  'redisbuffer'=>array(
                      'enabled' => true      // If enabled is true, requires redis enabled and feedwriter service running

Then you will need to select mysql as the feed type when you create a new feed.

Daoudi_imad · 6 July 2018 07:46

Thank you, it’s working.

whatsupskip · 7 July 2018 23:05

I would be interested to know what hardware you are running EMONCMS on.

I have found the file sizes are about 5 times larger.

I am currently running EMONCMS on an old AUS SD701 netbook with 2GB of RAM and 8GB of SSD. I have 21 feeds, most updating at 1 minute intervals. I have been thinking about running this on a RPi 3B+ with a small SSD.

Bill.Thomson · 8 July 2018 01:28

Not only that, but the retrieval time is significantly longer with MySQL vice the other data formats.
Especially when viewing more than a couple of months of data.

That was one of the reasons the alternate storage formats were devloped.

Daoudi_imad · 9 July 2018 07:03

I run the EMONCMS in Linux Ubuntu 18.04 8Gb of RAM and 500GB in HARD DISK,