For some time now we have used ext2 with a block size of 1024 for the emonSD data partition. Following research I did, documented here: Learn | OpenEnergyMonitor . The lower block size of 1024 resulted in ~half the disk write load compared to 4096. My tests for ext2 vs ext4 seemed inconclusive. Does…

[image] borpin: You have mentioned before about the usefulness of the emonhub logs in debugging. The question is, what is the minimum requirement (in terms of time). I have no idea, I would define the period of retention as “as much as the space on disc permits without being silly” keeping a …

Just as a general query, different processes all writing to the same file isn’t going to be an issue is it? I have a feeling feedwriter is now writing to the main log file now. Just asking…

[image] TrystanLea: does the size need to be increased >5MB No idea yet, but I very much doubt it. I’m not sure we can afford more tham 10M in a 40-50MB partition for one service in a fault condition, remember emonhub is the ONLY log that will behave itself under these circumstances, so it’s …

[image] pb66: I would define the period of retention as… In your setup, emonhub is rotating it’s own log in /var/log/. These are then rotated by logrotate, and persisted by L2R? How many do you end up with? [image] pb66: keeping a log that is already written doesn’t add any additional …

[image] pb66: We need to define the whole logrotation picture, not just emonhub. I think we have already agreed to use standard logrotate config for everything else? I think working out the emonhub config would be a good starting point, we can then apply the same to emoncms.log. [image] b…

[image] pb66: copytruncate is costly in terms of space in ram, we would need to maintain a greater headroom for copytruncate to work and not cause logrotate to fail. what should I use instead? could you show an example config?

The discussion I found was here. [Mattan] rsyslog with logrotate: reload rsyslog vs copytruncate rsyslog, logrotate asked by Mattan on 07:40AM - 05 May 15 UTC However, I’m not sure how much of an issue it is for our system. …

Thanks @borpin , I did read that post but could then not find renamecopy in the logrotate manual page here: https://linux.die.net/man/8/logrotate it is however here: http://manpages.ubuntu.com/manpages/cosmic/en/man8/logrotate.8.html Updated suggested emonhub logrotate config: /var/log/emonhub/e…

[image] TrystanLea: /var/log/emonhub/ Are we going to put all logs in an ‘emon’ (rather than emoncms) folder? So /var/log/emon/emonhub?

@TrystanLea , can I suggest that you move the install scripts to a new ‘EmonScripts’ repo, add in the L2R install, plus some initial config and then we could have a common setup (but with different inputs) to be able to comment on?

emonSD next steps: filesystem & logrotate

emonSD

TrystanLea (Trystan Lea) 25 April 2019 09:38 124

what should I use instead? could you show an example config?