Continuing the discussion from Direct pulse counting:
@Josef_S - can you log in by SSH?
Please post the output of sudo df -h
[edit]
@TrystanLea @glyn.hudson I did raise this as an issue a while ago
Thanks. Just trying to do a bit of investigation, if you don’t mind.
You can post the actual output (just select the PuTTY text as that loads it into the buffer, then in the forum use CTL-E and then paste between the ticks).
What about.
sudo du -h /var/log/
sudo du -h /var/log.old/
sudo ls -laR /var/log/
sudo ls -laR /var/log.old/
To fix it, you need to clear out log files from both /var/log/ and /var/log.old/
Start with the emoncms folder in both, then reboot.
If you can then repeat the commands above I’d be really grateful.
pi@emonpi:~ $ sudo du -h /var/log
44K /var/log/redis
0 /var/log/private
0 /var/log/mysql
0 /var/log/mosquitto
6.9M /var/log/logrotate
1.5M /var/log/emonpilcd
6.0M /var/log/emonhub
4.0K /var/log/emoncms
28K /var/log/apt
0 /var/log/apache2
50M /var/log
pi@emonpi:~ $ sudo du -h /var/log.old
20K /var/log.old/emonhub
116K /var/log.old/emoncms
6.5M /var/log.old
pi@emonpi:~ $ sudo ls -laR /var/log
/var/log:
total 36552
drwxr-xr-x 12 root root 580 Aug 8 01:17 .
drwxr-xr-x 14 root root 4096 Jul 21 2021 ..
-rw-r--r-- 1 root root 0 Dec 23 2022 alternatives.log
drwxr-x--- 2 root adm 100 Oct 2 2022 apache2
drwxr-xr-x 2 root root 100 Dec 23 2022 apt
-rw-r----- 1 root adm 32768 Aug 8 12:02 auth.log
-rw-r--r-- 1 root root 0 May 7 2021 bootstrap.log
-rw-rw---- 1 root utmp 0 Aug 1 00:17 btmp
-rw-r----- 1 root adm 32059392 Aug 8 12:02 daemon.log
-rw-r----- 1 root adm 0 Aug 5 09:54 debug
-rw-r--r-- 1 root root 0 Dec 23 2022 dpkg.log
drwxr-xr-x 2 pi root 180 Aug 6 00:17 emoncms
drwxrwxr-x 2 pi emonhub 80 Aug 8 00:29 emonhub
drwxrwxr-x 2 root pi 80 Aug 7 02:01 emonpilcd
-rw-r--r-- 1 root root 24000 Jul 21 2021 faillog
-rw-r----- 1 root adm 0 Aug 6 13:22 kern.log
-rw-rw-r-- 1 root utmp 292292 Aug 8 10:37 lastlog
-rw-r--r-- 1 root root 3512 Aug 8 11:17 log2ram.log
drwxr-xr-x 2 root adm 200 Aug 8 11:17 logrotate
-rw-r----- 1 root adm 12288 Aug 8 12:02 messages
drwxr-xr-x 2 mosquitto root 60 Apr 10 22:09 mosquitto
drwxr-s--- 2 mysql adm 60 Aug 8 00:17 mysql
drwx------ 2 root root 40 May 7 2021 private
drwxr-s--- 2 redis adm 60 Aug 6 00:17 redis
lrwxrwxrwx 1 root root 12 Jul 21 2021 rotated_logs -> /var/log.old
-rw-r----- 1 root adm 4886528 Aug 8 12:02 syslog
-rw-r----- 1 root adm 0 Aug 5 09:54 user.log
-rw-r--r-- 1 root root 4096 Aug 5 09:54 wifiAP.log
-rw-rw-r-- 1 root utmp 106368 Aug 8 10:37 wtmp
/var/log/apache2:
total 0
drwxr-x--- 2 root adm 100 Oct 2 2022 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-r----- 1 root adm 0 Jul 21 2021 access.log
-rw-r----- 1 root adm 0 Oct 2 2022 error.log
-rw-r----- 1 root adm 0 Jul 21 2021 other_vhosts_access.log
/var/log/apt:
total 28
drwxr-xr-x 2 root root 100 Dec 23 2022 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-r--r-- 1 root root 26868 Dec 18 2022 eipp.log.xz
-rw-r--r-- 1 root root 0 Dec 23 2022 history.log
-rw-r----- 1 root adm 0 Dec 23 2022 term.log
/var/log/emoncms:
total 4
drwxr-xr-x 2 pi root 180 Aug 6 00:17 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-r--r-- 1 root root 0 Aug 6 00:17 apache2-error.log
-rw-rw-rw- 1 root root 199 Aug 8 06:27 emoncms.log
-rw-r--r-- 1 pi pi 0 Aug 6 00:17 emonhub-restart.log
-rw-r--r-- 1 pi pi 0 Aug 6 00:17 emonupdate.log
-rw-rw-rw- 1 pi pi 0 Aug 6 00:17 update.log
-rw-r--r-- 1 root root 0 Aug 8 12:00 wificheck.log
-rw-r--r-- 1 pi pi 0 Aug 6 00:17 wifiscan.log
/var/log/emonhub:
total 6088
drwxrwxr-x 2 pi emonhub 80 Aug 8 00:29 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-r--r-- 1 pi pi 1114112 Aug 8 12:02 emonhub.log
-rw-r--r-- 1 pi pi 5119987 Aug 8 00:29 emonhub.log.1
/var/log/emonpilcd:
total 1464
drwxrwxr-x 2 root pi 80 Aug 7 02:01 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-r--r-- 1 pi pi 475136 Aug 8 12:02 emonpilcd.log
-rw-r--r-- 1 pi pi 1023903 Aug 7 02:01 emonpilcd.log.1
/var/log/logrotate:
total 7024
drwxr-xr-x 2 root adm 200 Aug 8 11:17 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-r--r-- 1 root root 7057408 Aug 8 11:17 logrotate.log
-rw-r--r-- 1 root root 107856 Dec 23 2022 logrotate.log.1
-rw-r--r-- 1 root root 3740 Oct 11 2022 logrotate.log.2.gz
-rw-r--r-- 1 root root 3393 Oct 10 2022 logrotate.log.3.gz
-rw-r--r-- 1 root root 3447 Oct 10 2022 logrotate.log.4.gz
-rw-r--r-- 1 root root 3772 Oct 10 2022 logrotate.log.5.gz
-rw-r--r-- 1 root root 3441 Oct 9 2022 logrotate.log.6.gz
-rw-r--r-- 1 root root 1579 Aug 8 01:17 logrotate.status
/var/log/mosquitto:
total 0
drwxr-xr-x 2 mosquitto root 60 Apr 10 22:09 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw------- 1 mosquitto mosquitto 0 Apr 10 22:09 mosquitto.log
/var/log/mysql:
total 0
drwxr-s--- 2 mysql adm 60 Aug 8 00:17 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-r----- 1 mysql adm 0 Aug 8 00:17 error.log
/var/log/private:
total 0
drwx------ 2 root root 40 May 7 2021 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
/var/log/redis:
total 44
drwxr-s--- 2 redis adm 60 Aug 6 00:17 .
drwxr-xr-x 12 root root 580 Aug 8 01:17 ..
-rw-rw---- 1 redis adm 45056 Aug 8 12:02 redis-server.log
pi@emonpi:~ $ sudo ls -laR /var/log.old
/var/log.old:
total 6472
drwxr-xr-x 4 root root 4096 Aug 8 01:17 .
drwxr-xr-x 14 root root 4096 Jul 21 2021 ..
-rw-r--r-- 1 root root 5864 Dec 23 2022 alternatives.log.1
-rw-r--r-- 1 root root 478 Oct 2 2022 alternatives.log.2.gz
-rw-r----- 1 root adm 1045 Aug 6 00:17 auth.log.1
-rw-r----- 1 root adm 2953 Aug 6 00:00 auth.log.2.gz
-rw-r----- 1 root adm 173 Jul 30 00:17 auth.log.3.gz
-rw-r----- 1 root adm 2944 Jul 30 00:00 auth.log.4.gz
-rw-rw---- 1 root utmp 0 Aug 1 00:17 btmp.1
-rw-r----- 1 root adm 935292 Aug 6 00:17 daemon.log.1
-rw-r----- 1 root adm 1508091 Aug 6 00:00 daemon.log.2.gz
-rw-r----- 1 root adm 41355 Jul 30 00:17 daemon.log.3.gz
-rw-r----- 1 root adm 1508062 Jul 30 00:00 daemon.log.4.gz
-rw-r----- 1 root adm 1357 Mar 14 02:17 debug.1
-rw-r----- 1 root adm 465 Feb 8 19:17 debug.2.gz
-rw-r----- 1 root adm 466 Dec 30 2022 debug.3.gz
-rw-r----- 1 root adm 465 Dec 27 2022 debug.4.gz
-rw-r--r-- 1 root root 118743 Dec 23 2022 dpkg.log.1
-rw-r--r-- 1 root root 11304 Oct 2 2022 dpkg.log.2.gz
drwxrwxr-x 2 root root 4096 Aug 6 00:17 emoncms
drwxrwxr-x 2 root emonhub 4096 Dec 18 2022 emonhub
-rw-r----- 1 root adm 389 Oct 2 2022 error.log.1-2022100212.backup
-rw-r----- 1 mysql adm 20 Aug 8 00:00 error.log.1.gz
-rw-r----- 1 mysql adm 20 Aug 7 00:17 error.log.2.gz
-rw-r----- 1 mysql adm 20 Aug 7 00:00 error.log.3.gz
-rw-r----- 1 mysql adm 20 Aug 6 21:23 error.log.4.gz
-rw-r----- 1 mysql adm 20 Aug 6 00:00 error.log.5.gz
-rw-r----- 1 mysql adm 20 Aug 5 18:04 error.log.6.gz
-rw-r----- 1 mysql adm 20 Aug 5 00:00 error.log.7.gz
-rw-r--r-- 1 root root 2142 Dec 18 2022 history.log.1.gz
-rw-r--r-- 1 root root 3069 Jul 21 2021 history.log.2.gz
-rw-r----- 1 root adm 8192 Apr 11 00:00 kern.log.1
-rw-r----- 1 root adm 7721 Mar 14 02:17 kern.log.2.gz
-rw-r----- 1 root adm 3598 Feb 8 19:17 kern.log.3.gz
-rw-r----- 1 root adm 6042 Dec 30 2022 kern.log.4.gz
-rw-r--r-- 1 root root 365 Aug 8 01:17 log2ram.log.1
-rw-r--r-- 1 root root 540 Aug 8 00:00 log2ram.log.2.gz
-rw-r--r-- 1 root root 228 Aug 7 01:17 log2ram.log.3.gz
-rw-r--r-- 1 root root 600 Aug 7 00:00 log2ram.log.4.gz
-rw-r--r-- 1 root root 264 Aug 6 01:17 log2ram.log.5.gz
-rw-r--r-- 1 root root 226 Aug 5 01:17 log2ram.log.6.gz
-rw-r--r-- 1 root root 224 Aug 4 01:17 log2ram.log.7.gz
-rw-r----- 1 root adm 252 Aug 6 00:17 messages.1
-rw-r----- 1 root adm 1323 Aug 6 00:00 messages.2.gz
-rw-r----- 1 root adm 157 Jul 30 00:17 messages.3.gz
-rw-r----- 1 root adm 1335 Jul 30 00:00 messages.4.gz
-rw-rw---- 1 redis adm 6844 Jul 8 23:56 redis-server.log.10.gz
-rw-rw---- 1 redis adm 283 Jul 2 00:12 redis-server.log.11.gz
-rw-rw---- 1 redis adm 6371 Jul 1 23:57 redis-server.log.12.gz
-rw-rw---- 1 redis adm 282 Aug 6 00:12 redis-server.log.1.gz
-rw-rw---- 1 redis adm 6030 Aug 5 23:57 redis-server.log.2.gz
-rw-rw---- 1 redis adm 325 Jul 30 00:16 redis-server.log.3.gz
-rw-rw---- 1 redis adm 6829 Jul 29 23:56 redis-server.log.4.gz
-rw-rw---- 1 redis adm 286 Jul 23 00:13 redis-server.log.5.gz
-rw-rw---- 1 redis adm 6442 Jul 22 23:58 redis-server.log.6.gz
-rw-rw---- 1 redis adm 286 Jul 16 00:14 redis-server.log.7.gz
-rw-rw---- 1 redis adm 6833 Jul 15 23:59 redis-server.log.8.gz
-rw-rw---- 1 redis adm 318 Jul 9 00:16 redis-server.log.9.gz
-rw-r----- 1 root adm 998050 Aug 8 00:17 syslog.1
-rw-r----- 1 root adm 327088 Aug 8 00:00 syslog.2.gz
-rw-r----- 1 root adm 41017 Aug 7 00:17 syslog.3.gz
-rw-r----- 1 root adm 764571 Aug 7 00:00 syslog.4.gz
-rw-r----- 1 root adm 42582 Aug 6 00:17 syslog.5.gz
-rw-r----- 1 root adm 3481 Aug 6 00:00 syslog.6.gz
-rw-r----- 1 root adm 1214 Aug 5 00:17 syslog.7.gz
-rw-r----- 1 root adm 13104 Dec 18 2022 term.log.1.gz
-rw-r----- 1 root adm 14779 Jul 21 2021 term.log.2.gz
-rw-r----- 1 root adm 760 Mar 14 02:17 user.log.1
-rw-r----- 1 root adm 185 Feb 8 19:17 user.log.2.gz
-rw-r----- 1 root adm 298 Dec 30 2022 user.log.3.gz
-rw-r----- 1 root adm 176 Dec 25 2022 user.log.4.gz
/var/log.old/emoncms:
total 120
drwxrwxr-x 2 root root 4096 Aug 6 00:17 .
drwxr-xr-x 4 root root 4096 Aug 8 01:17 ..
-rw-r--r-- 1 root root 20 Aug 6 00:00 apache2-error.log.1.gz
-rw-r--r-- 1 root root 20 Aug 5 11:26 apache2-error.log.2.gz
-rw-r--r-- 1 root root 20 Jul 30 00:00 apache2-error.log.3.gz
-rw-r--r-- 1 root root 20 Jul 23 00:17 apache2-error.log.4.gz
-rw-rw-rw- 1 root root 20 Aug 6 00:00 emoncms.log.1.gz
-rw-rw-rw- 1 root root 795 Aug 5 15:34 emoncms.log.2.gz
-rw-rw-rw- 1 root root 20 Jul 30 00:00 emoncms.log.3.gz
-rw-rw-rw- 1 root root 388 Jul 29 09:59 emoncms.log.4.gz
-rw-r--r-- 1 pi pi 20 Aug 6 00:00 emonhub-restart.log.1.gz
-rw-r--r-- 1 pi pi 20 Jul 30 00:17 emonhub-restart.log.2.gz
-rw-r--r-- 1 pi pi 20 Jul 30 00:00 emonhub-restart.log.3.gz
-rw-r--r-- 1 pi pi 20 Jul 23 00:17 emonhub-restart.log.4.gz
-rw-r--r-- 1 pi pi 20 Aug 6 00:00 emonupdate.log.1.gz
-rw-r--r-- 1 pi pi 20 Jul 30 00:17 emonupdate.log.2.gz
-rw-r--r-- 1 pi pi 20 Jul 30 00:00 emonupdate.log.3.gz
-rw-r--r-- 1 pi pi 20 Jul 23 00:17 emonupdate.log.4.gz
-rw-rw-rw- 1 pi pi 20 Aug 6 00:00 update.log.1.gz
-rw-rw-rw- 1 pi pi 20 Jul 30 00:17 update.log.2.gz
-rw-rw-rw- 1 pi pi 20 Jul 30 00:00 update.log.3.gz
-rw-rw-rw- 1 pi pi 20 Jul 23 00:17 update.log.4.gz
-rw-r--r-- 1 root root 157 Aug 6 00:15 wificheck.log.1.gz
-rw-r--r-- 1 root root 20 Aug 5 23:55 wificheck.log.2.gz
-rw-r--r-- 1 root root 156 Jul 30 00:15 wificheck.log.3.gz
-rw-r--r-- 1 root root 155 Jul 29 23:55 wificheck.log.4.gz
-rw-r--r-- 1 pi pi 20 Aug 6 00:00 wifiscan.log.1.gz
-rw-r--r-- 1 pi pi 20 Jul 30 00:17 wifiscan.log.2.gz
-rw-r--r-- 1 pi pi 20 Jul 30 00:00 wifiscan.log.3.gz
-rw-r--r-- 1 pi pi 20 Jul 23 00:17 wifiscan.log.4.gz
/var/log.old/emonhub:
total 24
drwxrwxr-x 2 root emonhub 4096 Dec 18 2022 .
drwxr-xr-x 4 root root 4096 Aug 8 01:17 ..
-rw-r--r-- 1 emonhub emonhub 20 Dec 18 2022 emonhub.log.1.gz
-rw-r--r-- 1 emonhub emonhub 2658 Dec 9 2022 emonhub.log.2.gz
-rw-r--r-- 1 emonhub emonhub 20 Dec 8 2022 emonhub.log.3.gz
-rw-r--r-- 1 emonhub emonhub 596 Oct 11 2022 emonhub.log.4.gz
So a lot of the logging has not been happening for a while!
First thing, delete all gz files in both \var\log\ and \var\log.old\ and then reboot.
[edit]
Can you also post
ls -la /etc/logrotate.d/
please 
pi@emonpi:~ $ ls -la /etc/logrotate.d
total 72
drwxr-xr-x 2 root root 4096 Dec 18 2022 .
drwxr-xr-x 89 root root 4096 Dec 18 2022 ..
lrwxrwxrwx 1 root root 71 Jul 21 2021 00_defaults -> /opt/openenergymonitor/EmonScripts/defaults/etc/logrotate.d/00_defaults
-rw-r--r-- 1 root root 716 Jul 21 2021 00_olddir
-rw-r--r-- 1 root root 120 Apr 19 2019 alternatives
-rw-r--r-- 1 root root 442 Jun 10 2021 apache2
-rw-r--r-- 1 root root 173 Apr 19 2021 apt
-rw-r--r-- 1 root root 130 Aug 29 2018 btmp
-rw-r--r-- 1 root root 112 Apr 19 2019 dpkg
lrwxrwxrwx 1 root root 67 Jul 21 2021 emoncms -> /opt/openenergymonitor/EmonScripts/defaults/etc/logrotate.d/emoncms
lrwxrwxrwx 1 root root 67 Jul 21 2021 emonhub -> /opt/openenergymonitor/EmonScripts/defaults/etc/logrotate.d/emonhub
-rw-r--r-- 1 root root 97 Jul 21 2021 log2ram
-rw-r--r-- 1 root root 154 Nov 16 2019 mosquitto
-rw-r--r-- 1 root root 802 May 10 2021 mysql-server
-rw-r--r-- 1 root root 124 Feb 25 2021 redis-server
-rw-r--r-- 1 root root 501 Feb 26 2019 rsyslog
-rw-r--r-- 1 root root 178 Aug 15 2017 ufw
-rw-r--r-- 1 root root 145 Feb 19 2018 wtmp
deleting gz files did not any change.
Thanks for that, as I thought, the changes to the logrotate setup have not been applied as an update.
can you
ls -la /opt/openenergymonitor/EmonScripts/defaults/etc/logrotate.d/
please.
Did you reboot? Did you clear the subfolders too?
What does
systemctl status log2ram
df -h
say
pi@emonpi:~ $ ls -la /opt/openenergymonitor/EmonScripts/defaults/etc/logrotate.d /
total 24
drwxr-xr-x 2 pi pi 4096 Dec 23 2022 .
drwxr-xr-x 5 pi pi 4096 Jul 21 2021 ..
-rw-r--r-- 1 pi pi 206 Dec 23 2022 00_defaults
-rw-r--r-- 1 root pi 118 Jul 21 2021 emoncms
-rw-r--r-- 1 root pi 190 Jul 21 2021 emoncms-non-emonsd
-rw-r--r-- 1 pi pi 181 Dec 23 2022 emonhub
pi@emonpi:/var/log $ systemctl status log2ram
● log2ram.service - Log2Ram
Loaded: loaded (/etc/systemd/system/log2ram.service; enabled; vendor preset: enabled)
Active: active (exited) since Tue 2023-08-08 13:04:21 CEST; 3h 29min ago
Process: 262 ExecStart=/usr/local/bin/log2ram start (code=exited, status=0/SUCCESS)
Process: 31783 ExecReload=/usr/local/bin/log2ram write (code=exited, status=0/SUCCESS)
Main PID: 262 (code=exited, status=0/SUCCESS)
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
pi@emonpi:/var/log $ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/root 4.1G 2.2G 1.8G 55% /
devtmpfs 430M 0 430M 0% /dev
tmpfs 462M 0 462M 0% /dev/shm
tmpfs 462M 47M 415M 11% /run
tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs 462M 0 462M 0% /sys/fs/cgroup
tmpfs 30M 0 30M 0% /tmp
tmpfs 1.0M 4.0K 1020K 1% /var/lib/php/sessions
tmpfs 1.0M 0 1.0M 0% /var/tmp
/dev/mmcblk0p3 11G 79M 9.7G 1% /var/opt/emoncms
/dev/mmcblk0p1 253M 49M 204M 20% /boot
log2ram 50M 50M 0 100% /var/log
tmpfs 93M 0 93M 0% /run/user/1000
there are no .gz files
yes there are 
(and in the subfolders).
and these (more importantly)
Is this something I’ve missed as part of the EmonScripts update process? or just that the update didnt apply in @Josef_S’s case?
I cant delete .gz files
pi@emonpi:~ $ sudo rm -r /var/log.old/*.gz
rm: cannot remove '/var/log.old/*.gz': No such file or directory
Did you check they were still there?
No, I think once the log directories are clear, the update needs to be applied. the logrotate.conf is not is the Scripts folders so isn’t up to date. There is a lone in the update process to add the symlink.
Hello all, I am leaving Emoncms. There is undoubtedly many good work done but it does not work as I supposed. If you follow the EmonTx way and connect an Arduino to Tx pin and use standard setup - that is ok. But everything else needs a couple days exploration and system modification.
For instace: read energy meter DS353 - thats Modbus device. Try to use Modbus interfacer does not work: Why? The serial protocol needs Even parity - how to set it? After setting does not wrk. Why? Modbus registers are holding registers (function 03) but Modbus intefacer knows only Input registers (function 04). After modifying the code meter works.
Another: Pulse meter output S0 connected to pin GPIO4. Pulse counting does not work. What pin number in config is correct? 4 or 7 (GPIO numbered or processor numbered)? No one works. Question to community - no help. Possible problem - /var/log full. Why? I have no time to take care about directories free space.
How long the SD card stays keep a data? Backup? How often? I needed export database in some readable format to make some analysis in Excel. The only possibility is to backup the whole system and restore.
These are things that annoyed me and led to my decision.
Regards
Josef