Octopus energy : Smart Meter Feed

Robert.Wall · 2022-10-06T12:56:30.628Z

Bill.Thomson:

you’re speaking of antenna reciprocity.

Yep, you’re right. The word escaped me at the time. It was late here.

Bill.Thomson · 2022-10-06T14:38:37.021Z

Robert.Wall:

What’s been created is in effect a pair of antennas linked by the cable.

After remembering your “loft” is essentially our “attic,” I’d say yes, it does indeed sound like two monopoles connected via a length of feedline.

Robert.Wall:

It was late here.

Been there and done that.

mjr · 2022-10-07T11:26:09.996Z

Vster:

There was a thread on the Octopus forum a while back -

That link is only visible to octopus agile customers and that’s not a competitive tariff just now. What did it say?

borpin · 2022-10-07T12:33:34.277Z

mjr:

What did it say?

The poster said…

Vster:

Using coax cable -
So 17 cm of copper core exposed and tied to the security tab on the comm hub, then directing it over the left hand side of the hub (where the hub antenna is), and up into the loft (in its full protected sheath) and exposing 17 cm of core again pointing upwards in the loft has improved the reliability of the signal.

Just tried it myself to see if it improves reliability without having to open my garage doors on a daily basis

Vster · 2022-10-07T13:24:01.134Z

@Bill.Thomson here’s the photo (it’s a bit blurry) and the text -

[Owner of the photo requested it was deleted - BPO]

Look at the meter security tab you will see a thin wire that has heat shrink over it, if you look further along you will see the start of the shielded coax. This then travels up the wall to a hole in the ceiling and into the roof void and above the insulation on the ceiling. The other end is also exposed by the 17cm. The exposed measurement is what makes sure it received the correct signal.

[The occupier of the premises advises that the 1.5 mm² wires disappearing off to the left are temporary, put there by the Distribution Network Operator and are connected to their voltage monitor. Moderator (RW)]

Robert.Wall · 2022-10-09T23:44:00.272Z

7 posts were split to a new topic: Dangerous Practice by Supply Authority

Robert.Wall · 2022-10-08T11:40:20.350Z

Welcome, @newbuilder22 to the OEM forum.

Clearly, no-one here was in a position to know that those wires were a temporary installation by the DNO, even so, I think I had a duty as an electrical engineer by profession to call it out, if only to warn anyone reading this topic of the dangers of something like that.

newbuilder22 · 2022-10-08T11:47:35.984Z

Thanks for the welcome, my bigger annoyance is with my photo being posted, although I was asked I didn’t authorise it or I would have trimmed it to avoid this ambiguity.

You called it out without getting fact first. May be a question re, normally these wires shouldn’t be in here, I wonder if the photo is taken during DNO testing, otherwise it should be condemned. You jumped straight to condemning an installation you have no information on. All electricians I know would not pass such a scathing comment even on the phone until they had seen the full installation.

newbuilder22 · 2022-10-08T13:28:59.848Z

Thanks, I think I have said my piece and others have said there’s so happy to be that we have all been grown up and voiced.

For background the small cables are going to a volt recorder that is set up to capture voltage from a very large CT clamp- the large black hoop, the wires are used to power the recorder

Timbones · 2022-10-08T20:59:17.892Z

Vster:

does you script handle missing data? Does recover missing data when it appears?
If so, can we see a copy?

Here is a modified version of agile.py which requests the last 10 days and put it into a cumulative feed instead. On first run it will request the last year. Any missing holes in the data should hopefully be filled in before they fall out of the 10 day window. If you’re still having trouble, make this number bigger.

total.py

This should work off of the same config file*, and (probably) won’t collide any existing setup you might have. (*I’ve not attempted to fix the bugs in the original, so set the tag and feed names in the script before you run it, on two lines).

If this script warrants any further refinement, I’d suggest:

make last N days be user configurable
fixing tag and feed config (without breaking it for users of agile.py)
add support for multiple meters (2 is not uncommon)

Vster · 2022-10-09T21:43:20.193Z

pi@raspberrypi:~/tim_agile $ python3 agile.py
Emoncms feed created: 195676
Number of data points: 100
End: 2022-10-06T23:30:00+01:00 => 16.071000000000005 kWh
Posting data to emoncms

It ran in a few seconds, created the feed OK, but didn’t populate it. Any ideas?

Timbones · 2022-10-09T22:20:44.573Z

Vster:

It ran in a few seconds, created the feed OK, but didn’t populate it. Any ideas?

No idea. Should have just worked. Try running it again in a few days?

mjr · 2022-10-12T17:34:48.636Z

Timbones:

Here is a modified version of agile.py which requests the last 10 days and put it into a cumulative feed instead.

Please can anyone tell me how to use the original agile.py or this total.py to make the “Time of use version of My Electric” app display the calculated cost?

That app seems to want two inputs (use and use_kwh) and each of these seem only to make one, plus puts them in the feed API so I can’t use input processors to create the other (can I?).

Timbones · 2022-10-12T19:12:32.249Z

mjr:

That app seems to want two inputs (use and use_kwh)

Technically, the Octopus feed is only giving you kWh consumed in each half-hour. Dividing by half-an-hour (or multiplying by 2) will give you average kW for that time interval. So, one option is to run both scripts, modifying agile.py to give kW instead of kWh.

Or, edit total.py to populate both feeds at the same time from the single API request.

If you don’t want to mess with code, then a Virtual feed could be created to take agile:consumption, multiply by 2 and give you average power instead.

mjr · 2022-11-07T18:48:05.667Z

Timbones:

Technically, the Octopus feed is only giving you kWh consumed in each half-hour. Dividing by half-an-hour (or multiplying by 2) will give you average kW for that time interval.

Cool. And what is that? The feed called use?

Timbones:

Or, edit total.py to populate both feeds at the same time from the single API request.

If you don’t want to mess with code

I’m quite happy to mess with code. I’ve just no idea what those apps want as input (what use and use_kwh should be) and am unfamiliar with putting things into the feed API instead of the input API, as well as unfamiliar with the Octopus feed.

Editing total.py seems to result in the feeds being created (once I’d solved the hardcoding of the names in the create commands, which meant it was ignoring agile.conf) but only the last values get populated.

Timbones:

then a Virtual feed could be created to take agile:consumption, multiply by 2 and give you average power instead.

but how then do I generate use_kwh? I don’t seem to be able to apply the kwh process to a virtual feed.

Timbones · 2022-11-07T22:56:18.076Z

Let me see if I can explain it better.

Option A

agile.py populates a feed called consumption, which is kWh used per half-hour. A virtual feed that multiplies this by 2000 would give you average power in Watts. This is the “use” feed that “My Electric” app is asking for.

total.py populates a feed called consumption_total which is the cumulative energy that starts at zero and keeps on going up [great for daily/weekly graphs]. This is the “use_kwh” feed to give to “My Electric”.

So, running both scripts and creating a virtual feed will get you want you need.

Here’s a chart showing consumption_total (from total.py) (aka use_kwh) on the left axis and consumption_watts (virtual feed) (aka use) on the right.

image1043×526 93.9 KB

(Plotting the delta of the total on 1800 second interval should perfectly match up with watts)

Option B

Instead of running two python scripts and needing a virtual feed, total.py could do the conversion and populate both feeds at the same time. I can write this up if you think it would be useful, however…

Option C

Had agile.py used the input api to upload the data instead of the feed api, then you could created the two feeds with a standard process list:
x 2000, Log to feed → ‘consumption_watts’, Power to kwh → ‘consumption_total’.

Something like this in place of Step 4 and Step 5 in agile.py:

# Step 4: Process history into data array for emoncms
for dp in data['results']:
   time = int(datetime.timestamp(datetime.strptime(dp['interval_end'],"%Y-%m-%dT%H:%M:%S%z")))
   value = dp['consumption']
   result = requests.post(settings['emoncms']['server']+"/input/post",
               params={'node':'agile','time':time,
                       'fulljson':json.dumps({'consumption':value}),
                       'apikey':settings['emoncms']['apikey']})

You’ll need to change the hard-coded node and input names, making sure the feed has the same name as the input. Once you have it working, empty the feed and run it again so it will download the maximum number of records from Octopus API.

Option C is probably the more typical way of doing things in emoncms, though option B is better for working out-of-the-box. I’ll probably rewrite total.py at some point, and fix the other issues. Hopefully there’s something useful in my ramblings to help you get what you need to get My Electricity app working.

borpin · 2022-12-16T07:32:43.747Z

Vster:

So 17 cm of copper core exposed and tied to the security tab on the comm hub

@Bill.Thomson - I tried this and it appears to have not helped the situation.

I did leave the inner insulation on - would bare core help?

It occurred to me that, if the antenna is on one side of the Comms Hub, is there another sort of antenna that could be used to stick on the outside of the Comms Hub and perhaps be more effective in ‘boosting’ the antenna? Something like this https://uk.rs-online.com/web/p/gsm-gprs-antennas/2188364

Bill.Thomson · 2022-12-16T12:10:02.316Z

borpin:

would bare core help?

Yes. As with any electrical connection, metal to metal contact is necessary.
Even if connected metal to metal, it may not work. An RF ground is very different than a DC ground.

borpin:

perhaps be more effective in ‘boosting’ the antenna?

Once the signal level drops because of cable loss, there’s no way to make it up with a passive device,
i.e. an antenna. An amplifier at the near end of the feedline would be needed to overcome the loss as well as provide some additional signal strength at the far end.

The antenna referenced in your link is meant for operation at 700 MHz and above. It would work
if the transmitter is operating at 915 MHz, but not for a transmitter at 433 MHz.

borpin · 2022-12-16T12:55:27.078Z

Bill.Thomson:

Yes. As with any electrical connection, metal to metal contact is necessary.

The bit around the tag is bare.

Bill.Thomson:

The antenna referenced in your link is meant for operation at 700 MHz and above. It would work
if the transmitter is operating at 915 MHz, but not for a transmitter at 433 MHz.

Oh yes, I knew that wasn’t any use, just wondered if there was something similar that if stuck on the outside close to the existing internal antenna, might help, that I could connect to an external antenna.

Bill.Thomson · 2022-12-16T13:43:32.191Z

borpin:

The bit around the tag is bare.

Earlier, you said:

borpin:

I did leave the inner insulation on

So is it still insulated?
If so, the center conductor needs to be bare too.
Take care to keep the shield (outer braid) from contacting the center conductor.

borpin:

just wondered if there was something similar…

Gotcha.
Given the close proximity between the two antennas, it likely wouldn’t make much difference.