Accessing and analysing data from your heat pump
Posted by: @derek-mCathodeRay managed to locate and extract some data from the Mideo controller and data stream.
Indeed I did, and I have documented most of my experiences to date here on this forum in considerable detail.
The bottom line for me - emphasis because others have chosen different routes, this really is a horses for courses thing - is that Home Assassin is a shortcut to incurable and probably terminal insanity. It is (IMHO) very over complicated, the code is a nightmare with a learning curve that makes the North Face of the Eiger look like a gentle ramp.
The python midea_ac_lan package (and other similar ones) manage to snoop on the Midea app traffic but again it is painfully complicated, and only limited data can be collected. Part of the clue is in the name, it is not chiefly aimed at AHSPs, but rather at air conditioners, but there is some overlap. Midea also encrypt the data which doesn't help...
Midea (and Samsung and maybe others) make available a modbus connection in their controllers, and in my experience, for me, this by far the best way to collect and analyse modbus enabled heat pump data. At a practical level, you need to be able to strip thin wires without shredding them and use a screwdriver, and you need to be comfortable with fairly basic python code, plus some form of charting software - the data ends up in a csv file which you can do whatever you want with.
I'm waiting for the heating season to start at which point I will double check my system works and then document what I did here.
The other possibility, yet to be tested in heat so to speak, is not just monitoring the heat pump over modbus, but also controlling it. Again, I will be working on this over the next few months, and will report back findings here.
Midea 14kW (for now...) ASHP heating both building and DHW
@cathoderay Thank you for your efforts.
If we could get the modbus data bridged to MQTT, the Home Assistant integration would probably then be a simple and familiar step for many of the HA community developers. Wish I had more time to learn the basics and have a play myself.
Another option for HA might be to use the File integration to import the data from the CSVs you have been able to create.
File - Home Assistant (home-assistant.io)
Their example only shows how to extract a single value per row out to an entity. Ideally we would be looking to extract multiple values for date, energy consumed, etc.
Posted by: @leichatthe Home Assistant integration would probably then be a simple and familiar step for many of the HA community developers. Wish I had more time to learn the basics
This is the problem: HA developers and a few other understand HA, Joe Bloggs, I and many others don't. Another PITA for me about HA is that because it is a work in progress, the developers have given unto themselves a licence freely to make breaking changes in the code. It drove me (and judging by their forum, many others), nuts.
I did use that file sensor, and I think I mentioned it recently, but why go to all the trouble of doing that in HA? And somehow get round the fact it can only extract the last row - can be done by making sure each reading gets into HAs database, at least until the HA database crashes and burns. It defaults to a sqlite database (and no I am not going to add another painfully complicated 'better' database onto my system) and may or may not be recoverable, probably not. Why not do the charting from the csv file itself? Freely available spreadsheets can do the charting just fine in a few clicks, and I've also posted various examples using highcharts.js, and more recently have found plotly in python works well, Here's a proof of concept screen grab I posted recently of an interactive plotly based chart:
That's the out of the box version, without any tweaking, reading directly from my midea data csv file, only one variable etc, but the point is, it just works. HA, on the other hand, often doesn't (see posts a-plenty on their forum). On the plotly chart, you can zoom in and out at will, select various time ranges (see top left buttons, they are customisable) and takes as many snapshots as you want. Guess how many lines of code were needed?
The code that produced that chart:
import plotly.express as px import pandas as pd df = pd.read_csv('mideadata.csv') fig = px.line(df, x='datetime', y='ambient', title='Ambient Temp with Range Slider and Selectors') fig.update_xaxes( rangeslider_visible=True, rangeselector=dict( buttons=list([ dict(count=1, label="1m", step="month", stepmode="backward"), dict(count=6, label="6m", step="month", stepmode="backward"), dict(count=1, label="YTD", step="year", stepmode="todate"), dict(count=1, label="1y", step="year", stepmode="backward"), dict(step="all") ]) ) ) fig.show()
In short, load the necessary modules, load the data, make a line chart, set some custom things and then show the chart. Even I can understand that!
Once you get to know python (or if you already know it), you will appreciate that getting something into a pandas dataframe (that's what's happening in line 3) is extremely powerful. I think of it as a spreadsheet in memory that you can do almost anything with.
Midea 14kW (for now...) ASHP heating both building and DHW
- 26 Forums
- 2,208 Topics
- 48.7 K Posts
- 23 Online
- 5,868 Members
Join Us!
Podcast Picks
Latest Posts
-
@editor fortunately we have a boiling water tap in the ...
By bontwoody , 3 hours ago
-
RE: Low Flow Rate Error - 8 kW Ideal Logic ASHP - Help!
@wh0am3ye super, glad your back up and running.
By ASHP-BOBBA , 5 hours ago
-
RE: What crazy nonsense are inverter limits and why are they imposed?
A DNO allowing 5kW export on a single-phase supply is u...
By Transparent , 5 hours ago
-
As promised, here's Cap'n Burrows delivering on his pro...
By Mars , 5 hours ago
-
RE: Heat Pump Installers: Competence, Illusion and the Hard Truth Homeowners Must Face
@Fiona, I really don’t want to disappoint you, but I ha...
By Mars , 5 hours ago
-
RE: Are We Sleepwalking Into Another Race to the Bottom?
@dgclimatecontrol, hard to disagree with that. “Zero di...
By Mars , 5 hours ago
-
RE: Daikin 9kW to 8kW Swap Offer from Octopus
@matban I would have to check the CIBSE guide as we hav...
By ASHP-BOBBA , 6 hours ago
-
RE: Ecodan Energy Monitoring Pack
Hi @carpenterstation Did you ever resolve the energ...
By CAMorgan , 7 hours ago
-
RE: is a home battery without an EV worth it?
I would find it difficult to justify a battery without ...
By Batpred , 7 hours ago
-
RE: What is the Heat Geek Guarantee?
Very useful post, one observation: I can see why instal...
By Batpred , 7 hours ago
-
RE: Widespread failure of insulation installation
And there are different kinds I guess. One fri...
By Batpred , 7 hours ago
-
@drei - there is definitely something not right, notwit...
By cathodeRay , 8 hours ago
-
RE: Octopus tariffs - a quick comparison
Great summary, @majordennisbloodnok! I'd take the ho...
By Batpred , 8 hours ago
-
RE: RDSAP10 effect on existing heat pump EPC rating?
@mike-patrick I'm no expert... but believe your ASHP is...
By Tim441 , 11 hours ago
-
RE: Renewables & Heat Pumps in the News
Good News from NESO released today which d...
By Transparent , 11 hours ago
-
RE: Samsung Heat pump with Yonos Pico circulating pump running all the time
I agree with your last last sentence, but for another r...
By JamesPa , 11 hours ago
-
RE: New Fogstar 15.5kWh upright solution
Just wanted to share my experience with this kit, as I ...
By Batpred , 15 hours ago
-
RE: The Hidden Secret to a Successful Heat Pump: Pipe Size Matters
@jamespa And then there was the window company I had...
By davidnolan22 , 16 hours ago