Quantcast
Channel: Raspberry Pi Forums
Viewing all articles
Browse latest Browse all 4151

General discussion • Re: How to process MQTT data as they arrive?

$
0
0
A quick scan of your message makes me think of 'tee', standard UNIX command that can split a stdout pipe. But you need to figure out how to use that.

Overall, I do also have some scripts that use mosquito CLI tools. After years of creating and working via all sorts of logfiles textfiles etc, I am very glad now that the scripts push data immediately in a database. I my case influxDB. I use its v1.x methods, so like SQL. Ones (raw) data is in there, influxDB queries and its build-in dataprocessing capabilities can do what I need. Like averaging, max, min, many other things. Also great if you use Grafana to present data from influxDB.

For really own algorithms, I use Node-RED to get data from influxDB, process it, and push it back for example.
I still have lots old text files with voltages, currents, power consumption and temperature data still not imported into the time-series database, because it is a lot of effort to convert timestamps already ( e.g. UTC v.s. local time is already a mess). influxDB has all methods for that, so you won't waste time on it.

Statistics: Posted by redvli — Thu Sep 12, 2024 7:11 am



Viewing all articles
Browse latest Browse all 4151

Trending Articles