Subj : Monitoring BBS logs
To   : Dan Clough
From : Mike Miller
Date : Thu Feb 01 2024 02:26 pm


Hello Dan!

25 Jan 24 21:09, you wrote to all:

 DC> Hello all,

 DC> Wondering what you all do/use for monitoring logs on your boards.

 DC> I have a few terminals open to "tail" various logs on my system
 DC> (running Synchronet).  Been doing it that way for a long while, and it
 DC> works fine, I guess.

 DC> Has anyone used the 'lnav' utility to watch logs?  It's pretty slick,
 DC> has LOTS of options, and I like the use of colors in logs to help
 DC> things "jump out" at you.  If anyone is using this, and has taken the
 DC> time to customize the look/feel of how it displays, would you comment
 DC> on how you're using it, and would you maybe be willing to share your
 DC> custom config that I could use as a starting point to learn how it's
 DC> done?

 DC> Appreciate any input you may have!


The free grafana-cloud tier is plenty for monitoring my bbs server.  I'm streaming the logs to it via the grafana-agent.

Last week I got a wild hair and set up this:

https://snapshots.raintank.io/dashboard/snapshot/ybCmnOlQAJnFye872Dsmdi1ev7EV038q

(snapshot from the last 24 hours as of this post)


I still plan on adding number of messages from/to uplinks/downlinks.  I may actually send out alerts if dupes rise above a certain pecentage.



I do have another dashboard that I'm working on. It has number of connections over time, number of connections by IP address, and a few other things.


doing this via logs is not all that efficient, though. At some point I'll likely create some kind of prometheus exporter to just scrape data, rather than forcing grafana to parse its entire history of logs (only 48 hours worth on the free tier) to display data.

Grafana will, however, allow you to set up alerts based on triggers,  such as a specific line in a log file.  SBBS choked on me in a weird way the other day, for the first time in forever, so I may set it up to send an alert to my phone if something like that happens again.  I didn't catch it, and the board was down for more than a day.





Mike


.... A blind gynecologist can read lips.
=== GoldED+/LNX 1.1.5-b20231112
--- SBBSecho 3.20-Linux
 * Origin: War Ensemble - warensemble.com - Appleton, WI (1:154/30)