Remix.run Logo
x2tyfi a day ago

It’s interesting to observe and build LLM-driven solutions in Networking.

The biggest challenges that most of us networking people have are around velocity (how fast we can build and scale networks) and how effectively we can operate them (avoid defects, fix them fast when something breaks).

LLMs are great in both areas. AI helps with deployment challenges by speeding up tooling development and the creation of workflows on orchestration platforms. A manual process step today, say - reserving an IP address in an IP DB — is automated the next day instead of on a backlog for years. This post is an example of that (config-gen/config-deploy).

Operations use-cases are more interesting, IMO, and address the “too many signals” problems that we face. Network substrate telemetry, overlay telemetry, service host metrics, service metrics, customer metrics, recent change data, prior alarms - the list goes on. Being a network operator is not for the faint of heart and is under-mentioned on high stress job lists. AI makes AMAZINGLY good network operations triage agents, since they are able to immediately process so many signals.

Exciting times!

protocolture a day ago | parent [-]

>LLMs are great in both areas.

Nuance. LLMs are just going to report that they cant SSH to an endpoint, after delivering your vibeconfig, and throw it back to you to resolve connectivity. Your velocity with LLMs will stall at break fix every time.

>AI makes AMAZINGLY good network operations triage agents, since they are able to immediately process so many signals.

I have seen a lot of tokens spent on solutions that could have just been grafana.

nineohtoo 9 hours ago | parent [-]

I'm a network engineer at a F500 and am no stranger to automation. We use a lot of Ansible and Terraform to manage both on-prem and AWS network infrastructure. Lots of Juniper and Cloudflare products, and we use NetCM, Netbox, Prometheus, and Grafana. But we've been playing with agents since late 2024, and our team has come a long way since then.

It was already easy enough and straightforward to deploy a network because we had built so many CLI tools to handle what we needed, but it still required a bit of a human touch to validate outputs and feed those to different tools. Thanks to skills with helper scripts, we're pretty close to one click deployments these days. So much of our maintenances or operations can even be handled from our phones. We can just tell an agent that there's a new version, or AMI, and we can reliably trust them to safely update the fleet from end to end without causing service disruptions. When customers need updates made, agents draft the PRs and I just review, and they deploy after I approve.

I would argue that most of what makes this possible though isn't LLMs themselves, but having invested in robust network design, consistent standards (snowflake setups or configs will cause you problems), proper observability, and detailed docs/runbooks. While I have my doubts that someone will ever be able to vibe code that knowledge and experience, you can certainly use agents to amplify an already strong engineering foundation.

protocolture an hour ago | parent [-]

>While I have my doubts that someone will ever be able to vibe code that knowledge and experience, you can certainly use agents to amplify an already strong engineering foundation.

Yep, I dont see any disagreement with you at all.