Iroh

Mesh LLM, built on the peer-to-peer networking library iroh, splits large AI models across whatever GPUs happen to be online: a laptop holds layers 0 through 15, a server holds the rest, and the pool answers as one OpenAI-compatible API. The project's own writeup shipped without a single benchmark.

A commenter dug the only number out of the model catalog anyway, a modest one for a flagship-sized model, right as four existing rivals for the same idea surfaced in the replies.

Last week's climbers: iroh, a Rust stack that dials devices by cryptographic key instead of IP address (and just shipped 1.0); Plane, a self-hostable, air-gap-capable alternative to Jira and Linear; Presidio, Microsoft's PII scrubber that teams now wire in front of every LLM call; Meshery, a manager for your own cloud-native infrastructure.

The odd one out is freeCodeCamp, at 450k stars and trending yet again with nothing new to say. iroh reached 1.0 the hard way: it tore out its QUIC engine and shipped one it wrote itself.

Today's GitHub Trending: iroh, a Rust networking stack that dials a peer's key instead of an IP address; Plane, a self-hosted Jira alternative; LibreTranslate, a translation API you run offline; Unciv, an open-source Civ V remake.

Four of the five exist to delete a dependency: a relay server, a Jira license, the Google Translate API, an ad-funded app store. Their threads praise not features but the missing middleman — “I use dumbpipe daily”, “they don't call home”. The fifth, Microsoft's qlib, reached 44k stars with an empty comment section.

Today's GitHub Trending: iroh, a Rust stack that connects devices by cryptographic key instead of IP (it hit 1.0 this week); Plane, a self-hosted Jira and Linear alternative; LibreTranslate, a translation API that never touches Google; Unciv, an ad-free remake of Civ V.

Not one AI model among them. What unites the list is subtraction: each repo removes a vendor from the picture, and the loudest praise, aimed at Unciv, is simply that it doesn't call home, push ads, or spy on you.

Today's GitHub Trending: iroh (Rust peer-to-peer networking that dials public keys, not IP addresses), Meshery (one control plane for Kubernetes and ten service meshes), NautilusTrader (a self-hosted trading engine — Rust core, Python cockpit), and Unciv (an ad-free open-source remake of Civ V).

The catalyst is at the top: iroh shipped its first stable 1.0 on June 15, after four years and 65 pre-releases, and a maintainer dropped into the Hacker News thread to field questions. Two of the five are Rust — and not one AI agent framework in sight.

In today's GitHub Trending: iroh (a Rust library that dials devices by public key, not IP), Meshery (a Kubernetes-stack manager), and three reference repos — freeCodeCamp's curriculum, build-your-own-x, and a self-hosting guide.

The lists pull the stars; the threads pull the doubt. The top Hacker News comment on the Self-Hosting-Guide calls it «a giant list of tools», not the how-to its title promises, and it hasn't been updated in a year. iroh is the outlier: a maintainer ran an open AMA the day it hit the front page.

The numbers are real: 200 million endpoints created on the public relays in the last 30 days, with about 95% of traffic flowing directly device-to-device instead of through a cloud hop.

Two of Iroh's own developers showed up to field questions, including the hard one a 'really pretty old' networking veteran asked: how does a flat key-based address space scale without every node tracking every other?