Skip to content

Beta: real launches, updated every morning. Rankings may change while we tune them.

trnrt

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

trnrt launched on 30 October 2026. It ranked #23 on Daily Launch on 18 November 2026 with a Launch Score of 58, from 48 points on Show HN and +36 stars on 18 Nov on GitHub. It was new in the ranking that day.

Visit site#2 on Show HN the day before · 48 points
Share

What is trnrt?

TrnRT is an open inference engine for large language models on AWS Trainium. It serves an OpenAI-compatible API from one trn2.48xlarge, runs decode as NKI megakernels (about one kernel per layer half), and keeps a prefix cache across device and host memory. GLM-5.3-Flash is the first supported model; more open models are on the way.

From its README on GitHub

trnrt is a launch on Show HN. It is written in Python and released under the Apache-2.0 license.

Daily Launch card for trnrt

In its own words

An open-source LLM inference engine for AWS Trainium

From its Show HN post

Launch timeline

  1. GitHubRepository created

  2. GitHub1.1k stars in 11 days, ranked #112 on Daily Launch

  3. GitHub+280 stars, ranked #21 on Daily Launch

  4. GitHub+188 stars, ranked #52 on Daily Launch

  5. Show HN48 points, ranked #23 on Daily Launch

  6. GitHub+36 stars

Launch Score, last 7 days

05010012 Nov: 5112 Nov13 Nov: 3713 Nov14 Nov: 014 Nov15 Nov: 015 Nov16 Nov: 016 Nov17 Nov: 017 Nov18 Nov: 5818 Nov58 18 Nov
Launch Score, 0 to 100. Days it was not ranked show 0.

#53 of 226 in the roundup for the week of 16-22 November 2026.

Similar new launches