Story

In the news · 1 source · first seen 3d ago · Hacker News
Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to c

Briefing

Written from the coverage below · deepseek-v4.1-flash

RunAnywhere open-sourced TrnRT, an inference engine for AWS Trainium chips, after three weeks of development. It serves two instances of GLM-5.3 Flash (FP8) on a single trn2.48xlarge box with a cache-aware router, reporting 3.57M tokens per minute on one benchmark.

Why it mattersNo vulnerability, actor or defensive relevance; this is an AI infrastructure release, not a security incident.

Actionnone

Coverage

1 article