Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to c
Briefing
Written from the coverage below · deepseek-v4.1-flash
RunAnywhere open-sourced TrnRT, an inference engine for AWS Trainium chips, after three weeks of development. It serves two instances of GLM-5.3 Flash (FP8) on a single trn2.48xlarge box with a cache-aware router, reporting 3.57M tokens per minute on one benchmark.
Why it mattersNo vulnerability, actor or defensive relevance; this is an AI infrastructure release, not a security incident.
Actionnone
Coverage
1 article