Runway 发布 Solaris:实时生成软件界面的 Interface World Model

内容摘要
Runway公司推出了名为Solaris的“界面世界模型”,该模型通过实时渲染用户界面,并直接响应点击或语音指令,旨在取代固定应用,实现动态环境以适应用户需求。Solaris基于Gen-4.5视频模型,能够将设计直接渲染为720p界面,并支持拖拽、点击或语音命令操作。该系统适用于在线购物、产品可视化、教程和学习教育等领域。Runway认为,随着AI技术的发展,传统的“应用”固定单元将逐渐消失,操作系统将能够自主生成所需界面。然而,由于文本渲染仍存在误差,且不支持屏幕阅读器,Solaris目前仍处于研究阶段。Runway正在寻找合作伙伴,并计划通过表单提供早期访问。
Runway公司推出了名为Solaris的“界面世界模型”,该模型通过实时渲染用户界面,并直接响应点击或语音指令,旨在取代固定应用,实现动态环境以适应用户需求。Solaris基于Gen-4.5视频模型,能够将设计直接渲染为720p界面,并支持拖拽、点击或语音命令操作。该系统适用于在线购物、产品可视化、教程和学习教育等领域。Runway认为,随着AI技术的发展,传统的“应用”固定单元将逐渐消失,操作系统将能够自主生成所需界面。然而,由于文本渲染仍存在误差,且不支持屏幕阅读器,Solaris目前仍处于研究阶段。Runway正在寻找合作伙伴,并计划通过表单提供早期访问。
Image description

Runway

Key Points

  • Runway has unveiled Solaris, an "Interface World Model" that doesn't run user interfaces as code but renders them live and responds directly to clicks or voice.
  • The system aims to replace fixed apps with dynamic environments that adapt to the user, and could prove useful for interactive shopping or visual tutorials.
  • With text rendering still error-prone and no support for screen readers, the system, which builds on the Gen-4.5 video model, remains a research effort for now.

AI company Runway has unveiled Solaris, the first model in a new category it calls "Interface World Models." Instead of running code, the system generates the user interface frame by frame as you interact with it.

Rather than translating a design into code first, the model renders the interface itself in 720p and responds to clicks, drags, or voice commands. That's a sharp break from how software normally works, where the operating system decides what happens on screen and an app stays the same until someone ships an update.

Runway lists several use cases: In online shopping, the store itself would become the interface, with users dragging a shirt onto a picture of themselves to try it on. A shop would no longer be a fixed layout but would adapt to each user.

视频 · 前往原文观看

For product visualization, you can say "move the table" or "change the color of the couch," and the scene reacts instantly, which Runway sees fitting furniture and interior planning.

The company also sees a use for tutorials and learning. Instead of a text answer like a chatbot gives, Solaris shows the next step visually in its own context, for example as a combustion demo with different materials.

视频 · 前往原文观看

Runway wants the "app" as a fixed unit to disappear

Solaris builds on Runway's video model Gen-4.5 and follows the path the company started with GWM-1. A language model decides how the interface changes, while the world model renders each frame. Runway also sees it as a training ground for AI agents, which still fail at tasks like hotel bookings because they're trained on fixed layouts and can't handle websites that deviate from them.

Runway's bigger claim is that the "app" as a fixed unit will disappear. Today, getting something done means opening the right prebuilt app, one for shopping, one for messages, one for reservations. If an operating system can generate the right interfaces on its own, there's less reason to sort software into a fixed catalog of apps.

视频 · 前往原文观看

An online store would then no longer be a fixed layout that everyone sees the same way, but a generated environment that adapts to each user. Whether people actually want interfaces that keep changing is a question Runway leaves open.

For now, this is still a long way off, as Runway says stable, readable text remains a hard problem to solve even though interfaces depend heavily on it. Long sessions and reliability are open questions too, and a wrong but convincing-looking result can be worse than none at all. A generated interface also has to work with assistive tech like screen readers.

That makes Solaris a research effort for now. Runway is looking for partners for a launch and offers early access through a form.

Runway

原始发布方:The Decoder:AI News(RSS)

原文时间:2026-09-01 20:53:46 +08:00

阅读原文 · 数据来源:AIHOT

提示

本文用于信息整理与经验分享。第三方订阅、支付及账号服务可能调整,实际规则、价格和可用性请以下单页面及服务方最新说明为准。

咨询 GPT 充值咨询充值