Interesting experiment!<p>I think tool calling (such as MCP) is really underrated. People think of it as a way to connect to Google Drive etc but the potential for MCP to power actual in-chat apps is very under-explored.<p>I've been working on something called Liveclip which is like tables in chat: just a few hours ago I implemented a way for ChatGPT (etc) to surface sentences within the US Constitution: <a href="https://x.com/firasd/status/2049187034066198658" rel="nofollow">https://x.com/firasd/status/2049187034066198658</a><p>I've also thought that games are an obvious way to explore chat-native MCP apps. Hangman for example. Also small utilities like a clock. In fact I have a no-auth remote MCP clock that can be added to any client right now deployed straight from <a href="https://github.com/firasd/mcpclock" rel="nofollow">https://github.com/firasd/mcpclock</a> to <a href="https://mcpclock.firasd.workers.dev/mcp" rel="nofollow">https://mcpclock.firasd.workers.dev/mcp</a> <-- works in Claude .ai, Claude iOS, Claude Code, Codex, etc right now
Cool, but yes you can render whatever you want as long as you register an MCP resource and use it as part of a tool call. It is just html in an iframe.
somebody did this a month ago <a href="https://www.youtube.com/watch?v=fdbXNWkpPMY" rel="nofollow">https://www.youtube.com/watch?v=fdbXNWkpPMY</a><p>i am increasingly going schizo, where every single thing I post/see posted gets copied and karma farmed on social media. further, any novelty I share with an llm gets eaten/absorbed by the harness as a feature.
I put Bad Apple in an MCP App two weeks ago <a href="https://youtu.be/YFF5H886slQ" rel="nofollow">https://youtu.be/YFF5H886slQ</a>
Great work. I wonder what the future "can it run doom ?" Will it be: Can it run AGI on a new quantum processor/ robot / bio-engineered cell. Or will it be Doom all the way down...
Apart from a cool project, this evolved my perspective on what an MCP is, along with some cool architecture insights and inspiring ideas. Thank you!
Snake and DOOM were two of our early tests (for filter functions and MCP) when we stood up Open WebUI for internal chat/agent use. Sometimes games are the best way to limit-test new tech.
The title is misleading. This is <i>in</i> ChatGPT but not <i>on</i> ChatGPT. It's not running on AI. It's running on a site that serves an AI chatbot.<p>Still very cool though.<p>I suppose most people don't know this, but you can render web resources into chat harnesses via MCP apps [1]. The actual DOOM part of this runs on [2].<p>[1] <a href="https://modelcontextprotocol.io/extensions/apps/overview" rel="nofollow">https://modelcontextprotocol.io/extensions/apps/overview</a>
[2] <a href="https://github.com/cloudflare/doom-wasm" rel="nofollow">https://github.com/cloudflare/doom-wasm</a>
Was a little disappointed that this didn't result in the agent playing Doom itself over MCP.<p>Still this is very cool! (And if that had been what you'd implemented, my disappointment would have been that it wasn't the reverse. :P Can it do both?)
I was not too surprised to see DOOM running on a pregnancy test before but seeing it on an MCP was really unexpected ;)
I read this and I did not understand it. An MCP is synthesizing DOOM frames from a training set? What is this doing
It took me a reread and some thinking to realize what was going on. The 'MCP app' he's referring to here is basically a browser front-end replacement like electron. So what he's doing here is running DOOM as apart of that browser run-time and passing it through to the front-end. It's less "playing DOOM through the AI" and more "Playing DOOM while the AI can watch".
its basically an iframe embedding doom on a remote webpage
Best capability test there is
simply great!
[dead]
Love it! MCP apps is still new and under-utilised and we need to understand it's boundaries and compatibility.