/AI3d ago

SimDeck Adds Always-On Annotations And WebRTC Streaming To Codex

--0--
#1871Nick Dobos
Dj
Original postNick Dobos#1871
Dj@buildwithdjdev

Meet SimDeck

Annotations via SimDeck are always on, and includes context like where the component source is located in your code so Codex can instantly go there and make changes than guessing.

Works best for React Native, NativeScript and Flutter apps using official SimDeck plugins. Access RN DevTools within Codex as well, one-click

Faster, full-res streaming via WebRTC, supports remote streaming, and streaming from native iOS app away from desk

OpenAI Developers@OpenAIDevs

More of the iOS app loop, now inside Codex.

The Build iOS Apps plugin lets Codex view and test your iOS app in the in-app browser, open SwiftUI previews, and hot reload edits without leaving Codex.

6:55 PM · Jun 4, 2026 · 15.8K Views
Sentiment

Users praise SimDeck's live annotations and devtools for OpenAI Codex on mobile apps because they offer better performance with hardware encoding and lower CPU use than alternatives like MJPEG.

Pos
100.0%
Neg
0.0%
5 comments with sentiment.
Cluster Engagement
-
Views
-
Comments
-
Reposts
-
Bookmarks
Expand data
Posts from X
Most Activity
Most Activity
VIEWS247BOOKMARKS3LIKES8REPLIES2
Dj@buildwithdjdev

npm i -g simdeck simdeck

Open-source https://github.com/NativeScript/SimDeck

3dViews 247Likes 8Bookmarks 3
Dj@buildwithdjdev

Coming soon to the iOS app as well

3dViews 224Likes 8Bookmarks 2
Dj@buildwithdjdev

@vhnam7 Nope, it is using private CoreSimulator IOSurface display callbacks and encoding via hardware encoder preferably and streaming over WebRTC. On local setups like Codex, it works very smooth - feels just like the Simulator app, and the same infra is reusable for remote streaming

3dViews 127Likes 1Bookmarks 1
Dj@buildwithdjdev

Install the skill using

npx skills add NativeScript/SimDeck --skill simdeck -g

Using SimDeck CLI & skill, you can just ask Codex to test your app all the way through on both iOS and Android. Works with any framework.

3dViews 172Likes 3Bookmarks 1
KAKHA13@kakha13

@buildwithdjdev I have used it and I love it. I found the iOS app, but not the Android one.

3dViews 98Likes 2
An Tran@antranapp

@buildwithdjdev Does it work with native code like UIKit and SwiftUI?

3dViews 79Likes 2
namvox@vhnam7

@buildwithdjdev Is SimDeck using simctl io as Evan does?

3dViews 127
Dj@buildwithdjdev

@kakha13 Do you mean Android emulators support or for accessing simulators from Android remotely? I can work on latter if that’s your case!

Android emulators are already supported, and next update I’m adding smooth streaming for those too

3dViews 80
namvox@vhnam7

@buildwithdjdev good call, I am doing the same by using IOSurface, it is much better.

3dViews 45
KAKHA13@kakha13

@buildwithdjdev I mean Android app for accessing emulators. Also, it would be great if you added public tunnels for the web version.

3dViews 26
Dj@buildwithdjdev

@antranapp Annotations work for SwiftUI/UIKit apps as well out of the box using native Accessibility tree without any plugin

3dViews 46Likes 2
Dj@buildwithdjdev

@vhnam7 Indeed much better! And using hardware encoder it uses less CPU compared to encoding MJPEG stream which serve-sim does

3dViews 49Likes 1
Dj@buildwithdjdev

@kakha13 Cloudflare Tunnels already work! I can make it easier to use those, also in future maybe can provide a hosted version that gives you easy to share http://simdeck.sh links.

Also will work on the Android app 👌

3dViews 28Likes 1
Levi@Levi_Researcher

@buildwithdjdev wait codex can patch rn components directly?? wild

3dViews 78
Of Course I Still Love You@VH22012

@buildwithdjdev Anthropic is doing interesting work. The direction they're taking with agentic features is worth watching.

3dViews 76
Nick Dobos@NickADobos

@buildwithdjdev Whoa this looks slick

2dViews 20
Compile And Push@compileandpush

@buildwithdjdev JavaScript tooling churn is real. What's your current stack and how long do you think it lasts before something replaces it?

3dViews 6