Browser annotations / @LinearUncle / ZH
Recreate browser annotation interactions from a recording
ENGLISH SUMMARY
Recreate browser annotation interactions from a recording
In response to the REA annotation investigation, this post offers an alternative: record the interaction and have an agent reproduce the visible behavior.
The question
Can a screen recording provide enough reference when reproducing an interaction?
The workflow
- Record marking, writing a comment, and sending it.
- Give the recording to Fable as an interaction reference.
- Implement the feature in the author's own harness.
Findings & output
The author reports recreating the built-in browser annotation feature in their harness using recordings.
Evidence scope
The author's implementation uses recording-based reconstruction; REA refers to dotey's separate investigation. The Opus suggestion is an estimate.
中文摘要
用录屏，复刻浏览器注解交互
回应 REA 的 Codex 注解调查，提供另一条路线：录下标记、评论、发送的完整操作，让助手按可见行为实现。
调查的问题
只复现交互时，录屏是否已经足够提供参考？
怎么做的
- 录下标记、填写评论与发送操作。
- 将录屏交给 Fable，要求按交互复刻。
- 在自己的 harness 中实现对应功能。
发现与产出
作者报告自己的 harness 已通过录屏方式复刻内置浏览器注解功能。
证据范围
作者自己的实现采用录屏方法；提到 REA 是引用宝玉的调查。Opus 的部分是作者估计，不是已验证结果。
Original sources / 原始来源
Checked / 核对 2026-10-12 · Related inspiration / 相关思路