Repository navigation
Annotate pasted images (arrows, circles, numbered comments) before sending #19126
arthureffting
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Problem
When I paste a screenshot into the chat input, the only thing I can do with the thumbnail is look at it or remove it. Most screenshots I send are about one specific spot ("this button is misaligned", "this error here"), and I end up describing positions in words, or annotating in another tool first and pasting the result.
Proposal
Clicking an attached image thumbnail opens a lightweight annotation editor:
What the agent receives
Comments travel as text rather than drawn pixels, because small rendered text is read unreliably by models, and the numbers on the image tie each comment to its spot. The original image should stay recoverable (re-open the thumbnail to edit marks again).
Out of scope for a first version
Freehand drawing, rectangles, text boxes and cropping. They can follow if the basics prove useful.
Why
It turns "the third button in the second row, the one next to the dropdown" into a circle and a number, and it makes UI feedback loops with the agent much faster and less ambiguous.
All reactions