Show HN: Giving Opus 5.5 a simulated paint canvas

(stillwet.art)

83 points | by alstonite 17 hours ago

12 comments

  • moojacob 24 minutes ago
    It’s interesting how diffusion models are getting bitter lessened by LLMs. I suspect anthropic has tens of thousands of RL environments recreating famous paintings with code because it was anthropic employees who first started posting about these capabilities on X.

    Opus is also getting decent pixel art. I have ran some experiments with Opus 5.5 to turn 90s pinball displays (black and white pixel art) into double resolution colored remastered pixels.

    https://files.catbox.moe/tbx2u7.png

    I prompted it a lot but didn’t draw any pixels. Seems to be bad at hands still. I think a skilled pixel artist could greatly speed up their work with Claude code.

    It also makes me sad for artists. They didn’t get paid much anyway. Art should be something human to human like writing text. Although, most large commercial art products (marvel movies) already lack any human to human connection you see in paintings or indie games. The large commercial art products will be 50% AI soon.

    • ncr100 5 minutes ago
      > Art should be something human to human like writing text.

      I support this should comment.

      Opining:

      Musing about the ethics of generative AI art is becoming easier, certainly there's a lot more aggressive feedback in the wind, although I think it's clear, people still want people to grow and share themselves.

      Don't fool yourself into thinking that we as technologists are not creating a mind. A viable mind with fewer rights than you or I. But potentially one that will be creative and feel and worry. I don't think we're there yet, in spite of openai claiming AGI 3 weeks ago with whatever that model's name was.

      There's a pro-consumerism argument implicit with current culture's unsophisticated unthoughtful easy usage of generative AI.

      Sticking to your ethics is becoming more challenging as an artist who uses AI. Copying the Great Masters has been commonplace for a long time, probably for as long as art has 'existed'. Yet with AI, if the individual human is meticulously driving the progression of their AI artwork creation, they are still leveraging technique, and control over technology, and presentation effort of other humans, cooked into a model that often times has not compensated those original human contributors. So it's unethical, even if not 'artistically'.

      Q: Is it too absurd to claim that using a clawhammer, manually to do construction or destruction work IRL, is similarly unethical?

    • demibabs 2 minutes ago
      Is this an example of the bitter lesson? Could diffusion models not be this good with equal scaling/compute as LLMs?
  • danielvaughn 4 minutes ago
    Very interesting. I think a useful experiment would be to show AI a photograph, then ask it to paint it or draw it.
  • dangoodmanUT 7 minutes ago
    This is such a good idea. Idk how to make this a benchmark, but it should be (maybe elo?).

    Should be a Twtich stream tbh

    • vunderba 5 minutes ago
      The idea of using an LLM to drive graphic output is pretty popular, so I definitely wouldn’t be surprised if there are already several benchmarks out there already.

      I've seen a few voxel-based benchmarks built around the same idea, with LLMs effectively constructing models using a discrete set of instructions.

      https://minebench.ai

  • cronin101 4 hours ago
    This is simultaneously incredibly impressive and annoyingly uncanny valley, since most of the landscapes are "ruined" by a cluster of churches right next to each other that is completely nonsensical.
  • albert_e 11 hours ago
    This is in the same space as this creative exploration posted a few months ago -

    ---

    Training AI to Paint with Code, March 2026

    https://surya.website/rling-qwen-to-paint-with-code

    HN Discussion:

    https://news.ycombinator.com/item?id=49411800

    Thesis presentation:

    https://vimeo.com/1190839818

    And I believe the HN user who created this is @kickingkeys

    ---

    fascinating space to explore:

    Instead of having AI directly generate an output, what happens if we ask AI to take a stab at the PROCESS of creating something.

  • threethirtytwo 14 minutes ago
    I find it unlikely that there's any direct training data for this. I'm talking about direct training data for using brush strokes like humans to construct an image.

    Correct me if I'm wrong but this capability is emergent, and very very compelling evidence that LLMs are actually intelligent.

  • davidcollantes 5 hours ago
    I love the canvases, and truly would like to have a bit more inside on the process this specific author used to reach the results shown. I have read Surya's "Training AI to Paint with Code" but, what's Alice's technique?
  • BobbyTables2 15 hours ago
    I’m a bit behind the times…

    How does Opus actually paint? Thought it only generated text…

    • TeMPOraL 0 minutes ago
      Half of the industry is, going by the amount of "AI doesn't amount to anything and is just regurgitating text".

      Two things:

      - For the past year or more, many models can emit images directly, and all models that matter can see images directly - that's what "multimodal" means. Tokens don't have much to do with textual language anymore, they're more like units of sensory experience.

      - Even restricted to text, a language model can operate anything that can be expressed as text, as long as you have a translation layer between textual representation and the final form. That includes giving commands as text. The total addressable space of what models can do (however badly or well) is, thus, approximately anything humans can do.

    • vunderba 15 minutes ago
      Think of it like the old turtle graphics feature in the LOGO programming language.

      You give an LLM a virtual canvas and a set of “instructions” to control the pen.

      https://en.wikipedia.org/wiki/Turtle_graphics

    • ncr100 3 minutes ago
      Another idea:

      You can generative AI to create an embedded web page of a voxel Mona Lisa head. And it will generate basically an image.

      And I Hope you could ask it to sample that image and extract out of it. A binary that is well formed in the PNG data format...

    • llagerlof 13 hours ago
      It generate commands and coordinates to move the mouse and use the paint tools.
  • mhw11 7 hours ago
    What capability makes this possible? It’s incredible! Does it have an image-generation model?
    • voxic11 3 hours ago
      No this is just it moving the mouse and viewing the results with it's vision capabilities.
  • mannanj 57 minutes ago
    I don’t like how it’s a human aiming to portray the ai generation with their taste and judgements about it but then becoming lazy and quitting on that and leaving in the ai generated portrayal about its own judgment in the site.

    Just share your opinions, dude, we get its ai generated but share your own taste. We want to know what YOU think. Stop being shy and lazy.

  • londons_explore 10 hours ago
    Now combine this with a robot able to move a paint brush and mix on a palette, and you could make some pretty awesome real-paint artwork
    • chasd00 13 minutes ago
      Would be a good project for an afterschool club. Even using a multi color pen plotter + webcam would be pretty neat.
    • albert_e 8 hours ago
      Bob ROS
      • Koala_ice 1 hour ago
        This is an S-tier comment. Thank you for your service.
  • no_multitudes 22 minutes ago
    What a misanthropic thing to make. I'm embarrassed for you.