Collaborative Movement Study for Realtime AI and Human Improvisation
A co-create iterative feedback loop between human and AI, where visuals are generated in response to the dancer who, in turn, improvises dance in response to ever-changing imagery.
Dancer: Erin Lovrien
2026 ASU MIX Center
Built in TouchDesigner, this real-time Stable Diffusion experience treats the body as both input and interpreter. Instead of typing details and instructions at a terminal, the dancer prompts with her movements. The system isolates the figure from its background and lets gestures, posture, and proximity become the prompt itself. Each motion absorbs into the generative stream: a hand sweep remaps color fields, a turn of the torso dissolves one leaf shape into another.
2025 Mesa Arts Center, 22ft x 12ft
Instead of “AI art” as static image, a relational aesthetics emerges from the visuo-somatic negotiation—algorithmic inference converses with human movement. It replaces linguistic precision with the preverbal ambiguity of embodiment. The interface is no longer textual but proprioceptive; what is generated arises through relation instead of dictation. In this sense, the work reframes “prompt engineering” as an act of listening through motion, a choreography of mutual influence where body and AI model are collaborators composing in real time.
Running a hyper-compact diffusion model locally on a RTX 4070 gaming laptop, the system sidesteps the usual rendering queues, cloud pipelines and textual bottlenecks—traditional affordances that distance the human artist from the algorithmic expression. Custom scripting compresses inference time so that frames cascade as consequences of motion rather than static, prepackaged endpoints. 24fps image generation—a near impossibility for Stable Diffusion—is treated with clever post-processing that pushes response times into a generative visual articulation that is synchronized with the body and preceding the verbalization of it.
This immediacy is not technical bravado; it is philosophical consideration: the real-time exchange collapses the distance that usually governs human-machine interaction and supersedes the wait time of the AI model to “understand.” No more typing the right words to coax an image into being. This dialogue happens fast and loose, at the level of impulse and reaction: AI becomes an inhabitable, perpetually unfinished state that catches impressions of movement in the act of becoming dance.