diary

 



audience interaction with avatars after the performance 



artists talk at Trafó


Naoto from Modina makes a 3D scan of the Trafó main hall and we add it to Unreal to experiment with staging/lighting options, alongside making a physical model of the space.


Audience trying the markerless mocap system after the performance



nino teaser from Trafó



rehearsal shot



performance shot



testing ReMocapp wih Will and Naoto (all these images above from maÌteÌ kalicz

choreography



skinner releasing technique (srt) facilitates the release of tension in the body, enabling greater freedom of movement and challenging habitual movement patterns. it invites engagement with the imagination through poetic imagery, offered by the teacher in clusters. central principles include weight, buoyancy, and the belief in an innate, primal grace shared by all bodies.

for this project, we drew upon the ethos of srt—its energetic fields, philosophy, and guiding principles. we explored concepts such as body economy, the idea that “less is more,” and the quiet strength of gentleness. our focus was on translating key principles of srt into performance, embedding aspects of its pedagogy into both choreography and stage presence.

modina offers a framework capable of reaching deeper into societal layers, blending embodied knowledge with ai to interrogate how we inhabit the world. the stage becomes a magnifying lens for life itself. what truths or sensations might we unearth here that have remained inaccessible until now?

one central question we explored was: how does information move through the body?

the rehearsal process involved five dancers: one with extensive experience in srt, one with some prior exposure, and three with none. due to the tight timeframe, each rehearsal session began with an srt class, allowing the dancers to gradually absorb and embody the work.

following auditions, we identified an interest in seeing balázs engage with srt—particularly intrigued by how it might influence his movement, inviting sudden, supple moves.

upon encountering the basement performance space at trafo, i was inspired to incorporate whispering on stage—an element drawn from the srt pedagogy. this choice aimed to introduce an air of suspense and ambiguity at the beginning of the performance. i was also curious about how whispering, with its asmr-like qualities, could communicate kinaesthetic experiences and provoke a sensory response in the audience.

studio practice overview


compositional structures:
  • groupings: solos, duets, trios, full group work.

  • tasks: following and leading, shadowing, not touching, shifting energies, finding balance, and changing places (inspired by ai tracking camera).

  • movement qualities: slowing down, gliding, skimming, sudden shifts, subtle lifts, and phantom gestures.

  • spatial concepts: figure-of-eight pathways, entering/exiting around seated audience, tipping, falling, melting, and rolling.


srt-inspired elements:
  • key classes referenced:

    • class 3: rolling shoulders, counterbalance into rise

    • class 4: sighing, readiness, letting go

    • class 7: sudden supple moves

    • class 8–9: unexpected moves, whispering, tiny lift-off, gliding, “river running,” and skimming

  • key concepts:

    • whispering nonsense growing louder, traveling through the body

    • spongey squats, nudging pulse, instant readiness

    • luxuriating into space, phantom hands, laying out

    • whispering as asmr/kinaesthetic experience


ai & technology integration:
  • ai camera influences spatial choices: changing places, leadership dynamics, and ‘stealing the camera’ game.

  • dancers explore themes of ai replacing nature in virtual landscapes.

  • sound/sensory layering:

    • weather effects (visual/sound)

    • animal words (not sounds)

    • fast music with stillness, slow music with frenetic movement


improvisational & game-based tasks:
  • ‘blind copy,’ ‘steal the camera,’ ‘imaginary partner’ folk improvisations.

  • port de bras as duet without physical connection.

  • onomatopoeia and amanuensis (sound-based imitation, following/leading).

  • duets include skipping, counterbalance, tipping with a partner.


choreographic themes & motifs:
  • recurrent imagery: nudging dance, hair/crown of strings, leaning back (software metaphor), dark weather passing.

  • embodied metaphors: dog nuzzle (constant connection), failing gracefully (radical), nature vs ai.

themes and energies

  • human / non-human energies:
     exploring the interplay between human and non-human elements—how energy manifests across bodies, technologies, and environments.

  • radical / ai camera:
     investigation into ai-based pose estimation and how ai influences choreography, perception, and presence on stage.

  • embodied focus:
     special emphasis on hands, weight, buoyancy, and floating qualities in movement—linking physicality to thematic concepts of transformation and presence.



music

  • sound arc development:
    testing a range of tracks from marcus’ albums to shape a cohesive sonic arc for the performance.

  • new compositions:
    marcus is composing new pieces inspired by onomatopoeia and guitar chord resonance, using an a.i system suno.ai to generate tracks -  text prompts describe the genre and mood of the song, lyrics, and melody.

  • performance format:
    marcus will not perform live but will contribute via audience-interactive sound elements during the show.





visual design

  • midjourney visuals from srt prompts:
    digital avatars and environments were developed based on srt-inspired prompts, including:

    • characters:

      • blob

      • ash

      • sphere

      • folk dance avatars

    • environments:

      • blob world

      • brueghel-style black and white scene

      • testbox

      • concrete bunker

      • trash world

      • forest

      • desert

      • succulent garden

      • sky with translucent spheres





technology & motion capture

pose estimation & camera setup:
  • tested 2 ai-based pose estimation systems.

  • set up front and side camera views for 3d tracking.

  • best results found on depth-axis tracking.


motion capture tools tested:
  • openpose (python-based):
     3d support, best for single-performer capture, studio use only—no real-time mode.

  • theia3d / captury / move.ai / radical:
     explored capabilities and limitations across multiple platforms.


technical infrastructure:
  • systems tested for:

    • ease of use

    • aesthetic integration with movement language

    • stability (crashability)

    • latency

    • real-time capability

    • prototype feasibility

  • tools and resources:

    • windows-based systems

    • poe switch for bandwidth/data

    • post net system

    • linux flir cameras

    • motion bank tracker license

    • sound/ml/webtech integration using mc and python

    • motion bank mac code

    • physical dongle for optitrack (with 1-week delivery lead)

    • captury demo and computer tracker licenses


dramaturgy / stage design
concept ideas and future possibilities


1. dual space installation – capture station landscape
  • a stage set featuring a sculptural "cut-out" landscape with two distinct yet interconnected zones:

    • space 1: live or pre-recorded performance by one of the dancer-characters.

    • space 2: live or pre-recorded music, inspired by the winterscape format used at event gallery.

  • integrated with a web interface, allowing interaction, observation, or feedback loops between audience and performers.


2. object manipulation & capture
  • a dancer engages in a live interaction with objects that are optionally captured or tracked, emphasizing the relationship between movement, matter, and perception.


3. architectural transformation
  • the theatre’s curved roof is treated as a dynamic scenographic element, transforming the spatial atmosphere—evoking scale, enclosure, or celestial themes.


4. dmx lighting & gesture-controlled color
  • use of dmx lighting system with gesture-responsive controls, linking dancer movement to live color and sound modulation—creating a synesthetic interplay between gesture and environment.


5. ai and the natural world – a novacene perspective
  • themed around the tension between ai and nature.

    • one thread explores ai as a threat or replacement for nature.

    • another, inspired by james lovelock’s novacene, suggests ai and humans co-evolve as planetary stewards—working together to preserve the earth.


6. immersive entry – blind copy installation
  • the audience enters an installation-like environment where dancers are already performing blind copy, creating intimate and proximate encounters.

  • emphasizes immediacy, perception, and mimicry.


7. chromatic shift – from monochrome to colour
  • a visual dramaturgy where the performance moves from a black-and-white aesthetic into a world of colour, signifying transformation, awakening, or technological/human evolution.