Kun je met technologie improviseren op de vloer in een theatermaakproces? Hoe moet je zoiets doen?
En wat levert dat dan op?

Zaterdag 19 juni 2010
Huis aan de Werf, Grote zaal
Aanvang 20:30

Toegang is gratis – reserveren niet nodig

Download de Flyer.

Het gebruik van technologie in het theater is zo oud als het theater zelf. Hedendaagse technologische ontwikkelingen gaan echter zo snel dat theatermakers niet alle innovaties kunnen bijhouden en integreren. In een theatermaakproces waar improvisatie en maken op de vloer een rol speelt lijkt complexe technologie vaak een belemmering voor de creatieve flow van het moment. Zowel technologie als de maker moeten zich aanpassen om samen te kunnen werken.

Deze theatrale lezing, een zogenaamde Performance Lecture, is een lezing met illustratieve theatrale momenten, geïnspireerd door Franz Kafka’s The Metamorphosis. Hiervoor wordt
gebruik gemaakt van de Performance Engine, een door de onderzoeksgroep ontwikkelt prototype van een interactief systeem  die improvisatie mogelijk maakt met digitale media.

Doordat de interface, een soort intermediair tussen de gebruiker en het systeem, zo is ontworpen dat onmiddellijk aanpassingen kunnen worden gemaakt, kunnen makers keuzes op de vloer uitproberen en de consequenties ervan ervaren en interpreteren. Makers als Nirav Christophe, Falk Hubner en Moniek Merkx gingen in drie zogenaamde LABs met dit systeem op diverse manieren en momenten in hun maakproces op zoek naar de potentiële meerwaarde van digitale media in hun werk. De lezing zal deze praktijk gebaseerde onderzoeken in een breder kader presenteren.

Deze tweede Performance Lecture uit een reeks van twee maakt deel uit van de verslaglegging van het onderzoek van Joris Weijdom, hoofd van de onderzoeksgroep Virtueel Theater. Deze onderzoeksgroep maakt deel uit van het Lectoraat Theatrale Maakprocessen.

Naast de lezing bestaat de mogelijkheid om het eindexamenwerk te zien van de opleiding Design for Virtual
Theatre and Games (DVTG) op vrijdag 18 en zaterdag 19 juni. vanaf 16:00.

Please select your preferred resolution (360p /480p / 720p)  in the player toolbar after pressing the play button for better videoquality. Pressing the button right next to the play button (left side) will show you the thumbnails of all 14 video parts. Or use simply the arrow buttons to browse through them. If you would like to see a specific part of this presentation please click on the  [Continue reading...] link below to see the full Chapter list.

If you like to see the whole 100 minute presentation just press play and enjoy!

Chapter overview:

PART I

Chaper 01: Häcka (student project #1), Introduction by Joris Weijdom and Marcel Alberts
PLMixedReality_deel1_01.avi (9:48 min)

Opening with the first student project called Häcka, an experiment with video projection on translucent screens. The performance is designed to be a loop that could potentially run forever. Because of the light situation the video camera’s have captured only a fraction of the actual piece. Have a look at the Mixed Reality project page for more information on this piece.

Next Joris Weijdom gives an introduction on the context of the evening and the Mixed reailty project. Marcel Alberts, one of the mentoring teachers, gives a more in-depth response to the interdisciplinary nature of the working process and a first reflection on the first student piece.

Chapter 02: Introduction on the research context, a definition of Mixed Reailty and why we focused on space (instead of reality)
PLMixedReality_deel1_02.avi (8:59 min)

In this chapter the research context of the researchgroup Virtual Theatre is briefly introduced and  related to the subject of Mixed Reality. Then the term Mixed Reality is explained and defined through the model of the Virtuality continuum. In the second half the problematics concerning the perception of reality is discussed.

Chapter 03: About the definition of physical and virtual space
PLMixedReality_deel1_03.avi (10:52 min)

In order to combine physical and virtual space one needs to find a common method of defining both types of spaces. First relative approaches to physical space are explored. Then more absolute mathematical systems are introduced and used to move to virtual space. At the end of the video the cycle of bringing physical objects into virtual space (digitizing) and bringing virtual objects in to the physical space is discussed.

Chapter 04: Tabula Rasa (student project #2) and reflection by Marcel Alberts
PLMixedReality_deel1_04.avi (8:52 min)

The second student project group has been researching the potential of live drawing with light on 3D objects. Although they had many ideas the end result focuses on the simple aesthetics of live drawing itself. Have a look at the Mixed Reality project page for more information on this piece. The white character head has been designed with a 3D computer program, printed out on paper and folded into an analogue 3D head. A procedure briefly explained in the end of chapter 3.

In the second half of this video Marcel Alberts gives his reflection on the piece.

Chapter 05: A virtual 3D model of the theatre (live demo)
PLMixedReality_deel1_05.avi (3:15 min)

Being able to present four student projects with intense use of seven different video-projectors and only two days to build up we decided to build the whole theater-space in the computer as a scale model to figure out the video-projector placing, screen positioning, cable lengths and sight-lines. In this short video the 3D virtual model is briefly demonstrated as an example of using a virtual model to solve problems in physical space.

Chapter 06: Theater space, Virtual Reality and the CAVE
PLMixedReality_deel1_06.avi (8:51 min)

How can a theatre-space be theoretically observed? In this video a model by Peter Eversmann is discussed as a means of observing theatre-space by looking at the structural and the usage dimensions. Thus categorizing differnet types of theatre in a two-axis model. The 3 axis Multiverse model of jospeh Pine II is briefly mentioned.

The second half of the video gives an introduction to Virtual Reality and the progression to the CAVE. Hinting to a growing need and technological development to share and combine physical and virtual space into one mixed reality.

PART II

Chapter 07: Return to sender (student project #3) and reflection by Marcel Alberts
PLMixedReality_deel2_01.avi (8:07 min)

The third student project group got fascinated by a shadow having its own life. In order to project a shadow that could be animated and at the same time have a front projection for the performer and objects was quite a challenge. Also they managed to do a simple 3D projection map on the physical cube. Have a look at the Mixed Reality project page for more information on this piece.

In the second half of this video Marcel Alberts gives his reflection on the piece.

Chapter 08: About Augmented Reality (with live demo)
PLMixedReality_deel2_02.avi (9:03 min)

This video is entirely about Augmented Reality (AR). First three important aspects are summarized about AR then a live demonstration is given of a desktop AR marker based setup. In the second half of this video attention is given to the beautifull AR project of Julian Oliver called Levelhead.

Chapter 09: More about Augmented Reality, terms and recent technology
PLMixedReality_deel2_03.avi (7:19 min)

AR related terms as; Desktop AR and Mobile AR, marker and markerless, Magic mirror vs Magic lens, are explained through examples. A brief moment is given to the consequences of OLED technology. Which brings us to the question if these recent technological developments are usable in theatre.

Chapter 10: The power of projection, 2D and 3D surfaces
PLMixedReality_deel2_04.avi (9:47 min)

The first part of this video gives an overview of projection methods on 2D surfaces through recent examples. The second half is about projection on 3D surfaces or objects. These objects can be sculptures or even buildings. The extra challenge to this method is to perspectively compensate for the angled surfaces by using so called projection mapping techniques.

Chapter 11: Cool projection mapping, but is Mixed Reality technology new (in theatre)?
PLMixedReality_deel2_05.avi (9:45 min)

Our own experiments with projection mapping is shown adding the real-time 3D aspect to this development. Also briefly attention is given to mobile projectors and their potential usage. However the question is asked if all this Mixed Reality technology is new to theatre. In the second half of the video examples are given of historic usage of Mixed Reality technology.

Chapter 12: Schildeurij (student project #4) and reflection by Marcel Alberts
PLMixedReality_deel2_06.avi (8:09 min)

The last student project group took the Droste effect, the endless repetition of an image in an image, as the starting point of their research. This ancient effect still has the power to mesmerize the audience. What will happen if somebody loses their ball in a painting that is depicting the space where the painting hangs? Although the effect seems to be a simple live video feedback, suddenly the effect becomes much more complex, both technically and conceptually… Have a look at the Mixed Reality project page for more information on this piece.

In the second half of this video Marcel Alberts gives his reflection on the piece.

Chapter 13: Theatre outside the theatre (building)
PLMixedReality_deel2_07.avi (5:15 min)

Theater can both refer to the performance piece or the building in which this is performed. A theatre performance does’nt have to partake in a theatre building. This video is about using public space and the Internet as a theatre space. By integrating a non-theatre space into a theatrical context one could see similarities with Mixed Reality principles. A short moment is given to the Alternate Reality Gaming (ARG) as a potential interesting genre for theatre.

Chapter 14: This is not a conclusion
PLMixedReality_deel2_08.avi (5:30 min)

In this last video the Virtuality continuum model for mixed reality is re-introduced and compared with a model by Kaisu Koski showing a scale from the visible to the invisible stage.  Implications for the theatre making processes and disciplines are discussed. And finally a plea is made for investigating the potential of Mixed Reality technology in a theatrical context together without holding on to conservative ideas about what theatre is and how it is made (or tought in art academies).

In this 50 minute presentation we show all major features of the Performance Engine and give some insight on its research context and development philosophy. The 50 minute video below is divided into six chapters, so you have a choice of watching the full presentation or jump right to the part that has your particular interest. Read a brief description of the chapters below the video (click on the ‘Continue reading…’ link).

This video is entirely in Dutch though, for an English version please have a look at a similar presentation we did in september in Huis ad Werf.

Please select your preferred resolution (360p /480p / 720p)  in the player toolbar after pressing the play button for better videoquality. Pressing the button right next to the play button (left side) will show you the thumbnails of all 7 video parts. Or use simply the arrow buttons to browse through them. If you like to see the whole 50 minute presentation just press play and enjoy!

Read the content of the chapters below and choose the part of your particular interest!

Part 1-6: Introduction research context (8:39 min)
As the title suggest in this four minute introduction the context of the research is briefly explained. For a more in-depth information please read the Theory section of this website.

Part 2-6: Development overview (4:31 min)
In this video a short overview is given of the development of the Performance Engine through several versions. Some attention is given to the development of its custom GUI.

Part 3-6: The Statemachine, Audio-engine and WII-mote patch (9:41 min)
Here the live demonstration starts with the text-engine and moves quickly on to the core of the system; the Statemachine. The basic functionality and principles of the Statemachine is explained and demonstrated. With the help of the WII-mote module a sound is triggered with a simple buttonpress and other features are used to control volume.

Part 4-6: Motiontracking, the Audio-engine and the 2D-engine (9:23 min)
Motion tracking is a great way to trigger and control media onstage. In the first part of this video color tracking, a particular form of motion tracking, is demonstrated. The Audio Engine is capable of producing Surround sound by connecting the Motion tracking data with the physical speaker locations. The same tracking method is used in the demonstration of the 2D-engine. This time position data is used to control video.

In the last part of this video another motion tracking method is shown enabling the performer to move more freely. Together with the so-called Region patch the performer can trigger media and events at certain regions on the floor. This combination of techniques opens up a whole range of interesting possibilities.

Part 5-6: The 3D Engine and examples (8:26 min)
The Performance Engine v0.4 makes use of the 3D Engine software called Unity 3D. With serious modifications on the free Miyu MaxMSP patch the 3D engine is connected to the Statemachine. In the first part of this video motion-tracking and the Wii-mote patch are combined to create a live interactive demonstration of ‘breaking down the wall’.

In the second part of this video a few simple connections with the embedded Reactivision marker motion tracking system is demonstrated in a fully rendered real-time 3D world. Enabling the performer to interact with objects inside of the virtual 3D space.

Part 6-6: Performance Engine undemonstrated options (7;28 min)
In this part of the presentation the features are briefly summarized that have not been shown in the live presentation. Also the ‘koppelpatch’ template is mentioned; a file that can be used by other artists/programmers to create their own modules for the system. Or as a means to build a way of communication of an already existing system with the Performance Engine.

Please contact us for more information.

Häcka is an experiment with video projection on translucent screens. The performance is designed to be a loop that could potentially run forever.

A queen is floating in abstract space absorbing energy of dead moths lying on the floor. When critically energized she gives birth to a new generation of moths. They fly around the space and eventually die and drop to the floor. Their life energy is floating upward and is being absorbed by the queen closing the perfect cycle of life and death.

When the the flock of new moths die and fall to the floor a large quantity of paper moths fall from the theatre ceiling in front of the audience in an attempt to give the moths a physical presence.

Because of the light situation the video camera’s have captured only a fraction of the actual piece. In the very first 2 minutes of the full video presentation of the Performance Lecture Mixed Reality an impression of the  actual performance can be seen. Or have a look at the photos below for better quality images.

Foto’s: Lucinda Bouten, Stefanie Bonte, Kimberly van Eijk,  Joris Weijdom.

[Show as slideshow]

The second student project group has been researching the potential of live drawing with light on 3D objects. Although they had many ideas the end result focuses on the simple aesthetics of live drawing itself. The white character head has been designed with a 3D computer program, printed out on paper and folded into an analogue 3D head. A procedure briefly explained in video chapter three of the full video registration of the Performance Lecture Mixed Reality

Below you can see the chapter four video showing the Tabula rasa performance. In the second half of this video Marcel Alberts gives his reflection on the piece. Scroll further down to see the photos for a quick impression.

Foto’s: Lucinda Bouten, Stefanie Bonte, Kimberly van Eijk,  Joris Weijdom.

[Show as slideshow]

The third student project group got fascinated by a shadow having its own life. In order to project a shadow that could be animated and at the same time have a front projection for the performer and objects was quite a challenge. Also they managed to do a simple 3D projection map on the physical cube.

A girl appears on stage and sees a large box. When touching the box a strange thing happens; her shadow gets a life of her own. The girl tries to gain control over the shadow in a struggle with light and darkness. Eventually she destroys the box and restores order. However this is not quite the end…

Below you can see the chapter seven video from the the Performance Lecture Mixed Reality showing the Return to sender performance. In the second half of this video Marcel Alberts gives his reflection on the piece. Scroll further down to see the photos for a quick impression.

Foto’s: Lucinda Bouten, Stefanie Bonte, Kimberly van Eijk,  Joris Weijdom.

[Show as slideshow]

This last student project group took the Droste effect, the endless repetition of an image in an image, as the starting point of their research. This ancient effect still has the power to mesmerize the audience. What will happen if somebody loses their ball in a painting that is depicting the space where the painting hangs? Although the effect seems to be a simple live video feedback, suddenly the effect becomes much more complex, both technically and conceptually…

Below you can see the chapter twelve video from the the Performance Lecture Mixed Reality showing the Schildeurij performance. In the second half of this video Marcel Alberts gives his reflection on the piece. Scroll further down to see the photos for a quick impression.

Foto’s: Lucinda Bouten, Stefanie Bonte, Kimberly van Eijk,  Joris Weijdom.

[Show as slideshow]