Interactive audiovisual installation, 2017
EchoSystem is an interactive audiovisual installation, carried out in collaboration with the pedagogical team and the students of the school of Jettingen (France). This artwork was conceived during the Creation En Cours artist-in-residence program, initiated by the Ministry of Culture and Communication and the Ministry of National Education, Higher Education and Research, in cooperation with Médicis Clichy Montfermeil.
Two versions of the work have been developed. The first version is an installation comprising a Kinect (capture device to detect the position, shape of the silhouette and movements of users), two speakers, a video projector and a projection screen. A second version installed on the interactive whiteboard of the class, tactile and perennial, allows students to keep track of our creation and rediscover it whenever they wish
Kinect version
Interactive whiteboard version
My goal was to truly place the students at the heart of the creative process: they were the ones who drew all the visual elements of the work (backgrounds, butterflies, flowers, etc.). In addition, all the sound material that I used for the composition of the interactive musical composition also comes from the school: some recordings of noises made by students using their mouth, body and objects, and recording of small instruments found in the institution.
The algorithmic system that I have developed give life to the various audiovisual elements in order to generate an interactive ecosystem: trees grow to the rhythm of music, butterflies fly autonomously and come to rest on motionless spectators. By moving the arms, one streaks of flowers appear, and when one brings the hands together, one makes appear a kaleidoscopic mandala that one can then manipulate...
Audio tracks
EchoSystem
EchoSystem is an interactive audiovisual installation, carried out in collaboration with the pedagogical team and the students of the school of Jettingen (France). This artwork was conceived during the Creation En Cours artist-in-residence program, initiated by the Ministry of Culture and Communication and the Ministry of National Education, Higher Education and Research, in cooperation with Médicis Clichy Montfermeil.
Two versions of the work have been developed. The first version is an installation comprising a Kinect (capture device to detect the position, shape of the silhouette and movements of users), two speakers, a video projector and a projection screen. A second version installed on the interactive whiteboard of the class, tactile and perennial, allows students to keep track of our creation and rediscover it whenever they wish
Kinect version
Interactive whiteboard version
My goal was to truly place the students at the heart of the creative process: they were the ones who drew all the visual elements of the work (backgrounds, butterflies, flowers, etc.). In addition, all the sound material that I used for the composition of the interactive musical composition also comes from the school: some recordings of noises made by students using their mouth, body and objects, and recording of small instruments found in the institution.
The algorithmic system that I have developed give life to the various audiovisual elements in order to generate an interactive ecosystem: trees grow to the rhythm of music, butterflies fly autonomously and come to rest on motionless spectators. By moving the arms, one streaks of flowers appear, and when one brings the hands together, one makes appear a kaleidoscopic mandala that one can then manipulate...
The algorithmic system that I have developed give life to the various audiovisual elements in order to generate an interactive ecosystem: trees grow to the rhythm of music, butterflies fly autonomously and come to rest on motionless spectators. By moving the arms, one streaks of flowers appear, and when one brings the hands together, one makes appear a kaleidoscopic mandala that one can then manipulate...
Audio tracks
Interactive audiovisual device, 2016
The Interactive Musical Planetarium is a digital audiovisual device created specifically and simultaneously for the Necker hospital
in Paris (France) and the Johns Hopkins Children Center in Baltimore (USA).
This device consists of an interactive audiovisual installation for TV screen, computer and Kinect and a tablet application for
bedridden children.
I designed and developed this device to provide children a
space for creative expression, allowing them to draw music
by moving their arms, head, body (Kinect version) or by
tapping and sliding finger(s) (tablet version).
This work allows anyone, whatever their age or psychomotor
ability to have fun, to express themselves and to feel valued
through a playful experience.
This device also motivates children to move, helps them
to forget pain and promotes their rehabilitation. It also
offers new channels of communication between therapists,
patients and their families.
My goal is to help children to forget about the walls of the
hospital, their isolation, to make them feel connected with
their bodies and with the cosmos. On the screen, their
silhouette is made up of hundreds of stars and is recomposed,
reconfigured at every moment, like their physical body.
By creating beautiful drawings and melodies, they regain
confidence in themselves, confidence in their aptitudes and
by extension in the therapeutic process.
The installation proposes several modes of expression and
communication: body interaction (the form of the silhouette
is reconstituted on the screen by hundreds of stars), gestural
interactions (the movements of the created hands of the
melodic and visual lines, and when the two hands are brought
closer together, a ball of energy that can be manipulated is
created), facial interaction (when one opens the mouth,
children’s choruses are heard , and hundreds of stars are
emitted), etc.
The drawings made by the bedridden children on the tablet
version appear on the screen of the installation. These musical
drawings can also be exchanged between the two hospitals
to create communication between the children of the Johns
Hopkins Children Center in Baltimore and those of the Necker
Hospital in Paris.
This project was made possible thanks to Art Dans La Cité and the generous support of the Stavros Niarchos Foundation and the french Ministry of Culture and Communication.
Technical setup
Interactive Musical Planetarium
The Interactive Musical Planetarium is a digital audiovisual device created specifically and simultaneously for the Necker hospital in Paris (France) and the Johns Hopkins Children Center in Baltimore (USA).
This device consists of an interactive audiovisual installation for TV screen, computer and Kinect and a tablet application for
bedridden children.
I designed and developed this device to provide children a space for creative expression, allowing them to draw music by moving their arms, head, body (Kinect version) or by tapping and sliding finger(s) (tablet version).
This work allows anyone, whatever their age or psychomotor
ability to have fun, to express themselves and to feel valued
through a playful experience.
This device also motivates children to move, helps them
to forget pain and promotes their rehabilitation. It also
offers new channels of communication between therapists,
patients and their families.
My goal is to help children to forget about the walls of the
hospital, their isolation, to make them feel connected with
their bodies and with the cosmos. On the screen, their
silhouette is made up of hundreds of stars and is recomposed,
reconfigured at every moment, like their physical body.
By creating beautiful drawings and melodies, they regain
confidence in themselves, confidence in their aptitudes and
by extension in the therapeutic process.
The installation proposes several modes of expression and
communication: body interaction (the form of the silhouette
is reconstituted on the screen by hundreds of stars), gestural
interactions (the movements of the created hands of the
melodic and visual lines, and when the two hands are brought
closer together, a ball of energy that can be manipulated is
created), facial interaction (when one opens the mouth,
children’s choruses are heard , and hundreds of stars are
emitted), etc.
The drawings made by the bedridden children on the tablet
version appear on the screen of the installation. These musical
drawings can also be exchanged between the two hospitals
to create communication between the children of the Johns
Hopkins Children Center in Baltimore and those of the Necker
Hospital in Paris.
This project was made possible thanks to Art Dans La Cité and the generous support of the Stavros Niarchos Foundation and the french Ministry of Culture and Communication.
Technical setup
Acousmatic Composition, 2014
La Isla is an acousmatic piece created from very little audio material: a few sound recordings made on a small island, a text written and interpreted by a Spanish-speaking friend and a little bit of audio synthesis.
This piece is an impressionist audio painting whose subjects are the fading and the resurgence of memories, the evanescent nature of thoughts and events.
This piece was awarded at the Petite Formes Acoustic Music Competition in 2014 and was performed in Taiwan and Europe.
La Isla
La Isla is an acousmatic piece created from very little audio material: a few sound recordings made on a small island, a text written and interpreted by a Spanish-speaking friend and a little bit of audio synthesis.
This piece is an impressionist audio painting whose subjects are the fading and the resurgence of memories, the evanescent nature of thoughts and events.
This piece is an impressionist audio painting whose subjects are the fading and the resurgence of memories, the evanescent nature of thoughts and events.
This piece was awarded at the Petite Formes Acoustic Music Competition in 2014 and was performed in Taiwan and Europe.
Musical interactive devices, 2012
This video presents a test of one of a serie of different interactive musical devices I'm develloping.
They'll be used in a therapeutic context.
I use a ethernet camera and Eyecon to track both hands, and I map the data in Max/MSP. Basically, more the hands are high, more the notes played are high-pitched, and more the hands/fingers are moving fast, more quick are the notes. Degrees (chords) change when there is no movement.
Here is a video of one of the first test of this device
(Weimar, Germany. Video credits : Motion Composer)
Virtual piano
interactivity +
Max/MSP +
music
This video presents a test of one of a serie of different interactive musical devices I'm develloping.
They'll be used in a therapeutic context.
I use a ethernet camera and Eyecon to track both hands, and I map the data in Max/MSP. Basically, more the hands are high, more the notes played are high-pitched, and more the hands/fingers are moving fast, more quick are the notes. Degrees (chords) change when there is no movement.
Here is a video of one of the first test of this device
(Weimar, Germany. Video credits : Motion Composer)
Immersive interactive audiovisual installation, 2010
With this installation we wanted to make people experience the state of being a fetus inside their mother’s womb.
Users are lying on their back in a seat in a fetus-like position, surrounded by eight speakers and watching a panoramic projection screen located behind them.
The audiovisual content is reacting to their movement thanks to an infrared camera located above them. When users are moving, they feel like they are swimming inside the sound, because noises are triggered by their gestures and follow their movements all around them.
There are two levels of sounds. The first one is the realist level, with a wide range of biological sounds, like borborygmus, mother’s heartbeat, breathing or voice.
The second level is the psychoactive one, with some noises like Shepard-Risset glissando or binaural beat which are known to help inducing altered states of consciousness.
Audio : Adrien Garcia
Visual : Edouard Lanctôt-Benoit
Birth
audiovisual +
interactivity +
Max/MSP
With this installation we wanted to make people experience the state of being a fetus inside their mother’s womb.
Users are lying on their back in a seat in a fetus-like position, surrounded by eight speakers and watching a panoramic projection screen located behind them.
The audiovisual content is reacting to their movement thanks to an infrared camera located above them. When users are moving, they feel like they are swimming inside the sound, because noises are triggered by their gestures and follow their movements all around them.
There are two levels of sounds. The first one is the realist level, with a wide range of biological sounds, like borborygmus, mother’s heartbeat, breathing or voice.
The second level is the psychoactive one, with some noises like Shepard-Risset glissando or binaural beat which are known to help inducing altered states of consciousness.
Audio : Adrien Garcia
Visual : Edouard Lanctôt-Benoit
Interactive audiovisual installation, 2011
I developed the audio programming of this installation during my internship at Moment factory, a Montreal based company known for its interactive large scale multimedia installations.
The intention was to develop a multi-touch musical wall to allow several players to really play and compose music, even without musical knowledge.
A laser scanner detects the position of the hand of users and sends it to a computer. Algorithms analyse the movements of user(s) and translate them in real time visually (lines and shapes) and musically (melody and chord).
The notes played depend of the others notes played at the same time, of the position of the hands, of the speed, the angle and the velocity of the movement.
When a player drawn a melody, he can replay it, move it to have highest or lowest notes, harmonized it with others line or chord.
Playing with this wall is physically and mentally very intuitive, and everybody can easily compose very nice music.
Audio : Adrien Garcia
Visual : Edouard Lanctôt-Benoit
The interactive musical wall
audiovisual +
interactivity +
Max/MSP +
music
I developed the audio programming of this installation during my internship at Moment factory, a Montreal based company known for its interactive large scale multimedia installations.
The intention was to develop a multi-touch musical wall to allow several players to really play and compose music, even without musical knowledge.
A laser scanner detects the position of the hand of users and sends it to a computer. Algorithms analyse the movements of user(s) and translate them in real time visually (lines and shapes) and musically (melody and chord).
The notes played depend of the others notes played at the same time, of the position of the hands, of the speed, the angle and the velocity of the movement.
When a player drawn a melody, he can replay it, move it to have highest or lowest notes, harmonized it with others line or chord.
Playing with this wall is physically and mentally very intuitive, and everybody can easily compose very nice music.
Audio : Adrien Garcia
Visual : Edouard Lanctôt-Benoit
Interactive audiovisual installation, 2011
Our goal with this installation was to give back a bit of spirituality and magic to the church. We wanted to propose to the users an easy way to communicate with sounds and architectural projections, making them feel they are an integral part of the magic.
To do so, we built interactive spheres allowing people to play music and interact in real time with the visual projections on the church.
Three projectors were on another building to project the visuals on the church, and there were speakers inside the different spheres (for the sounds which react to the actions of users), and others all around (for the background music).
I wrote the algorithms for the interactive sounds and I recorded gongs, glass organ, tibetan bowls or shakuhachi which I mixed with piano or more electronic sounds to create meditative moods.
Collective project.
For this project, I was the audio team supervisor.
Transition track 1 (long version) :
Prélude
audiovisual +
interactivity +
Max/MSP +
music
Our goal with this installation was to give back a bit of spirituality and magic to the church. We wanted to propose to the users an easy way to communicate with sounds and architectural projections, making them feel they are an integral part of the magic.
To do so, we built interactive spheres allowing people to play music and interact in real time with the visual projections on the church.
Three projectors were on another building to project the visuals on the church, and there were speakers inside the different spheres (for the sounds which react to the actions of users), and others all around (for the background music).
I wrote the algorithms for the interactive sounds and I recorded gongs, glass organ, tibetan bowls or shakuhachi which I mixed with piano or more electronic sounds to create meditative moods.
Collective project.
For this project, I was the audio team supervisor.
Transition track 1 (long version) :
Enso V2
Audio performance for augmented shakuachi, 2013
Live recording during my performance in La Gaité Lyrique (Paris, France) during Ircam Live event.
All the sounds heard during this performance are exclusively made from the notes I played and recorded live during the presentation. I built an usb controller and wrote an algorithm in order to loop, change the pitch, slice, transform and spacialize these notes in real-time in a 5.1 multi-channel environment.
During this performance, people are surrounded by sounds and can feel how the simplicity of a few simple notes can procreate the complexity of a very rich soundscape, how time and space are connected and how immaterial phenomena impact on their mind and body.
Programming, electronics and interpretation : Adrien Garcia
Enso studio version
Composition, 2011
Enso V1
Audio performance for augmented shakuachi, 2011
Enso
electronics +
Max/MSP +
music
Audio performance for augmented shakuachi, 2013
Live recording during my performance in La Gaité Lyrique (Paris, France) during Ircam Live event.
All the sounds heard during this performance are exclusively made from the notes I played and recorded live during the presentation. I built an usb controller and wrote an algorithm in order to loop, change the pitch, slice, transform and spacialize these notes in real-time in a 5.1 multi-channel environment.
During this performance, people are surrounded by sounds and can feel how the simplicity of a few simple notes can procreate the complexity of a very rich soundscape, how time and space are connected and how immaterial phenomena impact on their mind and body.
Programming, electronics and interpretation : Adrien Garcia
Enso studio version
Composition, 2011
Enso V1
Audio performance for augmented shakuachi, 2011
Interactive audio installation, 2014
Présence(s) is a multi-channel and interactive sound installation. It was exhibited on March 2014 in the Reine Bérengère museum, in Le Mans (France).
Adrien Garcia : algorithms, sound design, composition
Romain Barthélémy : sound design, composition
Présence(s)
electroacoustic +
interactivity +
Max/MSP
Présence(s) is a multi-channel and interactive sound installation. It was exhibited on March 2014 in the Reine Bérengère museum, in Le Mans (France).
Adrien Garcia : algorithms, sound design, composition
Romain Barthélémy : sound design, composition
Different little arduino projects
This is my first Arduino project, and it's a very simple one : when water is flowing through the nozzle of the water can, it make a connection between 2 pins. This is detected by Arduino which send the infos to Jitter which plays the little animation...
This video shows two little arduino projects. Both are paper pianos made with conductive paint.
The first one is based on the capacitance property of the human body, and the second one is just about the resistive property of the conductive paint.
Arduino projects
Arduino +
interactivity +
Max/MSP +
music
This is my first Arduino project, and it's a very simple one : when water is flowing through the nozzle of the water can, it make a connection between 2 pins. This is detected by Arduino which send the infos to Jitter which plays the little animation...
This video shows two little arduino projects. Both are paper pianos made with conductive paint. The first one is based on the capacitance property of the human body, and the second one is just about the resistive property of the conductive paint.
Musico-theatrical performancee, 2010
This performance is a journey through the evolution of the human-environment relationship.
Originally co-creator of his environment, Man, thanks to tools and technology, will gradually increase its mastery of events to a totalitarian and dictatorial control.
Gradually transforming the creative act in destructive act, his bloated ego gradually causes complete alienation of its kind.
EgoSystem
This performance is a journey through the evolution of the human-environment relationship.
Originally co-creator of his environment, Man, thanks to tools and technology, will gradually increase its mastery of events to a totalitarian and dictatorial control.
Gradually transforming the creative act in destructive act, his bloated ego gradually causes complete alienation of its kind.