biorythmic/posture control of modular!

Anything modular synth related that is not format specific.

Moderators: Kent, luketeaford, Joe.

Post Reply
User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

biorythmic/posture control of modular!

Post by sensien » Fri Nov 22, 2013 1:36 pm

[video][/video]

We ( mostly not me ) have been working on this for some time.
The signals from a Zephyr bh3 bioHarness are sent to my modular.
I had to use this in person before I truly understood its power !

For the bass track : Average heartrate controls the tempo. Heartbeat triggers the env.
Posture controls sequencer direction/loop length and transposition.

For the breath track : Breath triggers envelope. Posture = notes

What do you guys think ?

best
Mark
Last edited by sensien on Fri Nov 22, 2013 1:56 pm, edited 1 time in total.

User avatar
ignatius
Super Deluxe Wiggler
Posts: 15824
Joined: Tue Dec 23, 2008 4:03 pm
Location: oregon
Contact:

Post by ignatius » Fri Nov 22, 2013 1:51 pm

i think i'd get dizzy.

probably a fun way to disconnect from interface once in a while and just dance around though..

StoneLaw
Super Deluxe Wiggler
Posts: 1631
Joined: Mon Feb 04, 2013 9:59 pm
Location: Minneapolis, MN

Post by StoneLaw » Fri Nov 22, 2013 2:50 pm

pretty cool! sounds great

User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

Post by sensien » Sat Nov 23, 2013 7:36 am

Thanks for your comments.

I feel I should expand a little on how this is working.
When Ove tried to explain his idea to me a few years ago I was a little confused. When I tried it a year or so later I was blown away. When I took my modular to Finland and we worked with that I was in love with it !

At the moment is uses a BioHarness ( http://www.zephyranywhere.com/products/bioharness-3/ )
It can send ( iirc ) 6 streams..
So those go through max/ableton/silent way and a MOTU Ultralite.
This gives you 6 CVs.
Some triggers and some voltages..
e.g. Breath ( trig ) averaged heartrate ( eg to clock ) activity ( eg filter ) forwards/backwards tilt ( eg pitch ) sideways tilt ( eg sequence start/end points ) up/down height etc etc
Obviously you can patch things wherever you fancy.
Basically a patch becomes alive. We have shown it to a few people who didnt know what was going on and they were truly astonished as Ove started moving around the room and the modular responds.
It also works with lighting!
It also works with software..

I do hope I didnt make that more confusing!

Mark

User avatar
Paranormal Patroler
Super Deluxe Wiggler
Posts: 11321
Joined: Tue Aug 30, 2011 3:40 pm
Location: the Terminal beach

Post by Paranormal Patroler » Sat Nov 23, 2013 7:48 am

Doesn't eowave make similar type of controllers? I assume this needs a computer as an intermediate, huh?
All rights reserved; all wrongs reversed.

User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

Post by sensien » Sat Nov 23, 2013 8:05 am

I believe the Eowave stuff is gestural/spacial only.

this follows your respiration rate and general activity , plus posture etc.

Its a lot more full on basically !

User avatar
Paranormal Patroler
Super Deluxe Wiggler
Posts: 11321
Joined: Tue Aug 30, 2011 3:40 pm
Location: the Terminal beach

Post by Paranormal Patroler » Sat Nov 23, 2013 8:13 am

Didn't mean to piss on your parade. This does looks nice and that's coming from someone who is really into gestural control for his modular system (can't beat gestures to shape music imho). There is some overlap with the Eowave stuff. Depending on sensor I think you can pull off most of the stuff you're doing but probably not respiration. Anyway, cool concept. Would love to see more!
All rights reserved; all wrongs reversed.

User avatar
oscillateur
Super Deluxe Wiggler
Posts: 1131
Joined: Sun Feb 20, 2011 1:45 am
Location: Tokyo

Post by oscillateur » Sat Nov 23, 2013 8:46 am

That reminds me of Atau Tanaka's work. He used to do wonderful performances halfway between dance and music using lots of body sensors (muscle tension, etc.) controlling Max/MSP. He was a researcher at Sony CSL labs in Paris until maybe 5 years ago, he's doing research in another university in England now I think.

User avatar
Paranormal Patroler
Super Deluxe Wiggler
Posts: 11321
Joined: Tue Aug 30, 2011 3:40 pm
Location: the Terminal beach

Post by Paranormal Patroler » Sat Nov 23, 2013 8:48 am

And of course Fuyuki Yamakawa

[video][/video]
All rights reserved; all wrongs reversed.

User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

Post by sensien » Sat Nov 23, 2013 10:22 am

Thanks for the links/names. I will look into them!

PP, no parade pissing noticed :)
It's not my system.
I know that Ove is well aware of other peoples work in this field, I am not though !

The main difference with " normal " gesture control is with the breath, heartbeat and activity levels, the more you move/work out the faster/brighter or whatever you have patched it becomes.

The patch/music realy becomes alive.

At the moment work is bieng done to make this computer free. It may involve producing a custom module, although some exist already..
Also smaller, less intrusive than the chest belt, sensors are being looked at.


Mark

edited to add:
There are more videos on Oves YouTube channel,
http://www.youtube.com/user/H0LMIUM?feature=watch

User avatar
Paranormal Patroler
Super Deluxe Wiggler
Posts: 11321
Joined: Tue Aug 30, 2011 3:40 pm
Location: the Terminal beach

Post by Paranormal Patroler » Sat Nov 23, 2013 10:41 am

Please keep us posted Mark, this is definitely interesting.
All rights reserved; all wrongs reversed.

ae.viaxe
Learning to Wiggle
Posts: 14
Joined: Sat Nov 23, 2013 6:26 pm

Post by ae.viaxe » Thu Dec 26, 2013 4:15 pm

Emotiv EPOC looks really cool, but I didn't tried it yet.
It is a brain–computer interface based on EEG technology.
Also, there is a new generation of interfaces is successfully funded at kickstarter

There is several "music" apps in Emotiv store:
Emotiv EPOC MIDI Control utility
Mind Your OSCs (Send EPOC data as OSC packets to programs like Max/MSP and PureDATA)
subConch
Image

User avatar
CJ Miller
Super Deluxe Wiggler
Posts: 4256
Joined: Thu Apr 28, 2011 3:10 pm
Location: Mumfordshire

Post by CJ Miller » Thu Dec 26, 2013 5:39 pm

I have played around with using biosensors in my work, such as OpenEEG with Max/MSP. Then I lost my electrodes and hadn't made new ones. Computer-interpreted signals are kind of the long way around for modular work - I have used regular laboratory bio-amplifiers to get my signals in with no pre-modular conversion or processing necessary.

Also, I have played my modular signals through my body by using transformers with electrodes. This requires caution, obviously.

Combining the signal inputs and outputs in the same performance could make for some interesting biofeedback loops!

User avatar
deathbeef
Common Wiggler
Posts: 104
Joined: Tue Jul 16, 2013 6:19 pm
Location: Columbus, Ohio

Post by deathbeef » Sat Jan 25, 2014 1:50 pm

I'd love to have a biofeedback module. Getting this away from a computer would be idea.
Time To Swim.

User avatar
dan_p
Super Deluxe Wiggler
Posts: 3507
Joined: Tue Jan 19, 2010 5:47 pm
Location: UK 4000' above Worc's

Post by dan_p » Sat Jan 25, 2014 5:28 pm

that was pretty damn cool, nice one. :tu:
Oh you got a Nickel, I got a Dime,
I'd like to get to know you but I haven't got the time,
You got to walk like a mannequin, roll like a tyre,
Act on reaction dodge the big spud fryer
------------------------------------------
www.Soundcloud.com/dan_p
www.YouTube.Com/d4nnyp

User avatar
L.C.O.
Super Deluxe Wiggler
Posts: 2383
Joined: Sun Jan 20, 2013 2:34 pm
Location: usa

Post by L.C.O. » Tue Jan 28, 2014 12:00 am

There is an amazing peformance called "Heartbeat MB" during which Baryshnikov dances to his own heartbeat (hooked up to cardio monitor)... wher as he dances he is able to manipulate theh speed of his own heart. really mind blowing in a way, wher you can not tell if the heartbeat defines the dance, or the movement shapes the heartbeat. With him/his body caught somewhere in between.

seems relevant here.

User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

Post by sensien » Sat Mar 22, 2014 3:06 pm

Recently we were asked to demonstrate the system..
we took some video of reheasals..
There are 12 cv sources coming from the performer into the modular

[video][/video]

Thanks for all your interesting comments !

Mark

User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

Post by sensien » Sat Mar 22, 2014 3:22 pm

deathbeef wrote:I'd love to have a biofeedback module. Getting this away from a computer would be idea.
Its in the plan :)

User avatar
antennafarm
Wiggling with Experience
Posts: 269
Joined: Thu Dec 04, 2008 2:05 pm
Location: Delta City, MI

Post by antennafarm » Sat Mar 22, 2014 4:52 pm

i think there'd be some real awesomeness (beyond its already-impressive display) if you could get this worked into an aerial silk routine (although it'd have to be wireless and fairly sturdy).

User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

Post by sensien » Sun Mar 23, 2014 4:33 am

antennafarm wrote:...... (although it'd have to be wireless and fairly sturdy).
It is wireless :)

User avatar
sensien
Common Wiggler
Posts: 98
Joined: Sun Sep 23, 2012 1:47 pm
Location: Brussels

Post by sensien » Sun Mar 23, 2014 4:42 am

! Non Modular Warning !

Here is a performance/demonstration made using Live ( + VSTs ) for the audio..

You can maybe also tell that he has the lighting under control also.
On the wall on the left you can see his biodata being projected.

[video][/video]

Mark

Post Reply

Return to “Modular Synth General Discussion”