Page 1 of 1
GestureSpark - Multitouch controller software for Windows 7
Posted: Tue Apr 12, 2011 3:42 am
by wouterz
Here is a video of an early development version of my multitouch controller software for Windows 7 with support for OSC and MIDI.
http://youtu.be/X2BmAtKXSZ4
I some point I will build panels for the popular Scope devices

Any comments or suggestions are welcome.
Keep an eye on
http://www.gesturespark.com
I'm not going to use the word "soon"

Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Apr 12, 2011 6:15 am
by jksuperstar
Very, very cool. I have been wanting a nice touch surface as a controller for a while, admittedly just so that I wouldn't have to program a MIDI controller until I had identified the knobs I need to adjust live, the rest of the time I'd use the touch screen directly with scope

But this looks very promising, especially if templates would exist (and ould be added to by users in a community) for all the scope devices!
For a touch surface, though, I'd move labels *above* each element. Also, larger buttons with the label inside is better than outside with a button too small to touch easily. Just my opinion, which can be ignored!
Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Apr 12, 2011 6:54 am
by wouterz
jksuperstar wrote:For a touch surface, though, I'd move labels *above* each element. Also, larger buttons with the label inside is better than outside with a button too small to touch easily. Just my opinion, which can be ignored!
Good point, I will put this on my ToDo list, the second suggestion is already possible.
Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Apr 12, 2011 7:26 am
by siriusbliss
Great start!
Can't wait to see how it progresses.
We'll have to start mapping all the various synths (or at least ModIV)
Have fun,
Greg
Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Apr 12, 2011 12:06 pm
by wouterz
I also used Vocodizer in the backgound track, at 0:37 the effect it best heard, sort of a robotized drumloop.
Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Apr 12, 2011 12:16 pm
by garyb
interesting!
Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Apr 12, 2011 8:07 pm
by jksuperstar
Oh, just a few more ideas: any chance of Morphing, Randomization, cross breeding patches, or Mutation? That would be very powerful for the modular, plus other devices!!
Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Apr 12, 2011 8:09 pm
by siriusbliss
What screen/hardware are you using?
Greg
Re: GestureSpark - Multitouch controller software for Window
Posted: Wed Apr 13, 2011 2:24 am
by wouterz
jksuperstar wrote:Oh, just a few more ideas: any chance of Morphing, Randomization, cross breeding patches, or Mutation? That would be very powerful for the modular, plus other devices!!
Randomization is already implemented, at 0:13 I'm pressing a randomize button

Morphing is on the ToDo list.
Re: GestureSpark - Multitouch controller software for Window
Posted: Wed Apr 13, 2011 2:29 am
by wouterz
siriusbliss wrote:What screen/hardware are you using?
Greg
I'm using a borrowed EeeTop PC but I'm looking for a new one which supports more fingers. Maybe this one:
http://solutions.3m.com/wps/portal/3M/e ... h/M2256PW/
I't not cheap and I don't have 20 fingers so maybe there are better alternatives.
Re: GestureSpark - Multitouch controller software for Window
Posted: Thu Oct 20, 2011 6:35 am
by jksuperstar
At least there's finally an LED touch screen...22". I can't find any reviews yet that really show the multi-touch in action.
AOC e2239fwt
http://us.aoc.com/monitor_display/e2239fwt
Re: GestureSpark - Multitouch controller software for Window
Posted: Thu Oct 20, 2011 7:01 am
by wouterz
I'm still searching for a multitouch monitor that can be placed on a table with an angle of 60 degrees or more. Like this:
http://www.eizo.com/global/products/vid ... index.html
http://www.eizo.com/global/products/fle ... index.html
But this monitor has only two touch points.
Or maybe there is a vesa mount that can do this.
Re: GestureSpark - Multitouch controller software for Window
Posted: Thu Oct 20, 2011 8:37 am
by jksuperstar
Honestly, I'm thinking about waiting for the iPad HD. Using AirDisplay or some other apps, you could use the iPad as a second display, and also possibly use it as a multi-touch input to Windows 7 as well. Maybe there's a similar app for Android, but I haven't seen it yet. I have some research to do there, but it seems possible. I don't know what the overhead is for using such a display to extend windows, but I use VNC daily at work and one machine (in linux) can support 15+ users. Not realtime use, but shows what can be done these days!
These large-format touch screens don't seem to have anywhere near the capability the small mobile devices have...such a shame!! A VESA mounted touch screen that could track (10+) inputs would be perfect.
Re: GestureSpark - Multitouch controller software for Window
Posted: Fri Dec 16, 2011 8:28 am
by jksuperstar
Wouterz, how is this coming?
A friend & I will try to build a large (~1.2m) touch panel in the new year using frustrated-interference
http://cs.nyu.edu/~jhan/ftirtouch/
combined with a projector, camera, and TUIO software running on a stand-alone PC for mutli-touch tracking, and a TUIO input bridge (or similar) to translate that into a Windows HID multi-touch device. I am looking for an OSC/MIDI based panel graphic system to work with once that's all established.
Have you built or tried anything similar? Maybe I can get the tracking and the panel graphics on the same PC hardware, then communicate over network OSC and rtpMIDI to the SCOPE PC system.
My plan is to build something large enough for at least two people to operate a full 24 or 48 channel mixing desk plus all aux/buss effects control on one surface. And use my XITE-1 as the audio brains behind it all. I do wish there was a way to get OSC to directly control into SCOPE. MIDI zippers are killing me.
Re: GestureSpark - Multitouch controller software for Window
Posted: Fri Dec 16, 2011 9:19 am
by Nestor
jksuperstar wrote:Oh, just a few more ideas: any chance of Morphing, Randomization, cross breeding patches, or Mutation? That would be very powerful for the modular, plus other devices!!
This is my way also, great open posilibities with a single touch, fantastic!
Re: GestureSpark - Multitouch controller software for Window
Posted: Sat Dec 17, 2011 2:19 am
by wouterz
jksuperstar wrote:Wouterz, how is this coming?
A friend & I will try to build a large (~1.2m) touch panel in the new year using frustrated-interference
http://cs.nyu.edu/~jhan/ftirtouch/
combined with a projector, camera, and TUIO software running on a stand-alone PC for mutli-touch tracking, and a TUIO input bridge (or similar) to translate that into a Windows HID multi-touch device. I am looking for an OSC/MIDI based panel graphic system to work with once that's all established.
Have you built or tried anything similar? Maybe I can get the tracking and the panel graphics on the same PC hardware, then communicate over network OSC and rtpMIDI to the SCOPE PC system.
My plan is to build something large enough for at least two people to operate a full 24 or 48 channel mixing desk plus all aux/buss effects control on one surface. And use my XITE-1 as the audio brains behind it all. I do wish there was a way to get OSC to directly control into SCOPE. MIDI zippers are killing me.
I'm making some good progress here. One of the features that I have added is CopperLan support
http://www.copperlan.org/ CopperLan is a very powerful networking system to control musical equipment. One of the great features is to be able to explore all the parameters that a musical device has and automatically map there parameters to a control surface. This control surface does not have to run on the same PC as the software that it is controlling. This could even be a modular synth
http://www.alyseum.com/product_MS-812.p ... 039696ef9f The also have a MIDI over ethernet feature and that can be used to control the Scope hardware over a network. The CopperLan guys have done a great job and it's all free to use for the end user. Imagine what would be possible if Scope would fully support CopperLan. I think we should start asking Sonic Core if they want to implement CopperLan into their Scope system. If there are people going to NAMM 2012 I recommend to visit the CopperLan booth.
Re: GestureSpark - Multitouch controller software for Window
Posted: Sun Jan 08, 2012 7:30 am
by wouterz
I created a page on Facebook and Google+ with a lot of screenshots
http://www.facebook.com/pages/GestureSp ... 8245315185
https://plus.google.com/115208656288511880724
If you're planning to visit the NAMM show 2012 make sure you visit the CopperLan booth (Booth# E13) because they will be showing a preview version of GestureSpark. It's in the same hall as the Sonic Core booth
http://www.namm.org/files/X/interactive_floorplan.html
Re: GestureSpark - Multitouch controller software for Window
Posted: Wed Mar 21, 2012 8:22 am
by wouterz
I'm reading on the CopperLan Facebook page that Sonic Core is going to implement CopperLan support in their Scope Platform
http://www.facebook.com/CopperLan?sk=wa ... =1&theater
This means that in the future every Scope device can be remote controlled over a network. No more MIDI limitations (e.g. the number of assignable controllers and zippernoise)

Re: GestureSpark - Multitouch controller software for Window
Posted: Wed Mar 21, 2012 10:17 am
by siriusbliss
wouterz wrote:I'm reading on the CopperLan Facebook page that Sonic Core is going to implement CopperLan support in their Scope Platform
http://www.facebook.com/CopperLan?sk=wa ... =1&theater
This means that in the future every Scope device can be remote controlled over a network. No more MIDI limitations (e.g. the number of assignable controllers and zippernoise)

Yes, we introduced them at NAMM back in January.
They were right across the room from each other.
It's a nice development. Offers up other options for live and show-control/stage types of applications.
Greg
Re: GestureSpark - Multitouch controller software for Window
Posted: Tue Oct 14, 2014 7:44 pm
by jksuperstar
Just checking in on the development again...because I picked up this Touch monitor, that is based on a 15" HD laptop screen, very maneuverable, adjustable height (or add a VESA mount and put it on an mechanical arm, etc). If feels nice, and for what I can use with it, it is just as responsive as any other smart phone or tablet. But I'd like to see the response via MIDI for real
Do you have a demo or beta available to try? I've seen the Smithson Martin Emulator Pro, but would rather shop locally, especially if copperlan is involved!
http://www.gechic.com/product_help_en.asp?s=10
