GestureSpark - Multitouch controller software for Windows 7

[wouterz]

Here is a video of an early development version of my multitouch controller software for Windows 7 with support for OSC and MIDI.

http://youtu.be/X2BmAtKXSZ4

I some point I will build panels for the popular Scope devices
Any comments or suggestions are welcome.

Keep an eye on http://www.gesturespark.com

I'm not going to use the word "soon"

[jksuperstar]

Very, very cool. I have been wanting a nice touch surface as a controller for a while, admittedly just so that I wouldn't have to program a MIDI controller until I had identified the knobs I need to adjust live, the rest of the time I'd use the touch screen directly with scope But this looks very promising, especially if templates would exist (and ould be added to by users in a community) for all the scope devices!

For a touch surface, though, I'd move labels *above* each element. Also, larger buttons with the label inside is better than outside with a button too small to touch easily. Just my opinion, which can be ignored!

[wouterz]

For a touch surface, though, I'd move labels *above* each element. Also, larger buttons with the label inside is better than outside with a button too small to touch easily. Just my opinion, which can be ignored!

Good point, I will put this on my ToDo list, the second suggestion is already possible.

[siriusbliss]

Great start!
Can't wait to see how it progresses.

We'll have to start mapping all the various synths (or at least ModIV)

Have fun,

Greg

[wouterz]

I also used Vocodizer in the backgound track, at 0:37 the effect it best heard, sort of a robotized drumloop.

[garyb]

interesting!

[jksuperstar]

Oh, just a few more ideas: any chance of Morphing, Randomization, cross breeding patches, or Mutation? That would be very powerful for the modular, plus other devices!!

[siriusbliss]

What screen/hardware are you using?

Greg

[wouterz]

Oh, just a few more ideas: any chance of Morphing, Randomization, cross breeding patches, or Mutation? That would be very powerful for the modular, plus other devices!!

Randomization is already implemented, at 0:13 I'm pressing a randomize button Morphing is on the ToDo list.

[wouterz]

What screen/hardware are you using?

Greg

I'm using a borrowed EeeTop PC but I'm looking for a new one which supports more fingers. Maybe this one: http://solutions.3m.com/wps/portal/3M/e ... h/M2256PW/

I't not cheap and I don't have 20 fingers so maybe there are better alternatives.

[jksuperstar]

At least there's finally an LED touch screen...22". I can't find any reviews yet that really show the multi-touch in action.

AOC e2239fwt

http://us.aoc.com/monitor_display/e2239fwt

[wouterz]

I'm still searching for a multitouch monitor that can be placed on a table with an angle of 60 degrees or more. Like this:

http://www.eizo.com/global/products/vid ... index.html

http://www.eizo.com/global/products/fle ... index.html

But this monitor has only two touch points.

Or maybe there is a vesa mount that can do this.

[jksuperstar]

Honestly, I'm thinking about waiting for the iPad HD. Using AirDisplay or some other apps, you could use the iPad as a second display, and also possibly use it as a multi-touch input to Windows 7 as well. Maybe there's a similar app for Android, but I haven't seen it yet. I have some research to do there, but it seems possible. I don't know what the overhead is for using such a display to extend windows, but I use VNC daily at work and one machine (in linux) can support 15+ users. Not realtime use, but shows what can be done these days!

These large-format touch screens don't seem to have anywhere near the capability the small mobile devices have...such a shame!! A VESA mounted touch screen that could track (10+) inputs would be perfect.

[jksuperstar]

Wouterz, how is this coming?

A friend & I will try to build a large (~1.2m) touch panel in the new year using frustrated-interference
http://cs.nyu.edu/~jhan/ftirtouch/

combined with a projector, camera, and TUIO software running on a stand-alone PC for mutli-touch tracking, and a TUIO input bridge (or similar) to translate that into a Windows HID multi-touch device. I am looking for an OSC/MIDI based panel graphic system to work with once that's all established.

Have you built or tried anything similar? Maybe I can get the tracking and the panel graphics on the same PC hardware, then communicate over network OSC and rtpMIDI to the SCOPE PC system.

My plan is to build something large enough for at least two people to operate a full 24 or 48 channel mixing desk plus all aux/buss effects control on one surface. And use my XITE-1 as the audio brains behind it all. I do wish there was a way to get OSC to directly control into SCOPE. MIDI zippers are killing me.

[Nestor]

Oh, just a few more ideas: any chance of Morphing, Randomization, cross breeding patches, or Mutation? That would be very powerful for the modular, plus other devices!!

This is my way also, great open posilibities with a single touch, fantastic!

[wouterz]

Wouterz, how is this coming?

A friend & I will try to build a large (~1.2m) touch panel in the new year using frustrated-interference
http://cs.nyu.edu/~jhan/ftirtouch/

combined with a projector, camera, and TUIO software running on a stand-alone PC for mutli-touch tracking, and a TUIO input bridge (or similar) to translate that into a Windows HID multi-touch device. I am looking for an OSC/MIDI based panel graphic system to work with once that's all established.

Have you built or tried anything similar? Maybe I can get the tracking and the panel graphics on the same PC hardware, then communicate over network OSC and rtpMIDI to the SCOPE PC system.

My plan is to build something large enough for at least two people to operate a full 24 or 48 channel mixing desk plus all aux/buss effects control on one surface. And use my XITE-1 as the audio brains behind it all. I do wish there was a way to get OSC to directly control into SCOPE. MIDI zippers are killing me.

I'm making some good progress here. One of the features that I have added is CopperLan support http://www.copperlan.org/ CopperLan is a very powerful networking system to control musical equipment. One of the great features is to be able to explore all the parameters that a musical device has and automatically map there parameters to a control surface. This control surface does not have to run on the same PC as the software that it is controlling. This could even be a modular synth http://www.alyseum.com/product_MS-812.p ... 039696ef9f The also have a MIDI over ethernet feature and that can be used to control the Scope hardware over a network. The CopperLan guys have done a great job and it's all free to use for the end user. Imagine what would be possible if Scope would fully support CopperLan. I think we should start asking Sonic Core if they want to implement CopperLan into their Scope system. If there are people going to NAMM 2012 I recommend to visit the CopperLan booth.

[wouterz]

I created a page on Facebook and Google+ with a lot of screenshots

http://www.facebook.com/pages/GestureSp ... 8245315185

https://plus.google.com/115208656288511880724

If you're planning to visit the NAMM show 2012 make sure you visit the CopperLan booth (Booth# E13) because they will be showing a preview version of GestureSpark. It's in the same hall as the Sonic Core booth http://www.namm.org/files/X/interactive_floorplan.html

[wouterz]

I'm reading on the CopperLan Facebook page that Sonic Core is going to implement CopperLan support in their Scope Platform

http://www.facebook.com/CopperLan?sk=wa ... =1&theater

This means that in the future every Scope device can be remote controlled over a network. No more MIDI limitations (e.g. the number of assignable controllers and zippernoise)

[siriusbliss]

I'm reading on the CopperLan Facebook page that Sonic Core is going to implement CopperLan support in their Scope Platform

http://www.facebook.com/CopperLan?sk=wa ... =1&theater

This means that in the future every Scope device can be remote controlled over a network. No more MIDI limitations (e.g. the number of assignable controllers and zippernoise)

Yes, we introduced them at NAMM back in January.
They were right across the room from each other.

It's a nice development. Offers up other options for live and show-control/stage types of applications.

Greg

[jksuperstar]

Just checking in on the development again...because I picked up this Touch monitor, that is based on a 15" HD laptop screen, very maneuverable, adjustable height (or add a VESA mount and put it on an mechanical arm, etc). If feels nice, and for what I can use with it, it is just as responsive as any other smart phone or tablet. But I'd like to see the response via MIDI for real

Do you have a demo or beta available to try? I've seen the Smithson Martin Emulator Pro, but would rather shop locally, especially if copperlan is involved!

http://www.gechic.com/product_help_en.asp?s=10