A Toolkit for Explorations in Sonic Interaction Design

A Toolkit for Explorations in
Sonic Interaction Design
Stefano Delle Monache - Università IUAV di Venezia
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
SONIC INTERACTION DESIGN
EU COST IC0601 Action on
Sonic Interaction Design - 2007 / 2011
http://www.sid.soundobject.org/
is about enhancing the qualities of objects in use through sound.
Sound can make the qualities of interaction manifest, sharable
and social.
> shape the sonic appearance of products
> support new functions or display possibilities for products
> improve the performance in interaction processes
> design informative and pleasant sonic environments
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
SONIC INTERACTION DESIGN
Understanding and interpreting non-visual sketches and prototypes
is a core issue when designing for movement-based interaction.
‣
creation
manipulation
Research
through
design
practices
performance
understanding
interpretation
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
SONIC INTERACTION DESIGN
Sonic interaction designers expect an effective set of
methods, practices and tools.
‣
Product Sound Design Summer School, Aalto University,
Espoo, Finland 23th-26th August 2010
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
SOUND DESIGN TOOLKIT
The SDT is a front-end application in Max/MSP and Pure Data,
providing a palette of virtual lutheries and foley pits for Sonic
Interaction Design sketching and prototyping.
‣
http://www.soundobject.org/SDT/
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
SOUND DESIGN TOOLKIT
‣
Set of interactively controllable physics-based sound models
‣ natural behaviour (natural mapping)
‣ continuous sound feedback
‣ potentially an embodied experience
Impact
Friction
‣
Procedural approach to sound design
Resonator and interactor description by their physical-geometric
properties
‣
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
SOUND DESIGN TOOLKIT
Simulation
examples
footsteps
on gravel
can
crushing
paper
crumpling
walking
Derived
processes
hammered
string
bouncing
crushing
rolling /
braking
wheel
falling
coin
struck
bar
crumpling
glass
cleaning
breaking
dropping
hitting
squeaking
door
bowed
string
splashing
sliding
filling
pouring
fracturing
rubbing
IMPACT
model
sucking
whooshing
rolling
burbling
FRACTURE
model
rubbed
glass
squeaking
Basic events
And textures
Low-level
models
Vacuum cleaner (turning
on/off, corking tube)
dripping
burning
flowing
exploding
braking
FRICTION
model
SOLIDS
BUBBLE
model
FLUID FLOW
model
LIQUIDS
TURBULENCE
model
EXPLOSION
model
GASSES
SDT is based on an everyday sound taxonomy.
from
and Gaver (1993)
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
popping
SOUND DESIGN TOOLKIT
Iterative process of development and evaluation of the system in
workshop settings towards a tool that could:
‣
1. grow away from a musical metaphor
2. respond to the requirements of design thinking
3. be sufficiently immediate and easy to use
4. represent a valuable platform in SID education and research
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
SOUND DESIGN TOOLKIT
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
EMBODYING THE SDT
‣
interactive installation: Gamelunch, a sonic dining table
‣ investigation of surprise and contradiction in sonic interaction
(Polotti et al., 2008)
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
EMBODYING THE SDT
‣
research: designing continuous sonic interaction
‣ continuous sound feedback for mechanical connections
‣ supportive and expressive feedback for cyclic continuous
actions (Rocchesso et al., 2009)
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
EMBODYING THE SDT
workshop on paper-driven sonic narrative - paper mechanisms for
sonic interaction at Conservatorio di Musica Statale C. Pollini of
Padova - 2011. (Delle Monache et al., 2012)
‣
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze
REFERENCES
S. Delle Monache, P. Polotti, and D. Rocchesso, “Sonic InteractionDesign”, Disegno
Industriale – Industrial Design, n. 46-47, pp. 130-139, Gangemi Editore, Roma 2011.
‣
(http://rice.iuav.it/163/1/soundesign.pdf)
D. Rocchesso, P. Polotti and S. Delle Monache, “DesigningContinuous Sonic Interaction”.
International Journal of Design, 3(3),2009. (http://www.ijdesign.org/ojs/index.php/IJDesign/article/view/
‣
620/271)
S. Delle Monache, P. Polotti, and D. Rocchesso, “A Toolkit forExplorations in Sonic
Interaction Design”, In the 5th Audio MostlyConference: A Conference on Interaction with
Sound (AM '10),Pitea, Sweden. September 15 – 17, 2010. ACM, New York, NY,USA.
‣
(http://rice.iuav.it/170/1/SDT_atoolkitforSID.pdf)
S. Delle Monache, D. Rocchesso, J. Qi, L. Buechley, A. De Gotzen,D. Cestaro, “Paper
mechanisms for sonic interaction”. In Proc.TEI2012 - 8th Conference on Tangible,
Embedded and EmbodiedInteraction. Kingston, Canada, 2012.
‣
(http://soundingpopables.wordpress.com/)
FKL 2013 - Per chi suona il paesaggio sonoro, 13 aprile 2013 - SUC, Firenze