Case Studies

	FACIAL ANIMATION. The animated three-dimensional model of a human head was constructed to investigate how to produce fully controllable facial expressions of emotion. The facial activity of the model is based on the Facial Action Coding System, which allows construction of new facial expressions from elemental action units.
	INVISIBLE ENI is an eyes only computer game, built to investigate the scope and possibilities, as well as design aesthetics, of eyes only Human-Computer Interaction. Playing the game engages the player in various different forms of interaction. The game uses gaze direction, blinking and a novel interaction technique, voluntary pupil dilation. Pupil based interaction also investigates new forms of affective computing as players are invited to explore their emotions as a way of controlling elements in the game.
	FISHING GAME. We investigate how the muscle force of actions can be used as a control in 3D virtual environments, especially for 3D modelling tasks. The system detects muscle activation trhough an EMG-sleeve and makes available different interaction possibilities depending on the force of a gesture. A fishing game prototype was developed to evaluate EMG-based interaction - the type of fish you can catch depends on how you pull the hook!

Publications

2008

Inger Ekman; Antti Poikola; Meeri Mäkäräinen; Tapio Takala; Perttu Hämäläinen Voluntary Pupil Size Change as Control in Eyes Only Interaction. Eye Tracking Research & Applications Symposium, 26-28 March 2008, Savannah, USA. [PDF]

Inger Ekman; Antti Poikola; Meeri Mäkäräinen. 2008.Invisible Eni - Using Gaze and Pupil Size to Control a Game. ACM CHI'08 Extended Abstracts.

Cumhur Erkut; Jean-Julien Filatriau; Rémy Lehembre; Inger Ekman. 2008. Sonic Interaction Design with Physiological Interfaces in a Workshop Setting. Workshop on Sonic Interaction Design: Sound, Information, and Experience, CHI2008.

2007

Ville Nenonen; Aleksi Lindblad; Ville Häkkinen; Toni Laitinen; Mikko Jouhtio; Perttu Hämäläinen Using Heart Rate to Control an Interactive Game. SIGCHI conference on Human factors in computing systems CHI '07, April 28 - May 3, 2007, San Jose, California, USA, pp. 583-586

Hämäläinen Perttu Novel applications of real-time audiovisual signal processing technology for art and sports education and entertainment. Doctoral dissertation, Publications of Telecommunications Software and Multimedia, TML-A18, 2007, Helsinki University of Technology

Takala, Tapio. A Playable Synthesis Model And Controller For Bowed String Instruments. Proc. Intl. Computer Music Conf. ICMC'07, Copenhagen, Denmark, 2007, Vol.1 pp. 382-385

Takala, Tapio An Enactive Interface for Playing Physical Sound Synthesis of Bowed String Instruments. 4th International Conference on Enactive Interfaces, Grenoble France, 19-24 Nov 2007

Lankoski, P.; Ekman, I. & Heliö, S. 2007. A Method for Designing Multifaceted Player Characters in Computer Games. Art & Design, December, 2007, 72-75.

Ekman, I. 2007. Sound-based Gaming for Sighted Audiences - Experiences from a Mobile Multiplayer Location Aware Game. In Proc. Audio Mostly 2007, 2nd Conference on Interaction with Sound, Ilmenau, Germany.

2006

Mäkäräinen, Meeri Expressions of Emotion on an Animated Face Model. M.Sc. thesis, Helsinki University of Technology, 2006