Research

ICE (2009-2015)

Collaboration in the ICE project The ICE (Interactive Collaborative Environment) project explores how to design and implement a smart computer-mediated collaborative environment which supports 1) multiple users interacting with a common application simultaneously, 2) interaction with the common application using a variety of devices including mobile phones, tablets, touch-tables and laptop computers, 3) an ecology of shared and private displays and 4) both co-located and telepresent interaction. In particular, I am interested in how awareness, distraction and privacy in a multi-user context can affect collaboration and how technology can be used to effectively handle these issues in order to improve the experience of computer-mediated collaborative work.


Mobile MedSLT (2008-2009, consultant)

Mobile MedSLT screen The MedSLT system is a speech-to-speech translation system for the medical domain. It was initially developed for use on a desktop or laptop computer, but the project team wanted to also move the system onto smaller mobile devices such as PDAs. I worked with the team to design the interface and interactions for the mobile version of the system and helped them define a protocol for performing a user evaluation with it.

Regulus (2008, consultant)

Regulus GUI screen Regulus is an open-source Prolog-based toolkit for building spoken dialogue systems. When a GUI was added to the Regulus environment, which had previously been command-line based, I performed heuristic evaluations of early versions of the Regulus GUI.


Interactive Multimodal Information Management (IM2) - Archivus (2003-2007)

The Interactive Multimodal Information Management (IM2) project was a Swiss National Science Foundation NCCR in the field of Human-computer Interaction. The aim of the project was the advancement of research "particularly concerned with technologies coordinating natural input modes (such as speech, image, pen, touch, hand gestures, head and/or body movements, and even physiological sensors) with multimedia system outputs, such as speech, sounds, images, 3D graphics and animation."

Archivus screenOne aspect of the project involved the development of specially equipped SmartRooms capable of recording everything that happens in a meeting (video, audio, slide capture and electronic whiteboard use). Meetings that take place in these rooms leave an extensive series of browsable and searchable artifacts in the form of audio and video files, electronic copies of documents used during the meeting, and a text transcript of what was said. This multimedia data can also be annotated (topics, dialogue acts, arguments, etc.). The result is that people have access to a much richer resource of information about meetings than they ever had before, and possibly new ways to explore this data. I was part of a small group that tried to address the issue of how people would want to access that stored information - both in terms of the types of information that they would want to find, and the interactions that they prefer to use to find it. To do this we designed, implemented and evaluated a multimodal dialogue-driven system for multimedia meeting data retrieval and browsing called Archivus. Archivus acted as a portal to the multimedia meeting database, allowing users to browse and search the data using any of mouse, keyboard, voice or stylus - independently, or in combination with one another.


Parmenides (2003-2005)

The Parmenides project was a European Union project concerning "Ontology driven temporal text mining on organizational data for extracting temporal valid knowledge" whose aim was "to develop novel techniques for building and maintaining domain specific ontologies, automatic detection and extraction of events in textual data, integrating the textual temporal information which has been extracted in a document warehouse and temporal knowledge discovery tasks for trends analysis, temporal validity of knowledge, etc.". The project involved academic, public and private sector partners. Our role in the project was user-oriented system evaluation. Our group's work resulted in the conception, design and initial implementation of two software tools:

Quality Model Builder screen The Quality Model Builder (QMB) allows software designers and end-users to develop a hierarchical quality model to help evaluate complex software.

Relative Ordering Tool for Evaluation screen The Relative Ordering Tool for Evaluation (ROTE) is designed to help end-users rank the relative importance of their user requirements in order to guide software developers as to the priorities that should be attached to individual requirements.

Both these tools are available online at http://www.issco.unige.ch/en/research/resources/.