HCI Sorbonne

Title: A computational approach 
to modelling gestural interactions 
of the upper-limb on planar surfaces.
When / Where: July 4, 11:00AM; Sorbonne Université, Campus Jussieu, ISIR Lab, Room H20
Speaker: Antoine Loriette
Abstract: There are many compelling reasons for proposing new gestural interactions: one might want to use a sensor that affords access to data that couldn’t be captured previously, or transpose a well-known task in a previously unexplored scenario. The design and optimisation of new interactions remains, however, a challenge. Models have been used to make predictions about interaction properties. Fitts’ law, for example, accurately predicts movement time in pointing and steering tasks. But what happens when no existing models apply?
In this talk, I will present how a computational approach using data-driven modelling was employed to create new interactions or afford their optimisation. In particular, two gestural interactions of the upper-limb on planar surfaces are investigated: text-entry through optically tracked virtual surfaces and reach rehabilitation through adapted digital gameplay. Then, reflecting on the lessons learned from these two case studies, a tool for exploring systematically the space of motions users can produce (in terms of variability and stability) is presented, supporting the idea that motion analysis is an important step before gestures can be designed.
Bio: Antoine Loriette recently submitted his PhD Thesis on “Models and Performance of Upper-limb Interactions on Planar Surfaces” under the supervision of Dr. John H. Williamson (University of Glasgow). Antoine holds a MSc in Engineering from the University of Strasbourg and a MSc in Physics from the Royal Institute of Technology in Stockholm. After graduation, Antoine worked for 6 years at Ericsson for the development of 4G products where he took on the various roles of software designer, SCRUM master and researcher. In 2014, Antoine joined the group of Barry Brown in the Mobile Life research centre as a research assistant where he worked on designing speech interactions. He then joined the group of Roderick Murray-Smith in 2015 for undertaking a PhD, funded by the European project MoreGrasp, with a strong focus on computational interaction.
Language: English
Host: Gilles Bailly

Title: The Effects of the Design of Mobile Security Notifications and Mobile App Usability on Users’ Security Perceptions
When : June 25, 3:00PM
Where: Sorbonne Université, Jussieu Campus, ISIR Lab, Room 304. More information

Abstract: The explosive global adoption of mobile applications (apps) has been fraught with security and privacy issues. App users typically have a poor understanding of information security; worse, they routinely ignore security notifications designed to increase security on apps. Lacking training regarding app security and ignoring app notifications concerning security behaviors cause users to form distorted and inaccurate security perceptions. By considering both mobile app interface usability and mobile security notification (MSN) design, we investigate how security perceptions of apps are formed and how these perceptions influence users’ intentions to continue using apps. Accordingly, we designed and conducted a set of controlled survey experiments with 317 participants in different MSN interface scenarios by manipulating the types of MSN interfaces (i.e., high vs. low disruption), the context (i.e., hedonic vs. utilitarian scenarios), and the degree of MSN intrusiveness (high vs. low intrusiveness). We found both app interface usability and the design of MSNs significantly impacted users’ perceived security, which in turn has a positive influence on users’ intention to continue using the app. In addition, we found an important conundrum that disruptive MSNs—a very common approach to delivering MSNs—irritate users and negatively influence their perceptions of app security. Thus, our results directly challenge current practice. If they hold, current practice must shift away from MSNs that interrupt task performance.
Short Bio: Dr. Dezhi Wu is currently an associate professor in the Department of Integrated Information Technology, University of South Carolina, Columbia, SC, USA. She earned her Ph.D. in Information Systems with a concentration on Human-Computer Interaction from New Jersey Institute of Technology, USA. She is also a certified Project Management Professional (PMP). Dr. Wu is a passionate and dedicated scholar in the information systems field, especially as it pertains to the intersection area among human-computer interaction, cybersecurity, health IT, and cyberlearning. Her academic work explores how users interact with computers, the Internet, robotics and smart devices, as well as other emerging technologies, to accomplish their goals. Her passion also extends to creating innovative and cutting-edge interfaces and designing transformative experiences that fill the gaps between users and today’s evolving technologies. Through all this, Dr. Wu engages and inspires her students through experiential learning methods to foster their lifelong learning experiences.
Language: English
Host: Gilles Bailly

Title: Designing Personalized User Interfaces
When: June 20, 2:30PM
Where: Sorbonne Université, Jussieu Campus, ISIR Lab, Room H20. More information

Abstract: There is no such thing as an average user. Users bring their own individual needs, desires, and skills to their everyday use of interactive technologies. Yet many of today’s technologies, from desktop applications to mobile devices and apps, are still designed for some mythical average user. It seems intuitive that interfaces should be designed with adaptation in mind so that they would better accommodate individual differences among users. Yet, what seems intuitive is not necessarily straightforward.

I will highlight examples of my research in the area of personalized user interfaces. The focus will be on various approaches to adaptation and what we’ve learned about the strengths and limitations of those approaches. I will argue that the most promising future opportunities lie with a human-computer partnership model, but that such a model is challenging to design.

Short Bio: Joanna McGrenere is a Professor in Computer Science at the University of British Columbia (UBC) and is an Inria & Université Paris Sud International Research Chair. She earned her PhD from the University of Toronto, after completing her MSc at UBC. Joanna specializes in Human-Computer Interaction research, with a focus on designing personalized user interfaces, computer supported cooperative work, as well as on developing interactive systems for diverse user populations, including older adults and people with impairments. She is currently serving as the overall Technical Program Co-Chair for ACM CHI 2020, and was recently the Program Co-Chair for ACM ASSETS 2018. She is a member of the editorial board for ACM Transactions on Computer-Human-Interaction (ToCHI) and ACM Transactions on Accessible Computing (TACCESS).

Language: English
Host: Ignacio Avellino

Title: Social HMDs: Designing Mixed Reality Technology to Fit into the Social Fabric of our Daily Lives
Speaker: Jan Gugenheimer
When – Where: Sorbonne Université, Room 304. Tuesday, June 4th.
Abstract:Technological advancements in the fields of optics, display technology and miniaturization have enabled high-quality mixed reality (AR and VR) head-mounted displays (HMDs) to be used beyond research labs. This enables a novel interaction scenario where the context of use changes drastically and HMDs aims to become a daily commodity. In this talk, I will argue that the current design of HMDs does not consider the context of use (e.g. physical environment, social factors) and therefore impedes the adoption and acceptance of the technology. I will use the framework of context-aware computing to show that a parallel development happened with the transition from desktop PCs to smartphones and present six use cases, highlighting how a potential future HMD could be designed that fits this upcoming social context.
Bio: Jan Gugenheimer recently submitted his PhD Thesis on “Nomadic Virtual Reality: Overcoming Challenges of Mobile Virtual Reality Head-Mounted Displays” under the supervision of Prof. Dr. Enrico Rukzio (Ulm University). Jan holds a BSc in Media Informatics and MSc in Media Informatics (with a focus on HCI) from Ulm University. During his studies Jan had several stays abroad, visiting research groups at Universities and Industry. Jan wrote his Master thesis in cooperation with Mercedes-Benz Research and Developement North America (MBRDNA) in Palo Alto, spent 3 Months at the MIT Media Lab in the Fluid Interfaces Group under the supervision of Pattie Maes and was a summer intern at Microsoft Research Redmond working with Hrvoje Benko and Eyal Ofek on mobile Virtual Reality. His work is frequently published and awarded at venues such as ACM CHI, UIST, ISMAR and IEEE VR.
Host: Marc Teyssier
Language: English

Our group presents three articles at this year’s CHI conference in Glasgow, UK:

• Increasing the Transparency of Research Papers with Explorable Multiverse Analyses by Pierre Dragicevic, Yvonne Jansen, Abhraneel Sarma, Matthew Kay, Fanny Chevalier
• Impacts of Telemanipulation in Robotic Assisted Surgery by Ignacio Avellino, Gilles Bailly, Geoffroy Canlorbe, Jérémie Belghiti, Guillaume Morel, Marie-Aude Vitrani
• Effects of Locomotion and Visual Overview on Spatial Memory when Interacting with Wall Displays by Yvonne Jansen, Jonas Schjerlund, Kasper Hornbæk

Title : Brain-Computer Interface : Learn how to use it and use it to learn.

Where: Room H20, ISIR, Sorbonne Université, Campus Jussieu,

When: March 27, 2019 à 10:00AM

Who: Camille Jeunet

Host: Gilles Bailly

Language: English

Abstract : Les interfaces cerveau-ordinateur (ICO) sont des technologies permettant à l’utilisateur de contrôler une application par le seul biais de son activité cérébrale, mesurée la plupart du temps grâce à un ElectroEncéphaloGraphe (EEG). Malgré le fait qu’elles soient extrêmement prometteuses,  notamment pour contrôler des technologies d’assistance, les ICO restent peu développées en dehors des laboratoires de recherche. Une raison majeure est leur manque de fiabilité : les études montrent que 15 à 30% des utilisateurs n’arriveraient pas à utiliser une ICO. Parmi les différents facteurs pouvant expliquer ce manque de fiabilité, nous nous intéressons à un élément peu étudié jusqu’à présent : l’apprentissage humain. En effet, utiliser une ICO requiert l’acquisition de compétences spécifiques et donc un entraînement approprié. Or, les protocoles d’entraînement standards actuels sont inappropriés et doivent être améliorés. Mes recherches visent donc à améliorer l’entraînement à l’usage des ICO afin que les utilisateurs puissent plus facilement « apprendre à s’en servir ». Pour ce faire, nous comptons utiliser les informations recueillies lors de l’utilisation de l’ICO, et notamment l’activité EEG de l’apprenant, afin d’inférer son état et d’adapter dynamiquement l’entraînement (p. ex., nature et difficulté des tâches, fréquence et information fournie par le feedback) en fonction de cet état. Il s’agit donc de détourner l’usage standard de l’ICO et de « s’en servir pour apprendre ». Autrement dit, nous souhaitons combiner une utilisation ‘active’ de l’ICO (i.e., utilisation des signaux EEG comme commandes pour une application) à une utilisation ‘passive’ de celle-ci (i.e., utilisation des signaux EEG comme indicateurs de l’état de l’apprenant). L’objectif fondamental de ces travaux de recherche est de comprendre et modéliser les processus sous-tendant l’apprentissage ICO sous ses différentes dimensions : neurophysiologique, cognitive, psychologique et sociale. Derrière cet objectif fondamental se trouve un objectif plus applicatif : démocratiser l’usage des ICO pour l’entraînement cognitif/moteur (amélioration de la performance des athlètes, rééducation des patients post-AVC, …) et le contrôle d’applications (technologies d’assistance, jeux vidéo, …) afin de favoriser l’autonomie de sujets tout-venant et de patients.

Bio : Camille Jeunet is a CNRS research scientist, working in the CLLE Lab (Univ. Toulouse Jean Jaurès, CNRS, Toulouse, France). her main topic of interest is Brain-Computer Interfaces (BCIs) & Neurofeedback (NF). She does her best to lead her research using an interdisciplinary approach combining cognitive sciences, psychology, neuroscience, computer sciences and sport sciences in order to better understand the mechanisms underlying human performance and learning in BCIs/NF.

Experiments on alternative locomotion techniques for micro-robots

Where: Room 304 (Campus Jussieu)
When: 2:00PM
Host: Nicolas Bredeche

In this informal talk I will describe some experiments on alternative 
methods of locomotion for micro or macro objects not using wheels or 
other electro-mechanical methods – in particular, the idea is to harness 
vibrations from the environment and coupling it with internal degrees of 
freedom of the system using machine learning. These techniques, along 
others now being studied can be extended to study swarming robots as 
well as control the vibration phase of the quantum hydrodynamic walkers.

The talk will not be theoretical in nature, but rather experimental and 
based on computer simulations – my background is quite particular I hold 
a PhD from Paris XI on Optoelectronic Stochastic Parallel Processors and 
I worked for 15 years as director of a human computer and robotics 
laboratory at the University of Tokyo (and as an independent Media 
Artist…). That is to say, I very much look forward your feedback as 
well as learn from you!

When: December 12th, 10AM

Where: Room H20, Pyramide (ISIR), Campus Jussieu, Sorbonne Université

Title: Toward Highly Reconfigurable Interactive Devices

Abstract: The static shape of computers is the bottleneck of today’s interactive systems. I argue that we need shape-changing computers that are malleable and reconfigure into any shapes and provide affordances that unleash users interactive potential. However, despite tremendous breakthroughs in advanced materials, their implementation is far off because we don’t understand how to support interactions with them. In this talk I will present my work toward creating malleable and reconfigurable interactive devices, as well as future challenges (more at http://anneroudaut.fr/).

Bio: Anne Roudaut is a Senior Lecturer, Leverhulme Trust fellow and co-leader of the Bristol Interaction Group at the University of Bristol (UK). Her research is rooted within Human Computer Interaction with leaves growing toward Material Engineering and Soft Robotics. Her research approach is a blend of theory, experimentation, and software/hardware design and her goal is to help designers create the best possible interfaces and devices we will soon have in our hands. Before arriving in Bristol she spent two years as a research assistant at the Hasso Plattner Institute and she did her Ph.D at Telecom ParisTech.

Host: Gilles Bailly

Thursday 25/10

Mitigating the Attraction Effect with Visualizations
Evanthia Dimara, Gilles Bailly, Anastasia Bezerianos, and Steven Franconeri

Session: Perception & Cognition 2

Abstract
Human decisions are prone to biases, and this is no less true for decisions made within data visualizations. Bias mitigation strategies often focus on the person, by educating people about their biases, typically with little success. We focus instead on the system, presenting the first evidence that altering the design of an interactive visualization tool can mitigate a strong bias — the attraction effect. Participants viewed 2D scatterplots where choices between superior alternatives were affected by the placement of other suboptimal points. We found that highlighting the superior alternatives weakened the bias, but did not eliminate it. We then tested an interactive approach where participants completely removed locally dominated points from the view, inspired by the elimination by aspects strategy in the decision-making literature. This approach strongly decreased the bias, leading to a counterintuitive suggestion: tools that allow removing inappropriately salient or distracting data from a view may help lead users to make more rational decisions.

Links
https://hal.inria.fr/hal-01845004
https://aviz.fr/deletion

Wednesday 24/10

Best Paper Award 🏅
Caractérisation de la transition entre les menus et les raccourcis claviers
Gilles Bailly, Emmanouil Giannisakis, Marion Morel, Catherine Achard

Session: Adapter, s’adapter

Abstract
This paper aims at better understanding the transition from menus to shortcuts. We first discuss the limitations and the opportunities of the theoretical and empirical characterizations of this transition. We then consider keyboard shortcuts as a case study and manually annotate empirical data to estimate several behavioral markers such as the initial switch, the transition duration or the performance dip. These markers serve to precisely characterize and compare three interaction techniques. Finally, we compare two methods to automatically characterize the transition from menus to shortcuts

When: October 19th, 2018, 9:00 AM

Where: Paris Telecom

Title: Understanding the experiences of schooling of visually impaired children: A French ethnographic and design inquiry.

Jury:

Madeleine Akrich, DR, CSI, Mines ParisTech, CNRS i3, PSL University (rapporteur)

Gilles Bailly, CR CNRS (HDR), Sorbonne Université, ISIR (PhD supervisor)

Annie Gentès, MCF (HDR), CNRS i3, Télécom ParisTech (PhD supervisor)

Ann Heylighen, Professor, KU Leuven (examiner)

Wendy Mackay, DR, INRIA Saclay (rapporteur)

Marine Royer, MCF, University of Nîmes (examiner)

Abstract: In 2005, France passed a law on equal rights and opportunities, participation and citizenship of people with disabilities. It consecrated the right of all children to attend their neighbourhood school and re-organized the provision of services to this population, including the provision of assistive technologies. This research conducted a decade later between 2014 and 2017, investigates visually impaired children’s experiences of schooling and the roles of technologies in supporting their well-being at school.

I developed a mixed-methods interdisciplinary approach, blending qualitative sociological research with Human-Computer Interaction experiments. Specifically, I conducted a two-years-long ethnographic study at a service provider for visually impaired children in the South of France, during which I made several design interventions. This field-work is contextualized by a critical review of the statistics on the schooling of visually impaired children provided by the Ministry of Education.

I use an ecological understanding of resilience to examine children’s narratives about school, across different schooling modalities (e.g., mainstream and special education school) and sociodemographic characteristics. I discuss the resources and strategies children and their carers use to open opportunities for well-being at school, including uses of technologies. I contextualize these by investigating desirable schooling outcomes that define who is resilient and what resilience is for.

From there I propose to develop a non-visual approach to the (geography) curriculum inspired by the sensory turn. By changing what is considered as a valued way of learning, this thesis aims at providing opportunities to develop the sense of belonging and the perception of self-efficacy in the classroom. It informs us on the uses of hearing, smell, taste, and kinesthesia in geography; it supports pupils in reshaping of the learning activities and spaces; Finally, it opens opportunities for collective geographical knowledge rooted in experiences of social inequalities. More broadly, it opens a discussion on building collective well-being and resilience in schools.

Keywords: Meaning-making; Resilience; Geography; Geography Curriculum; Multisensory; Sensory turn; Sensory Knowledge; Disability; Education; School; Human-Computer Interaction; Design; Pupils; Children; Probes; Classroom.

When: July 16th, 11:00 AM

Where: Sorbonne Université (Campus Jussieu), ISIR Lab (Pyramid), Room H20 (with air-conditioning)

Title: Machine Learning and Interpretation of Human Interactions from Mobile and Mixed Reality Systems

Speaker: Vir Phoha (Professor at Syracuse University)

Host: Gilles Bailly

Abstract: I posit the birth of a new research field focusing on multi-faceted human-machine interface in any computing environment. Gestures, touch, gait, autonomic, and cognitive response will form the basis of this emerging multi-faceted interface to computing devices. I will present results of learning and analysis of behavior streams, resulting from gestures, typing, swiping; mouse movement; head and torso movement; and gait as captured through sensors, such as accelerometer, gyroscope, keyboard sensors etc. on mobile devices including smart phone and Google Glass. These patterns provide rich information, which can be used for biometric authentication and predictive modelling.

As the multi-faceted interface begins to steadily replace the mouse and keyboard as the dominant human-machine interface, many phenomena relating to how humans interact with computers will have to be re-evaluated under the new interface. The recent introduction of devices for Holographic Computing, Virtual Reality (VR), and Augmented Reality (AR) has opened a new and yet unexplored facet of computing. I will address question of whether authentication could indeed be practical on real devices using behavioral and autonomic and natural body responses measured through smart phones, head-mounted displays and other input devices for AR, VR, and Holographic computing.

Bio:  Dr. Vir Phoha is a Professor of Computer Science in the College of Engineering and Computer Science at Syracuse University. Before joining Syracuse University, Dr. Phoha was a W.W. Chew Endowed Professor of Computer Science at Louisiana Tech University. From 2007-2014 Professor directed the Center for Secure Cyberspace, which was started through an $8M grant from the State of Louisiana.

He has written six books and over 200 research papers. He has 14 US patents and his technology is widely used in industry. Professor Phoha received an MS (1990) and Ph.D. (1992) degree in computer science from Texas Tech University, Lubbock. His research interests include study of human behavioral patterns captured through wearable and mobile devices. In particular, he has interest in behavioral biometrics, authentication in networks; Machine Learning (Bayesian, reinforcement, evolutionary), and Data Mining.
Professor Phoha is an ACM Distinguished Scientist and is a Fellow of SDPS. Recently, he received the 2017 IEEE Region 1 Technical Innovation Award for Contributions towards Principles of Behavioral Biometrics.

EICS 2018 is the tenth international conference devoted to engineering usable and effective interactive computing systems. The event is co-organized by Yvonne Jansen (CNRS/UPMC, technical program chair) together with Emmanuel Pietriga (Inria, general chair) and Kris Luyten (Hasselt University, general co-chair).
http://eics.acm.org/2018

When: Wednesday, May 30th, 11:00 AM

Where: Sorbonne Université, Campus Jussieu, Room 211 (second floor) Tower 55-65

Title: WRiST: Wearables for Rich, Subtle, and Transient Interactions in Ubiquitous Environments

Speaker: Edward Lank

Host: Gilles Bailly

Abstract: Modern personal computing devices – tablets, smartphones, smartwatches, fitness trackers, remote controls – represent an ever-more-pervasive component of everyday life. Alongside this trend toward an increase in computing that you bring with you, we also continually encounter devices that exist both in tangible spaces and in the electronic domain. While this computationally augmented reality exists around us, interactions with this embedded, encountered computation rarely achieves the fluidity that one would desire. As a simple example, consider connecting your laptop or smartphone to a data projector. It almost always works well … except when it does not.

In this talk, I will detail some of our early work leveraging personal devices as computational proxies to control and manipulate external computation. Motivated by our early work on motion gestures for smartphone input, I will describe on-going research projects leveraging commodity smartwatches as proxies to support WIMP-style input, text input, and rich gestural input to external computation.  Because this work lies in the domain of free-space gestural input, I will also discuss our work on enhancing both the reliability and the perceived reliability of gesture recognition for end-users.  I will conclude by outlining our emerging vision of wearables and personal devices as a platform for the rich, subtle, and transient interactions necessary in an ever-more ubicomp-based reality.

Bio: Edward Lank is a faculty member in the David R. Cheriton School of Computer Science at the University of Waterloo where, effectively July 1^st, he will hold the rank of Professor. Edward joined Waterloo in 2006.  With Michael Terry, he co-founded the Waterloo Human-Computer Interaction Lab, a lab he continues to co-direct.  Prior to joining the faculty at Waterloo, Edward was an Assistant Professor at San Francisco State University, a Post-Doctoral Intern at Xerox’s Palo Alto Research Centre, the Chief Technical Officer of MediaShell Corporation, and a sessional lecturer at Queen’s University.  Edward Lank received his Bachelor of Science Degree (Honours Physics) from the University of Prince Edward Island in 1994 and a Ph.D. in Computer Science from Queen’s University in 2001.  Edward’s current research interests are varied, and include intelligent user interfaces, surface and free-space gestural input, sketch and drawing interfaces, usable privacy and security, and other aspects of interactive system design.

You can find out more about his current research projects from his webpage

When: May 16th, 2018, 11:00 AM

Where: Sorbonne Université, Campus Jussieu, Pyramid H20.

Title: Augmenting Touch Expressivity to Improve the Touch Modality

Abstract: During the last decades, touch surfaces have become more and more ubiquitous. Whether on tablets, on smartphones or on laptops, touch surfaces are used by a majority of us on a daily basis. However, the limited expressivity – the different channels used to convey information to the system – of the touch modality restricts drastically the amount of features that can be controlled via touch only. For instance, a typical smartphone touchscreen only provides the absolute position of a contact on the screen, thus applications usually offer only one way to carry out tasks (which can augment user frustration or cap performances) or restrict possibilities (e.g. Photoshop on desktop offers more than 600 commands but only about 40 on smartphones and tablets). In this talk, I will present an overview of my research and discuss different ways to tackle this problem, augment touch expressivity and user efficiency: from tools that helps better designing touch interfaces to the use of new input dimensions in original interaction techniques. 

Speaker: Alix Goguey

Bio: Alix Goguey is a post postdoctoral fellow working with Matt Jones in the FIT lab at Swansea University. He was previously working with Carl Gutwin in the Interaction Lab at the University of Saskatchewan, Canada. He received his Ph.D. in Computer Science in October 2016 in the Mjolnir research group at Inria Lille – Nord Europe, France, under the supervision of Géry Casiez. His work focuses on understanding and designing interaction techniques on touch input devices and particularly through the use of new information such as finger identification. To learn more about Alix’s work: www.alixgoguey.fr

Tiffany Wun from the iLab at the University of Calgary (Canada) joins the group for 3 months.

This year the HCI Sorbonne group presents 3 articles at CHI 2018 in Montréal:

• Yvonne Jansen and Kasper Hornbæk. How Relevant are Incidental Power Poses for HCI? (Best Paper Award)
• Emeline Brulé, Gilles Bailly. Taking into Account Sensory Knowledge: The Case of Geo-technologies for Children with Visual Impairments
• Yang Li, Samy Bengio, Gilles Bailly. Predicting Human Performance in Vertical Menu
  Selection Using Deep Learning.

When: March 30th, 2018, 14:00AM
Where: ISIR Lab, Room 211 (Tower 55-65)
Title: Implicit and explicit Statistical Learning during the Analysis of Visual Scenes: Evidence form Contextual Cueing
Speaker: Annabelle Goujon
Abstract: How does the visual system prioritize the relevant information for further processing? By structuring the world and by making it coherent and predictable, Statistical Learning would play a key role in object recognition, scene identification, attentional guidance and navigation in complex, dynamic environments. Statistical Learning refers to an unconscious cognitive process in which repeated patterns, or regularities, are extracted from sensory inputs. In this regard, the Contextual Cueing paradigm constitutes an elegant way to understand how learning mechanisms can detect contextual regularities during visual search, allowing an optimization of basic visual processing and/or attentional deployment in subsequent encounters. In this presentation, I will review and discuss the main mechanisms likely to be involved in contextual cueing phenomena, as well as the implicit vs. explicit nature of learning that take place.

Bio: Since September 2015, Annabelle Goujon is lecturer in Cognitive Sciences at the University of Bourgogne Franche-Comté. Her research covers different domains, that is, the Perception of visual scenes, Implicit learning, Statistical learning and Contextual cueing. More recently, her works aim at investigating more specifically how implicit and explicit/declarative memory systems interact in the formation and the consolidation of sensory memories in long term memory.

When: March 15th, 2018, 2:00PM

Where: Sorbonne Uni, towers 65/66 – room 304 (3rd floor)

Title: Accessible interactive graphics for visually impaired users

Speaker: Christophe Jouffrais

Abstract: STEM is an American acronym for science, technology, engineering and mathematics. These four disciplines rely on graphical representations and are considered central in technologically advanced societies. Obviously graphs are inherently visual and therefore inaccessible for the visually impaired (approx 5% of the world population.) This has important consequences on education, social inclusion and quality of life.

Raised-lines maps are the most common tool for providing access to tactile graphics but have numerous limitations (cost, limited number of elements displayed, knowledge of Braille, etc.) A few research projects aimed to overcome these limitations by designing interactive systems for accessing digital image [see 1 for review]. Based on this previous work, we developed a set of devices based on tactile exploration that allow non-visual access to images. The interactive audio-tactile device called Mappie [2] allows access to multiple levels of information. It is based on a raised-line map overlay placed over a tactile surface. In addition to map exploration, it provides advanced interactions functions (e.g. learning routes). We showed that it is effective for acquiring spatial concepts, and is more usable than regular raised-lines map [3]. It is currently used by professionals of low vision and commercialization is planned. We have also designed a device allowing the visually impaired to build and explore tangible representations of digital graphics [4]. It is based on the design of tangible objects that represent important elements on a map, and which can be linked to each other in order to create interactive lines and areas. Adapted non-visual guidance assists users in placing and linking objects to build new graphical representations. We have shown that this device is usable by visually impaired users to build and explore graphs of various complexities. More recently, we designed a device based on a smartwatch and filtering functions that allows visually impaired users to explore virtual maps in mobility [5].

Bio: Dr. Christophe Jouffrais is with the IRIT Lab (UMR5505, CNRS & Univ of Toulouse) in Toulouse, FR. Recently, he joined the IPAL research lab in Singapore. He is a senior CNRS researcher with a background in Cognitive Science. He holds a European PhD (2000) in cognitive neuroscience from the University of Lyon, FR and the University of Fribourg, CH. His current research focuses on non-visual spatial perception, action and cognition in visually impaired human, with an emphasis on non-visual human-computer interaction, and Assistive Technologies. Ongoing research projects aimed at designing technologies that help visually impaired users to understand and interact with maps.

More: CherchonsPourVoir.org

Video broadcast + archive:

Our HCI lecture starts January 30th.

When: Dec 20th, 2017, 11:00AM
Where: ISIR Lab, Room H20
Title: Vocal explorations in HCI

Abstract: In my work at the Opera of the Future group I build tools and experiences to explore the relationship people have with their own voice and the voices of others. Our voice is an important part of our individuality. From the voice of others, we are able to understand a wealth of non-linguistic information, such as identity, social-cultural clues and emotional state. But the relationship we have with our own voice is less obvious. We don’t hear it the same way others do, and our brain treats it differently from any other sound we hear. Yet its sonority is highly linked to our body and mind, and is deeply connected with how we are perceived by society and how we see ourselves. At the MIT Media Lab we design and create transformative experiences that merge science, art, engineering and design. I explore the use of new technologies (virtual reality, rapid prototyping, deep learning, real-time digital signal processing, lasers, wearable technologies and robotics) and HCI techniques to transform our perception of voices to better our interpersonal interactions. My previous projects range from devices that exteriorize voices, wearables sensor masks to provide interactive visualization of vocal vibration patterns for vocal training or speech disorder treatment, stuttering or prosody acquisition; bluetooth wearable haptic anchor for auditory hallucinations to help schizophrenic patients to feel external voices and easily distinguish internal hallucinatory voices; deep learning-based real-time speaker recognition system designed to be used in real-world settings and raise group intelligence or interactive web vocal application for mass musical collaboration.

Bio: Rebecca Kleinberger is a PhD candidate at the MIT Media Lab. Her work mixes science, engineering, design and art to explore ways to craft experiences for self-reflection and human connection. As part of the Opera of the Future group at the MIT Media Lab, she creates unique experiences to help people connect with themselves and with others. She accomplishes this using approaches that include virtual reality, rapid prototyping, deep learning, real-time digital signal processing, lasers, wearable technologies and robotics.

More:
– Portfolio: rebecca.media.mit.edu
– Personal page: media.mit.edu/people/rebklein/overview

When: Dec 13th, 2017, 11:00AM
Where: UPMC, towers 65/66 – room 304 (3rd floor)
Title: “What Neuroscience taught me about Robotics”

Abstract: I have been trying to build autonomous real-time intelligent systems for more than ten years. This took me from computer science academia into applied research, but the goal of synthesizing autonomous behavior adapted to the external environment remained elusive. An opportunity then presented itself to join a rising multidisciplinary PhD program in Systems Neuroscience. In this talk, I will present the two major outputs that resulted from this six-year experience. First, the engineering challenges of measuring brain physiology in freely moving animals resulted in the development of Bonsai, a visual programming language for the rapid prototyping of reactive systems. Second, I will discuss the results of our investigations into the role of motor cortex. We investigated the behavior of rats facing various motor problems, with or without motor cortex. Surprisingly, we found that rats lacking the entire motor cortex do not show any obvious movement impairments. Indeed, their performance is entirely on par with controls, even in dynamic environments, except when presented with unexpected motor challenges that demand fast and flexible readjustment of the entire motor system to a new situation — the kind of challenges where robots also dramatically fail. If given the opportunity to train and repeat the challenging situation over and over, even rats without motor cortex will be able to learn how to adapt and optimize their behavior to overcome the obstacles. It is the resilience and robustness to unexpected failures of control — when the actual motor problem needs to be framed all over again — that seems to be one of the primordial roles of mammalian motor cortex.

Bio: Gonçalo is a software engineer turned neuroscientist, fascinated by the behaviour of intelligent systems. With a background of applied research in virtual and augmented reality, parallel processing and autonomous agents, he joined the Champalimaud Neuroscience program in 2010, hoping to find better ways of building machines that learn by themselves. Gonçalo completed his PhD with Adam Kampff and Joe Paton, trying to understand the role of motor cortex in the control of movement in non-primate mammals. Along the way, he extended his experience making interactive systems to rodents and other animal models. Gonçalo developed the Bonsai visual programming language as a way to rapidly prototype interactive neuroscience experiments.

More:
– UCL Intelligent Systems Lab: kampff-lab.org
– His new company: neurogears.org

Video archive:

See our summer internships

UEIS 2017 is the first International Symposium on User Expertise and Interactive Systems. UEIS is a place where researchers and practitioners from Human-Computer Interaction, Cognitive Science, Experimental psychology discuss the latest trends in command selection and user expertise on PCs, tablets, smartphones, smartwatches, tabletops and interactive walls

UEIS 2017 will take place at Sorbonne Université, Paris (France) the 31^st October 2017.

website: www.hci.upmc.fr/hci/ueis17/

http://ihm2017.ensma.fr

Title: Remote collaboration across large interactive spaces
Where: ISIR Lab, Room H20
When: June 14, 10:00AM

Abstract: In my thesis, I study communication for remote collaboration across wall-sized displays, a technology that allows two collaborators to move in a large space and to interact using their bodies. These characteristics make traditional tools (e.g. a skype call) fall short. Informed by structured observation, I built CamRay, a system that uses camera arrays to capture user’s faces as they move, and display their video across a remote tiled wall-sized display. I study how to support different types of communication in remote collaboration by leveraging collaborator’s movement. I perform two main studies that inform the design of future systems for collaboration across wall-sized displays.

Short bio: Ignacio Avellino is a PhD Candidate at the ExSitu, Inria Saclay, under the supervision of Michel Beaudouin-Lafon and Cédric Fleury. He was born in Uruguay where he obtained his computer engineer degree, working also in industry for one and a half years in software design and development. He completed a double-degree HCI master program, jointly at RWHT Aachen and UNITN Trento universities, where he focused on using everyday objects as input devices. Currently he is in his last year of his PhD thesis; his research focuses on enabling effective communication through technology.

Designing Learning Activities around Physical Data Representations
The workshop is organized by Trevor Hogan, Uta Hinrichs, Yvonne Jansen, Samuel Huron, Pauline Gourlet, Eva Hornecker, and Bettina Nissen.
See the workshop website for more information.

Title: Interaction techniques for 3D audio production and mixing
Where: ISIR Lab, Room H20
When: May 31, 4:00PM

Abstract: There has been a significant interest in providing immersive listening experiences for a variety of applications, and recent improvements in audio reproduction have provided the capability for 3D audio practitioners to produce realistic and imaginative immersive auditory scenes. Even though technologies to reproduce 3D audio content are becoming readily available for consumers, producing and authoring this type of content is difficult due to the variety of rendering techniques, perceptual considerations, and limitations of available user interfaces. This presentation discusses work that investigated these issues through the development of a framework of design spaces from three different viewpoints: Ethnographic, Spatial Perception, and Interaction Design. From these three viewpoints, we identified design criteria required for 3D audio user interfaces that developed the framework of design spaces that could help designers better account for important dimensions in the design process, analyze functionalities, and significantly improve user interfaces for 3D audio production tools.

Short Bio: Justin D. Mathew is a current PhD student in the Mjolnir Team (Inria-Lille), LIMSI-CNRS, and Université Paris-Saclay working on visualization and interaction techniques for 3D audio production tools. He received his Bachelor’s of Computer and Electrical Engineering at the University of Rochester (Rochester, NY) and his Master’s in Music Technology at New York University (New York, NY). His main interests are in the research and design of creative digital tools, 3D audio and graphics, and information retrieval applications.

L’Association Française pour l’Intelligence Artificielle (AFIA) et l’Association Francophone d’Interaction Homme-Machine (AFIHM) avec le soutien du Labex SMART organisent la troisième journée IHM et IA.
Quand: March 17, 2017
Où: Amphi 25, UPMC (more)

La participation est gratuite et ouverte à tous

Michel Beaudouin-Lafon (Université Paris-Sud – LRI) is the next invited speaker of the colloquium in computer science of UPMC Sorbonne University.

Title: Interfaces Homme-Machine : Unifier les Principes pour Diversifier l’Interaction
Where: Amphi 25 Univsersité Pierre et Marie-Curie (more)
When: Tuesday, February 28, 2017: 6:00PM
This event is free and open to the public. A cocktail will take place at 5:15 in front of the Amphi 25.

Following the January 2017 call for collaborative projects within the SMART labex, our proposal for SAHMI – Situated Analysis of Human-Machine Interaction in Smart Environments was accepted. The project involves researchers from ISIR, the Costech lab at UTC Compiègne, and gets research support from the INSEAD-Sorbonne University Behavioural Lab. The project will fund two post-doctoral researchers and one research engineer.

Title: Coupling Motion and Perception for Haptic Interfaces
Where: Room H20, ISIR, UPMC
When: January 17, 2017, 11:00AM

Paul is PhD candidate in the department of Computer Science in Copenhagen, with Kasper Hornbæk.
His research topics currently are eTextiles and haptic feedback, but his broader research interest is HCI that focuses on the physical human body as an active agent in the world.
He described his research interests in more detail in a recent Graduate Student Consortium at TEI.

Title: Coupling Motion and Perception for Haptic Interfaces
Where: Room H20, ISIR, UPMC
When: January 17, 2017, 11:00AM

• Emeline Brule is the winner of the T-Shirt Design Contest
• IconHK: Using Toolbar buttons Icons to Communicate Keyboard Shortcuts
  with Emmanouil Giannisaki, Gilles Bailly, Sylvain Malacria and Fanny Chevalier.
• Passive Yet Expressive TouchTokens
  with Rafael Morales Gonzalez, Caroline Appert, Gilles Bailly and Emmanuel Pietriga.
• Effects of Frequency Distribution on Linear Menu Performance
  with Wanyu Liu, Gilles Bailly and Andrew Howes
• VersaPen: An Adaptable, Modular and Multimodal I/O Pen
  with Marc Teyssier, Gilles Bailly and Eric Lecolinet

Visual Menu Techniques by Gilles Bailly, Eric Lecolinet and Laurence Nigay.