Work in Progress

• Mr Murtada Dohan – Faculty of Arts, Science & Technology, University of Northampton, Northampton, United Kingdom
• Dr Mu Mu – The University of Northampton, Northampton, United Kingdom

Abstract: Understanding the user’s intent has a pivotal role in developing immersive and personalised media applications. This paper introduces our recent research and user experiments towards interpreting user attention in virtual reality (VR). We designed a gaze-controlled Unity VR game for this study and implemented additional libraries to bridge raw eye-tracking data with game elements and mechanics. The experimental data show distinctive patterns of fixation spans which are paired with user interviews to help us explore characteristics of user attention.

• Irina Popovici – MintViz Lab, University Stefan cel Mare of Suceava, Suceava, Romania
• Radu-Daniel Vatavu – MintViz Lab, University Stefan cel Mare of Suceava, Suceava, Romania
  Wenjun Wu Beihang University, Beijing, China

Abstract: We present a gesture-based user interface for smart TVs that employs deictic gestures to control the content displayed on the TV screen. Our interface implements an instance of the “Smart-Pockets” interaction technique, where links to digital content, in our case to users’ preferred television channels and shows, are stored inside users’ pockets and readily accessed with a mere pointing of the hand to those pockets. Pointing gestures to the pockets and towards the TV screen are detected using the Inertial Measurement Unit embedded in Myo, a smart armband. We discuss the ways in which our prototype opens new opportunities for hybrid, gesture- and pointing-based interactions for smart TVs, and also opportunities for designing interactions that take place at the periphery of user attention.

• Tiffany Marques – Department of Communication and Art, Aveiro University , Oliveira do Bairro, Portugal
• Mário Vairinhos – Comunication and Art, University of Aveiro, Aveiro, Aveiro, Portugal
• Pedro Almeida – Digimedia, University of Aveiro, Aveiro, Aveiro, Portugal

Abstract: Virtual Reality (VR) is increasingly a tempting option for creators seeking more immersive VR audiovisual experiences. In the suspense genre, VR promises to deliver a more impactful experience to the viewers. Nevertheless, it’s needed to confirm if such promise is real. This study focused on the creation of a suspense genre content to understand the impact on the immersive experience of the viewer if presented in stereoscopy VR 360º. An evaluation was developed, with a convenience sample of 36 participants. The immersive differences were evaluated when viewing the same audiovisual content of suspense in different formats: VR 360º; 360º, and; 2D non-panoramic. The results showed that the VR 360º intensifies the perceptual immersion, but diminishes the narrative immersion, a consequence of the 360º.

• Irina Popovici – MintViz Lab, University Stefan cel Mare of Suceava, Suceava, Romania
• Radu-Daniel Vatavu – MintViz Lab, University Stefan cel Mare of Suceava, Suceava, Romania

Abstract: We present an agenda for the visual augmentation of television watching based on recently booming technology, such as smart wearables and Augmented/Mixed Reality. Our agenda goes beyond second-screen viewing trends to explore the opportunities delivered by wearable devices and gadgets, such as smartglasses and head-mounted displays, to deliver rich visual experiences to viewers. While still a work in progress, we hope that our contribution will be inspiring to the TVX community and, consequently, foster critical and constructive discussions towards new devices, application opportunities, and tools to augment visually the television watching experience.

• PhD Saar Bossuyt – University College Leuven Limburg, Leuven, Belgium
• Roos Voorend – Meaningful Interactions Lab, KU Leuven – imec, Leuven, Belgium
• David Geerts – Meaningful Interactions Lab (mintlab), KU Leuven, Leuven, Belgium

Abstract: The trend of time-shifted viewing worries television networks and advertisers, as time-shifting viewers often fast-forward through commercials, resulting in lower advertising impact. The present research tests an alternative solution to this problem by augmenting fast-forwarded commercials with brand logos placed in the center of the screen. We tested the potential of augmented fast-forwarding in an experiment in which participants watched a television show interrupted by a commercial break using three experimental conditions: commercials played at regular speed, at fast-forwarded speed, or at fast-forwarded speed but enriched with logos. Advertising impact was measured during the commercial break (using eye-tracking glasses), right after the TV show (brand recognition), and the day after the TV show (day after brand recognition). Interestingly, the results showed that augmented fast-forwarding performed equally well as regular-speed viewing on two out of three advertising impact measures.

• Dr Chris J Hughes – University of Salford, Manchester, United Kingdom
• Mario Montagud Climent – i2CAT Foundation, Barcelona, Spain
• Mr. Peter tho Pesch – Institut für Rundfunktechnik GmbH, Munich, Germany

Abstract: The Immersive Accessibility Project (ImAc) explores how accessibility services can be integrated with 360-degree video as well as new methods for enabling universal access to immersive content. ImAc is focused on inclusivity and addresses the needs of all users, including those with sensory or learning disabilities, of all ages and considers language and user preferences. The project focuses on moving away from the constraints of existing technologies and explores new methods for creating a personal experience for each consumer. It is not good enough to simply retrofit subtitles into immersive content: this paper attempts to disrupt the industry with new and often controversial methods. This paper provides an overview of the ImAc project and proposes guiding methods for subtitling in immersive environments. We discuss the current state-of-the-art for subtitling in immersive environments and the rendering of subtitles in the user interface within the ImAc project. We then discuss new experimental rendering modes that have been implemented including a responsive subtitle approach, which dynamically re-blocks subtitles to fit the available space and explore alternative rendering techniques where the subtitles are attached to the scene.

• Dr. Christian Roth – Professorship Interactive Narrative Design, HKU University of the Arts, Utrecht, Netherlands
• Hartmut Koenitz – HKU University of the Arts Utrecht, Utrecht, Netherlands

Abstract: The Netflix production Bandersnatch represents a potentially crucial step for interactive digital narrative videos, due to the platform’s reach, popularity, and ability to finance costly experimental productions. Indeed, Netflix has announced that it will invest more into interactive narratives – moving into romance and other genres – which makes Bandersnatch even more important as first step and harbinger of things yet to come. For us, the question was therefore how audiences react to Bandersnatch. What are the factors driving user’s enjoyment and what factors might mitigate the experience. For example, novelty value of an interactive experience on Netflix might be a crucial aspect or the combination with the successful series Black Mirror. We approach these questions from two angels – with a critical analysis of the work itself, including audience reactions and an initial user study using Roth’s measurement toolbox (N = 32).

• Pedro Carvalho – LASIGE, Faculdade de Ciências, Universidade de Lisboa, Lisboa, Portugal
• Prof. Teresa Chambel – LASIGE, Faculdade de Ciências, Universidade de Lisboa, Lisboa, Portugal

Abstract: This paper explores the potential of media and how it can be leveraged to create a tool to help individuals become more aware of their emotions and promote their psychological wellbeing. It discusses main motivation and background and presents EmoJar, an interactive application being designed and developed to allow users to collect and review media that have significant impact and remind them of the good things they experience along time. EmoJar is based on the Happiness Jar concept that gets enriched with media and its emotional impact, as an extension to Media4WellBeing, aligning with the goals and approaches of Positive Psychology and Positive Computing.

• Yoshinari Takegawa – Future University, Hakodate, Japan
• Kohei Matsumura – Ritsumeikan University, Shiga, Japan
• Hiroyuki Manabe – Information Science and Engineering, Shibaura Institute of Technology, Koto-ku, Tokyo, Japan

Abstract: In this paper, with propose PokeRepo Go++, which is our one-man live reporting system (PokeRepo Go) with an added commentator function that enables outside experts to make comments. As a consequence of the spread of live broadcast streaming services, anybody is now able to broadcast his/her own interests, concerns and everyday occurrences. To support reports made by a single person in the form of a live broadcast, we have developed and actually operated PokeRepo Go. PokeRepo Go only had a function to transmit video to viewers in one direction, i.e. non-interactively. For this reason, because an interviewee or reporter had no reaction from the audience, there was uncertainty as to whether the broadcast content was being conveyed to the audience as per his/her intention. This exposed the importance of two-directional, i.e. interactive, communication. In PokeRepo Go++, we provide a commentator function by which commentators can seamlessly participate in live broadcast content and communicate naturally with an interviewee. Additionally, we considered the UI design to realize the compatibility of use of the commentator function with use of the pre-existing PokeRepo Go functions, such as filming operations (including acquirement of video/audio and control of lighting) and editing operations. At a demo session in a domestic conference we operated the prototype system of PokeRepo Go++ and evaluated the usefulness thereof.

• Amaya Herranz Donnan – British Broadcasting Corporation, London, United Kingdom

Abstract: Accurately quantifying audience appreciation poses significant technical challenges, privacy concerns and difficulties in scaling the results to realistic audience sizes. This paper presents a new approach to appreciation measurement based on the analysis of BBC iPlayer on-demand viewing pattern data, such as the timeline of the user’s interactions with the play button, combined with appreciation scores from traditional feedback surveys. This methodology infers implicit viewer appreciation automatically, without adding significant cost or time overheads and without requiring additional input from the participant or the use of intrusive methods, such as facial recognition. The results obtained, based on data from a sample of over 27,000 iPlayer users, show accuracy scores above 90% for predictions generated using computationally efficient models, including Decision Trees and Random Forests. The analysis suggests that the user’s appreciation of a programme can be predicted based on their online viewing behaviour, potentially improving our understanding of the audience.

• Kai Kang – Industrial Design Department, Eindhoven University of Technology, Eindhoven, Netherlands
• dr. Jun Hu – Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands
• dr.ir. Bart Hengeveld – Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands
• Caroline Hummels Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands

Abstract: Institutional care settings are often described as places where residents suffer from social isolation. Although sharing media preferences, consumption patterns and practices is believed to be effective to trigger communications and develop friendships between older adults, it rarely happens in care homes. Our research explores the potential to promote residents’ social interaction by augmenting public print media. In this work-in-progress, we started with newspapers as an example to understand residents’ information sources, media habits and preferences. We were also interested in their perceptions of the attractiveness and sociability of augmented print media. The findings showed that the participants held positive attitudes on such technologies. Preliminary design requirements were summarized to inform the future development of related social technologies in public caring environments.