St Andrews HCI Research Group

News

Seminar: Learning Vocabulary in Augmented Reality Supported 10th April 2024


VocabulARy: Learning Vocabulary in Augmented Reality Supported by Keyword Method

Abstract:

The “keyword method” is an effective mnemonic technique for learning vocabulary in a foreign language. It involves creating a mental association between the object the foreign word represents and a word in one’s native language that sounds similar (called the keyword). Learning foreign language vocabulary is enhanced when we encounter words in context. This context can be provided by the place or activity we are engaged with. This talk will present our work “VocabulARy” which enhances the language learning process by providing users with keywords and their visualisations in context using augmented reality (AR).

Bio:

Maheshya Weerasinghe is a Research Associate in Human-Computer Interaction (HCI) at the University of Glasgow, School of Computing Science, UK. Her research centres on extended reality and guided learning environments. She obtained her joint PhD in Computer Science at the University of St Andrews, UK, and the University of Primorska, Slovenia (2023).
Before joining the University of Glasgow, Maheshya has engaged in many collaborative research work with the HICUP Lab, University of Primorska, Slovenia; SACHI Lab, University of St Andrews, UK; Mixed Reality Lab, University of Coburg, Germany; IDM Lab, Nara Institute of Science & Technology, Japan; and the Monash University, Malaysia.

More about Maheshya Weerasinghe Arachchillage

Event details:

  • When: 10th April 2024 12:30 – 13:30
  • Where: Jack Cole 1.19

 

If you’re interested in attending any of the seminars in room 1.19, please email the SACHI seminar coordinator: aaa8@st-andrews.ac.uk so they can make appropriate arrangements for the seminar based on the number of attendees.

Seminar:User Language and Perspective in Speech-Based Human-Machine Dialogue 3rd April 2024


Perspective taking, partner models and user language use in speech based human-machine dialogue

Abstract:

Speech based conversational user interfaces (CUIs) such as speech agents are now commonplace. Design is critical in supporting and informing our perceptions of speech agents as dialogue partners (i.e. our partner models), which are commonly used to inform perspective taking in dialogue. My talk will explore how CUI design shapes our beliefs of a machine partner’s abilities, the dimensions relevant to partner models, how partner models are crucial to consider in terms of speech agent interaction, and how this concept can help us begin to explain our language interactions with conversational AI more broadly.

Bio:

Benjamin R Cowan is Professor of Human-Computer Interaction at University College Dublin’s School of Information & Communication Studies in Ireland. He completed his undergraduate studies in Psychology & Business Studies (2006) as well as his PhD in Usability Engineering (2011) at the University of Edinburgh. His research lies at the juncture between psychology, human-computer interaction and communication systems in investigating how design impacts aspects of user behaviour in social, collaborative and communicative AI interactions.
Prof. Cowan is the co-founder and co-director of the HCI@UCD group, one of the largest HCI research groups in Ireland. He is also Co-Principal investigator in the SFI funded ADAPT Centre, a world leading €90+ million Research Centre on AI driven content technologies, where he leads the Interaction and Control research strand. Prof. Cowan is also the co-founder of the ACM International Conferences Series on Conversational User Interfaces (ACM CUI) and has been heavily involved in the ACM CHI conference, having acted as Associate Chair (AC-2017-2018; 2021) and Subcommittee Chair (SC- 2022 & 2023) of the Understanding People Quantitative Methods Subcommittee.

Event details:

  • When: 3rd April 2024 12:30 – 13:30
  • Where: Jack Cole 1.19

 

If you’re interested in attending any of the seminars in room 1.19, please email the SACHI seminar coordinator: aaa8@st-andrews.ac.uk so they can make appropriate arrangements for the seminar based on the number of attendees.

Seminar: Tangible User Interfaces 13th March 2024


We have 2 presentations on the 13th March focusing on Tangible interfaces by Laura Pruszko and Anna Carter.

Talk 1: Designing for Modularity – a modular approach to physical user interfaces

Abstract:

Designing for Modularity – a modular approach to physical user interfaces by Laura Pruszko
Physical user interfaces, future or history? While some of our old physical UIs get progressively replaced by their graphical counterparts, humans still rely on physicality for eye-free interaction. Shape-changing user interfaces — i.e. physical devices able to change their shape to accommodate the user, the task, or the environment – are often presented as a way to bridge the gap between the physicality of physical user interfaces and the flexibility of graphical user interfaces, but they come with their fair share of challenges. In this presentation, we will talk about these challenges under the specific scope of modular shape-changing interfaces: how do we design for modularity? What is the impact on the user? As these kinds of interfaces are not commonplace in our everyday lives, they introduce novel usability considerations for the HCI community to explore.

Bio:

Laura Pruszko is a lecturer in the Applied Computer Games department of Glasgow Caledonian University. Her research focuses on interaction with physical user interfaces and modular systems. She obtained her PhD from Grenoble Alpes University in 2023, as part of the multidisciplinary Programmable Matter consortium. This consortium brings together people from different horizons such as artists, entrepreneurs, HCI and robotics researchers, to collaborate towards enabling the long-term vision of Claytronics.

Talk 2: Sense of Place, Cultural Heritage and Civic Engagement

Abstract:

In this presentation, I will provide an overview of my recent work, where I implemented a range of interactive probes, exploring sense of place and cultural heritage within a regenerating city centre. Through these digital multimodal interactions, citizens actively participated in the sharing of cultural heritage, fostering a sense of belonging and nostalgia. Looking ahead, I’ll discuss how these insights inform my ongoing work at the intersection of the Digital Civics project and the Centre for Digital Citizens project. This presentation will not only offer my personal insights but also open the floor for collaborative discussions on integrating these crucial aspects into future embedded research.

Bio:

Anna Carter is a Research Fellow at Northumbria University she has extensive experience in designing technologies for local council regeneration programs, her work focuses on creating accessible digital experiences in a variety of contexts using human-centred methods and participatory design. She works on building Digital Civics research capacities of early career researchers as part of the EU funded DCitizens Programme and on digital civics, outdoor spaces and sense of place as part of the EPSRC funded Centre for Digital Citizens.

Event details:

  • When: 13th March 2024 12:00 – 14:00. There’ll be cakes and soft drinks from 12 onwards. The talks will be from 12:30 – 13:30
  • Where: Jack Cole 1.33 (Soft drinks and cake provided by F&D)

Seminar: Rights-driven Development 28th Feb 2024


Abstract:

Alex will discuss a critique of modern software engineering and outline how it systematically produces systems that have negative social consequences. To help counter this trend, he offers the notion of rights-driven development, which puts the concept of a right at the heart of software engineering practices. Alex’s first step to develop rights-driven practices is to introduce a language for rights in software engineering. He provides an overview of the elements such a language must contain and outlines some ideas for developing a domain-specific language that can be integrated with modern software engineering approaches. 

Bio:

Alex Voss, who’s an Honorary Lecturer here at the school and an external member of our group. Alex was also a Technology Fellow at the Carr Center for Human Rights Policy at Harvard’s John F. Kennedy School of Government and an Associate in the Department of Philosophy at Harvard.

Alex holds a PhD in Informatics and works at the intersection of the social sciences and computer science. His current research aims to develop new representations, practices and tools for rights-respecting software engineering. He is also working on the role that theories of causation have in making sense of complex socio-technical systems.

His research interests include: causality in computing, specifically in big data and machine learning applications; human-centric co-realization of technologies; responsible innovation; computing and society; computer-based and computer-aided research methods.

More about Alex: https://research-portal.st-andrews.ac.uk/en/persons/alexander-voss

Event details:

  • When: 28th February 2024 12:30 – 13:30
  • Where: Jack Cole 1.19

 

If you’re interested in attending any of the seminars in room 1.19, please email the SACHI seminar coordinator: aaa8@st-andrews.ac.uk so they can make appropriate arrangements for the seminar based on the number of attendees.

TEI ’24 Entangled Threads Workshop


Sign up for our workshop Exploring the value and significance of bringing a craft ethos to debates around the IoT/connected things

Call for Participation

Join us for a one day workshop to explore how a craft practice and ethos can help us to respond to privacy, trust, bias and the Internet of Things.

“How healthy is the internet?”  As more and more things become internet-connected (i.e. become part of the IoT) questions of trust, privacy, security, data ownership, data bias, and the commercial abuse of data, become ever more pressing. This reflects a recognition of a wider problem with the internet alongside the rapid developments in machine learning (i.e. AI) and how it is being unreflectively ‘put to work’ in an ever-increasing range of applications. This workshop will explore these tensions and concerns through the lens of craft, both as a practice and a conceptual ethos.

Embroidery pieces along with some 3d printed silhouette of people

This studio will use embroidery as a craft-oriented communal/social practice activity to scaffold a discussion framed by our craft ethos characteristics, involving notions of; subjectivity, bespokeness, localism, embodiment, provenance, authenticity, and care-full-ness. Embroidery is an appropriate craft-oriented method which we believe encourages flavors of conversation that are distinct from other forms of participatory workshops. Whilst these activities will likely enable mindful stitching, we are more pointedly using this method as a dialogical activity where the acts of communal stitching will enable us to direct conversation to certain aspects of craft characteristics beyond the literal objects participants are making. Through this embodied making activity, you will create a bespoke embroidered badge based on a set of provocations and take a deep dive into the issues with IoT we have highlighted.

Through making together in small groups, supported by experienced researchers working in the field, we hope to provide an environment for rich discussion and material speculation on alternative visions of ‘healthier’ connected futures. The studio will use the embroidered outcomes as well as a range of predesigned props and design resources to not only discuss entanglements of living well in a digital culture, but also to help us collectively and individually envision stories/scenarios which encapsulates vision/s of an alternative, healthier, digitally connected future. At the conclusion of the workshop we will explore the possibility of setting up a special interest group that takes our thinking forward into the future.

More information and Sign up here

Congratulations to Xu, Pireh, and Abd.


We are delighted to see Xu, Pireh, and Abd graduated this week! Congratulations!

 

 

 

 

 

 

 

 

 

Emory – St Andrews Collaborative Research Grant


Dr Jason Jacques (St Andrews) and Dr Kristin Williams (Emory) have been awarded the Emory – St Andrews Collaborative Research Grant for their project Considering Household Division of Labor when Engaging Civic Participation in Environmental Stewardship’

 

 

Climate change and environmental policy research often focuses on planetary scale changes, that are challenging for individuals to contextualise in their own environment. The project focuses on exploring and understanding how individuals engage with environmental stewardship on a hyper-local level: how do individual households understand their environment and are they able to draw connections between their actions, the activities in their community, and the environment around them?

In answering these questions, the project will connect households and communities together, combining this network of citizen scientists and environmental sensors, to enhance their understanding through bespoke visualisations customised for these communities.

“It great that the St Andrews is willing to take the initiative to support international collaboration on big questions, including environmental policy and sustainability. Connecting with Kristin, and others at Emory, for this project has offered unique opportunities to build capabilities and contrast the unique needs of communities on both sides of the Atlantic.” 

See more information about the Global Partnerships at St Andrews.

User Troubles during “Shoot St Andrews to Green”!


A map shows missing images from the OpenStreetMap for St Andrews

A map shows missing images from the OpenStreetMap for St Andrews

Many photos of St Andrews are missing from open-access maps. WikiShootMe allows anyone to add an image to places on Wikimedia and Wikipedia that doesn’t already have one. So we took the initiative to take photos of St Andrews’ historic buildings and upload them to Wikicommons using WikiShootMe. However, WikiShootMe is currently only a desktop website and is difficult to use when out and about. Many usability challenges emerged, leading us to turn this into a User-Centred Interaction Design project.

MORE

Measuring heart rate and blood oxygen remotely in the home


Pireh Pirzada has developed and validated a first rPPG system (Automated Remote Pulse Oximetry System, or ARPOS) that measures both heart rate and blood oxygenation levels remotely within participants’ home environments (real-life scenarios).

The research shares the first data set collected from real life scenarios which includes various factors such as skin pigmentations, illuminations, beard, makeup, and glasses. The research also shares its experiment protocol and source code used to collect and analyse the data.

 

Abstract:

Current methods of measuring heart rate (HR) and oxygen levels (SPO2) require physical contact, are individualised, and for accurate oxygen levels may also require a blood test. No-touch or non-invasive technologies are not currently commercially available for use in healthcare settings. To date, there has been no assessment of a system that measures HR and SPO2 using commercial off-the-shelf camera technology that utilises R, G, B, and IR data. Moreover, no formal remote photoplethysmography studies have been performed in real-life scenarios with participants at home with different demographic characteristics. This novel study addresses all these objectives by developing, optimising, and evaluating a system that measures the HR and SPO2 of 40 participants. HR and SPO2 are determined by measuring the frequencies from different wavelength band regions using FFT and radiometric measurements after pre-processing face regions of interest (forehead, lips, and cheeks) from colour, IR, and depth data. Detrending, interpolating, hamming, and normalising the signal with FastICA produced the lowest RMSE of 7.8 for HR with the r-correlation value of 0.85 and RMSE 2.3 for SPO2. This novel system could be used in several critical care settings, including in care homes and in hospitals and prompt clinical intervention as required.

Keywords: remote health monitoring; heart rate measurement; blood oxygenation level measurement; rPPG system

 

The research outputs also include:

Dataset: https://doi.org/10.5281/zenodo.6522389

Experiment protocol: dx.doi.org/10.17504/protocols.io.n2bvj6zkxlk5/v1

Code: https://github.com/PirehP/ARPOSpublic

 

Researchers:

Pireh Pirzada

Collaborate and Celebrate the First Female Alumni


Collaborate and celebrate event poster

Students were invited to collaborate on researching digitised archival information about St Andrew’s first female alumni and thus expand the limited amount of information we have about these front-running women.

Description:

The Postgraduate Development Officer collaborated with Tomas Vancisin, a SACHI Group researcher focusing on visualising historical university records, and the Inclusion Diversity Equity Accessibility (IDEA) network to host a pilot event to raise awareness about the University’s first female students.

The University of St Andrews is over 600 years old, but women have only been allowed to study here for the past 145 years. In 1877, 15 years before women were officially allowed to study at universities around Scotland, St Andrews started offering women the Lady Literate in Arts qualification, which was equivalent to an MA degree. Despite the significance of this qualification for gender equality and beyond, the amount of information we have about these pioneering women is sparse. The event aimed to spark a discussion and encourage attendees to become “knowledge activists” by looking for additional information about these women. In addition to filling information gaps about underrepresented women, the session also showcased opportunities to develop skills in digital media, research, public engagement, and team collaboration

The long-term goal is to run Wikipedia training as a means to encourage writing Wikipedia Biographical articles about LLA’s we identify as notable.

Here is what one of the attendees said about their experience: 

“I really enjoyed searching for information about the LLA graduates. It was exciting to try and uncover what information is out there, and it was good fun. I also enjoyed hearing more about the IDEA network, and I am keen to get involved as a ‘knowledge activist.”

More information: