Month: November 2024

HTO-Coverage: AHFE 2024 and a Nice Conference Presentation

Jonathan Källbäcker and I attended the Applied Human Factors and Ergonomics 2024 conference in Nice, France during the summer. The tasty seafood and baked goods found in the region aside, we were there to present a paper in the AROA-project. The conference was held at Campus St Jean at Université Côte d’Azur over four days and consisted of about 150 sessions of about five to seven presentations each split across 42 tracks and about 100 posters. Since it was not possible to attend all the sessions (I only got around to 12 of them), I chose to prioritize sessions related to work and AI.

Nice, France

This blog post consists of my pick of three highlights of the conference in the order of their sessions occurred, some issues with the conference format and how I would try to work around them if I organised a conference in the future, and a summary of the paper we presented on the conference. With a conference of this size, this will not be much more than a snapshot of it.

Highlights as an Attendee

During the session on Human factors in game design, Andrade (2024) presented on the placement of buttons in video game ads and the consequences of placing buttons outside of a handheld devices’ functional area. The functional area is often discussed as the space where buttons should be placed on handheld touch screens to make sure that they are reachable, but the design literature I have used in teaching rarely boggle down into the actual consequences of and reasons for placing buttons outside of it. The presentation discussed how this deliberate design choice makes the button hard to reach which increases the time needed to press the button and the duration of the ad that was viewed. It also causes a lot of strain and ads in free mobile games are common and often require multiple button presses. While the presentation was not related to AI or work, it was a highlight of the conference as it was an interesting and well-presented while contextualising and giving very practical and clear implications for a heavily discussed but maybe often-overlooked design principle.

The title of the session Individualization of services using Generative AI was a bit misleading as most presentations of the session were about the future of technology in some way. The session was packed with interesting topics, such as Grosch (2024) and Haase (2024) presented on future skills, Stübinger (2024) discussed how students would use generative AI in their work processes, Kröckel (2024) presented a literature review on how Generative AI can redefine emergency services, and Nhi et al. (2024) looked at awareness of environmental impact and willingness to reduce behaviours of video stream consumption. While the session overall gave a promising view of our adaption for the future, the presentation by Nhi et al. (2024) was one of the strongest presentations I attended as it conveyed its research gap and takeaway points very well, had a clear and visually interesting set of slides, while managing to portray their research in ways that anyone could understand.

Left: Stübinger (2024), Middle: Maibaum et al (2024), Right: Nhi et al. (2024)

The last highlight was the session Digital Dynamics in the Workplace, Exploring AI Integration, Flexible Work Models, and Participatory Design. The presenters were mainly from ifaa (it apparently translates to Institute for applied work science) in Germany and they were doing a lot of interesting research on work design and designing for work processes which turned out to be an interesting angle of approach compared to the workplace studies that we are doing in the research project I am in. The presentations included interesting things such as the need of workers in public administration (Maibaum et al. 2024), Socio-technical success factors for AI-based knowledge management (Reyes et al. 2024) and work design of chipping production (Weber et al 2024).

Conference Format Issues and Possible Workarounds

The main issues we experienced with the conference was due to the hybrid format and with the scheduling. The conference was hybrid and a lot of presenters were presenting and attending remotely. This was done through a video conference tool which a volunteer moderated by allowing participants to screen-share and such. We watched the keynote remotely on our way to the conference and but the conference call only had the slides being shared, not the audio so we didn’t hear what was said. Multiple attendees wrote about this in the chat but no one took note of it. When we arrived at the conference, we noticed the same issues taking place. The audio from the conference was often not turned on in the conference call and when it was, the microphones were not working well with the presentation set up and often cut out. Attendees wrote about it in the video call chat during those sessions as well, but the volunteers were not tasked with keeping up with the chat in the video call and often left the room during the presentation which made them not aware of the issues. By using proper microphones for such type of usage, having the volunteers be active in the video call chat, and preparing a cheat sheet for how to fix audio issues for the volunteers would have solved a lot of issues with the hybrid format and improved the participants experience of the conference.

The conference program

The other issue was that the scheduling of the sessions was at times uneven and the lack of breaks between the afternoon sessions caused sessions to run into the time slot for the following session. Each day was split into four time slots for sessions. The third time slot each day was only 60 minutes while the rest were 90 minutes. That being said, multiple sessions in the third time slot had 6 or 7 presentations of 10 minutes each while some of the 90-minute sessions only had 4 or 5. By either prolonging the 60-minute session to 90 minutes or by adjusting the number of presentations in those slots to fit within the time allotted to it, you would reduce the number of clashes and delays experienced. This is issue was further worsened by the lack of a break between the third and fourth time slot which made it impact the fourth slot even more. Adding a short break between those session would have reduced the amount of clashed and allowed people the time to move from one session to another.

We presented a paper

As you might be aware, we are working with a project on digital work engagement in which we are studying the impacts of automation, robotisation, and AI on work engagement in different domains with the aim to synthesise a framework on working towards digital work engagement. During the conference, we presented our initial findings from a workshop with our reference group regarding enabling technologies and work engagement (Bergqvist et al 2024). The members of the reference group got to discuss challenges and opportunities with enabling technologies within their domains as well as challenges and concerns regarding work engagement. Some of the main takeaways included that while the potential financial impacts of automation, robotisation, and AI in the work place are many and easy to imagine, we cannot forget about the concerns regarding sustainability, inequality, fear of lack of competence, and job displacement that exist in the work force. We need to continue to look into strategies to prevent discrimination induced and enforced by technology and continue to study the societal impacts that these technologies bring with them into the work place, society, and humanity.

We are also happy to say, if you haven’t heard about it yet, that we got the best paper award in the category of Challenges with AI at the Human Level.

The project is financially supported by Afa Försäkringar.

References

Andrade, W. M. (2024). Designing Mobile Game Input Unreachability: Risks When Placing Items Out of the Functional Area. Human Factors in Virtual Environments and Game Design, 126.
Bergqvist, A., Källbäcker, J., Cort, R., Cajander, Å., & Lindblom, J. (2024). Towards a framework for digital work engagement of enabling technologies. Artificial Intelligence and Social Computing, 257.
Grosch, C. (2024). Developing Future Skills through a Sequential Module Structure and Practical Orientation: A Case Study of the Bachelor Program in Applied Digital Transformation. Health Informatics and Biomedical Engineering Applications, 185.
Haase, S. (2024). Future Skills and (Generative) Al-New Era, New Competencies?. Health Informatics and Biomedical Engineering Applications, 178.
Kröckel, P. (2024). Redefining Emergency Services with Generative AI: Insights from a preliminary literature review. The Human Side of Service Engineering143(143).
Maibaum, M., Weber, MA, & Stowasser, S. (2024). Participatory Approaches to Design Work in the Context of Digital Transformation: An Analysis of the Needs of Employees in Public Administrations. Human Factors and Systems Interaction, 85.
Nhi, D. T. T., Chuloy, M., & Glomann, L. (2024). Environmental Impact of Video Streaming from Users’ Perspectives. Health Informatics and Biomedical Engineering Applications, 192.
Reyes, C. C., Ottersböck, N., Prange, C., Discher, A., Peters, S., & Dander, H. (2024). Technical and Socio-Technical Success Factors of AI-Based Knowledge Management Projects. Human Factors and Systems Interaction154(154).
Stübinger, J. (2024). Beyond Traditional Boundaries: The Impact of Generative Artificial Intelligence on Higher Education. Health Informatics and Biomedical Engineering Applications, 160.
Weber, J., Weber, MA, & Stowasser, S. (2024). Work design in production: Foundations and recommendations for the implementation of mobile, time-flexible work design in chipping production. Human Factors and Systems Interaction, 59.

New Publication: A Review of IT Applications Supporting Informal Caregivers

Informal caregivers—family and friends supporting loved ones with chronic illnesses or disabilities—play a critical role in our healthcare ecosystem. Yet, their contributions often go unnoticed, and they face challenges like stress, burnout, and a lack of resources. Our recent research, published in the Journal of Medical Internet Research (JMIR), reviews the literature and explores how IT applications can alleviate these burdens and empower caregivers. This study was led by Shweta Premanandan with Awais Ahmad, and Åsa Cajander from the HTO group among others. The purpose of this study was to conduct a scoping review to outline design recommendations for IT applications gathered from informal caregivers. In addition, this study presents evaluations of the use of IT applications by informal caregivers.

The methodological framework by Arksey and O’Malley (2005) for scoping reviews was followed for this review. A structured search was conducted across the PubMed, Scopus, IEEE Xplore Digital Library, Web of Science, and ACM Digital Library databases. In addition, reference list hand searches and keyword searches in Google Scholar were undertaken. Two reviewers independently identified articles for review and extracted the data. Conflicts were resolved through discussion, with a third reviewer consulted if consensus could not be attained. Thematic analysis was used to analyze the data.

With an aging population and stretched healthcare resources, informal caregivers are increasingly shouldering the responsibility of care. While rewarding, caregiving often leads to significant emotional and physical strain. IT applications offer a promising solution, acting as virtual assistants and support networks. However, these tools must be thoughtfully designed to address the unique and diverse needs of caregivers. A total of 82 articles were selected for the scoping review—44 (54%) related to design and 39 (48%) related to evaluation of IT applications.

What to include in these Caregiver Support Applications?

Easy Access to Information
Caregivers need quick, clear, and tailored advice. Good apps provide step-by-step guides, helpful tips, and even myth-busting facts to clear up common misconceptions.

Support Networks
Caring can feel lonely. Apps that connect caregivers to support groups or online communities help people share experiences, advice, and even a laugh.

Streamlining Tasks
Managing medications, tracking health updates, or coordinating with family members can get overwhelming. Apps that organize all this in one place save time and stress.

Caring for the Caregiver
Caregivers often forget to care for themselves. Some apps include features like relaxation exercises, gratitude journals, or tips on staying healthy.

Better Communication with Healthcare Professionals
Many caregivers need information or quick access to a healthcare professional or to share updates with doctors or navigate healthcare systems. Apps that simplify this communication help everyone stay on the same page.

Simple Tools for Daily Tasks
Reminders, user-friendly interfaces, and voice commands can make apps easier for caregivers to use, even if they’re not tech-savvy.

What caregivers think about these tools?

Most caregivers like the idea of using apps to help them. They appreciate:

  • Quick Access to Information: Being able to find answers right away.
  • Social Connections: Knowing they’re not alone.
  • Flexibility: Using the app when it fits their schedule.

But there are challenges, too. Some caregivers worry about:

  • Privacy: Will their data be safe?
  • Trust: Is the app’s information reliable?
  • Ease of Use: Older caregivers may struggle with complex apps.

Looking Ahead

As technology continues to evolve, so do the opportunities to create more impactful tools for caregivers. Our findings act as a starting point for designers to design IT applications for caregivers that not only ease caregiving tasks but also foster a supportive ecosystem for caregivers.

Let’s continue the conversation. What features would you like to see in future caregiving applications? Or any other comments. Share your thoughts with us!

New Publication: Why Some Patients Choose to Read Their Health Records Online and Others Do Not

In the digital age of healthcare, why do some patients engage with electronic health records (EHRs) while others opt out? A study led by Irene Muli with Åsa Cajander from HTO and others explore this question. Conducted seven years after Sweden introduced patient-accessible electronic health records (PAEHRs), the research reveals both progress and persistent gaps in adoption.

The study found that while 86% of patients were aware of PAEHRs, 23% chose not to read their records. Common reasons included feeling they didn’t need to or being satisfied with information from their doctor. Meanwhile, readers primarily sought a health overview or followed up on healthcare visits. A digital divide emerged, with older adults, single individuals, and those with lower information literacy less likely to engage, while smartphone access significantly increased use.

Key Takeaways for Healthcare Providers

Barriers like portal usability and digital literacy hinder PAEHR adoption. For healthcare professionals, simple actions—such as guiding patients during visits—can improve uptake. Targeted support for older or less tech-savvy patients is essential to ensure equitable access.

The Swedish experience highlights opportunities for other countries: usable portals, better training, and promoting the benefits of digital tools. By addressing these barriers, we can make healthcare more inclusive and empower all patients to take charge of their health.

To dive deeper, the full paper is accessible here.

Summering av referensgruppsmötet i AROA-projektet oktober 2024

Arbetet pågår för fullt i AROA-projektet vilket handlar om arbetsengagemang vid automatisering, robotisering, och artificiell intelligens (AI) inom tre skilda sektorer i arbetslivet: IT, tåg, samt lantbruk. AROA finansieras av Afa försäkringar och en del i projektets genomförande är att organisera regelbundna träffar med referensgruppen. För några veckor sedan var det återigen dags för avstämning och erfarenhetsutbyte mellan projektdeltagare och medlemmar i referensgruppen. Denna gången genomfördes träffen digitalt under en förmiddag

Det blev glada tillrop när vi inledde med att berätta att tankegångar och erfarenheter från vårt första referensgruppsmöte har bidragit till vårt uppmärksammade konferensbidrag på AHFE-konferensen i Nice, Frankrike tidigare i somras. Där erhöll vi utmärkelsen ”Best Paper Award” för publikationen ”Towards a framework for digital work engagement of enabling technologies”.


Nästa punkt på agendan var en uppdatering av den pågående litteraturstudien gällande digitalt arbetsengagemang. De preliminära resultaten indikerar att många studier är utförda i Kina och Tyskland men ingen explicit i en svensk kontext. Likaså varierade arbetskontexterna och typen av teknik väldigt stort. IT-sektorn fanns med men varken tåg- eller lantbrukssektorn. Några iakttagelser så här långt är att återkommande resurser som nämns är stöd, autonomi, och meningsfullhet samt att krav kan upplevas utmanande eller hindrande. Givetvis skiljer det sig vad som anses vara resurser eller krav mellan olika former av arbeten. Värt att nämna är att få studier nämner konsekvenser av engagemang vid automatisering eller digitalisering. Vi hade sedan en diskussion där deltagarna reflekterade över hur de tentativa resultaten tog sig uttryck i deras respektive områden.

Sedan presenterades mer specifika resultat och tentativa fynd från de tre sektorerna. Med början i IT-sektorn så presenterades två examensarbeten som har genomförts inom ramen för projektet. Det ena arbetet handlade om hur AI-verktyg påverkar IT-professionellas känsla av flow baserat på analyser av dryga 10-talet intervjuer. Slutsatsen var att AI-verktyg kan underlätta delar av arbetsflödet och stödja repetitiva uppgifter, men att de inte är förknippat med att uppnå flow. Det andra examensarbetet handlade om hur användning och effekter av AI-verktyg på tekno-engagemang hos UX designers baserat på analyser av knappa tio-talet intervjuer. Slutsatsen var att AI-verktygen kan potentiellt förbättra tekno-engagemanget, förutsatt att de överensstämmer med UX-designernas värderingar och arbetsflöden. AI-teknikens roll i kreativa branscher ökar, vilket gör det viktigt att utforska hur verktygen optimalt kan stödja digitalt arbetsengagemang och produktivitet. Sedan presenterades resultaten från en omfattande intervjustudie av professionella aktörer gällande AI i IT-branschen kopplat till verktyg och arbetsdynamik i förändring. Resultaten visar exempelvis att många olika AI-verktyg används, olika motiveringar nämns till varför man använder AI-verktyg. Det finns flera möjligheter och utmaningar kopplat till användningen. Intressant var att ingen upplevde att de fick mindre att göra trots att AI:n utförde några av arbetsuppgifterna. En av slutsatserna är att balansen mellan att dra nytta av AI och att hantera dess utmaningar är avgörande för framtiden.

För tågsektorn pågår intervjuerna för fullt med lokförare och tågplanerare. Några tentativa fynd så här långt indikerar att kärnan i arbetet för trafikplanerare är den kreativa problemlösningen som de upplever som väldigt engagerande. Kärnan i arbetet för lokförare är att framföra tåget, de ser den automatiserande tekniken som ett effektiviserande stöd och upplever inte att tekniken tar över det som engagerar med jobbet. Det framträder en bild av att båda dessa yrkesgrupper är starkt kopplade till tid samt upplever en stor ansvarskänsla och att de har ett helhetsperspektiv på tågtrafiken. Det är viktigt att tekniska implementationer inte underminerar dessa värden. Fler intervjuer genomförs i nuläget och mer konkreta fynd hoppas vi kunna presentera under våren 2025.


För lantbrukssektorn visar de tentativa fynden från gårdsbesöken på gårdar med mjölkrobotar att det finns en stor omsorgskänsla för kor, mjölkningsrobotar och anställda. Arbetsengagemanget verkar främst drivas av en kombination av meningsfullhet och passion för att bruka marken och ta hand om korna samt självständighet och frihet i utförandet av arbetet på gården. Fördelar med mjölkningsrobotar är den ökade automatisering av fysiskt krävande arbetsuppgifter, bättre datainsamling och analys samt ökad precision, självständighet och djurvälfärd. Nackdelar som nämns är exempelvis tekniska problem, begränsad flexibilitet hos roboten samt att kunna samla och analysera data smidigt och enkelt från olika IT-system på gården. Det digitala arbetsengagemanget tar sig uttryck på två nivåer. Dels generellt när lantbrukarna upplever en bättre kontroll för att följa upp sina djur och mjölkproduktionen. Några nämner att de blir sporrade av siffrorna över hur mycket mjölk som korna producerar varje dag. Dels mer konkret, där tekniken förstärker en positiv upplevelse “här och nu” som främjar det digitala arbetsengagemanget. Exempelvis kan man avläsa på skärmen hur mjölkflödet är i en spene i realtid, vilket är mycket svårare att uppfatta utan teknikens stöd. Inom lantbruket sker en snabb utveckling av AI och nya tekniker men upptaget sker inte lika snabbt i lantbruket på grund av höga investeringskostnader. Likaså uppmärksammas behovet att ha dubbla kompetenser, då anställda behöver både ha ett gott ’djuröga’ för att kunna läsa av korna samt ett gott ’robotöga’ för att hantera mjölkningsroboten och de andra IT-systemen vilket sammantaget försvårar rekryteringen till lantbruksnäringen. Vi kommer under senhösten och vintern att genomföra fortsatt datainsamling genom intervjuer av fler lantbrukare och även inkludera växtodling där det finns många tekniska för precisionsodling vilka dock inte används i lika stor grad som mjölkningsrobotar.

Dagens avslutades med en diskussion om hur förändringar av arbetsdynamiken, dvs vem som gör vad i utförandet av arbetsuppgifterna – tekniken eller människan – i respektive sektor och dess påverkan på det digitala arbetsengagemanget.

Det är alltid inspirerande och givande att diskutera våra delresultat med representanter från näringslivet och andra forskare samt få inblick i deras vardag på arbetet. Vi ser fram emot nästa träff våren 2025 som blir på plats här vid Uppsala Universitet.

Jessica Lindblom och Andreas Bergqvist

Biomimicry for Human-Computer Interaction: Insights from workshops hosted at the HTO group at Uppsala University in 2023 and 2024.

As technology continues to evolve, so do the ways people interact with it. From wearables and voice-based systems to virtual and augmented reality (VR and AR), sensors, and artificial intelligence (AI), human interaction with digital systems has transformed drastically. Simultaneously, urgent challenges affecting the health of the planet, including climate change, biodiversity loss, and inequality, has made the role of research and design in transformative change increasingly important as we pursue a sustainable, just and resilient future. These transformations push the boundaries of Human-Computer Interaction (HCI), as it necessitates the integration of the many different ways people engage with technology. Biomimicry, or biometrics, the practice of emulating forms, functions, and systems found in nature (Vincent et al., 2006), offers a unique approach to designing HCI systems that are intuitive, regenerative, and sustainable.

Why Biomimicry for HCI?

Biomimicry invites HCI researchers and designers to rethink interactions with technologies. Beyond inspiring new design aesthetics, biomimicry offers insights into designing systems that process data intuitively, sends and receives signals, respond dynamically, and adapt as living organisms do within their ecosystems. By applying design principles abstracted from nature, HCI researchers and designers can create systems that are more adaptable, environmentally responsive, and seamlessly integrated with users’ surroundings. When we incorporate these adaptive strategies into HCI, we can create interfaces that are more intuitive and efficient, using fewer resources and contributing to a regenerative approach to technology. Nature is a network of adaptive interfaces that continuously sense, process, and respond to environmental signals. Imagine if our digital systems could similarly evolve and adapt based on changes in their environment.

Workshop Highlights: Exploring Nature’s Blueprint for HCI

At two recent “Biomimicry for HCI” workshops at Uppsala University, participants delved into nature’s models of sensing, processing, and adapting to information, discovering ways to inspire “living” interfaces. In such interfaces, information is not merely displayed but dynamically revealed in response to environmental cues. The workshops aimed to:

  • Bridge biomimicry and HCI: Participants brainstormed and conceptualized interfaces inspired by natural, organic processes.
  • Go beyond screen-based interaction: Moving away from traditional, screen-centered designs, they considered how natural systems communicate, sense, and process data.
  • Design for sustainability and intuitiveness: By translating nature’s efficient, adaptive mechanisms, participants envisioned HCI systems that are integrated within their environments, where users interact with a system that feels responsive and organically integrated.

Conclusion: Toward a Biomimicry-Inspired HCI

The workshops offered new perspectives on designing HCI systems that emulate models found in nature. By emulating nature’s strategies for adaptation and sustainability, we can create HCI systems that are not only intuitive but also deeply integrated with their environments. This reframing encourages researchers and designers to approach interfaces as living entities that, like natural systems, process and adapt to sensory data fluidly, responding to users as ecosystems respond to environmental cues. Nature does more than aesthetically inspire, it offers models for creating HCI frameworks where the interface itself becomes a dynamic, living system, continuously adapting to and engaging with its surroundings.

In the rapidly evolving field of HCI, biomimicry offers an approach beyond conventional screen-based interaction toward a future where interfaces breathe, respond, and co-exist in harmony with the natural world.

If you are interested in exploring ideas in biomimicry for HCI, please reach out to Karin van den Driesche at c.j.h.m.vandendriesche@uva.nl or info@kadendesign.nl. Additionally, you can download the worksheet, Biomimicry Using Shape Change in Nature, for a hands-on approach: Download Worksheet.