People-oriented Software Engineering

A.I. and Autonomy Lab Project

Project Overview

Modern technologies can positively transform lives. Many good concepts fail, however, to have a transformative effect by not meeting the individual and emotional needs of intended users. Creating software applications that satisfy emotional needs such as 'feeling in touch' or 'feeling accepted' is difficult, due to the hard-to-define, personal and subtle nature of the needs. This project aims to develop and evaluate new approaches to integrate emotional design into software engineering, focusing on people, their life context and technology adoption, in concert with existing methods for expressing functionality. A key tool in these methods is the agent paradigm, which is used to model individuals, roles, goals, emotions, and software that exist within a socio-technical system. The major research outcome from this proposal is new connections between design and software engineering, which will enable users, designers, and software engineers to work together to produce software that better meets people's emotional needs. Development outcomes will include software applications to improve access to food, shelter, and support services to homeless people, and to improve financial literacy for older people in Australia.

Funding

2016-2018 Catering for individuals' emotions in technology development --- Australian Research Council DP160104083. Tim Miller, Leon Sterling, Sonja Pedell (Swinburne University), Antonette Mendoza, and Alex Lopez-Lorca.
2013-2015 Software engineering of people-oriented technology and services --- Australian Research Council DP130102660. Leon Sterling, Tim Miller, Alex Lopez, and Sonja Pedell (Swinburne University).
2014-2016 Increasing knowledge and motivating collaborative action on Low Carbon Living through team-based and game-based mobile learning --- CRC for Low Carbon Living. Tim Miller, Antonette Mendoza, Leon Sterling, and others.
2014-2017 A randomised trial of a clinical prediction tool for targeting depression care (Target-D) --- NHMRC Project Grant 1059863. Leon Sterling, Antonette Mendoza, and others.
2014-2015 Evaluation of a robotic arm for people with limited upper-body mobility --- DSDBI Technology Voucher and Student Voucher. Tim Miller, Marita Cheng (2Mar Robotics)
2013 Supportive technology for monitoring sleep problems -- Barbara Dicker Brain Science grant. Leon Sterling, Alex Lopez.

Case Studies

  • Emergency alarm systems for older people

    Many older adults who live independently at home are required to use a personal alarm system. These systems are often composed of two elements, a button to call for help (worn as a pendant or wristband) and a base station to “check in” in a daily basis (as a way of indicating that everything is okay). Many older adults do not like the pendant or base station and do not use them properly. Cases where alarm users find themselves in urgent need for help but cannot reach the caller are, unfortunately, not uncommon. This project sought to understand the reasons behind the low uptake of personal alarm systems. We conducted a field study involving four emergency alarm users, four relatives and four non-users. We interviewed them in relation to their perception and use of technology in general, and emergency alarms systems in particular. The general opinion was that existing systems make older adults feel old, dependent and stigmatised. Although personal alarms were adopted to bring relief to relatives, their lack of flexibility frequently made them a source of stress more than of reassurance. The older people’s goal in using the emergency alarm systems was to feel safe, in touch, cared about, independent and unburdened. They also wanted to feel that they were in control of the system and that it was integrated in their lives.

    screenshot of Emergency alarm website.
    Website screenshot
  • A picture frame to stay in touch

    This project followed on from the field study involving older adults in which their emotional needs in the use of emergency alarm systems were identified. The purpose of this project was to design, develop and evaluate an emotion-informed alternative to the “check in” mechanism in personal alarms systems. The chosen design is an iPad placed in the older person’s home as a picture frame. Carers can send pictures of significance for the older person. Pictures are displayed as a digital carousel for the older person to swipe, comment on, or like. All these interactions are interpreted as an indication that the older person is okay. The picture frame allows the older person to feel cared about and in touch with their loved ones. At the same time, its use is flexible and does not attempt to modify the older person’s routine but adapts to it by capturing interactions at any time, and particularly around the time that the relative sends pictures. Our design underwent two iterations. In the first iteration, it was developed as a web-based service. The initial prototype was tested by nine older people. Their feedback was then used to redevelop the prototype as a mobile app. The second version of the prototype is being evaluated in another field study involving more older adults.

    Get TouchFrame

  • Ask Izzy – A to Z Homeless help information

    In 2014 Infoxchange was one of the winners of the Google Impact Challenge Australia, a grant awarded to non-profits to have a social impact through technology. In this project we collaborate with Infoxchange in the development of an online resource to improve access to food, shelter, health and other support services for people who are homeless or at risk of homelessness. This project followed a report from University of Sydney stating that 95% of homeless people owned a mobile phone, with 77% of those being smartphones.

    Initially, we worked with the design team to elicit the requirements of the system. We talked to over 60 people including homeless people, case workers and other organisations and government stakeholders to build the analysis models. Infoxchange acknowledged that a key aspect in determining the success of the product was its emotional engagement. The research process focused on identifying emotional factors around the homelessness experience that could be addressed or harnessed by the system. Through the discussions with the stakeholders we found out that the homeless people want to feel dignified, empowered, hopeful but realistic amongst other emotions. The result of this stage was the design of Ask Izzy. Its design and features were geared towards the fulfilment of the emotional, quality and functional goals identified during the research phase.

    In the second stage of our interaction with Infoxchange we assisted them in the user testing of the Ask Izzy. The next stage of the collaboration will be to assess the appropriation and social impact of Ask Izzy, once that the system is launched.

    View of the Ask Izzy project on a mobile phone.
    Ask Izzy Infographic
  • A robotic arm for people with limited upper-body mobility

    Partner: 2Mar Robotics

    2Mar’s Jeva robotic arm aims to improve the daily lives of people with limited upper mobility including spinal cord injuries, muscular dystrophy, multiple sclerosis, amyotrophic lateral sclerosis, cerebral palsy and Parkinson's. It can be mounted onto the wheelchair, bedside table, kitchen, or bathroom. As well as enabling families to return to work by increasing the independence of people from their parents, the arm has impacts the wellbeing of people who use it, giving them more independence and control and their daily lives.

    In conjunction with 2Mar, we designed a series of user studies aimed at measuring the emotional and quality aspects of Jeva. As well as measuring standard usability measures to assess the arm, we assessed the users’ emotional response, by asking questions such as what the arm made the user feel more independent, retained their dignity, and increased their confidence. Four different control devices were assessed: an iPhone app controller, and Android app controller, an Emotiv headset controller, and a Google Glass controller. The findings demonstrated the Jeva can indeed improve independence while retaining dignity.

  • Sleep Well – A mobile app to alleviate sleep difficulties

    This project supported by a grant from the Barbara Dicker Foundation seeks to investigate how to design mobile technologies that can contribute to alleviation of sleep difficulties. We have developed a mobile app to teach relaxation exercises to people with sleep difficulties. It is essential that the design of the app takes into account that the people using the app in the middle of the night will be sleep deprived and anxious, fearing that insomnia will affect their performance next day. In an interesting exercise, we developed two versions of the app. The first version was developed by a team of software engineering master students. The second team was developed by a team composed by undergraduate design students and software engineers. The difference between the versions is very significant. We finally decided to use the version produced by the interdisciplinary team.

    We have conducted interviews with participants before they trial the app to identify these emotions in greater detail. After the trial, we will interview the participants again to find out whether their sleep pattern improved and what were their feelings about using the tool. This project sits alongside an online behavioural cognitive therapy for sleep disorders developed by a team of psychologists.

    View of the Sleep Well project.
    View of the Sleep Well project

    Download the Android App

  • SMART – Self-Management and Recovery Technology

    The purpose of this project is to develop an online platform to support people suffering from psychosis. The goal of the platform is not only to enable the intervention delivery but to make consumers feel empowered, hopeful, connected and that their lives have meaning. The role of our team was to help the psychologists in the elicitation of the emotion-informed requirements, modelling, and validation of the platform. A number of focus groups consisting of consumers and mental health workers were part of the project. They have informed the requirements elicitation process for the platform and will continue to be involved during the development and validation.

    The platform is currently being trialled by participants recovering from psychosis. The consumers use SMART during their sessions with their case managers and outside these sessions to reinforce their discussions. Our team is involved in studying the uptake and appropriation of the participants and how to improve these factors in future mental health online treatments.

    Development

  • A survey for early prognosis of depression in primary care

    In this project we have developed an app for early detection of depression. The app will be available in the offices of GPs for anyone waiting. The app consists of a number of questions that the medical team consider (based on the analysis of data collected over a decade) are a good indication of depression. The role of our team was to design and develop the app in such a way that the result is engaging and inviting. It will have to be sufficiently appealing to attract people who do not know that are sufferers of depression or even that have negative attitudes towards the diagnosis of depression. It will also have to seek the best way of delivering the results in a way that does not lead to panic but to discussion with the GP.

  • The Dusted Community – an online resource for people suffering from an asbestos related disease

    The emotional impact of being “dusted” or diagnosed with an asbestos related disease (ARD) such as mesothelioma cannot be overstated. People living with the diagnosis must face feelings such as impotence, guilt and worry for the family that they leave behind (particularly victims of the third wave of exposure). The carer has to retreat from social live to devote to the care of the diagnosed person. The feeling of isolation and lack of understanding from their environment is huge.

    This project builds on the lessons learned from a previous study conducted in NSW to design an online community for people suffering from an ARD, their carers, family members and friends. We are conducting a number of participatory design workshops with past carers and other stakeholders to identify the requirements (emotional and otherwise) of the dusted community.