Research & Engineering

ToeTapText

REsearch / Accessible Tech / Fabrication
Dec 2023

Co-designed with Jessica Cox, this project aims to explore and understand the typing needs of people without arms. It encompasses research, prototyping, and continuous improvement based on feedback to create an effective and user-friendly solution

3 months in

Feedback and iterations

Initial Research and Consultation

The journey began with understanding the unique challenges faced by Jessica Cox, a motivational speaker and pilot born without arms. Jessica uses her feet for tasks that others typically perform with their hands, and our goal was to design an assistive device to enhance her typing efficiency. The initial phase involved a comprehensive study of her daily activities and the specific issues she encounters while typing.

We discussed two focus areas:

  1. Back and neck strain and pain caused by having to look down at the keyboard as she types.
  2. Exploring alternative versions of a computer mouse as the current versions are not optimized for users that operate a computer mouse with their feet.

Abilities & Challenges:

To address the pain and tension in Jessica’s shoulders and back, we discussed exploring different methods including a neck cradle and posture corrector. We also went over her current abilities and method of typing with a focus on what muscles are more engaged. To provide us with a better understanding of these options, she generously shared her experience with different products she’s tried. This allowed us to gain valuable insight into the effectiveness and her comfort with these solutions. We brainstormed ideas that could help craft a chair for optimal support and posture. Among the various chairs she has experimented with, she highlighted the current chair she’s using. This chair has proven to be significantly beneficial in providing support to her thighs while she types.

Based on the insights from our research, we brainstormed various design solutions. Understanding her abilities and needs was the key to solving this design problem. The focus was on creating a keyboard setup that would be ergonomically suitable for Jessica, allowing her to type comfortably with her feet. We sketched several concepts and discussed them with Jessica to gather her feedback and preferences.

Conceivable Proposals:

  • Mirrors: Mirrors can help Jessica see the keys without having to look down, allowing her to maintain better posture and reduce the strain on her neck. The low-tech option seems accessible and feasible and could be implemented at schools and organizations that may not have easy access to hi-tech solutions.
  • Touch Screen Keyboard: A touch screen with haptic feedback could provide tactile sensations to simulate the feeling of pressing physical keys. This option could help Jessica customize the spacing and size of the keyboard to her liking.
  • On screen Keyboard that simulates the keys that are being typed in real time eliminating the need to look down.
Research & Observations

The feedback from our presentation provided valuable insights and suggestions for further refinement of our project. Here is a detailed elaboration on the key points raised:

  1. Utilizing Phone Cameras for Foot Movement: Can we use phone cameras to capture foot movement? By leveraging phone cameras, we can potentially create a more accessible and user-friendly solution for monitoring foot movement. This approach could eliminate the need for mirrors and enhance the overall efficiency and versatility of our system.
  2. Challenges with Mirrors and Low-Light Conditions: The feedback points out the limitations of using mirrors, particularly in low-light conditions. Exploring alternative solutions such as utilizing phones as cameras may offer a more practical and adaptable approach, potentially mitigating the challenges associated with mirrors.
  3. Addressing Toe Arthritis and Touch Typing Challenges: A main feedback and concern from the audience and our instructors was the possibility of toe arthritis and the difficulty of touch typing on a touch screen.  Key guards with a touch screen may offer a solutions – we will explore this further with Anita.
  4. Exploring Different Text Input Methods: In addition to keyboard and touch screen, there are alternative ways to type such a voice, such as voice recognition or other innovative approaches that cater to different abilities and preferences.
  5. No Hands Mouse and Gesture-Controlled Keyboard: The feedback prompted exploration into no hands mouse options and gesture-controlled keyboards, indicating a broader consideration for users with varying levels of physical mobility. This aligns with the overarching goal of creating a universally accessible system that caters to diverse user needs.
Understanding foot movement & health concerns:

During our meeting with Dr. Anita Perr, Clinical Professor at Occupational Therapy (OT), our primary focus was on exploring potential solutions to address the impact of various muscle joints on Jessica’s typing experience. Anita proposed a multi-faceted approach, starting with adjustments to the angles of the iPad which will be used as a keyboard. To achieve this, she suggested the implementation of a stand for the iPad, complemented by ankle support.

Anita’s vision for the iPad stand included a modular design with slats, allowing for both height and angle customization. This adaptability would cater to Jessica’s specific needs based on her posture, ensuring optimal comfort and support not only when she’s sitting upright but also when she wants to lean back.

Anita emphasized the importance of considering not only the toes and ankle but also the calves when determining the ideal angle and height for the iPad.

In addressing the tactile aspect of typing, Anita proposed enhancements to the home keys. For the on-screen keyboard on the monitor, she recommended a clear sheet of plastic, possibly made of vinyl, to delineate key locations or using high contrast so Jessica can see which keys are being typed via the simulation of the screen.

This sheet would be easily removable, offering flexibility and convenience. Additionally, for the iPad, Anita suggested using tape to create a similar delineation of keys, or using a clear sheet or providing tactile feedback .

In summary, we will develop a comprehensive solution to accommodate the impact of muscle joints on Jessica’s typing. The proposed measures included a versatile iPad stand with ankle support, along with enhancements to the home keys using clear sheets of plastic or tape for both the on-screen keyboard and the iPad.

A sketch of potential way of using the keyboard when leaning back with support under calves and tablet set at a higher angle.
A sketch of potential way of using the keyboard when sitting up with support under heel and tablet set on an angled stand.

While the end product did not incorporate this design, understanding the movement of muscles gave us a clear vision of our next steps.

Feedback and Refinement

After finalizing the design concept, we moved on to creating a prototype. Using cardboard, we laser-cut an adjustable keyboard stand to test different angles and heights. This allowed us to identify the most ergonomic position for Jessica. The prototype was a crucial step in visualizing the final product and making necessary adjustments.

We presented the cardboard prototype to Jessica and observed her using it. Her feedback was invaluable in understanding the practical aspects of the design. Based on her input, we refined the stand to make it more stable and adjustable. The aim was to ensure that the keyboard could be tilted to various angles and heights to suit her needs perfectly.

After using the prototype for a month, we met with Jesssica for further feedback and thought.

Final Design and Testing

Jessica’s feedback after using the prototype for a month:

  • Comfortable with the angle of the stand.
  • Explored different use cases, adjusting the stand angle and heel support based on chair distance and posture.
  • The lip at the edge of the stand limits access to some keys, particularly the space bar and command key.
  • Adding heel support and elevating the keyboard on an inclined stand significantly improved her posture.

Image of the actual setup showing part of the stand and the mouse pad
Sketch of the laptop stand side view, showing keyboard and the lip of the stand
We adopted a modular approach and divided the setup into three parts. the stand for keyboard, the heel support and mat for friction.

The final prototype proved to be a significant improvement for Jessica, enabling her to type more efficiently and comfortably. This project not only showcased the power of assistive technology but also highlighted the importance of user-centric design. Moving forward, we plan to explore additional features and materials to further enhance the device's functionality and aesthetics. In addition to that, we are working on a modular design that can be used by users with varying needs and abilities.

With Special Thanks to

Amy Hurst, Dr. Anitta Perr, The Ability Project, Jessica Cox, her husband Patrick and the DAT class for their invaluable feedback