CASE STUDIES
Force Measurement and Ergonomic Study
EyeTracking Packaging Study
PaperLink Smartpen Project
1
Force Measurement and Ergonomic Study
Force Measurement and Ergonomic Study
Our firm was retained by Amgen to provide insights and user data on medical devices known as "autoinjectors". This project consisted of two empirical experiments. The first focused on testing and refining a measurement system that calculated the appropriate activation force across three medical populations. The second project aimed to test the Human Factors Testing Platform method (developed internally) which aimed to integrate subjective and objective data sources to create a quantitative measure of performance across any autoinjector prototype to be developed.
Central Research Questions:
What force level for cap removal and injection activation is most appropriate? Can we create a generalizable measurement method?
Does the design of the device allow the user to administer a self-injection safely and effectively?
Methods:
The “stair-step” force measurement system (internally developed)
The Human Factors Testing Platform (internally developed)
Location
New York, NY
features:
EmpATHIZE
EmpATHIZE
DEFINE
DEFINE
IDEATE
IDEATE
PROTOTYPE
PROTOTYPE
TEST
TEST
Roles
Core Team:
Human Factors Engineers, Human Factors Scientist, Research Assistant, CEO of Research Firm
Business Stakeholders:
Amgen's Human Factors Engineering team (autoinjection division)
My Role:
Human Factors Engineer
My Duties:
Contributed on study scoping and design; managed recruitment and screening criteria; acted as a study moderator; analyzed and wrote up research findings for final deliverables.
Process
Participant Criteria, Testing Environment, and Technology
73 session were ran over the course of 3 weeks. Each session averaged about 60 minutes in duration. Recruitment was handled by a third-party vendor and testing was conducted at a market research facility in midtown Manhattan. All study prototypes were fabricated and 3D printed by the client. We used three research technologies that collected data experimentally on (1) electromyography, (2) force measurement (3) 3D spatio-temporal tracking of study devices.
Experiment 1
Using testing devices outfitted with force sensors, we conducted a series of measurements to uncover preferred, maximum preferred, and absolute maximum force levels using our “stair-step” data collection methodology. Participants simulated injections on two sites (thigh and abdomen) with a number of devices and simulated removing cap models (twist and pull). Our report cut these data by variables including medical condition, age, gender, and hand and arm anthropometry.
Experiment 2
Using a mix of data streams we developed a new testing method to determine usability performance across device design. These data streams included EMG measurements of muscle excursion and fatigue, 3D spatio-temporal tracking of the location and excursion of a digital needle, and self-report semantic differential scales.
Outcomes
My firm delivered the findings report to key decision makers and design executives. The findings report is confidential; however, the client retained the research firm for a multi-year contract to produce research reports on medical devices for FDA approval with their goal of transitioning from a multi-step and potential dangerous syringe-based drug delivery system to a less complex, more safer autoinjector system.
My firm delivered the findings report to key decision makers and design executives. The findings report is confidential; however, the client retained the research firm for a multi-year contract to produce research reports on medical devices for FDA approval with their goal of transitioning from a multi-step and potential dangerous syringe-based drug delivery system to a less complex, more safer autoinjector system.
2
EyeTracking Packaging Study
EyeTracking Packaging Study
Our research firm was retained by the company Amgen to asses the visual design of medical devices known as autoinjectors and their packaging. Autoinjectors are single-use, disposable medical devices that administer a fixed dose of drug product into subcutaneous tissue. Importantly, the carton and the internal packaging contain crucial instructions and precautions regarding the safe and effective way injections should be carried out. Our research team designed a test of different packaging configurations with the main aim of assessing if the design effected the way patients interacted with the packaging and could be correlated with their overall performance giving a self-injection.
Central Research Questions:
How do participants scan the cartons and packaging visually?
Are there any ties between eye tracking metics and how participants administered a simulated injection?
Does the inclusion of a reference guide improve task performance?
Methods:
Eye-tracking
Task-based Performance Evaluation
Post-task debriefs
Location
New York, NY
features:
EmpATHIZE
EmpATHIZE
DEFINE
DEFINE
IDEATE
IDEATE
PROTOTYPE
PROTOTYPE
TEST
TEST
Roles
Core Team:
Human factors engineers, research assistant, CEO of research firm
Business Stakeholders:
Amgen's human factors engineering devision
My Role:
Human factors engineer
My Duties:
Worked with stakeholders on study scope and design; managed recruitment and screening critera; managed laboratory data collection; set-up and calibrated eye-tracking equipment prior to each session; analyzed study data, created visualizations, and generated the research delieverables; presented final report to business stakeholders and top executives.
Process
Experimental Design
50 participants plus floaters were recruited for this study. Prior to each session, the moderator read a set of standardized instructions directing participants to inspect the box and contents as they normally would and then carry out the task of administering a full injection as if they were at home. The injection kits were loaded with functional autoinjectors prototypes that contained placebo and all participants use an injection pad as if it were their body. Using a between group experimental design 3 unique packaging designs and 4 unique reference guides (RGs) were tested.
Outcomes
The core team delivered the findings to key decision makers and design executives. A detailed elaboration of the insights and how the research effective overall business direction and strategy is confidential. However, the client retained the research firm for a multi-year contract to produce research that would aid the Amgen team with their goal of transitioning from a multi-step and potential dangerous syringe-based drug delivery system to a less complex, safer autojector system.
The core team delivered the findings to key decision makers and design executives. A detailed elaboration of the insights and how the research effective overall business direction and strategy is confidential. However, the client retained the research firm for a multi-year contract to produce research that would aid the Amgen team with their goal of transitioning from a multi-step and potential dangerous syringe-based drug delivery system to a less complex, safer autojector system.
3
PaperLink Smartpen Project
PaperLink Smartpen Project
Google Advanced Technology and Projects Group (ATPG) retained our research firm to study and test a smart pen prototype. The smartpen's novel technology and two-camera design enabled it to (1) transcribe handwritten ink symbols and drawings into digital documents and (2) recognize programable commands that interface with smartphones and smartwatches. The firm produced two empirical research reports that measured writing behavior, speed, and user acceptance across nine pen concepts. Additionally, three pen models were subjected to testing to answer a critical research question: can pen design cause proper camera orientation.
Central Research Questions:
What design features positively influence user preference?
Can pen design cause correct top-camera orientation?
Methods:
Conjoint Analysis
Qualitative Feedback
3D tracking
Location
New York, NY
features:
EmpATHIZE
EmpATHIZE
DEFINE
DEFINE
IDEATE
IDEATE
PROTOTYPE
PROTOTYPE
TEST
TEST
Roles
Core Team:
Human factors engineers, human factors research scientist, CEO of research firm
Business Stakeholders:
Google's ATPG engineering team
My Role:
Human factors engineer
My Duties:
Collaborated with team on study design; managed recruitment and screening criteria, acted as study moderator; analyzed and wrote up research findings for final deliverables.
Process
Experiment 1
The first experiment evaluated nine pen prototypes. The goal was to collect user feedback in order to guide further design and business choices. The main focus was answering the following research questions (1) which of the nine visual designs appeals to the broadest range of users? and (2) which design features influenced user acceptance? A mixed methodology was used to facilitate learnings and data collection for part of the research study.
Experiment 2
The second experiment evaluated three smartpen prototypes. The goal was to determine if design factors influenced pen orientation and other ergonomic variables. Along with self-reported user feedback quantitative data was collected using advanced technological that included a 3D tracking systems and electromyography.
Outcomes
The core research team traveled to Mountain View, CA to deliver the report in person. A detailed elaboration of the insights is confidential but the research was received and helped the engineering team make informed design decisions based on user feedback and learnings. As of this writing, Google has yet to bring a smartpen product to market.
The core research team traveled to Mountain View, CA to deliver the report in person. A detailed elaboration of the insights is confidential but the research was received and helped the engineering team make informed design decisions based on user feedback and learnings. As of this writing, Google has yet to bring a smartpen product to market.