IMS Health User Research
I led the efforts to conduct a formal user research study for QuintilesIMS’s marketing automation product, Nexxus Marketing. Nexxus Marketing is primarily used for pharmaceutical marketing campaigns. It allows marketers to create campaigns using different tactics (e.g. email) and reach out to large groups of patients and health care professionals using segmentation logic. Our product team wanted to know what were the biggest issues our customers were facing when using Nexxus Marketing and how could we improve their experience.
My responsibilities included: forming a user research study plan, screening candidates for the interviews, leading interviews with customers, analyzing the data, and reporting the results to our larger product team.
Team
Denise Borges, UX Designer
Cassie Wallender, UX Manager
Molly Bennett, Senior UX Designer
Preliminary Research
Our team had previously collected telemetry data to look at what features customers used within Nexxus Marketing. The data showed that exporting data, the segmentation tool and creating emails were the most commonly used features. Our senior UX designer also did 5 interviews with internal stakeholders to learn more about our product and identify potential user stories.
Example of telemetry data.
Study Planning
Our formal study plan represented our collected decisions for the best approach to this study. We identified the following questions to answer:
What do our most current Nexxus Marketing customers look like?
Are they captured by our existing personas?
How do current customers use Nexxus Marketing?
What does success look like?
What actions/features are the most valuable to customers?
Where do customers face the most friction?
The plan outlined the following:
The purpose of the study.
Research questions.
Participant profiles.
Interview script.
Schedule of interviews.
Facilitation approach.
Data that will be collected.
Formal report.
Finding Our Participants
Our engineering support team was able to pull a search query of customers who had been actively using Nexxus Marketing over the last six months. This pool consisted of over 250 participants who worked in marketing agencies and big pharmaceutical companies. I sent an email out to this pool of customers asking if they were interested in participating in a user research interview.
Twenty-six people responded to the email expressing interest. I sent out a second screener asking for their availability and location which narrowed our participant list to 10 people. We interviewed 7 people onsite at their office while the remaining 3 were interviewed virtually using video conference software. Users were compensated with a gift card for their participation.
User Interviews
Our user interviews took place over 2 weeks. I conducted 1 pilot study prior to meeting with the 10 customers. The purpose of the pilot study was to test the interview script and to make sure our technical equipment was working as expected.
I led 8 of the interviews while my UX manager, Cassie, took notes. Molly led one virtual interview.
Me interviewing an internal employee who used Nexxus Marketing for my pilot study.
Findings and Recommendations
I had collected over 90 hours of video footage interviewing customers and looking at how they used Nexxus Marketing. It took me about three weeks to review the footage, collect quotes and video clips, and identify common themes throughout the study. The following were the most common themes:
“I need efficient workflows.”
“I need to trust the product.”
“I want to learn from my results.”
“I’d like more robust features.”
"In need efficient workflows."
Some sample problems we witnessed were a lack of order, an inability to archive or find content, poor system response time, and difficulty monitoring new marketing contacts in the user’s database. These were quotes we captured that captured this theme:
“If you go into our Campaigns you’ll see over 2.5 years… that’s 300 Campaigns. If there was a way we could organize them, that would be very helpful.”
“System response time is negatively impacting deployment of campaigns.”
Live example of "All Campaigns" page. Not only is this long list unsortable, there is no way to archive or organize the huge volume of campaigns.
We recommended that Nexxus Marketing needed to present it's listview screens with more clearer actionable options, provide the ability to sort, find, and archive items, and improve system response time.
“I need to trust the product.”
Customers struggled using the email editor and testing different tactics within Nexxus Marketing before deployment. The status for different marketing tactics were also not clear and difficult to track. These were quotes we captured that captured this theme:
“We are phasing out your HTML editor because it is not good… not robust enough.”
“No idea how to [test tactics]… they just can’t wrap their heads around it, because they are not super technical.”
“When emails stopped going out, the problem wasn’t discovered for two weeks.”
Live example of an email campaign. The user had to create and send himself several test emails to make sure the email was appearing correctly.
We recommended that Nexxus Marketing needed to improve it’s email editor, provide better opportunities to test tactics before deployment, and improved monitoring and system alerts to notify users of potential problems.
“I want to learn from my results.”
There is a lack of rollup reports within Nexxus Marketing. Users are able to input data into Nexxus Marketing and launch marketing strategies, but find the reports tool extremely lacking. These were quotes we captured that captured this theme:
“I don’t use [the Nexxus Marketing Reports tool]… the information I’m looking for is more global. Just tell me… what was the open rate for the entire program.”
“It might be the volume of data we have but the reports take a long time to load.”
We recommended that Nexxus Marketing had to improve their reports by integrating them throughout the system rather then keeping them isolated in their own section of Nexxus Marketing.
What's Next
We looked at our current user stories and updated them based on the qualitative research we collected. I updated our existing personas that were previously created using only telemetry data. Our team started exploring ideas of what Nexxus Marketing could look like through wireframes and clickable prototypes.