Connecting Data to Where it Matters Most

Product Team

Stephen Perkins, Kristin Landgraf, Amy Ng, Arnab Pal

Integrating data across platforms is hard.

Talking about it is also hard, so I will spare you the details.

What I will talk about is how implementing basic UX strategies made it easier.

The Problem

Many of the core functions of RudderStack were built by developers. In this case engineers had designed a form that put everything users could ever want to tell us on one page. (It's too long to show here, but click here to see it.)

It was an act of generosity, that fell short on user empathy.

From a design perspective it felt overwhelming. The data backed up that this all-in-one approach wasn’t working. Less than 50% of users who started the form completed it.

This was the project that I used to change our process at RudderStack.

Our Approach

To right this ship, we did just three things.

[Fig. 1] Mixpanel flow graph showing 50% drop-off rate at each step of the flow.
[Fig. 1] Mixpanel flow graph showing 50% dropoff rate at each step of the flow.

1. Dig into the Data

Up to this point the company didn’t do a good job of validating before to building. So the team began with an exhaustive exploration of how users setup destinations looking at behavior data, support tickets, and community feedback. We identified common stumbling blocks and opportunities for simplification.

2. Talk to Customers

Data can tell you what they did but not why, so I led our first ever discovery customer interviews, I wrote a research plan and script focused on open-ended questions about connecting destinations. We learned more about how people set up connections after 3 interviews than we did with all of the data we gathered. We even witnessed a customer struggle for almost 2 hours to configure a Snowflake destination.

I just spent half of my day trying to configure a Google Analytics destination. I have to constantly refer to the docs to understand what everything does.

Alex

3. Define Unclear Terms

CDPs are complicated, and even the people who make them (us) didn’t completely understand some of the fields. So the PM and I sat down with engineering and went field by field figuring out what each did, where the data connected, what the implications were, and what destinations shared that field. We mapped the web of settings and created an enormous and beautiful spreadsheet.

[Fig. 2] Our massive spreadsheet mapping all of the configuration settings their impacts, relations, and information.
[Fig. 2] Our massive spreadsheet mapping all of the configuration settings their impacts, relations, and information.

Out of 27 fields only 2 of them were required: Name and API Key. Most importantly we learned that one of the last settings on the list ‘Connection Mode’ was easily the most important setting and no body knew it.

Connection Mode: an aside

Connection Mode turned into a mini project all on its own. This little switch, hidden away, had zero helper text, and there was nothing in the docs about it. Only 1 in 5 customers we talked to actually knew what it did. But this little setting was the single most important choice when configuring a destination.

Our biggest problem it seemed was communication, our UX Writer played a pivotal role in demystifying what exactly this did and why it matters, so customers could make the right choice for them.

The writing defined the final design.

[Fig. 3] Connection Mode close up showing the language and interaction.
[Fig. 3] Connection Mode close up showing the language and interaction.

From 27 fields to 2 steps

We wanted to get customers to create the destination with as little friction as possible, asking only what was required. With this new workflow, once the destination is created it is disabled by default and the user goes straight to configuration so they can manage all of their settings in their own time and enable it once it’s ready.

[Fig. 4] RudderStack Destination create and configure flowchart.
[Fig. 4] RudderStack Destination create and configure flowchart.

Configuring with ease

We completely redesigned our settings forms to be organized and created plenty of room for helper text, and definitions of each field. We organized the form structure into  categories and provided critical information about the categories themselves.

Newly designed configuration  and settings form.
[Fig. 5] Newly designed configuration and settings page for destinations.

Outcomes

The impact of this project had ripples across the product and the business. By streamlining the core creation workflow we boosted new destinations by 220% and drastically decreased the time it took to get set destination set up. These changes also improved our new user retention.

+220%

Increase in new destinations being created

70%

Reduction in destination set up time.

20%

Boost in user retention during onboarding.

15%

increase in warehouse destinations

Select Work

Founding a Design team and Growing a Culture

How I built a collaborative design organization that helped RudderStack grow

Making Small Business Connections with CPAs

Bridging the Gap: Connecting Entrepreneurs with Expert CPAs

Revolutionizing the Insurance Appeal Process

Using AI to submit insurance appeals faster and with a higher acceptance rate