Develop A/B Testing methods and documentation
It is important to start early in developing templated systems and documents to log your research and tests so you can develop a regular testing cycle and reporting. I developed a process for performing, documenting and reporting A/B tests at UC San Diego Health.
The Opportunity
To develop a process for performing, documenting and reporting A/B tests.
Value it Produced
Provides significant value by establishing a structured approach to experimentation and optimization. This process ensures systematic testing of different variations, allowing for data-driven decisions to improve performance metrics such as conversion rates, engagement, and user satisfaction. It also facilitates clear documentation of test methodologies and results, enabling insights to be shared across teams and informing future strategies effectively. Ultimately, the structured A/B testing process enhances decision-making, fosters continuous improvement, and drives better outcomes for the organization.
My Role
Lead Researcher
Constraints
Resistance to Change: Introducing a new process faced resistance from stakeholders who were accustomed to making decisions based on intuition or traditional methods rather than data-driven insights.
Technical Infrastructure: Effective A/B testing relies on analytics tools. Setting up this infrastructure and ensuring it supports the testing process was a hurdle.
How did research inform the design
Overall, this project improved the organizations processes from planning to reporting. Here is an overview of the process:
Create A/B Testing (Experimentation) Hypothesis Logs
Build Testing Request Forms for clients or team members
Create Test Plan & Build Documents
Create Prioritization Roadmapping documents to focus on high priority tests and assess effort needed to complete tests