Pebellslearn by building
0%
RoadmapsMatrixCoursesSandboxSign in
Existing Design Analysis  ›  Lesson

Existing Process and Experiments

Identify Existing Design Process 12 minBefore changing an existing design, learn how the team currently designs and ships work and which past experiments, such as A/B tests, shaped the interface, so tested results are respected and the system fits the real workflow.

Existing Process and Experiments

The audit shows that the checkout button is a bright green, unlike every other button at Tiffinbox. You are about to "fix" it to orange. Then someone from the growth team mentions that they tested green against orange last year, and green led to more completed orders. That green was not an accident. It was a result.

The rule

Before changing how things look, learn how they got that way.

Pixels are only half of what exists. The other half is invisible: how the work gets done, and what the team has already learned.

The design process. Find out how a feature travels from idea to release today:

  • Who designs, and in which tools? Where do the files live?
  • How are designs handed to engineers, and how are they reviewed?
  • Where are decisions recorded, if anywhere?

Interview designers, engineers and product managers, and follow one real feature from start to finish. A design system has to fit into this flow, or change it on purpose. If using Thali adds three extra steps to a designer's day, people will quietly skip it.

Experiments. Many companies run A/B tests: two versions of a screen are shown to different groups of users, and the results are compared. Gather the past tests that shaped the current interface, what was compared, and which version won. Some things that look inconsistent in the audit are proven winners. Others won under old conditions that no longer apply.

Two rules follow. Don't undo a tested result on taste alone. And when the system does change a tested element, test again rather than assume. The system should also make experimenting easy, for example by letting a team try a variant without leaving the system.

The shortcut

Ask "why" before "fix". For each odd thing in the audit, find out which of three it is: an accident, a constraint, or an experiment result. Only accidents are safe to fix straight away.

The green checkout buttonStep 1 of 4
  1. Spot the odd one

    One button is green. Every other primary button is orange.

Drills

Answer fast — trust the rule.

quick drill

What is an A/B test?

quick drill

The audit finds an odd element. Following "ask why before fix", which kind is safe to change straight away?

quick drill

Why study how designs currently travel from idea to release?

quick drill

Thali's new button would replace a style that won an A/B test two years ago. What is the sound approach?

Remember

  • Before changing how things look, learn how they got that way: the process and the experiments.
  • Shortcut: ask "why" before "fix". Accident, constraint or experiment result; only accidents are safe to fix at once.
  • Trap: undoing a tested result on taste, or building a system that doesn't fit how the team actually works.

Practice — level up

0/1 solved

Write your answer, then compare it with a rubric and a model answer.

ExplainWhy before fix

The audit finds that the restaurant listing uses larger photos than every other list at Tiffinbox. Explain how you would decide whether to change it, and why you would also study how the listing team designs and ships its work.