Area 14 · Development and websites

Testing and QA

A defect spotted by a developer costs sixty minutes of their time. The same defect found by a customer at peak season costs lost revenue and a damaged reputation. Testing exists not to find someone to blame but so the problem surfaces before anyone else sees it.

×10
cheaper to catch before release
5
types of testing
Report
with steps to reproduce
Automated tests
repeat checks without hands

What a defect costs

The cost of the same defect depends on the stage at which it was found. That is the main argument for regular testing rather than a single run before handover.

At the idea stage

Once over. It is enough to correct the wording in the specification.

While the code is being written

Three times. The developer changes the lines before they reach a build.

In testing

Ten times. The work goes back to the developer and the whole cycle repeats.

After the release ships

Thirty times. An unplanned release with an emergency patch is required.

A customer found it

One hundred times. On top of the cost of the work come lost revenue and a dented reputation.

Investment in automation pays off not at once but after dozens of runs. That is why the machine is given the settled journeys that get walked at every release. Automating something rewritten weekly means spending the budget on maintaining the tests themselves.

How the testing works

The output is not a complaint about quality in general but reproducible findings with priorities, which a developer can start on immediately.

01

We study the product

We study the user journeys, who the users are and what matters to the business. Giving every area equal attention makes no sense.

02

We draw up the plan

We fix the list of checks and the list of devices and browsers. The document is agreed with you and sets both the effort and the price.

03

We test and write the report

Every finding comes with the steps to reproduce, a screenshot and a severity rating. Otherwise the report is worthless.

04

We check it again

When a fix arrives we look not only at it but at the neighbouring areas: whether anything broke along the way.

Questions and answers

They do test, but they confirm that what they built behaves as intended. A tester's job is the opposite: to find out what happens when you depart from the intention. The roles are fundamentally different and sit badly in one head - the eye stops noticing the obvious.

Yes, people come to us for this regularly just before accepting work from a contractor. We have no reason to hide findings, so the report is impartial. It makes more sense to run such a check before signing off rather than afterwards.

We start from your own analytics rather than a universal list. Usually two or three phone sizes and three browsers are enough - they account for the vast majority of visits. Testing everything is expensive and does not pay for itself.

Three numbers: how many simultaneous visitors it handles comfortably, at what point the slowdown begins and which component is the bottleneck - CPU, storage, the database or the code itself. With those you can choose between adding resources and rewriting.

We will find the defects before your customers do

Напишите, что подлежит проверке и к какой дате. Составим программу работ и рассчитаем стоимость по числу проверяемых путей.