They’re a good crew. The facilitator, SR, appears a bit casual - but they are a whiz at avoiding leading questions and practicing self-restraint. A person who knows the answer has to work hard not to hint to a participant who is struggling – SR is an ace at just responding minimally and getting the participant to explain their thought process.
SR is paired up with a serious usability pro, KR, so the report is sure to be airtight and professional. They are offsite, so we’ve scheduled a videoconference so the clients and developers can hear the report and ask questions.
Given the fact that my test plan has missed a key objective – I’m expecting to get tagged on the report. SR and KR won’t ding me for my plan – but a public reading of their findings can only highlight the gap in what I’d asked them to find out. I’m genuinely sweating it.
It’s the last item of the day, and all my other meetings cancel – so I’ve got all day to imagine the myriad ways SR will say “we don’t have much data on X.”
I ping SR twice about the report. “Make sure you hit the main test objectives first, the clients won’t want to hear about ancillary stuff until they have the big stuff.” I ask about a finding they mentioned in passing. I’m wondering if this finding will re-open old arguments with the Client. I get some assurances and go to lunch.
At work, I’ve been ever the optimist – but I just can’t relax. I hit one of the few decent restaurants near work and tell myself I might as well eat first.
Last time we used KR and SR, there were some communication errors that resulted in findings that were beyond the scope of the project, or made it look like my department didn’t understand the project they were working on. I’ve tried to minimize this risk as much as I can – but there’s so much information to get across. I’m afraid that SR will say something that will make us lose cred.
My department, we’re a latecomer to most projects, and we are generally regarded as just another mouth to feed. I’m convinced half the time that the Client would happily be rid of us – but somebody above them is forcing them to work with us.
The history of this project has been tumultuous – I smoke-jumped in just as people were getting canned. The timeline and scope keep getting changed in threatening ways – and we’ve been at loggerheads in design because the culture is “don’t change anything.” It’s the classic usability problem. Developers want the UI to look like the back-end code, the SME’s assume that everyone using the system eats and sleeps the operations manual, just like they do – it’s a mess.
I’ve gone out on a limb countless times, just to see if I can provoke discussions that lead us away from “do it the way we do now.” I’ve been shot down so many times, I’ve stopped noticing - but I’m determined to at least try to make things better.
Very rarely, one of our ideas gets approved, and my team celebrates. Sure, the whole design is a Frankenstein’s monster – but there’s this little part (call it function X) that we got into the project. We think it’s neat – we hope it lives until go-live.
It’s been a real struggle – and patience on some issues has worn so thin that we’ve abandoned all discussion of them. We’re just hoping that once things have cooled off, we can revisit them in better times.
So, here we are – having amassed a modest amount of cred – and I’m waiting for this presentation to highlight my test’s poor design.
I’ve told SR that he should plow through the biggies and expect interruptions. My group prefers the piranha method of discussion, so any suggestion that we hold questions is just a waste.
And we start.
---
SR starts on the part of the UI that I failed to evaluate against a previous design. Participants encountering the new design failed to see and interact with it 100% of the time.
No biggie, we just prompt them to look at it and observe their reactions to it with a prompt. Having seen most of the sessions – I know that most people were able to use the UI with a prompt. This is not ideal, but it means that our problem is likely one of visibility and labeling rather than actual function.
Except SR didn’t see it that way. SR details failure after failure in this UI even after prompts. This I do not recall, but I wasn’t at all the sessions. I’m a bit surprised, because this is a key piece of UI that two projects were waiting for. I’d thought (and unfortunately, said) that the issues with it were cosmetic and we could probably fix it easily. SR details a series of convincing issues that say otherwise. One of the project managers, short on time, expresses alarm and then leaves.
SR continues into another section I thought went well and proceeds to document why it is unadulterated crap. I’m really not liking where this is going.
Questions? The room is dead quiet. Everybody’s here, project managers, the Client, my boss – nobody says a thing.
It’s my show on this end, so I just tell SR to plow onward and they do. Right into a pet issue of mine. One of those little victories that I’d endured weeks of abuse to get into the design is now being held up as a cautionary tale. The Client and I were on opposite sides of this one and I’d carried the day mainly on persistence. Now, SR is basically listing all the same complaints the Client gave me when I first came up with the design.
The Client and the rest of the dev team go quiet – they remember the same discussions. They thought I was nuts – and SR is telling them all they were right to say so.
Now, normally, stuff like this – I don’t care. A design dies, but you make a better one out of the ashes. Everybody’s design takes a pounding, everyone gets a turn. But with this crowd, there will be people who will use this moment to discount any future input from me.
Remember that one thing? How you insisted it was better? Well, you were wrong, so shaddup!SR’s report plows onward, ripping on two other items that I’ll take the fall for, before finally winding down on issues that were too minor for the team to care much about.
It’s dead quiet. SR’s clearly a bit surprised by this, and tries to liven things up. He addresses me directly “You look like you have something intelligent to say.”
I’m about to reply when I’m cut off –
“No, he doesn’t” says the Client, scoffing.
We have a few pro forma questions and then it’s time to go.
---
SR’s report was honest and accurate – yet it managed to hit every issue where the Client had doubts about us and strengthen them. I’m absolutely stunned.
My boss is gone. No chance to debrief. One of the more sympathetic types comes up and says “Back to the drawing board, eh?” I’m looking over at the Client, who is in a huddle with the people they still have respect for.
I can’t even get my head around this. Every discussion after this will be uphill times ten.
Next meeting, all my suggestions will be stillborn – the Client may want me off their project and my boss, too for all I know.
I don’t blame SR at all – these were honest conclusions, but what are the odds that all the stuff singled out for abuse would be mine? Yeah, I know law of averages, but did it have to frickin' happen now??!!
All this fighting for a place at the table, some respect and now –
Shit. Square one if I’m lucky.


