"For usability, it's the best of times and the worst of times. At least that was my takeaway from this year's Boston UPA Usability and User Experience Mini-Conference. Attendance was at an all time high, and famous local gurus appeared and spoke alongside a wide range of presenters. A recent salary survey shows that practitioners are paid well and the field is expanding.
Before I opine, I want to note that the organizers did a great job running the conference. It was a terrific experience and I'm already looking forward to next year. In sessions I attended and during side conversations, several themes reoccurred as challenges to the discipline, with no clear solutions. Among them were:
FAULT LINES WITHIN THE FIELD
Several well-known experts called for the pendulum to swing back from 'quick and dirty' usability studies, to testing of statistically significant sample sizes. I was not surprised to find these folks all work for large software companies with budgets and long release cycles. Try working in an Agile development environment and you'll find little patience for these rigorous methodologies. However, if you're a practitioner, you can't just dismiss these concerns. At first your business superiors may not question your methodology. But if you recommend changes based on a six-person usability test, and then find even worse results afterwards, it's too late to bring up statistical validity.
This divide goes deeper than just disagreement over best practices. Many of the newer generation of practitioners lack formal training in statistics, and either they don't know what they're missing, or don't consider it relevant. The more rigorous faction often considers their web-raised peers to be lightweights, not fit to work alongside them on 'real' projects. I think it's best to be versed in the statistics, so even if you decide to run quick-and-dirty tests, you can present them as such and provide the appropriate caveats.
GOOD DESIGN IS THE ELEPHANT IN THE CORNER
If you want to make a usability expert twitchy and uncomfortable, ask her how companies like Apple can create acclaimed, wildly successful, and usable products using top-down design without usability testing. For extra discomfort, follow up by asking why there's no evidence that user-centered design works.
An objective look at the most successful products and companies suggests there's huge value in good design. Good design is intuitively attractive to people - they'll like it and they'll buy it, and brands that produce it acquire a positive aura that turns into money. We should be spending much more time talking about design processes and enabling great design. Yes, you can define good design. It's measured in sales!
Meanwhile, while good design can change markets, usability is incremental. It's difficult to see how good usability truly can result in innovative products and new categories. In an entrepreneurial age, usability practitioners risk being left behind." (Continued via Usability News, Joshua Ledwell) [Usability Resources]