Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If they kill A/B testing then probably a generation of startups that modeled themselves after Google and their diaspora won't know how to design products anymore.


Good riddance! It’s high time companies stop gravitating to the local maxima for every decision. As a user, I want thoughtfully developed experiences; not everything has to be a news feed.


A/B testing is an important super basic step to improving the user experience. Without it how would you know what users are looking for? It's important to test the right factors though. I can see it being done wrong and winding up detrimental to the user experience, but not doing it all is definitely not a solution.


How essential is it though really? How did we ever manage before it became a thing?

Obviously a good number of A/B tests are pretty innocent, but if it's non-trivial to differentiate between them and https://en.wikipedia.org/wiki/Nudge_theory then I'm 100% for completely ditching A/B tests.


How is A/B testing anything other than the scientific method with a control and a variable?

The answer is: modern science has always used a form of A/B testing.


I think the medium, data collection, and scale matter. It's never been so affective or efficient as it is now (and will become).

Gathering data from a million people on which shade of red makes them more likely to click a button is entirely different today due to the scale, how cheap it is to setup, and how cheap it is to tweak. This data can then be used to "nudge" people towards a direction that you benefit from (and they may or may not benefit from, and society at large may or may not benefit from). At scale, these very small nudges can have an impact. The unregulated methods we use for this keep improving (AI).

Not to throw shade, but there's a reason why Amazon has been hiring behavioural psychologists. We should be aware and thinking about this.


I disagree in that I feel the higher effectiveness results in better UI.

Perhaps we need to simultaneously inform people through better education at the same time for how to resist the urge to spend borrowed money whenever possible?


Incentives of the publisher and the consumer aren't always aligned. Publisher might want you to spend / use the mobile app (tracking) / budge your political leaning / confuse you with disinformation / etc. The consumer / user is simply outgunned, and it's getting more and more lopsided. Regulation is inevitable.

This isn't just about good UI. Not everyone is using these sort of behavioural tests to present a better UI. It's also about influence (micro influence). I'm not sure you're seeing the whole picture.

It sounds like conspiracy, but Obama and Cameron had "Nudge Units", and that was 5 years ago.

http://freakonomics.com/podcast/white-house-gets-nudge-busin...

https://www.warc.com/newsandopinion/opinion/how_the_likes_of...

https://www.forbes.com/sites/beltway/2015/09/16/obama-nudge-...


Before we used A/B testing with paper and a writing tool no doubt.


I think it's good policy and will also be really funny, which is why I think it should become law. It'll force Silicon Valley to learn empathy overnight.


It'll also lead to even shittier UI because you can't test your actual users for it.


About time!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: