The hash trick is clever. But what happens when you start with 4 versions, then ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		btilly on Sept 9, 2009 \| parent \| context \| favorite \| on: A/B and Qualitative User Testing The hash trick is clever. But what happens when you start with 4 versions, then find that one version is worse than the others? Do you have to start the test over? Is there some kind of rebucketing algorithm you use?

patio11 on Sept 9, 2009 [–]

I'd just start the test over. If you want to do rebucketing, see the following Ruby-esque psuedocode:

http://pastie.org/610630

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact