Your advice on Website Optimization Tools for A/B and Multivariant tests

[mozzello]

Hi everyone,

I've been looking for tools to support all the A/B and Multivatriant testing for my websites.

I've seen a lot of stuff out there but I'd like to hear what YOU think.

Are you using any of these tools?
Which one would you recommend?

Thanks a lot for your help
Michel

[Thumbtack]

Hi Michel,

Not sure if this is what you're looking for, but you might check out this tool that our engineers made:

http://www.thumbtack.com/labs/abba/

http://www.thumbtack.com/engineering/gambling-with-the-devil-ab-tests-done-right/

It's a pretty simple way (with lots of complexity under the hood) to interpret the results of binomial experiments (i.e. A/B tests).

We use this for all our A/B tests.

Sander

[john4math]

We're using Optimizely and we love it.  Their tool is incredibly easy to use, and very powerful.  It's powered by jQuery, but has a nice editor (which you can try out for free on any page on your site) where you can edit page elements simply by clicking and dragging, resizing, swapping, or deleting them.  For a lot of our tests, we handwrite JavaScript and jQuery to effect multiple elements on multiple pages, which was impossible for us to implement within Google Website Optimizer.

They also have all the reporting you'd expect and support multiple goals which is a must for us.  It's a very powerful full-featured tool.  We're very happy with it and have no regrets.