Overview
As part of implementation of A/B framework, we have evaluated 4 frameworks' that are available for A/B testing. Planout (by Facebook), Wasabi (by Intuit), Alephbet & sixpack (by seatgeek)
We will list down the salient feature and comparison among this tools in following table
| Planout | Wasabi | Sixpack | Alephbet | |
|---|---|---|---|---|
| Implemented By | Facebook (Python), Hubspot(Javascript), GlassDoor (Java) | Intuit | SeatGeek | GingerLime |
| Server Implementation | Multiple - Python, Java, PHP | Java | Python | None |
| Event logging mechanism | Add own logic for log-event - event object is received as an input | Full-fledged API - for assignment, impression, engagement | API for collection impression/engagement | Stores in javascript localstore, gives plug-in point |
| License information | BSD | Apache 2.0 | BSD | MIT |
Other dependency | None | Cassandra/MySQL | Redis | None |
| Other standout feature | Support's namespace - can be used to qualify experiment further |
It is desirable to use, just java-script implementation as minimal data storage or even just telemetry generation is enough for gathering data. So Planout/Alephbet are better fit for our purpose.
Sample Configuration
Schema for configuration
Syntax
JsonConfiguration
{
'stateCode': 'AP',
'deviceType': 'Android'
}