A SYSTEM AND METHOD FOR PERFORMING A/B TESTING

Abstract

Disclosed is a system and method for performing A/B testing in order to show the web page of an internet application to users in different variations and to allow action to be taken according to the usage behavior of the users. It allows always the correct A/B group to be shown when performing the A/B test in an internet application having cache memory that runs on client devices such as mobile or computing devices. The system and method allow A/B testing to be performed although it has cache by displaying the same web page content of an internet application with different contents by creating the internet application running on mentioned client device according to the cache and cache keys.

Claims

1. A system for allowing A/B testing to be performed in order to show a web page of an internet application running on a client device to users in different variations and to allow action to be taken according to usage behavior of the users, the system comprising:; a client device for internet application users, a test server that allows data of A/B testing applied on users to be obtained, a cache server where there is page content for client device, and an application server for an internet application that allows displaying of page content.

2. A system for allowing the A/B testing to be performed according to claim 1, comprising; a back cache server where there is the page content for the client device, and a web server that allows the page content specific to the test group to be detected and sent to the client device.

3. A method for allowing A/B testing to be performed in order to show a web page of the an internet application running on a client device to users in different variations and to allow action to be taken according to usage behavior of the users, the method comprising the following steps: sending a request to an A/B test server by the client device in order to obtain A/B test information for a relevant web page and cache keys created specially for the A/B test groups, if the client device is included in the A/B test group, transmitting the test information, test group information and cache key information to the client device by the test server, transmitting the cache key information to the cache server by the client device in order to access the content of the web page, if the URL and cache key combination of the web page is already registered in the cache server, sending the result of the page to the client device by the cache server, if the cache key and URL information for the web page are not available on the cache server, sending a request with together URL information and cache key to the application server by the cache server in order to reach the content of the web page for obtaining the result of the relevant web page, recording in the cache server the data came from the application server by combining it with the URL and cache key information and, sending the related web page content to the client device.

4. A method for allowing the A/B testing to be performed according to claim 3, comprising the following steps: sending the URL and cache key that came from the cache server, by the application server in order to receive the page content from a back cache server, if the URL and cache key combination of the web page was previously registered on the back cache server, sending the result of the web page to the client device, if the URL and cache key combination of the web page is not found in the back cache server, sending a request for the web page with together the cache key information to the web server by the back cache server, sending the page content that is prepared in the web server for the relevant group by using the cache key of the test group, to the other back cache server as response, caching the response that came from the web server by combining it with the URL information and cache key of the website by the back cache server, sending the web page related response that came from the web server to the application server by the back cache server, sending the web page content which is prepared in the application server by using the result of A/B test group came from the back cache server, to the cache server.

5. A method for allowing A/B testing to be performed according to claim 3, or comprising the following steps: displaying the same web page content of an interne application with different contents for different test groups by being created according to the cache and cache keys of the internet application running on the client device and, performing the A/B testing although there is cache related to the internet application.

6. A method for allowing A/B testing to be performed according to claim 4, comprising the following steps: displaying the same web page content of an internet application with different contents for different test groups by being created according to the cache and cache keys of the internet application running on the client device and, performing the A/B testing although there is cache related to the internet application.

Description

DESCRIPTION OF THE FIGURES

[0032] In FIG. 1, system components related to the method and the relationship between these system components are shown.

REFERENCE NUMBERS

[0033] 10. Client Device

[0034] 20. Test Server

[0035] 30. Cache Server

[0036] 40. Application Server

[0037] 50. Back Cache Server

[0038] 60. Web Server

DETAILED DESCRIPTION OF THE INVENTION

[0039] The invention is a system and method for performing A/B testing in order to show the web page of an internet application to users in different variations and to allow action to be taken according to the usage behavior of the users.

[0040] With the present invention, It is always allowed the correct A/B group to be shown when performing the A/B test in an internet application having cache memory that runs on client devices (10) such as mobile or computing devices. It is provided the A/B test to be performed although it has cache by displaying the same web page content of an internet application with different contents by creating the internet application running on mentioned client device (10) according to the cache and cache keys.

[0041] System components related to the present innovative method and the relationship between these system components can be seen in FIG. 1. Mentioned system generally comprises a client device (10) for internet application users, a test server (20) that allows the data of A/B testing applied on users to be obtained, a cache server (30) where there is the page content for client device (10), an application server (40) for an internet application that allows displaying of page content, a back cache server (50) where there is the page content for client device (10), a web server (60) that allows the page content specific to the test group to be detected and sent to the client device (10). In a preferred embodiment, mentioned web server (60) can be a search and navigation server.

[0042] In present invention; firstly; the client device (10) sends a request to the A/B test server (20) in order to obtain the A/B test information for the relevant web page and the cache keys created specially for the A/B test groups. If the client device (10) is included in the A/B test group; the test server (20) transmits the test information, test group information and cache key information to the client device (10). Then, the client device (10) transmits the cache key information to the cache server (30) in order to access the content of the web page. If the URL and cache key combination of the web page is already registered in the cache server (30); the cache server (30) sends the result of the page to the client device (10). If the cache key and URL information for the web page are not available on the cache server (30); the cache server (30) sends a request with together URL information and cache key to the application server (40) in order to reach the content of the web page for obtaining the result of the relevant web page. The application server (40) sends the URL and cache key that came from the cache server (30), in order to receive the page content from a back cache server (50). If the URL and cache key combination of the web page was previously registered on the back cache server (50); the result of the web page is sent to the client device (10). If the URL and cache key combination of the web page is not found in the back cache server (50); the back cache server (50) sends a request for the web page with together the cache key information to the web server (60). The page content that is prepared in the web server (60) for the relevant group by using the cache key of the test group is sent to the other back cache server (50) as response. In the back cache server (50), the response that came from the web server (60) is cached by combining with the URL information and cache key of the website. Then, the web page related response that came from the web server (60) is sent from the back cache server (50) to the application server (40). The web page content which is prepared in the application server (40) by using the result of A/B test group came from the back cache server (50) is sent to the cache server (30). The data came from the application server (40) is recorded in the cache server (30) by combining it with the URL and cache key information and, the related web page content is sent to the client device (10). Thus, the A/B test is performed by always displaying the correct A/B test group.

[0043] In the present invention, unlike all other methods, an web page is created according to the cache and cache keys. A/B test can be done even though it has cache by displaying the same web page with different contents. Mentioned cache key is the encoded version [Hex (Hexademical) Encode] of test ID number, variation ID number and various parameter values defined for variation. When it requires, the test information and parameters can be obtained by decoding of the parameters encoded with Hex. If there is more than one test content on the relevant page, the parameters of all tests on the page is located in the cache key as encoded.