Monday, June 10, 2019

Don’ts in Experimentation (A/B Testing, Multivariate, Personalization) while planning your testing Strategy aligned to digital strategy

“Search engines loves experimentation” 

A. I will love to start with don’t while you guys are experimenting on pages/ forms aligned to your  digital strategy idea we should avoid somethings as they will never give us any outcome & will only consume time & false expectation in the mind of the visitors coming to your web sites

1.       We all agree that it’s time to serve local content to local audience as it really help them know how locally you have become from being global that company looks.

2.       While Back-link strategy is liked by google from the trusted sites global page should try to avoid giving links to local country pages as it simply tells google to give them weight-age on a google.com console where you always want your global page to appear first than the local versions 

3.       Hence the first thing to avoid in testing give back links to local country pages from the global page

4.       So here is the real story:
Just look at the Variation below that will shown to audiences from china (Personalization Experiment) giving back-link from the global page to a local page can help move local page above the global page in GOOGLE.COM console which is really not we want to happen at all at any given circumstance


 Even after 9 days of running the exp & showing the variation to local audience we are still seeing only 4 visits of out 81 visits clicks on the CTA & engagement rate of the traffic https://www.xxxx.com/blogs/xxxx/cn-cn of the traffic clicking going from the global page to local page is down by -1.23% which clearly tells that on the global local content should not be mixed 

Click on the image to enlarge it

Personalization of these kinds should better be done using ECM likes sitecore, drupal, SharePoint from the server side itself any time  visitors  from a local country lands on a global page from the local page as it tells the search engines father & child relationship on localization journey 

Click on the image to enlarge it

B. Swapping page band by moving the band further up the fold without doing any changes on the page content 

Assumption made here is : Moving Client Success below “Featured Software & Services” section will help visitors gain visibility to Client Success section will uplift engagement
Position of the Client success has been changed without making any changes on the content of the section 

Click on the image to enlarge it

See what happens next?
In next than 5 working days the results comes negative as engagement rate of the page further falls on the variation drastically. Hence make some changes before moving any section of up/down before testing them

Click on the image to enlarge it

C. Now what I am write here is like committing a crime which will make your digital strategy really not getting best outcome for sure, so I will say don’t try this at all while doing testing 

I do agree to fact that it is not easy to get organic traffic to your industry specific pages as the keywords targeted are not having high search volume at all hence you need to plan some merchandising plan for it to drive traffic to these pages ie, leveraging owned media or align little paid media to these pages to really start giving visibility to these pages

But if you are only using organic traffic for Industry page & you try personalization using a cookies pool which personalizes the experience depending upon the past visit even you run the experiment for an year you will not even see 1% statistical significance reached by your experiment

So what I mean to say is Personalization works only when it is supports by a good amount of traffic flow else it is waste of time & effort

Click on the image to enlarge it

So below is unique kind of personalization where on the basis of cookie pool if any visitors qualifies ( (Health care NOT FOR TARGETING) done using DMP will show up the variation page

So this experiment is getting traffic only from organic search & hence even after running the experiment for one year which is wow time.

Even we are seeing the improvements in idea implemented it has not even reached 1% stats significance hence we still can’t say that the idea works or not conclusively. Refer the results shown below 

Click on the image to enlarge it

Note: All the results shown can be seen inside the Testing tools like Google Optimize/Adobe Target/ Optimizely ( All are Industry leaders in web testing/ Personalization)


  1. This is a smart blog. I mean it. You have so much knowledge about this issue, and so much passion. You also know how to make people rally behind it, obviously from the responses. cheap link building

  2. Wikipedia’s traffic
    I hope you will share such type of impressive contents again with us so that we can utilize it and get more advantage.

  3. If you are new user or exiting user of QuickBooks accounting software and looking for the QuickBooks technical support.If yes than you have come to right place as we provide efficient technical support service to customers who show complete faith in us. With our efficient and highly qualified team ,we never disappoint our customers.You can reach us at 1800-961-4623 at any hour of the day. You can also visit our website at https://www.quick.helplinenumber.support/ for the complete knowledge of the QuickBooks products and services.

    The Services we offered are following-

    QuickBooks Technical Support Phone Number
    QuickBooks Technical Support Number
    QuickBooks Tech Support Phone Number
    QuickBooks Tech Support Number
    QuickBooks Customer Support Phone Number
    QuickBooks Customer Support Number

  4. I really like your blog. Blog contains plenty of data and nice explanation. I think most of the readers collect content from your blog.
    Internet marketing affiliates

  5. If you are new user to sage 50 accounting software and looking for the sage 50 technical support.If yes than you have come to right place as we provide efficient technical support service to customers who show complete faith in us. With our efficient and highly qualified team ,we never disappoint our customers.You can reach us at 1800-910-4754 at any hour of the day. You can also visit our website at https://www.geekaccounting247.com/ for the complete knowledge of the sage products and services.

    The Services we offered are following-
    Sage 50 Technical Support Number
    Sage 100 Technical Support Number
    Sage 50 live chat
    Sage 50 Technical Support phone Number
    Sage 50 support phone number

  6. Hello Admin!

    Thanks for the post. It was very interesting and meaningful. I really appreciate it! Keep updating stuffs like this. If you are looking for the Advertising Agency in Chennai | Printing in Chennai , Visit Inoventic Creative Agency Today..

  7. Nice answers in replace of the question with real point of view and explaining about that.
    how to start a web design company

  8. Hey!

    DigiPeek is the best SEO & Link Building Service Provider In The World. I have 7+ Years Experience To Build SEO, Backlinks & Improve Website Ranking.

    If you need Profile Backlinks, Forum Backlinks, Dofollow Backlinks, Manual Backlinks, Trusted SEO Backlinks, Increase Domain Rating Then You Will Contact Me.

    I am glad to help You!

    Let's TRY!

  9. I read this article; it is really informative one. Your way of writing and making things clear is very impressive. I am really impressed by the way you detailed everything. Thanking you for such an informative article. Internet Marketing Agency.

  10. I even have been getting a lot of helpful and informative material in your web site.
    UI design company

  11. That’s really amazing and extraordinary blogs & can help those who get issues in searching this type of information.
    lead conversion system review

  12. Keep the balls rolling!! Nice posts you have given for us.
    Jono Armstrong Ministry of Freedom

  13. Wow what a Great Information about World Day its very nice informative post. thanks for the post. SEO Service on Fiverr

  14. truck art, In India, You can see indian truck art on the road. who are cover with full of shayri such as Buri Nazar Wale Tera Muh Kala, and "Dekho Magar Pyaar Se" etc. Mostly that art is design on the front and backside of truck.

  15. Tibet is situated on the northern side of the Himalayas. Lhasa is the capital city of Tibet who gives to tourists the best chance to experience the authentic Tibetan sacred land or Many more holiday destination are also available in tibet travel such as Potala Palace, Jokhang temple, and namtso, etc. More information on this link. vacation in tibet

  16. In 1969, shakuntala devi wins "Women of the Year" by the University of the Philippines and she also wins the Guinness Book of World Records. She has also added our name to the Guinness Book of World Records to solve the 13-digit number in a short time which was 28 seconds. She was famous for the name of "Indian human computer".

  17. Thank you for sharing this valuable information. Keep it update.
    classified ads platform in Bangladesh

  18. Customers can expect high-quality products delivered on time at an exceptional value.
    interaction design firms

  19. The messages are constantly timely, professional, clear, and courteous
    top website design companies

  20. Some are difficult to quantify, making it hard to tell what esteem they add. With SEO, notwithstanding, you can without much of a stretch measure your outcomes. https://www.sandeepmehta.co.in/affordable-seo-services-delhi/

  21. Amusingly, notwithstanding our best adult endeavors to leave these excruciating long stretches of being forgotten about or the euphoric long periods of being incorporated, because of the idea of social mediaclick here.