Comparison shopping website

A comparison shopping website, sometimes called a price comparison website, price analysis tool, comparison shopping agent, shopbot, aggregator or comparison shopping engine, is a vertical search engine that shoppers use to filter and compare products based on price, features, reviews and other criteria. Most comparison shopping sites aggregate product listings from many different retailers but do not directly sell products themselves, instead earning money from affiliate marketing agreements. In the United Kingdom, these services made between £780m and £950m in revenue in 2005^{[1][needs update]}. Hence, E-commerce accounted for an 18.2 percent share of total business turnover in the United Kingdom in 2012. Online sales already account for 13% of the total UK economy, and its expected to increase to 15% by 2017. There is a huge contribution of comparison shopping websites in the expansion of the current E-commerce industry.

History

The first widely recognized comparison-shopping agent was BargainFinder, developed by Andersen Consulting (now Accenture). The team, led by researcher Bruce Krulwich, created BargainFinder in 1995 as an experiment and published it on-line without advance warning to the e-commerce sites being compared. The first commercial shopping agent, called Jango, was produced by Netbot, a Seattle startup company founded by University of Washington professors Oren Etzioni and Daniel S. Weld; Netbot was acquired by the Excite portal in late 1997. Junglee, a Bay-area startup, also pioneered comparison shopping technology and was soon acquired by Amazon.com. Other early comparison shopping agents included pricewatch.com and killerapp.com. NexTag another entry into comparison shopping was named Times magazine world top 50 website in 2008,^[2] only to eventually close in 2018.^[3] In 2005, PriceGrabber was acquired by Experian for $485 million, negotiated by then-CEO and founder of the company, Kamran Pourzanjani, along with Tamim Mourad, in 1999.^[4][5]

Around 2010, the price comparison websites found their way to emerging markets. Especially South-East Asia has been a place for many new comparison websites.^{[citation needed]} It started in 2010 with CompareXpress in Singapore, and in the following years companies like Baoxian (China), Jirnexu (Malaysia), and AskHanuman (Thailand) followed.^[6]

Meanwhile, in developed markets, Google was accused of promoting Froogle and its replacement, the paid-placement-only Google Shopping, over competitors in its search results, driving down traffic to other sites and driving some out of business.^[7] The European Commission began an investigation in 2010, which concluded in July 2017 with a €2.42 billion fine against the parent company Alphabet, and an order to change its practices within 90 days.^[8]

Comparison shopping agent

In the early development stage from 1995 to 2000, comparison shopping agents included not only price comparison but also rating and review services for online vendors and products. Altogether, there were three broad categories of comparison shopping services.^[9]

Later, through mergers and acquisitions, many services were consolidated.

Services

Through 1998 and 1999, various firms developed technology that searched retailers websites for prices and stored them in a central database. Users could then search for a product, and see a list of retailers and prices for that product. Advertisers did not pay to be listed but paid for every click on a price. Streetprices, founded in 1997, has been a very early company in this space; it invented price graphs and email alerts in 1998.^[10]

Technology

Price comparison sites can collect data directly from merchants. Retailers who want to list their products on the website then supply their own lists of products and prices, and these are matched against the original database. This is done by a mixture of information extraction, fuzzy logic and human labour.

Comparison sites can also collect data through a data feed file. Merchants provide information electronically in a set format. This data is then imported by the comparison website. Some third party businesses are providing consolidation of data feeds so that comparison sites do not have to import from many different merchants. Affiliate networks aggregate data feeds from many merchants and provide them to the price comparison sites. Many of the popular shopping websites provide direct affiliation to the customer who wants to become affiliate partner. They provide their own API to the affiliate partner to show their products with specifications to the affiliate partner's website. This enables price comparison sites to monetize the products contained in the feeds by earning commissions on click through traffic.^{[citation needed]} Other price comparison sites have deals with merchants and aggregate feeds using their own technology.^{[citation needed]}

In recent years, many off the shelf software solutions^[11] have been developed that allow website owners to take price comparison websites' inventory data to place retailer prices (context adverts) on their blog or content the only website. In return, the content website owners receive a small share of the revenue earned by the price comparison website. This is often referred to as the revenue share^[12] business model.

Another approach is to crawl the web for prices. This means the comparison service scans retail web pages to retrieve the prices, instead of relying on the retailers to supply them. This method is also sometimes called 'scraping' information. Some, mostly smaller, independent sites solely use this method, to get prices directly from the websites that it is using for the comparison.

Yet another approach to collect data is through crowdsourcing. This lets the price comparison engine collect data from almost any source without the complexities of building a crawler or the logistics of setting up data feeds at the expense of lower coverage comprehensiveness. Sites that use this method rely on visitors contributing pricing data. Unlike discussion forums, which also collect visitor input, price comparison sites that use this method combine data with related inputs and add it to the main database though collaborative filtering, artificial intelligence, or human labor. Data contributors may be rewarded for the effort through prizes, cash, or other social incentives.

However, some combination of these two approaches is most frequently used. Some search engines are starting to blend information from standard feeds with information from sites where product stock-keeping units (SKUs) are unavailable.

Empirical projects that assessed the functionality and performance of page-wise SSC engines (AKA bots) exist. These studies demonstrate that no best or parsimonious shopping bot exists with respect to price advantage.^[13][14]

Major websites

Site	Regional focus
Buscapé	Brazil
Geizhals (Skinflint)	Germany, Austria, United Kingdom, Poland
Google Shopping	Worldwide
Kakaku.com	Japan
Pricesearcher	United Kingdom
Priceza	Southeast Asia
Shopping.com	United States
idealo	Germany
Shopzilla	United States
Yaoota	Egypt

Business models

Price comparison sites typically do not charge users anything to use the site. Instead, they are monetized through payments from retailers who are listed on the site. Depending on the particular business model of the comparison shopping site, retailers either pay a flat fee to be included on the site, pay a fee each time a user clicks through to the retailer web site, or pay every time a user completes a specified action—for example, when they buy something or register with their e-mail address. Comparison shopping sites obtain large product data feeds covering many different retailers from affiliate networks such as LinkShare and Commission Junction. There are also companies that specialize in data feed consolidation for the purpose of price comparison and that charge users for accessing this data. When products from these feeds are displayed on their sites they earn money each time a visitor clicks through to the merchant's site and buys something. Search results may be sorted by the amount of payment received from the merchants listed on the website.^[15] large price comparison sites.^[16]

In addition to comparing tangible goods, some sites compare prices of services, such as insurance, credit cards, phone bills, and money transfer.

Google Panda and price comparison

Like most websites, price comparison websites partly rely on search engines for visitors. The general nature of shopping focused price comparison websites is that, since their content is provided by retail stores, content on price comparison websites is unlikely to be absolutely unique. The table style layout of a comparison website could be considered by Google as "Autogenerated Content and Roundup/Comparison Type of Pages".^[17] As of the 2011 updates to its search algorithm, known as Google Panda, Google seems to have started considering these comparison sites to be of low quality.^[18]

Niche players, fake test sites and fraud

Due to large affiliate network providers providing easily accessible information on large amounts of similar products from multiple vendors, in recent years small price comparison sites have been able to use technology that was previously only available to large price comparison sites.^[16]

This technology includes software and plugins aimed to standardize the typical processes involving price and product comparison. Without much resources it became possible for amateurs to build seemingly professional websites, mostly using the popular Wordpress CMS. These small sites often rely on Google for their visitors, which are monetized using affiliate networks like Amazon.

The low content quality of typical niche sites, often bordering on spam and fraud, is a growing problem from the perspective of consumer protection and the quality of search engines. By playing the algorithm of search engine giant Google, it is possible to place low quality sites prominently in the search results.

Until recently the phenomenon of fake test or comparison websites had escaped public attention. An analysis by testbericht.de discovered that 34,6% of German search traffic related to product tests on the first page of google leads to fake test sites.^[19] When a big German newspaper published a report about such a website^[20] and consumer protection organization sending out warning letters,^[20] observers started to note a sense of panic in the industry, with site owners changing or deleting the content in question.^[21] Amazon, being the biggest player in the affiliate market, declined to comment on the matter.^[19]

Deceptive comparison sites give the impression of testing a product thoroughly. In reality, the tests are just an aggregation of freely available information, often leading to the most expensive products being recommended. This in turn increases the commission rate the site owners earn for the recommended products.^[22]

Google EU Court Case

In 2017, the European Commission fined Google €2.42BN for allegedly monopolising the comparison shopping engine (CSE) market.^[23] Google released a statement that the European Commission's assessment will be appealed.^[24] Google will review the formal decision, but expects that it will accrue the fine in the second quarter of 2017.^[25]

See also

• Discovery shopping
• Gasoline price website
• Customer switching
• Smartfinance
• Switchwise

Literature

• Doorenbos, B; Etzioni, O; Weld, D. A scalable comparison-shopping agent for the World-Wide Web, AGENTS '97 Proceedings of the first international conference on Autonomous agents CM New York, NY, USA 1997
• Clark, D. Shopbots become agents for business change, IEEE Computer, Vol. 33, Issue 2, 2000

References

1. "Shopping Comparison Engines market worth £120m-£140m in 2005, says E-consultancy". Ukprwire.com. 2006-04-12. Retrieved 2013-10-17.
2. "50 Best Websites 2008 - TIME". Time. 2008-06-17. ISSN 0040-781X. Retrieved 2017-03-22.
3. Steiner, Ina (7 January 2019). "What Happened to Comparison Shopping Engine NexTag?". EcommerceBytes.
4. Forbes December 16, 2005, at the Wayback Machine
5. "Experian Buys PriceGrabber.com For $485 Million". The Wall Street Journal. 14 December 2005. Retrieved 20 December 2017.
6. "The rise of price comparison sites in South East Asia". 18 December 2013.
7. "Episode 787: Google Is Big. Is That Bad?". NPR.org. Retrieved 31 July 2018.
8. Kelion, Leo (27 June 2017). "Google hit with record $2.7bn EU fine". BBC News. Retrieved 31 July 2018.
9. Wan, Y.; Menon, S.; Ramaprasad, A. (2003). "A Classification of Product Comparison Agents": 498–504. CiteSeerX 10.1.1.57.9018. {{cite journal}}: Cite journal requires |journal= (help)
10. . 8 May 1999. Archived from the original on 8 May 1999.
11. . Retrieved May 7th, 2010.
12. . Retrieved September 3rd, 2010.
13. Serenko, A., and Hayes, J. (2009). Investigating the functionality and performance of online shopping bots for electronic commerce: A follow-up study. International Journal of Electronic Business 8(1): 1-15.
14. Sadeddin K., Serenko, A. and Hayes, J. (2007). Online shopping bots for electronic commerce: The comparison of functionality and performance. International Journal of Electronic Business 5(6): 576-589.
15. Mulrean, Jennifer. How shopping bots really work
16. "Online Shoppers Are Rooting for the Little Guy". The New York Times. 16 January 2012.
17. "Get Rid of Autogenerated Content and Roundup/Comparison Type of Pages (Point 4)". Webconfs.com. Retrieved 2013-10-17.
18. "Shopping Search Engines Have Lost in the UK Google Panda/Quality Update". White.net. 2011-04-28. Retrieved 2013-10-17.
19. "Fake-Testseiten". www.testbericht.de (in German). Retrieved 2017-02-03.
20. "Verbraucherschutz: Hüten Sie sich vor diesen Warentest-Fake-Seiten - WELT". DIE WELT. Retrieved 2017-02-03.
21. . Kritzelblog (in German). 2017-01-11. Archived from the original on 2017-02-03. Retrieved 2017-02-03.
22. "Verbraucherschützer warnen vor Fake-Testseiten im Internet". idealo Magazin (in German). 2017-01-11. Retrieved 2017-02-03.
23. "European Commission - PRESS RELEASES - Press release - Antitrust: Commission fines Google €2.42 billion for abusing dominance as search engine by giving illegal advantage to own comparison shopping service". europa.eu. Retrieved 31 July 2018.
24. "Google's response to the European Commission fine - Hacker News". news.ycombinator.com. Retrieved 31 July 2018.
25. "8-K". www.sec.gov. Retrieved 2017-06-29.