web crawlers
Choose a category below to quickly discover all our device intelligence articles.
List of Web Crawlers and Their User-Agents
Letting web crawlers reach your pages is still how you get into Google and Bing. It is now also how you...
Introduction to Bot Traffic — Part One of our Bot Analytics Series
As much as 40% of internet traffic is from non-human sources. This traffic ranges from legitimate bots...
Dark Traffic and Misrepresentation - Analysing the Web Analysers (Part 2)
In part 1 of our Web Analytics Comparison: Analysing the Web Analysers post, we presented research findings...
Website Analytics Comparison - Analysing the Web Analysers (Part 1)
Analysing visitor traffic is important to determine the health of a website. In this article, we present...
Bot Analytics Series Part 2: The Importance of Monitoring Bot Traffic
Analysing your bot traffic can help you understand how your site is being used (for example by preview...
6 not so obvious ways companies can use device detection
With so many devices connected to the internet most companies have understood the need for a reliable...
How DeviceAtlas can protect your site against bots
Non-human traffic is larger than most business owners are aware of. This is mainly due to the fact that...
Bots and Crawlers May Represent up to 50% of Web Traffic
Dublin – May 12, 2016 – DeviceAtlas, a leading supplier of intelligence on mobile devices, today released...
