Follow Seo Tricks: Spam

<div dir="ltr" style="text-align: left;" trbidi="on">
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">You know what really grinds my gears? Opening up a report in Google Analytics and having to deal with referral spam. In this post, I’ll tell you how to deal with referral spam and why it’s dangerous.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /><em><a href="http://viget.com/advance/removing-referral-spam-from-google-analytics#solutions" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">Click here to go straight to the solutions...</a></em></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<img alt="referral spam grinds my gears" src="http://viget.com/uploads/image/blog/grindsmygears.jpg" style="-webkit-box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 0px; box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; box-sizing: border-box; display: block; height: 228px; line-height: 1.6em; margin-bottom: 20px; max-width: 100%; padding: 5px; vertical-align: middle; width: 301px;" /></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
In the past year, I’ve noticed an alarming trend of referral spam creeping into my Google Analytics reports. Referral spam is the practice of sending bogus referral traffic to a website or product. It may sound relatively harmless, but referral spam is quickly turning into a serious issue.</div>
<h2 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em; text-transform: uppercase;">
TYPES OF REFERRAL SPAM</h2>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">In the context of Google Analytics, referral spam comes in two main flavors: spammy web crawlers and ghost referral traffic.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Web crawlers are robots that visit websites, usually with the intention of indexing content. Most web crawlers identify <a href="http://en.wikipedia.org/wiki/Web_crawler#Crawler_identification" style="color: #1496bb; text-decoration: none;">themselves as such</a> to web servers and are then left out of analytics reports. However, some web crawlers like those from</span><span style="line-height: 1.6em;"> </span><a href="http://www.incapsula.com/blog/semalt-botnet-spam.html" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">Semalt</a><span style="line-height: 1.6em;"> (<a href="http://media.giphy.com/media/WrxoaVPiq0cG4/giphy.gif" style="color: #1496bb; text-decoration: none;">boo!</a>) don’t identify themselves as robots and end up showing up in analytics reports as sessions with a 100% bounce rate and 0 second duration. Google recently introduced a feature to </span><a href="http://www.lunametrics.com/blog/2014/08/07/bot-spider-filtering-google-analytics/" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">filter out known bots and spiders</a><span style="line-height: 1.6em;">, though it’s definitely not perfect (more on that later).</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Ghost referral traffic, arguably the greater of the two referral spam evils, never actually visits a website. In these cases, spammers exploit the fact that Google Analytics now transfers information via HTTP requests <a href="https://developers.google.com/analytics/devguides/collection/protocol/v1/" style="color: #1496bb; text-decoration: none;">directly to Google Analytics servers</a>, meaning someone can “spoof” a session very easily. Ghost referral traffic can be generated by a simple program that sends fake HTTP requests aimed at different Google Analytics properties, so this traffic doesn’t even hit your site. Even more annoying is the fact that this type of spam can be used to spoof organic search results, as well. See the screenshot below for an example:</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /><img alt="Google Analytics Spam Traffic Report" src="http://viget.com/uploads/image/blog/1.png" style="-webkit-box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 0px; box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; box-sizing: border-box; display: block; height: 305px; margin-bottom: 20px; max-width: 100%; padding: 5px; vertical-align: middle; width: 749px;" /></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<em style="line-height: 1.6em;">Note: For ghost referral traffic, modifying <a href="http://en.wikipedia.org/wiki/.htaccess" style="color: #1496bb; text-decoration: none;">.htaccess</a> won’t help at all since these spammers never actually visit your site -- for more information <a href="https://developers.google.com/analytics/devguides/collection/protocol/v1/" style="color: #1496bb; text-decoration: none;">view Google's Measurement Protocol documentation</a>.</em></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<h2 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em; text-transform: uppercase;">
NEGATIVE IMPLICATIONS</h2>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<blockquote style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; font-style: italic; line-height: 28.8000011444092px; margin: 1em 40px; position: relative;">
“A referrer is a simple HTTP header that's passed along when a browser goes from one page to another page, normally used to indicate where a user's coming from. But users can change it, and some people will set referrer at pages they want to promote and visit tons of people around the web -- people see it and say 'Oh, I should check it out'. It's not necessarily a link… there are some people who try to drive traffic by visiting a ton of websites with an automated script and setting the referrer to be the URL they want to promote... there's no 'authentication'… You can’t automatically assume that it was the owner of the URL if you see something showing up in your dashboard. Somebody is trying to do some hijinx.”<br />
- <a href="https://www.youtube.com/watch?v=QufRT-Gd-UI" style="color: #1496bb; text-decoration: none;">Matt Cutts</a>, Head of Google Webspam Team</blockquote>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
So, why is referral spam so bad? For one, it’s screwing up my web analytics data. “Sessions” entering via referral spam skew the data, clouding the accuracy of engagement metrics and inflating traffic volume metrics. Unfortunately, those unaware of spam issues may base decisions based on inaccurate data, especially for sites with low traffic.</div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Moreover, referral spam makes SEO more difficult for everyone. One aim of referral spam is to have </span><a href="http://en.wikipedia.org/wiki/Referer_spam" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">links from sites that publish their access logs</a><span style="line-height: 1.6em;">. </span><span style="line-height: 1.6em;">Some websites publish web analytics data publicly, which can include hyperlinks back to the spammer’s designated URL. These backlinks can improve search engine results for that URL since many websites publishing referrer data are presumably trustworthy.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">There are also more nefarious opportunities available to referral spammers. If a spammer wanted to send a website unwanted and unqualified traffic, they could simply change the name of the referral URL to the victim’s URL. As mentioned in the above quote from Matt Cutts, referral spam can’t truly be “authenticated” and tracked back to a specific source. With this in mind, referral spam could be used to harm reputations, possibly framing an innocuous website as a spam referrer.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Exposure to malware is another potential threat to anyone curious enough to visit referral spam addresses. With the rise of electronic data theft, it would be simple for referrer spam networks to point to URLs containing malicious software aimed at stealing valuable information.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Finally, no one wants to be advertised to while looking at web analytics acquisition reports.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<a href="https://www.blogger.com/null" name="solutions" style="color: #1496bb;"></a></div>
<h2 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em; text-transform: uppercase;">
SOLUTIONS</h2>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Within Google Analytics, there are multiple options to remove referral spam:</span></div>
<h3 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em;">
<span style="line-height: 1.6em;">Exclude Foreign Hostnames and Filter Spammy Crawlers</span></h3>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">One defining attribute of many ghost referrals is an inaccurate hostname attribution. When reviewing referral data in Google Analytics, the hostname will be completely unrelated to your website (e.g., “apple.com”). With this knowledge, it’s relatively simple to create a filter to only include data with an accurate hostname. For Google Analytics users using only one or a handful of domains, this solution may be the simplest (<a href="https://support.google.com/analytics/answer/1034324?hl=en" style="color: #1496bb; text-decoration: none;">check here for a quick refresher on regular expressions in GA</a>):</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<img alt="Google Analytics Hostname Filter" src="http://viget.com/uploads/image/blog/2gaspam.png" style="-webkit-box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 0px; box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; box-sizing: border-box; display: block; height: 541px; margin-bottom: 20px; max-width: 100%; padding: 5px; vertical-align: middle; width: 500px;" /><br /><span style="line-height: 1.6em;">In most cases, substituting your top domain name for example.com will be sufficient. For multiple domains, check your regular expressions with </span><a href="http://regexpal.com/" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">Regex Pal</a><span style="line-height: 1.6em;">.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">That first filter will remove any ghost referral traffic. However, an additional filter will also be required to remove spammy web crawlers (like Semalt) since they actually visit the site and will report an accurate hostname. A filter to remove the two most popular web crawler offenders can be seen below:</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<img alt="Google Analytics Web Crawler Referral Filter" src="http://viget.com/uploads/image/blog/3gaspam.png" style="-webkit-box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 0px; box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; box-sizing: border-box; display: block; height: 545px; margin-bottom: 20px; max-width: 100%; padding: 5px; vertical-align: middle; width: 500px;" /><br /><span style="line-height: 1.6em;">Featured Regular Expression:</span></div>
<pre class="prettyprint linenums" style="background: rgb(254, 251, 243); border-radius: 3px; border: 1px solid rgb(230, 230, 230); color: #a8a8a8; font-family: Monaco, 'Courier New', monospace; font-size: 14px; font-stretch: normal; line-height: 1.8; overflow-x: scroll; padding: 0px; word-wrap: normal;"><ol class="linenums" style="-webkit-box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; margin: 0px; padding: 13px 0px 13px 45px;">
<li class="L0" style="margin: 0px; padding-left: 13px;"><code style="background: 0px 0px; border-radius: 3px; border: 0px; font-family: Monaco, 'Courier New', monospace; font-stretch: normal; line-height: 1.8; padding: 0px 5px; word-wrap: normal;"><span class="pun" style="color: #666600;">.*(</span><span class="pln" style="color: #414141;">semalt</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">buttons\-</span><span class="kwd" style="color: #000088;">for</span><span class="pln" style="color: #414141;">\-website</span><span class="pun" style="color: #666600;">)</span><span class="pln" style="color: #414141;">\.com</span><span class="pun" style="color: #666600;">.*</span></code></li>
</ol>
</pre>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<em style="line-height: 1.6em;">Note: You should always retain an unfiltered view, as data processed by GA filters cannot be reverted.</em></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<h3 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em;">
Filter All Referral Spam Sources</h3>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">In cases where domains in a measured view can easily change, blocking referral spam may require a more exhaustive referral filter encompassing all offending referral sites. Over the past few months, I’ve created a list of offending sites and updated the filter accordingly, as seen below. As a quick caveat, while this list targets many of the offending referral spam sources, it’s by no means an exhaustive list.<em> With the discovery of more spam referrals, I've updated the regular expressions below the image, and this solution will now require two Exclude Referral filters.</em></span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<img alt="Google Analytics Spam Referral Filter" src="http://viget.com/uploads/image/blog/gaspam.png" style="-webkit-box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 0px; box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; box-sizing: border-box; display: block; height: 468px; margin-bottom: 20px; max-width: 100%; padding: 5px; vertical-align: middle; width: 500px;" /><br /><span style="line-height: 1.6em;">Featured Regular Expressions:</span></div>
<pre class="prettyprint linenums" style="background: rgb(254, 251, 243); border-radius: 3px; border: 1px solid rgb(230, 230, 230); color: #a8a8a8; font-family: Monaco, 'Courier New', monospace; font-size: 14px; font-stretch: normal; line-height: 1.8; overflow-x: scroll; padding: 0px; word-wrap: normal;"><ol class="linenums" style="-webkit-box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; margin: 0px; padding: 13px 0px 13px 45px;">
<li class="L0" style="margin: 0px; padding-left: 13px;"><code style="background: 0px 0px; border-radius: 3px; border: 0px; font-family: Monaco, 'Courier New', monospace; font-stretch: normal; line-height: 1.8; padding: 0px 5px; word-wrap: normal;"><span class="pun" style="color: #666600;">.*((</span><span class="pln" style="color: #414141;">darodar</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">priceg</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">semalt</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">buttons\-</span><span class="kwd" style="color: #000088;">for</span><span class="pln" style="color: #414141;">\-website</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">makemoneyonline</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">blackhatworth</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">hulfingtonpost</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">bestwebsitesawards</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">o\-o\-</span><span class="lit" style="color: #006666;">6</span><span class="pln" style="color: #414141;">\-o\-o</span><span class="pun" style="color: #666600;">|(</span><span class="pln" style="color: #414141;">social</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">simple\-share</span><span class="pun" style="color: #666600;">)</span><span class="pln" style="color: #414141;">\-buttons</span><span class="pun" style="color: #666600;">)</span><span class="pln" style="color: #414141;">\.com</span><span class="pun" style="color: #666600;">)|((</span><span class="pln" style="color: #414141;">ilovevitaly</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">econom</span><span class="pun" style="color: #666600;">)(</span><span class="pln" style="color: #414141;">\.co</span><span class="pun" style="color: #666600;">(</span><span class="pln" style="color: #414141;">m</span><span class="pun" style="color: #666600;">)?|</span><span class="pln" style="color: #414141;">\.ru</span><span class="pun" style="color: #666600;">))|((</span><span class="pln" style="color: #414141;">humanorightswatch</span><span class="pun" style="color: #666600;">|</span><span class="lit" style="color: #006666;">4webmasters</span><span class="pun" style="color: #666600;">)</span><span class="pln" style="color: #414141;">\.org</span><span class="pun" style="color: #666600;">).*</span></code></li>
</ol>
</pre>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Update - I've added another regular expression since the first one has reached the 255 character limit.</span></div>
<pre class="prettyprint linenums" style="background: rgb(254, 251, 243); border-radius: 3px; border: 1px solid rgb(230, 230, 230); color: #a8a8a8; font-family: Monaco, 'Courier New', monospace; font-size: 14px; font-stretch: normal; line-height: 1.8; overflow-x: scroll; padding: 0px; word-wrap: normal;"><ol class="linenums" style="-webkit-box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; margin: 0px; padding: 13px 0px 13px 45px;">
<li class="L0" style="margin: 0px; padding-left: 13px;"><code style="background: 0px 0px; border-radius: 3px; border: 0px; font-family: Monaco, 'Courier New', monospace; font-stretch: normal; line-height: 1.8; padding: 0px 5px; word-wrap: normal;"><span class="pun" style="color: #666600;">.*</span><span class="pln" style="color: #414141;">best\-seo\-solution\.com</span><span class="pun" style="color: #666600;">.*</span></code></li>
</ol>
</pre>
<h3 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em;">
Advanced Segments for Historical Data</h3>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Since filters only process data moving forward, use advanced segments to review historical data from before filters were implemented. Similar to the above solutions, decide which approach is most appropriate for your site and use regular expressions to remove sessions from referral spam, as seen below::</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<img alt="Google Analytics Advanced Segment" src="http://viget.com/uploads/image/blog/4bgaspam.png" style="-webkit-box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 0px; box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; box-sizing: border-box; display: block; height: 498px; margin-bottom: 20px; max-width: 100%; padding: 5px; vertical-align: middle; width: 800px;" /><br /><span style="line-height: 1.6em;">Featured Regular Expressions:</span></div>
<pre class="prettyprint linenums" style="background: rgb(254, 251, 243); border-radius: 3px; border: 1px solid rgb(230, 230, 230); color: #a8a8a8; font-family: Monaco, 'Courier New', monospace; font-size: 14px; font-stretch: normal; line-height: 1.8; overflow-x: scroll; padding: 0px; word-wrap: normal;"><ol class="linenums" style="-webkit-box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; margin: 0px; padding: 13px 0px 13px 45px;">
<li class="L0" style="margin: 0px; padding-left: 13px;"><code style="background: 0px 0px; border-radius: 3px; border: 0px; font-family: Monaco, 'Courier New', monospace; font-stretch: normal; line-height: 1.8; padding: 0px 5px; word-wrap: normal;"><span class="pun" style="color: #666600;">.*((</span><span class="pln" style="color: #414141;">darodar</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">priceg</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">semalt</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">buttons\-</span><span class="kwd" style="color: #000088;">for</span><span class="pln" style="color: #414141;">\-website</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">makemoneyonline</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">blackhatworth</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">hulfingtonpost</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">bestwebsitesawards</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">o\-o\-</span><span class="lit" style="color: #006666;">6</span><span class="pln" style="color: #414141;">\-o\-o</span><span class="pun" style="color: #666600;">|(</span><span class="pln" style="color: #414141;">social</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">simple\-share</span><span class="pun" style="color: #666600;">)</span><span class="pln" style="color: #414141;">\-buttons</span><span class="pun" style="color: #666600;">)</span><span class="pln" style="color: #414141;">\.com</span><span class="pun" style="color: #666600;">)|((</span><span class="pln" style="color: #414141;">ilovevitaly</span><span class="pun" style="color: #666600;">|</span><span class="pln" style="color: #414141;">econom</span><span class="pun" style="color: #666600;">)(</span><span class="pln" style="color: #414141;">\.co</span><span class="pun" style="color: #666600;">(</span><span class="pln" style="color: #414141;">m</span><span class="pun" style="color: #666600;">)?|</span><span class="pln" style="color: #414141;">\.ru</span><span class="pun" style="color: #666600;">))|((</span><span class="pln" style="color: #414141;">humanorightswatch</span><span class="pun" style="color: #666600;">|</span><span class="lit" style="color: #006666;">4webmasters</span><span class="pun" style="color: #666600;">)</span><span class="pln" style="color: #414141;">\.org</span><span class="pun" style="color: #666600;">).*</span></code></li>
</ol>
</pre>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Update - I've added another regular expression since the first one has reached the 255 character limit.</span></div>
<pre class="prettyprint linenums" style="background: rgb(254, 251, 243); border-radius: 3px; border: 1px solid rgb(230, 230, 230); color: #a8a8a8; font-family: Monaco, 'Courier New', monospace; font-size: 14px; font-stretch: normal; line-height: 1.8; overflow-x: scroll; padding: 0px; word-wrap: normal;"><ol class="linenums" style="-webkit-box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; box-shadow: rgb(241, 238, 231) 40px 0px 0px inset, rgb(230, 230, 230) 41px 0px 0px inset; margin: 0px; padding: 13px 0px 13px 45px;">
<li class="L0" style="margin: 0px; padding-left: 13px;"><code style="background: 0px 0px; border-radius: 3px; border: 0px; font-family: Monaco, 'Courier New', monospace; font-stretch: normal; line-height: 1.8; padding: 0px 5px; word-wrap: normal;"><span class="pun" style="color: #666600;">.*</span><span class="pln" style="color: #414141;">best\-seo\-solution\.com</span><span class="pun" style="color: #666600;">.*</span></code></li>
</ol>
</pre>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<em style="line-height: 1.6em;">Note: Advanced Segments can be applied retroactively to historical data, while Filters only process data moving forward. If unfamiliar with segments and filters, a quick comparison summary between the two can be found <a href="https://brianclifton.com/blog/2009/12/09/how-to-choose-between-advanced-segments-versus-profile-filters-in-google-analytics/" style="color: #1496bb; text-decoration: none;">here</a>.</em></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<h3 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em;">
Bot Filtering within View Settings</h3>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">In July 2014, Google introduced </span><a href="https://plus.google.com/+GoogleAnalytics/posts/2tJ79CkfnZk" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">bot and spider filtering</a><span style="line-height: 1.6em;"> to give users more accurate data. From the admin view interface, you can select this option, as seen below. This will exclude any sessions named in the </span><a href="http://www.iab.net/1418/spiders" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">IAB known bots and spiders list</a><span style="line-height: 1.6em;"> (at no extra cost for you).</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
In theory, this is great! However, this feature is still new, and we’re still seeing referral spam from some web crawlers make its way through the bot and spider filtering. That said, there's no harm in checking the box, especially if Google decides to introduce more functionality to this feature.</div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<img alt="Google Analytics Bots and Spiders" src="http://viget.com/uploads/image/blog/5gaspam.png" style="-webkit-box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 0px; box-shadow: rgba(0, 0, 0, 0.2) 0px 2px 4px; box-sizing: border-box; display: block; height: 689px; margin-bottom: 20px; max-width: 100%; padding: 5px; vertical-align: middle; width: 500px;" /><br /><span style="line-height: 1.6em;">For those familiar with Google Tag Manager, I'd highly recommend reading Sayf Sharif's post </span><a href="http://www.lunametrics.com/blog/2015/03/19/eliminating-dumb-ghost-referral-traffic/" style="color: #1496bb; line-height: 1.6em; text-decoration: none;">Eliminating Dumb Ghost Referral Traffic in Google Analytics</a>.<br /> </div>
<h2 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em; text-transform: uppercase;">
LIST OF OFFENDING SITES</h2>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
The current list of offenders includes:</div>
<ul style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px; margin: 1em 0px 1em 20px; padding: 0px;">
<li>semalt.com</li>
<li style="margin-top: 10px;">buttons-for-website.com</li>
<li style="margin-top: 10px;">darodar.com</li>
<li style="margin-top: 10px;">priceg.com</li>
<li style="margin-top: 10px;">makemoneyonline.com</li>
<li style="margin-top: 10px;">blackhatworth.com</li>
<li style="margin-top: 10px;">hulfingtonpost.com</li>
<li style="margin-top: 10px;">bestwebsitesawards.com</li>
<li style="margin-top: 10px;">o-o-6-o-o.com</li>
<li style="margin-top: 10px;">ilovevitaly.com</li>
<li style="margin-top: 10px;">simple-share-buttons.com</li>
<li style="margin-top: 10px;">social-buttons.com</li>
<li style="margin-top: 10px;">best-seo-solution.com</li>
<li style="margin-top: 10px;">econom.co</li>
<li style="margin-top: 10px;">ilovevitaly.co</li>
<li style="margin-top: 10px;">ilovevitaly.ru</li>
<li style="margin-top: 10px;">humanorightswatch.org</li>
<li style="margin-top: 10px;">4webmasters.org</li>
</ul>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<h2 style="background-color: white; color: #545454; font-family: 'Calluna Sans Black', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 24px; font-weight: 400; margin: 2em 0px 0.5em; text-transform: uppercase;">
THIS ISN’T A LONG-TERM SOLUTION</h2>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<span style="line-height: 1.6em;">Unfortunately, the solutions above are just short-term band-aids at the moment. As spammers innovate, users of products like Google Analytics are in danger of falling prey to bogus referral traffic through more sophisticated means. Google and other web analytics providers will, hopefully, create new mechanisms to combat this referral spam. However, without some serious changes to the current system, the world of web analytics may be in for some unpleasant surprises. </span><span style="line-height: 1.6em;">To improve your GA setup in other ways, check out some of our other posts like: <a href="http://viget.com/advance/15-ways-your-google-analytics-might-be-broken-part-1" style="color: #1496bb; text-decoration: none;">15 Ways Your Google Analytics Might Be Broken</a>.</span></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
For reasons why <em>not</em> to use the Referral Exclusion List and much more on referral spam in general, check out Mike Sullivan's guide: <a href="http://www.analyticsedge.com/2014/12/removing-referral-spam-google-analytics/" style="color: #1496bb; text-decoration: none;">http://www.analyticsedge.com/2014/12/removing-referral-spam-google-analytics/</a></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
For a great visual walkthrough of referral spam solutions, view Carlos Escalera Alonso's recent write-up: <a href="http://www.ohow.co/block-referrer-spam-list/" style="color: #1496bb; text-decoration: none;">http://www.ohow.co/block-referrer-spam-list/</a></div>
<div style="background-color: white; color: #545454; font-family: 'Calluna Sans', 'Gill Sans', Calibri, 'Trebuchet MS', sans-serif; font-size: 19.2000007629395px; line-height: 28.8000011444092px;">
<br /></div>
</div>

Removing Referral Spam from Google Analytics

You know what really grinds my gears? Opening up a report in Google Analytics and having to deal with referral spam. In this post, I’ll te...