|
It is very difficult to research a database of backlinks and come to completely unbiased conclusions. Below, we've summarized the key points you should keep in mind when doing any backlink research. Backlink index types Every backlink index is unique because each company takes a different approach to crawling to count and store backlink data. Therefore, comparing backlink indexes has the major drawback of analyzing essentially different databases. In our research, we accessed data through APIs, and the data they return is as follows: Ahrefs Live index (any existing link; it is considered a live link until it is re-crawled and determined to be missing) Semrush Fresh index (any links crawled in the last 6 months) Majestic Fresh index (all links crawled in the last 4 months) The SEO PowerSuite backlink index includes all existing links (similar to Ahrefs, links in our index are treated as existing links until they are re-crawled and determined to be missing). Unlike Ahrefs and SEO PowerSuite, Semrush and Majestic include existing and non-existing links in their reports. As a result, there are often large differences in the number of backlinks.
For example, if you look at Amazon.com's backlinks on Semrush, you'll see that the domain has over 18 billion backlinks (a number you can also see via the API). However, when you switch to active link mode, only 7 million links are displayed. Although Ahrefs' index includes Belgium Phone Number Data existing links, some discrepancies can still be observed. Ahrefs' API returns a number of backlinks of 114 million, which is close to the number shown in the summary dashboard. However, when you switch to the backlinks report, you only see 35 million links. While there may be a good explanation behind this discrepancy (perhaps low-quality or dead links were filtered out), we can draw two important conclusions from this. You can't be 100% sure about the backlink index you can get with the API. These discrepancies cannot be excluded from the study. Differences in how the number of links is calculated Another challenge faced when comparing backlink indexes is the different ways in which link counts are calculated. For example, duplicate links within the same page can be calculated as one link or as multiple links. The same can be said for redirects and canonicals.

All of these things affect the total count, so you can't just take the numbers at heart when comparing backlink indexes. Differences in how to record IP Similarly, how backlink API providers record IP data matters. Many providers only count the most recent IPs they discover when looking for backlinks. This means that only one IP is recorded for each domain. However, Semrush appears to record every IP it detects in the past six months. Therefore, there is a possibility that dozens of IPs are recorded for the same domain. IP/subnet statistics are included within the raw data . Initially, we planned to use this number in our report. However, they noticed significant differences in the IP calculations and decided that this statistical data should not be used to draw any meaningful conclusions. Different understandings of reference domains A domain is, of course, a domain. However, our research shows that when it comes to indexing backlinks, things get a little more complicated. According to VeriSign , "In the second quarter of 2021, the number of all top-level domains was 36730 domains." And while many data providers match the number of domains indexed (Ahrefs has 193.4 million domains, SEO PowerSuite has 264 million), Semrush holds 1.6 billion domains. This is a skeptical figure. In this way, what Semrush calculates as a unique domain seems to be different from the general concept.
|
|