So, let's start off with the simple website list crawl. So settings for this is covered by the general crawl settings and these apply to all the other types of crawl as well, such as the Search crawl and the Endless cruel, so pretty simple really. Delay between each request to a website. One second, this is in seconds. Secondly, concurrent websites crawl how many websites you want to crawl at any one point in time and then how many threads will concurrently crawl per website. So that's ten, a crawl of ten websites at once, and each of those websites there's three different threads crawling. That's 30 concurrent connections you've got going.
Warehousing: I have no clue to a percentage of warehoused domains but I know it happens. Tucows even admitted it on my blog “I know you don’t like that we’re allowed to select expiring names for the Tucows Portfolio rather than letting them all go to auction or drop but that seems to be something we have to agree to disagree about.” ~ Ken Schafer (1st comment) http://www.dotweekly.com/could-you-explain-tucows
Searching for a suitable domain name for your website can be quite trying. The reason for this is that the names that you want to get have already been assigned and are not available. As an SEO you know the importance of getting a domain name that describes your business as closely as possible. For example, if you are running a car rental service, you will look for a domain name that has the words ‘car’ and ‘rental’ in it. So if you can’t find a suitable name, you could use the expired domains tool which might show you domain names that would meet your requirements.
Of course, this does not happen equally across the board. Some site owners are lazy and barely put in any effort. As you can probably tell, the four situations I outlined above probably will not occur for website owners who are lazy. Now, for website owners who put in the work and the time for their online properties, you can bet that they would get to benefit from the four situations outlined above.
Some jerk stole my .com domain name after I had owned it for 10 years and accidentally let it expire, and he’s trying to extort lots of money from me for its return. On the site where it says who owns it, it says “Domain Status: clientTransferProhibited”. What does that mean? The domain expires on September 26. He’ll probably automatically renew it, like he has for the past couple of years. But in case it becomes available, I want to grab it. I’m the only person in the world with my name, and I posted at a blog for 10 years with that domain name. So I’m really upset I don’t have my own name anymore.
DomCop has a great offer that all of you buying expired domains should consider. For the price of a couple domain names, you can use DomCop for a month, snag some excellent domain names, which would otherwise cost you thousands of dollars. If you're considering expired domain software and don't have the knowledge to program your own crawler, I'd lean towards DomCop.
Here's an old post on search engine roundtable that claims google's policy is to discount previous backlink juice when a domain changes ownership. I'm not convinced whether this is actually true or something Google says to discourage excessive domain buying / 301 redirecting for SEO benefit. The comments above seem to give varying opinions on this matter. Would be great to get to the bottom of that one!
If the domain name is not with any auction house partner (I think that’s what you’re saying), then you can use a drop catch service anytime: https://www.domainsherpa.com/domain-name-backorder-services/ They do not make your order public information as NameJet and others do by sharing how many bids are placed on a domain name and thereby driving interest.
Since high quality expired domains are in low supply, the huge numbers of marketers competing for those drop domains tend to drive prices up. Also, if you use an exchange, you’re basically lucky to get whatever you can afford. In other words, niche specificity isn't guaranteed. This is going to be a problem because as Google continues to evolve, it is cracking down on domain niche relevance. In other words, its software is fast evolving to the point that it can tell what the niche of a particular domain is. If your private blog network is a patchwork of expired domains that involve many different and dissimilar niches, then you might be in trouble. You are at great risk of being penalized by Google.
If you *really* want to be sure the auction partner is NameJet (because it’s a name you cannot afford to lose in the drop), you can email the technical support team at SRSPLUS and ask them if they follow the same expiration/auction procedures as Network Solutions. Be specific and ask, “Will the domain name, (fill in), expire and be available for auction on NameJet.com as the process is listed at https://www.domainsherpa.com/how-to-grab-an-expiring-domain-name/?”