Then the number is an HRL so it’ll be quite a bit different then you’ll see an expired domains because domain pop service is not very good compared to HREFs. Usually this shows about 20 percent of the total lengths. This shows more like 80. Okay? As you can see it has actually 162 referring domains which is quite a lot better than we saw in expired domains.

So, let's start off with the simple website list crawl. So settings for this is covered by the general crawl settings and these apply to all the other types of crawl as well, such as the Search crawl and the Endless cruel, so pretty simple really. Delay between each request to a website. One second, this is in seconds. Secondly, concurrent websites crawl how many websites you want to crawl at any one point in time and then how many threads will concurrently crawl per website. So that's ten, a crawl of ten websites at once, and each of those websites there's three different threads crawling. That's 30 concurrent connections you've got going.

The great thing about this is that it’s kind of like a metasearch engine for all the places that you can find expired domains around the web. First, let’s look at deleted domains. Okay? To do that, you go click on the deleted domains button here and then click on any top level domain that you want to get. I prefer .com because it’s obviously the most common top level domain.


Regarding my statement above, “Any domain name that reaches expired status and is not renewed by the owner will be auctioned by an auction service.”–it did overstretch. I’ve modified it to be: “A domain name that reaches expired status and is not renewed by the owner will be listed at an auction service (see FAQ for exception to this rule).” Then I added a FAQ to clarify. Please check my thinking:
.ac .ae .af .ag .am .ar .as .at .au .aw .ax .be .bg .bi .bj .bn .bo .br .bw .by .bz .ca .cc .ch .ci .cl .cn .co .cr .cx .cz .de .dk .dm .do .ee .es .fi .fm .fo .fr .gd .gg .gi .gl .gs .gy .hk .hn .hr .ht .hu .id .ie .il .im .in .io .iq .ir .is .it .je .jp .ke .kg .ki .kr .ky .kz .la .lc .li .lt .lu .lv .ly .ma .md .me .mg .mk .mn .ms .mu .mx .nl .nc .nf .ng .no .nu .nz .om .pe .pf .pl .pm .pr .pt .pw .qa .re .ro .rs .ru .rw .sb .sc .se .sg .sh .si .sk .sm .sn .so .st .su .sx .tc .tf .th .tl .tn .to .tr .tv .tw .ua .ug .uk .us .uy .uz .vc .wf .yt .za
×