DataHub v1 is the original DataHub catalog of 11,000+ open datasets, now migrated to PortalJS Arc.
Dataset

Bulk Domain Names CSV Files -- varocarbas.com -- weekly updated

List of valid web domain names collected by the (bulk) crawling bots (stage-1 bots) running on varocarbas.com.

26-Oct-2014
9-Nov-2014
16-Nov-2014
23-Nov-2014
30-Nov-2014
07-Dec-2014
14-Dec-2014
21-Dec-2014
28-Dec-2014
04-Jan-2015
11-Jan-2015
18-Jan-2015
30-Jan-2015
About

List of valid web domain names collected by the (bulk) crawling bots (stage-1 bots) running on varocarbas.com.

These bots perform a blind recursive analysis of links, based on the "everything is connected" idea. That is: they started in a given webpage and are expected to retrieve a relevant proportion of all the existing domain names.

Download & API
26-Oct-2014csv
1311590 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
9-Nov-2014csv
1492116 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
16-Nov-2014csv
1584796 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
23-Nov-2014csv
1724833 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
30-Nov-2014csv
1856528 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
07-Dec-2014csv
1996006 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
14-Dec-2014csv
2121660 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
21-Dec-2014csv
2244637 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
28-Dec-2014csv
2354881 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
04-Jan-2015csv
2464134 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
11-Jan-2015csv
2542551 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
18-Jan-2015csv
2638794 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com.
Download
30-Jan-2015csv
2738176 valid web domain names collected by the bulk-retrieval (stage-1) bots running on varocarbas.com. As an immediate consequence of the recent crawling-bots stopping (http://varocarbas.com/search_engine/blog/bots-completely-stopped/), this will be the last CSV file which I will be uploading; at least, within the next months.
Download
Sources & license
License
  • Other (Public Domain)