so we have a list of arround 2 billion URLS in a txt file. and we need to make each line in this array format array('WEBSITE.com', 'WEBSITE.net', 'WEBSITE.org'); so we can schedule each domain for a crawl with our new search engine. any help would be hot
You can post now and register later.
If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.
so we have a list of arround 2 billion URLS in a txt file. and we need to make each line in this array format
array('WEBSITE.com', 'WEBSITE.net', 'WEBSITE.org'); so we can schedule each domain for a crawl with our new search engine. any help would be hot