Linux command 'whois' allows for retrieving data about particular domain age. Unfortunately, there is a limit on the number of operations that can be performed. I was wondering if it is possible to use different IP addresses via Crawlera. Is there any solution?
Best Answer
n
nestor
said
over 5 years ago
'whois' runs on TCP protocol, Crawlera is an HTTP proxy so it's not going to work. You can:
dkajtoch
Linux command 'whois' allows for retrieving data about particular domain age. Unfortunately, there is a limit on the number of operations that can be performed. I was wondering if it is possible to use different IP addresses via Crawlera. Is there any solution?
'whois' runs on TCP protocol, Crawlera is an HTTP proxy so it's not going to work. You can:
A) Use something like http://whois.domaintools.com/ or any other HTTP 'whois' service and scrape the results
B) Use a SOCKS proxy.
See: https://unix.stackexchange.com/questions/367409/how-do-you-use-proxy-with-the-whois-command
nestor
'whois' runs on TCP protocol, Crawlera is an HTTP proxy so it's not going to work. You can:
A) Use something like http://whois.domaintools.com/ or any other HTTP 'whois' service and scrape the results
B) Use a SOCKS proxy.
See: https://unix.stackexchange.com/questions/367409/how-do-you-use-proxy-with-the-whois-command
-
Crawlera 503 Ban
-
Amazon scraping speed
-
Website redirects
-
Error Code 429 Too Many Requests
-
Bing
-
Subscribed to Crawlera but saying Not Subscribed
-
Selenium with c#
-
Using Crawlera with browsermob
-
CRAWLERA_PRESERVE_DELAY leads to error
-
How to connect Selenium PhantomJS to Crawlera?
See all 395 topics