Start a new topic
Answered

How I can call Crawlera in PERL script?

How i can call Crawlera in PERL script


Best Answer

This should work: 

#!/usr/bin/perl
use LWP::UserAgent;
my $agent = LWP::UserAgent->new();
$agent->proxy(['http', 'https'], "http://APIKEY:@proxy.crawlera.com:8010");
print $agent->get('http://httpbin.scrapinghub.com/ip')->content();

 


It seems some firewall blocking the Crawlera proxy port. Can you please check the firewalls and open the port 8010.



Hi,


When I run this script from my local XP machine, it works fine but when I do the same from a remote server running on Linux, it says: 500 Can't connect to proxy.crawlera.com:8010 (connect: Connection refused).


Can you tell me what the issue could be? Thanks

Answer

This should work: 

#!/usr/bin/perl
use LWP::UserAgent;
my $agent = LWP::UserAgent->new();
$agent->proxy(['http', 'https'], "http://APIKEY:@proxy.crawlera.com:8010");
print $agent->get('http://httpbin.scrapinghub.com/ip')->content();

 

Login to post a comment