How I can call Crawlera in PERL script? - Zyte

How can we help you today?

Start a new topic

Answered

How I can call Crawlera in PERL script?

G

Gopal Velkan

started a topic almost 5 years ago

How i can call Crawlera in PERL script

Best Answer

n

nestor said almost 5 years ago

This should work:

#!/usr/bin/perl
use LWP::UserAgent;
my $agent = LWP::UserAgent->new();
$agent->proxy(['http', 'https'], "http://APIKEY:@proxy.crawlera.com:8010");
print $agent->get('http://httpbin.scrapinghub.com/ip')->content();

3 Comments

nestor

said almost 5 years ago

Answer

This should work:

#!/usr/bin/perl
use LWP::UserAgent;
my $agent = LWP::UserAgent->new();
$agent->proxy(['http', 'https'], "http://APIKEY:@proxy.crawlera.com:8010");
print $agent->get('http://httpbin.scrapinghub.com/ip')->content();

R

Rajesh Singh

said over 2 years ago

Hi,

When I run this script from my local XP machine, it works fine but when I do the same from a remote server running on Linux, it says: 500 Can't connect to proxy.crawlera.com:8010 (connect: Connection refused).

Can you tell me what the issue could be? Thanks

thriveni

said over 2 years ago

It seems some firewall blocking the Crawlera proxy port. Can you please check the firewalls and open the port 8010.

Login to post a comment

More topics in Technical Help

See all 354 topics