How I can call Crawlera in PERL script? - Zyte

How can we help you today?

Start a new topic

Answered

How I can call Crawlera in PERL script?

G

Gopal Velkan

started a topic over 4 years ago

How i can call Crawlera in PERL script

Best Answer

n

nestor said over 4 years ago

This should work:

#!/usr/bin/perl
use LWP::UserAgent;
my $agent = LWP::UserAgent->new();
$agent->proxy(['http', 'https'], "http://APIKEY:@proxy.crawlera.com:8010");
print $agent->get('http://httpbin.scrapinghub.com/ip')->content();

3 Comments

thriveni

said about 2 years ago

It seems some firewall blocking the Crawlera proxy port. Can you please check the firewalls and open the port 8010.

R

Rajesh Singh

said about 2 years ago

Hi,

When I run this script from my local XP machine, it works fine but when I do the same from a remote server running on Linux, it says: 500 Can't connect to proxy.crawlera.com:8010 (connect: Connection refused).

Can you tell me what the issue could be? Thanks

nestor

said over 4 years ago

Answer

This should work:

#!/usr/bin/perl
use LWP::UserAgent;
my $agent = LWP::UserAgent->new();
$agent->proxy(['http', 'https'], "http://APIKEY:@proxy.crawlera.com:8010");
print $agent->get('http://httpbin.scrapinghub.com/ip')->content();

Login to post a comment

More topics in Technical Help

See all 350 topics