Just a Crawler

最新推荐文章于 2023-06-10 02:53:36 发布

原创最新推荐文章于 2023-06-10 02:53:36 发布 · 892 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#url #output #csv #login #google #email

开源软件同时被 3 个专栏收录

45 篇文章

订阅专栏

Perl

44 篇文章

订阅专栏

WEB技术

20 篇文章

订阅专栏

本文介绍了一段Perl脚本，该脚本用于登录Google并爬取特定关键词的数据，然后将这些数据保存到本地文件中。需要注意的是，由于Google可能会禁止此类行为，脚本有时可能无法正常工作。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

use strict;
use WWW::Mechanize;
use HTTP::Cookies;

###go to login page and login.
#my $url = 'https://www.google.com/accounts/ServiceLogin?hl=en&service=finance&nui=1&continue=http%3A%2F%2Ffinance.google.com%2Ffinance';
my $url = 'https://accounts.google.com/ServiceLogin';
my $username = $ARGV[0];
my $password = $ARGV[1];
my $keyword = $ARGV[2];
my $outputfile = $ARGV[3];
chomp($username);
chomp($password);
chomp($keyword);
chomp($outputfile);

print "usr: $username\n";
print "psw: $password\n";
print "keyword: $keyword\n";
print "output: $outputfile\n";
print "Searching ......\n";

my $mech = WWW::Mechanize->new();
$mech->cookie_jar(HTTP::Cookies->new());
$mech->get($url);
$mech->form_number(1);
$mech->field(Email => $username);
$mech->field(Passwd => $password);
$mech->click();
#Go to the next link, now that we are logged in.
#$url = 'http://www.google.com/trends/viz?q=alan+kay&graph=all_csv&sa=N';
$url = 'http://www.google.com/trends/viz?q='.$keyword.'&date=all&geo=cn&graph=all_csv&scale=1&sa=N';
#$url = 'http://finance.google.com/finance/portfolio?action=view&pid=1&pview=pview&output=csv';

$mech->get($url);
my $output_page = $mech->content();

my $fh;
open $fh, ">$outputfile";
print $fh $output_page;