抓取github上的android源码地址做批量下载

大家都知道啊，想下载一份android源代码学习学习真的是不容易啊，起初是下载慢，现在都下不了了！好在我们知道android源码其实在github是有的，我们完全可以下载github上的，但是比较麻烦的是github上的源码没有官方的使用repo那么方便，而是有很多个文件，需要一个一个下载，最近做一个项目用到了php中的一个解析html的工具叫simple_html_dom.php,大家可以在网上搜一下，用法和jquery有些相似，用它解析网页还是挺不错的啊，我就使用他写了个php小程序，将github上的android源码所有地址抓了出来，这样就可以使用下载工具批量下载了！

贴上php代码，其实很简单：

<?php
include"simple_html_dom.php";
$arr = array();
for($i = 0;$i < 5; $i ++) {
    $page = $i == 0? "" : "?page=".$i;
    $url = "https://github.com/android".$page;
    $html = file_get_contents($url);
    $html = str_get_html($html);
    $arr = array_merge($arr, $html->find('h3[class=repo-list-name] a'));
}

foreach($arr as $val) {
    $text = trim($val->innertext);
    echo "https://codeload.github.com/android/".$text."/zip/master<br/>";
}

<pre name="code" class="html">

下面是赚取到所有地址，可以直接复制过去下载的啊！

https://codeload.github.com/android/platform_build/zip/master
https://codeload.github.com/android/platform_bionic/zip/master
https://codeload.github.com/android/kernel_common/zip/master
https://codeload.github.com/android/platform_system_core/zip/master
https://codeload.github.com/android/platform_frameworks_base/zip/master
https://codeload.github.com/android/platform_external_openssl/zip/master
https://codeload.github.com/android/platform_packages_apps_settings/zip/master
https://codeload.github.com/android/platform_external_qemu/zip/master
https://codeload.github.com/android/platform_packages_providers_mediaprovider/zip/master
https://codeload.github.com/android/platform_external_skia/zip/master
https://codeload.github.com/android/platform_frameworks_support/zip/master
https://codeload.github.com/android/platform_manifest/zip/master
https://codeload.github.com/android/platform_external_fdlibm/zip/master
https://codeload.github.com/android/platform_development/zip/master
https://codeload.github.com/android/platform_external_emma/zip/master
https://codeload.github.com/android/platform_external_neven/zip/master
https://codeload.github.com/android/platform_external_strace/zip/master
https://codeload.github.com/android/platform_external_protobuf/zip/master
https://codeload.github.com/android/platform_packages_apps_camera/zip/master
https://codeload.github.com/android/platform_packages_apps_browser/zip/master
https://codeload.github.com/android/platform_build/zip/master
https://codeload.github.com/android/platform_bionic/zip/master
https://codeload.github.com/android/kernel_common/zip/master
https://codeload.github.com/android/platform_system_core/zip/master
https://codeload.github.com/android/platform_frameworks_base/zip/master
https://codeload.github.com/android/platform_external_openssl/zip/master
https://codeload.github.com/android/platform_packages_apps_settings/zip/master
https://codeload.github.com/android/platform_external_qemu/zip/master
https://codeload.github.com/android/platform_packages_providers_mediaprovider/zip/master
https://codeload.github.com/android/platform_external_skia/zip/master
https://codeload.github.com/android/platform_frameworks_support/zip/master
https://codeload.github.com/android/platform_manifest/zip/master
https://codeload.github.com/android/platform_external_fdlibm/zip/master
https://codeload.github.com/android/platform_development/zip/master
https://codeload.github.com/android/platform_external_emma/zip/master
https://codeload.github.com/android/platform_external_neven/zip/master
https://codeload.github.com/android/platform_external_strace/zip/master
https://codeload.github.com/android/platform_external_protobuf/zip/master
https://codeload.github.com/android/platform_packages_apps_camera/zip/master
https://codeload.github.com/android/platform_packages_apps_browser/zip/master
https://codeload.github.com/android/platform_external_webkit/zip/master
https://codeload.github.com/android/kernel_msm/zip/master
https://codeload.github.com/android/platform_external_ppp/zip/master
https://codeload.github.com/android/platform_hardware_libhardware/zip/master
https://codeload.github.com/android/platform_external_libxml2/zip/master
https://codeload.github.com/android/platform_dalvik/zip/master
https://codeload.github.com/android/platform_external_dhcpcd/zip/master
https://codeload.github.com/android/platform_external_elfutils/zip/master
https://codeload.github.com/android/platform_external_tinyxml/zip/master
https://codeload.github.com/android/platform_external_oprofile/zip/master
https://codeload.github.com/android/platform_external_netperf/zip/master
https://codeload.github.com/android/platform_external_netcat/zip/master
https://codeload.github.com/android/platform_external_libpng/zip/master
https://codeload.github.com/android/platform_external_libpcap/zip/master
https://codeload.github.com/android/platform_external_libffi/zip/master
https://codeload.github.com/android/platform_external_jpeg/zip/master
https://codeload.github.com/android/platform_external_jhead/zip/master
https://codeload.github.com/android/platform_external_jdiff/zip/master
https://codeload.github.com/android/platform_external_iptables/zip/master
https://codeload.github.com/android/platform_external_icu4c/zip/master
https://codeload.github.com/android/platform_external_giflib/zip/master
https://codeload.github.com/android/platform_external_freetype/zip/master
https://codeload.github.com/android/platform_external_expat/zip/master
https://codeload.github.com/android/platform_external_esd/zip/master
https://codeload.github.com/android/platform_external_dropbear/zip/master
https://codeload.github.com/android/platform_external_apache-http/zip/master
https://codeload.github.com/android/platform_external_sonivox/zip/master
https://codeload.github.com/android/platform_packages_providers_telephonyprovider/zip/master
https://codeload.github.com/android/platform_packages_providers_downloadprovider/zip/master
https://codeload.github.com/android/platform_packages_providers_contactsprovider/zip/master
https://codeload.github.com/android/platform_packages_providers_calendarprovider/zip/master
https://codeload.github.com/android/platform_packages_apps_voicedialer/zip/master
https://codeload.github.com/android/platform_packages_apps_stk/zip/master
https://codeload.github.com/android/platform_packages_apps_soundrecorder/zip/master
https://codeload.github.com/android/platform_packages_apps_phone/zip/master
https://codeload.github.com/android/platform_packages_apps_packageinstaller/zip/master
https://codeload.github.com/android/platform_packages_apps_music/zip/master
https://codeload.github.com/android/platform_packages_apps_mms/zip/master
https://codeload.github.com/android/platform_packages_apps_htmlviewer/zip/master
https://codeload.github.com/android/platform_packages_apps_email/zip/master
https://codeload.github.com/android/platform_packages_apps_contacts/zip/master
https://codeload.github.com/android/platform_packages_apps_calendar/zip/master
https://codeload.github.com/android/platform_packages_apps_calculator/zip/master
https://codeload.github.com/android/platform_hardware_ril/zip/master
https://codeload.github.com/android/platform_external_zlib/zip/master
https://codeload.github.com/android/platform_external_yaffs2/zip/master
https://codeload.github.com/android/platform_external_tcpdump/zip/master
https://codeload.github.com/android/platform_external_tagsoup/zip/master
https://codeload.github.com/android/platform_external_srec/zip/master
https://codeload.github.com/android/platform_external_sqlite/zip/master
https://codeload.github.com/android/platform_external_safe-iop/zip/master
https://codeload.github.com/android/platform_system_bluetooth/zip/master
https://codeload.github.com/android/platform_prebuilt/zip/master
https://codeload.github.com/android/platform_packages_providers_drmprovider/zip/master
https://codeload.github.com/android/platform_external_ping/zip/master
https://codeload.github.com/android/platform_external_dbus/zip/master
https://codeload.github.com/android/tools_repo/zip/master
https://codeload.github.com/android/android.github.io/zip/master
https://codeload.github.com/android/platform_external_wpa_supplicant/zip/master
https://codeload.github.com/android/platform_packages_apps_googlesearch/zip/master
https://codeload.github.com/android/platform_system_wlan_ti/zip/master
https://codeload.github.com/android/platform_packages_providers_googlecontactsprovider/zip/master
https://codeload.github.com/android/platform_packages_apps_im/zip/master
https://codeload.github.com/android/platform_packages_providers_improvider/zip/master
https://codeload.github.com/android/platform_external_tremor/zip/master
https://codeload.github.com/android/platform_packages_apps_sync/zip/master
https://codeload.github.com/android/platform_packages_apps_alarmclock/zip/master
https://codeload.github.com/android/platform_external_aes/zip/master
https://codeload.github.com/android/platform_external_clearsilver/zip/master
https://codeload.github.com/android/platform_external_googleclient/zip/master
https://codeload.github.com/android/platform_packages_apps_launcher/zip/master
https://codeload.github.com/android/platform_external_bluez/zip/master
https://codeload.github.com/android/platform_external_gdata/zip/master
https://codeload.github.com/android/platform_frameworks_opt_com.google.android/zip/master
https://codeload.github.com/android/platform_external_elfcopy/zip/master
https://codeload.github.com/android/platform_frameworks_policies_base/zip/master
https://codeload.github.com/android/platform_packages_apps_updater/zip/master
https://codeload.github.com/android/platform_external_opencore/zip/master

等下载完了，写个shell脚本整理下目录就ok了，下载还是很快的哟！改天再把脚本文件写上来啊！呵呵，