|
|
|
|
|
|
| Webtools 4 larbin |
| 点击量: |
|
Larbin 是一个Web 爬虫,用于抓取大量网页,在一台标准PC上,它应该能够抓取多于100 百万个页面。这套PHP 和Perl 脚本,称为webtools4larbin,可以处理Larbin的输出。
Larbin is a Web crawler intended to fetch a large number of Web pages, it should be able to fetch more than 100 millions pages on a standard PC with much u/d. This set of PHP and Perl scripts, called webtools4larbin, can handle the output of Larbin.
- 数据库环境:PHP Pear::DB
- 目标用户:Advanced End Users, Developers, Information Technology
- 开源协议:GPL
- 操作系统:Cygwin (MS Windows), All POSIX (Linux/BSD/UNIX-like OSes), OS Portable (Source code to work with many OS platforms), Linux
- 编程语言:C++, Perl, PHP
- 主题:Database, Dynamic Content, Indexing/Search
- Translations: 英语
- 用户接口:Console/Terminal, Web-based
|
|
|
| [返回顶部↑]
[推荐好友]
[查看评论] |
|
|
|
|
|
|
|
|