楼上(shàng )说的很(hěn )多,我补(bǔ )充(chōng )一下,正确的应该叫(jiào )网络蜘蛛,又称爬虫,本(běn )质(zhì )是(shì )搜索引(yǐn )擎(qíng )派出(chū )的一个执(zhí )行抓取任务(wù )的程序蜘(zhī )蛛池的本(běn )质是大(dà )量(liàng )的网站互相链接(jiē ),每个站(zhàn )单独(dú )产(chǎn )生大(dà )量(liàng )的内容吸引蜘蛛来爬,几千个网站(zhàn )互链(liàn )时,可以(yǐ )想象蜘(zhī )蛛的链接
Copyright © 2008-2018