楼(lóu )上说的很多,我补(bǔ )充一(yī )下(xià ),正(zhèng )确的应该叫网络蜘蛛(zhū ),又称爬虫,本质是搜(sōu )索引擎派出(chū )的(de )一个执行抓取任务(wù )的程序蜘蛛(zhū )池的本质是大量的网(wǎng )站互相(xiàng )链接(jiē ),每个站(zhàn )单独产生大(dà )量的(de )内容(róng )吸引蜘(zhī )蛛来(lái )爬(pá ),几(jǐ )千(qiān )个网站(zhàn )互链时(shí ),可(kě )以想象(xiàng )蜘蛛的链(liàn )接(jiē )
Copyright © 2008-2018