楼(lóu )上说的(de )很多(duō ),我补充(chōng )一下,正确的应(yīng )该叫网络蜘蛛(zhū ),又(yòu )称爬虫(chóng ),本(běn )质是搜(sōu )索引(yǐn )擎派(pài )出的一个执(zhí )行抓取任务(wù )的程序(xù )蜘蛛(zhū )池的本质是(shì )大(dà )量的网(wǎng )站互相(xiàng )链接,每个站单(dān )独产(chǎn )生大量(liàng )的内容(róng )吸引蜘(zhī )蛛来爬(pá ),几千(qiān )个网站互链(liàn )时,可以想象蜘蛛的链(liàn )接(jiē )
Copyright © 2008-2018