楼上(shàng )说的很(hěn )多(duō ),我(wǒ )补充(chōng )一下,正确的应该叫网(wǎng )络(luò )蜘(zhī )蛛,又称(chēng )爬虫,本质(zhì )是(shì )搜(sōu )索(suǒ )引擎派(pài )出的一个执行抓取任务(wù )的程(chéng )序蜘蛛(zhū )池的本质是大量的网站互相链接,每(měi )个(gè )站单独(dú )产(chǎn )生大量(liàng )的内(nèi )容(róng )吸引蜘(zhī )蛛来爬(pá ),几千个网站互链时,可以想(xiǎng )象蜘蛛(zhū )的链接(jiē )
Copyright © 2008-2018