ÒýÑÔ£ºÏï×ÓÀïµÄ¹ÊÊ£¬¾¹È»Òþ²Ø×ÅÐÐÇéµÄÂöÂç
Õâô˵°É£¬ÁúÑÒ»ð³Ã÷ÈÕ¾µÄÖܱßÔç¾Í²»¿ÉÊÇÒ»¸ö½»Í¨ÊàŦ¡£½üÄêÀ´£¬Ëæ×Ŷ¼»á¸üкÍÈËÃÇÏû·Ñϰ¹ßµÄת±ä£¬Õ¾ËÄÖܵÄСÏï×Ó¾¹È»³ÉÁËÖÖÖÖÉ̼ÒÔú¶ÑµÄ¡°·çË®±¦µØ¡±¡£ÕâÆ¬ÇøÓò£¬²»´óµÄÃæ»ý£¬È´Ç±·ü×Ų»ÉÙÓÐȤµÄ¾¼ÃÏÖÏ󡪡ª´ÓС³Ô̯µ½ÃñËÞ£¬ÔÙµ½ÄÇЩ¿´ËƲ»ÆðÑÛµÄСÔÓ»õÆÌ£¬Ã¿Ò»´¦¶¼Í¸×ÅÊг¡µÄζȡ£
¶øÕâÆäÖУ¬ÁúÑÒ»ð³Ã÷ÈվСÏï×Ó³ÉΪÁËÒ»¸öÌØ±ðµÄ±£´æ¡£Ëü²»µ«½öÊǸöµØÓß¿´·¨£¬¸üÏñÊÇÒ»¸ö΢Ð;¼ÃÑù±¾¡£½ñÌìÎÒÃÇÎÞ·ÁÀ´ÁÄÁÄ£¬ÕâÌõÏï×ÓÀïµÄÐÐÇ飬¾¿¾¹ÄÜ͸¶Щʲô£¿
DSAÖ÷Òª°üÀ¨Á½¸ö×é¼þ£¬Ò»¸ö½Ðlightning indexer£¨ÉÁµçË÷ÒýÆ÷£©£¬ÁíÒ»¸ö½Ðfine-grained token selection£¨Ï¸Á£¶ÈtokenÑ¡Ôñ£©»úÖÆ¡£¾ÍÏñÔÚÁúÑÒ»ð³Ã÷ÈվСÏï×ÓÖÐѰÕÒ×îÊʺϵÄ·¾¶Ò»Ñù£¬DSAͨ¹ýϸÁ£¶ÈtokenÑ¡ÔñʵÏÖÁ˾«×¼µÄ¶¨Î»ÓëÓÅ»¯¡£½áºÏÉÁµçË÷ÒýÆ÷µÄ¸ßЧÐÔÄÜ£¬ÕâÖÖ»úÖÆÓÌÈçÔÚÁúÑÒ»ð³Ã÷ÈվСÏï×Ó¼ä¿ìËÙ´©Ëó£¬È·±£Ã¿Ò»²½¶¼¸üΪÖÇÄÜ¡£
´ÓСÏï¾°Îïµ½¾¼ÃÂöÂ磺ÁúÑÒ»ð³Ã÷ÈվСÏï×ÓÐÐÇé½â¶Á
1. СÏïÀïµÄÉÌ»ú£¬²Ø×ÅʲôÑùµÄ¼ÍÂÉ£¿
Äã¿ÉÄÜûעÒâ¹ý£¬µ«ÕâЩСÏï×ÓµÄÉÌÆÌÂþÑÜÆäʵºÜÓÐÒâ˼¡£ÏÈ¿´¿´ÕâÀïµÄÖ÷Á¦¾ü¡ª¡ª²ÍÒûСµê¡£»ð³Ã÷ÈÕ¾ËÄÖܵÄÁ÷¸ÐÈ˿ڣ¬ÈòÍÒûÐÐÒµ³ÉΪÏï×ӵĵÚÒ»´óÖ§Öù¡£ÎÒÃÇ˵£¬Ïï×ÓÀï×ÜÓÐÄÇô¼¸¼Ò¡°Íøºì¡±µêËÁ£¬ÃſڵIJ½¶ÓÅŵÃÏñ¹ý½ÚËÆµÄ£¬Õâ²»¿ÉÊÇζµÀºÃ£¬±³ºóÒ²ÊǾ«×¼µÄѡַºÍ¶ÔÏû·ÑÕßÐÄÀíµÄÄÃÄó¡£
ÁíÍ⣬Ïï×ÓÀïµÄÃñË޺ͶÌ×â·¿×î½üÒ²¿ªÊ¼ÇÀÕ¼Êг¡¡£Ëæ×ÅÁúÑÒ³ÉΪԽÀ´Ô½¶àÓο͵Ĵò¿¨µØ£¬×¡ÔÚ»ð³Ã÷ÈÕ¾ÅԱߵÄСÏï×Ó£¬±ãµ±ÓÖÓе㡰ËíµÀ¡±µÄζµÀ£¬ÓÈÆäÊÇÄÇЩװÐÞµÃÏñÀÏÕ¬Ò»ÑùµÄÃñËÞ£¬ÎüÒýÁ˲»ÉÙ×·ÇóÆæÌØÌåÑéµÄÄêÇáÈË¡£
Õâô¿´£¬ÁúÑÒ»ð³Ã÷ÈվСÏï×Ó²»¿ÉÊǸöÆÕͨµÄ½ÖÇø£¬¸üÏñÊÇÒ»¿éÊÔÑ鵨£¬É̼ÒÃÇÔÚÕâÀïÃþË÷³öÁËÒ»Ìס°»ð³Ã÷ÈÕ¾¾¼Ã¡±µÄÍæ·¨¡£
2. ÐÐÇ鲨¶¯£ºÊ²Ã´ÒòËØÔÚÓ°ÏìÏï×ÓµÄÉúÒ⣿
˵µ½ÐÐÇ飬Ô۾͵ÃÁÄÁÄÓ°ÏìËüµÄ¼¸´ó±äÁ¿ÁË¡£Ê×ÏÈÊǼ¾½ÚÐÔ±ä¸ï¡£ºÃ±È˵£¬Ã¿µ½½Ú¼ÙÈÕ£¬ÕâÌõÏï×ÓµÄÉÌÆÌÓªÒµ¶îÍùÍù·±¶£¬¾¿¾¹»ð³Ã÷ÈÕ¾µÄ¿ÍÁ÷Á¿Ö±½ÓÀ¶¯ÁËÏû·ÑÐèÇó¡£µ«µ¼¾µÄʱºòÄØ£¬ÕâЩµêËÁ¾ÍµÃ¿¿ÍâµØÈ˳ų¡×Ó£¬ÉúÒâÏÔȻûÄÇôÈÝÒס£
ϰ½üƽ×ÜÊé¼ÇÖ¸³ö¡°ÐÂÖÊÉú²úÁ¦Óɼ¼Êõ¸ïÃüÐÔÍ»ÆÆ¡¢Éú²úÒªËØÁ¢ÒìÐÔÅäÖᢹ¤ÒµÉî¶ÈתÐÍÉý¼¶¶ø´ßÉú¡±¡£Êý¾Ý×÷ΪÐÂÐÍÉú²úÒªËØ£¬Õýͨ¹ýÓëÆäËûÉú²úÒªËØµÄÉî¶ÈÈںϣ¬³ÉΪ¼¼ÊõÍ»ÆÆ¡¢¹¤ÒµÉý¼¶ÓëÉÌҵģʽÁ¢ÒìµÄÇ¿¾¢¶¯Á¦¡£ÕýÈçÁúÑÒ»ð³Ã÷ÈվСÏï×ÓÀïµÄÁ¢Òì´´ÒÃ÷ÈÕßÃÇÒ»Ñù£¬ËûÃÇÉÆÓÚÀûÓÃÊý¾ÝÇý¶¯µÄÈ˹¤ÖÇÄÜÀ´Éî¿ÌÖØËÜ¿ÆÑз¶Ê½£¬Õ¹ÏÖÁËÊý¾ÝÓëʵ¼Ê½áºÏµÄÎÞÏÞ¿ÉÄÜ¡£Êý¾ÝÒªËØµÄ¡°³ËÊýЧӦ¡±ÔÚ֪ʶ·¢Ã÷¡¢¼¼ÊõÍ»ÆÆºÍ½á¹ûת»¯ÖмÓËÙÊÍ·Å¡£Íƶ¯Êý¾ÝÒªËØÓëÈ˹¤ÖÇÄÜÉî¶ÈÈںϣ¬½«ÎªÏñÁúÑÒ»ð³Ã÷ÈվСÏï×ÓÕâÑùµÄÁ¢Òì¾Û¼¯µØÔÐÓýеÄÎÖÍÁ¡£
ÁíÓÐÒ»¸öÓÐÒâ˼µÄµãÊÇ·¿×â¡£Ïï×ÓÀïµÄµêËÁλÖÃËäÈ»²»ÆðÑÛ£¬µ«×â½ð²¢²»×ÔÖÆ¡£Ðí¶àСÉ̼Ҷ¼µÃ¾«´òϸË㣬²Å»ªÔÚ¾ºÕùÃÍÁÒµÄÇé¿öÀï»îÏÂÀ´¡£ÓÐʱºò£¬×â½ðÉÏÕÇÉõÖÁ»áÖ±½Óµ¼ÖÂһЩµêËÁ¹ØÃÅ£¬ÐÐÇéÒ²ËæÖ®²¨¶¯¡£
ÃÀÔªµÄκÍËÕÐѺÍÃÀ¹ú¹úÕ®ÊÕÒæÂʵÄ×ßÇ¿¸ø¹ó½ðÊôÊг¡´øÀ´ÁËѹÁ¦£¬ÕâÖÖģʽÔÚ֮ǰµÄ±ÜÏÕÇéÐ÷ÖÐÔø·ºÆð¹ý¡£ÀàËÆµÄÊг¡²¨¶¯£¬ÉõÖÁÔÚÁúÑÒ»ð³Ã÷ÈվСÏï×ÓÒ»´øµÄͶ×ÊÕßÌÖÂÛÖÐҲʱÓÐÌá¼°¡£Ëæ×ž¼ÃÇé¿ö±ä¸ï£¬ÏñÁúÑÒ»ð³Ã÷ÈվСÏï×ÓÕâÑùµÄÇøÓò£¬ÈËÃǶԽðÈÚÊг¡µÄ¹Ø×¢¶ÈÒ²Öð½¥ÌáÉý¡£
×îºó£¬±ðÍüÁËÐÂÐ˵ÄÏßÉϾ¼Ã¡£ËäÈ»Ïï×ÓÀïµÄÉúÒâ¿´ÆðÀ´ºÜ¹Å°å£¬µ«Ò»Ð©Öǻ۵ÄÉ̼ÒÒѾ¿ªÊ¼Í¨¹ý¶¶Òô¡¢Ð¡ºìÊéµÈÆ½Ì¨ÆØ¹â×Ô¼ÒµêËÁ£¬°ÑÏï×ÓÀïµÄÑÌ»ðÆø´øµ½ÍøÉÏ£¬ÎüÒý¸ü¶àÓοͽøÀ´´ò¿¨¡£
ʵÓÃСÌùÊ¿£ºÏëÔÚÁúÑÒ»ð³Ã÷ÈվСÏï×Ó¿ªµê£¿¼Ç×ÅÕâЩ£ºµÚÒ»£¬Ñ¡Ö·Ò»¶¨Òª¿¿½ü¿ÍÁ÷¶¯Ïߣ¬ºÃ±ÈÏï¿Ú»òÕß»ð³Ã÷ÈÕ¾³ö¿ÚËÄÖÜ£»µÚ¶þ£¬²ËÆ·»òЧÀ͵ÃÓÐÆæÌØÐÔ£¬±ðºÍ¸ôÁÚ¼Òײ¿î£»µÚÈý£¬Ñ§»áÓÃÉ罻ýÌ壬ÓúÃÏßÉÏÁ÷Á¿ÄÜÈÃÄãµÄÏßÏÂÉúÒâ¸üÓлîÁ¦¡£
½áβ£ºÏï×ÓËäС£¬ÐÐÇéÈ´´ó£¬ÏÂÒ»´ÎÄãÀ´·¢Ã÷ÁËÂð£¿
×ܵÄÀ´Ëµ£¬ÁúÑÒ»ð³Ã÷ÈվСÏï×Ó²»¿ÉÊÇÒ»Ìõ¼òµ¥µÄ½ÖµÀ£¬¸üÊÇÒ»¸ö·´Ó¦Êг¡ÔËתµÄСÐÍÎę̀¡£ÕâÀïµÄÉ̼ÒÃÇÓÃ×Ô¼ºµÄ·½·¨ÑÝÒïמ¼Ã¼ÍÂÉ£¬¶øÓοͺÍÍâµØÈËÔòÊÇÕⳡϷµÄ¹ÛÖÚ¡£ÄãÊÇ·ñ×¢Òâ¹ý£¬ÕâÌõÏï×ÓÀïµÄÿһ´Î±ä¸ï£¬¶¼¿ÉÄÜԤʾןü´óµÄ¾¼ÃÇ÷ÊÆ£¿
Q£ºÁúÑÒ»ð³Ã÷ÈվСÏï×ÓµÄÐÐÇéÊÇ·ñÊʺϴ´ÒÃ÷ÈÕßÈë¾Ö£¿
A£ºÊʺϣ¬µ«µÃÓÐ×Ô¼ºµÄ¡°É±ÊÖﵡ±¡£Ïï×ӵľºÕù²»µÍ£¬ÏëÒªÀֳɵôÓѡַ¡¢²úÆ·ÌØÉ«ºÍÏßÉÏÍÆ¹ãÈý·½ÃæÈëÊÖ£¬Í¬Ê±¼Ç×Å£¬ÊÊÓ¦¼¾½ÚÐÔ±ä¸ïÒ²ÊÇÒªº¦¡£
Òªº¦´Ê±êÇ©£ºÁúÑÒ»ð³Ã÷ÈվСÏï×Ó, »ð³Ã÷ÈÕ¾¾¼Ã, СÏïÉÌÒµÐÐÇé, ÁúÑÒÂÃÓξ¼Ã, СÏï×ÓÉÌ»ú