ÑÇÂíÑ·ÔƿƼ¼

¹ã¸æ

°¢ÀïÔÆ

¹ã¸æ

Óſ̵ÃGPUÔÆÖ÷»ú¾µÏñÊг¡ÉÏÏßLlama3¾µÏñ

ÃÀ¹úÔÆ·þÎñÆ÷ÍƼö

2024Äê4ÔÂ18ÈÕ£¬Meta AIÕýʽÐû²¼ÍƳö¿ªÔ´´óÄ£ÐÍLlama3£¬Õâ±êÖ¾×Å¿ªÔ´´óÐÍÓïÑÔÄ£ÐÍ£¨LLM£©ÁìÓòµÄÓÖÒ»ÖØ´óÍ»ÆÆ¡£Llama3ÒÔÆä׿ԽµÄÐÔÄܺ͹㷺µÄÓ¦ÓÃÇ°¾°£¬»ò½«Íƶ¯È˹¤ÖÇÄܼ¼Êõ¿ìËÙÂõ½øмÍÔª¡£

Ϊ·½±ãAIÓ¦ÓÃÆóÒµ¼°¸öÈËAI¿ª·¢Õß¿ìËÙÌåÑéLlama3µÄ³¬¸ßÐÔÄÜ£¬½üÆÚÓſ̵ÃÔÆÖ÷»úÉÏÏßLlama3-8B-Instruct-Chinese¾µÏñ£¬Ò»¼üÅäÖ㬿ìËÙ²¿ÊðÄ£ÐÍ¿ª·¢»·¾³¡£Îª¿Í»§Ìṩ¿ªÏä¼´ÓõÄLlama3Ä£ÐÍ΢µ÷¼°ÍÆÀí»·¾³£¬½ÚÊ¡ÅäÖÃʱ¼ä£¬Ìá¸ß¿ª·¢Ð§ÂÊ¡£

¿ìËٴLlama3µÄ΢µ÷»òÍÆÀí»·¾³£¬½öÐèÒÔÏÂ4²½£º

1¡¢µÇ¼UCloud¿ØÖÆ̨

2¡¢Ñ¡ÔñGPUÔÆÖ÷»ú£¬¸÷Ä£Ð͵ÄÍƼö»úÐͼ°ÅäÖòο¼Îĵµ£ºhttps://docs.ucloud.cn/gpu/practice/Llama3-8B-Instruct-Chinese

ÍƼö£º¡¶UCloud GPUÔÆ·þÎñÆ÷¿ñ»¶ÌØ»Ý Ð¿ÍÊ×ÔÂ1.4ÕÛÆð¡·

3¡¢ÔÚ¾µÏñÊг¡Ñ¡Ôñ¾µÏñ£¬ËÑË÷Llama

4¡¢Á¢¼´´´½¨£¬¿ª»úÖ´Ðнø³ÌÆô¶¯ÃüÁî

Óſ̵ÃGPUÔÆÖ÷»ú

Llama3ÓÉMetaÔÚ15ÍòÒÚtokensÊý¾Ý¼¯ÉÏѵÁ·¶ø³É£¬ÊÇLlama2ÌåÁ¿µÄ7±¶£¬°üÀ¨4±¶µÄ´úÂëÊý¾Ý¡£ÆäÖÐԤѵÁ·Êý¾Ý¼¯Öл¹ÓÐ5%µÄ·ÇÓ¢ÓïÊý¾Ý¼¯£¬×ܼÆÖ§³Ö¸ß´ï30ÖÖÓïÑÔ£¬ÔÚ×ö·ÇÓ¢ÓïÓïÑÔÄÜÁ¦¶ÔÆë·½ÃæÒ²»á¸üÓÐÓÅÊÆ¡£Llama3 Instruct ¸üÊÇÕë¶Ô¶Ô»°Ó¦ÓýøÐÐÁËÓÅ»¯£¬½áºÏÁ˳¬¹ý1000ÍòµÄÈ˹¤±ê×¢Êý¾Ý£¬Í¨¹ý¼à¶½Ê½Î¢µ÷£¨SFT£©¡¢¾Ü¾ø²ÉÑù¡¢ÁÚ½ü²ßÂÔÓÅ»¯£¨PPO£©ºÍÖ±½Ó²ßÂÔÓÅ»¯£¨DPO£©½øÐÐѵÁ·¡£±¾´ÎÓſ̵ÃGPU¾µÏñÊг¡ÉÏÏßµÄÊÇ»ùÓÚÖÐÎÄÓïÁÏÖ¸Áî΢µ÷Ö®ºóµÄÄ£ÐÍ£¨Llama3-8B-Instruct-Chinese£©£¬ÔÚÖÐÎıíÏÖÉÏÓÐÏà¶Ô²»´íµÄЧ¹û¡£

ÔÚÉÏÏÂÎÄ·½Ã棬Llama3Ö§³Ö8KµÄÉÏÏÂÎij¤¶È£¬ÊÇLlama2ÈÝÁ¿µÄÁ½±¶£¬¼«´óµØÌá¸ßÁ˶ಽÖèÈÎÎñµÄ´¦ÀíÄÜÁ¦¡£Í¬Ê±£¬¸ÃÄ£ÐÍÌرðÇ¿µ÷ÔÚÀí½â¡¢´úÂëÉú³ÉºÍÖ¸Áî¸úËæµÈ¸´ÔÓÈÎÎñÉϵÄÐÔÄܸĽø¡£Llama3 8BºÍ70B²ÎÊýµÄÄ£ÐÍÔÚ¶à¸öÐÐÒµ»ù×¼²âÊÔÖÐչʾÁË×îÏȽøµÄÐÔÄÜ£¬ÌرðÊÇÔÚÍÆÀíºÍ±àÂëÈÎÎñÉÏ¡£ÆäÖÐ700ÒÚ²ÎÊý¹æÄ£µÄÄ£ÐÍÆÀ²â½á¹û¼«ÆäÓÅÐã¡£×î´óµÄÁÁµãÊÇÔÚÊýѧÆÀ²âGSM8KµÄµÃ·Ö´ïµ½93·Ö£¡¸ù¾ÝDataLearnerAIÄ¿Ç°ÊÕ¼¯µÄÊý¾Ý£¬Õâ¸ö·ÖÊý½ö´ÎÓÚClaude3-OpusµÄ95·Ö£¬³¬¹ýGPT-4£¬Î»¾ÓÈ«ÇòµÚ¶þ£¬ÊÇÄ¿Ç°¿ªÔ´´óÄ£ÐÍÖе÷Ö×î¸ßµÄÒ»¸ö¡£

Óſ̵ÃGPUÔÆÖ÷»ú

Óſ̵ÃGPUÔÆÖ÷»ú

Óſ̵ÃGPUÔÆÖ÷»ú¾µÏñÊг¡ÉÏÏßLlama3¾µÏñ£¬¿ÉΪAIÓ¦Óÿͻ§Ìṩ×îÐÂÄ£ÐÍÒ»¼ü²¿ÊðµÄ¼«ËÙÌåÑé¡£²»½öÈç´Ë£¬Óſ̵û¹Í¬²½¶ÔÍâÌṩÖÇËãµ÷¶È¡¢Ä£ÐÍ΢µ÷¼°ÍÆÀí·þÎñ²¿Êð·þÎñ¡£Óſ̵ÃÒÔÔÆÖ÷»ú¡¢Âã½ðÊô¡¢¸ßÐÔÄÜ´æ´¢¡¢µÍÑÓ³ÙÍøÂçµÈ»ù´¡ÉèÊ©ÁìÓò»ýÀÛµÄÔËÓª¾­ÑéΪ»ù´¡£¬´îÅä¡°¿×Ã÷¡±µÄ×ÊÔ´µ÷¶È¡¢¶àÓû§¹ÜÀíÓë·Ö²¼Ê½ÑµÁ·µÄÄÜÁ¦£¬ÒÔ¼°UModelVerseÄ£ÐÍÍÆÀí·þÎñƽ̨£¬ÐγÉһվʽµÄAI¼ÆË㿪·¢½â¾ö·½°¸£¬·þÎñ´óÄ£ÐÍ¿ª·¢Õß¡¢Ó¦Óó§ÉÌ¡¢¸ßУ¼°¿ÆÑлú¹¹µÈºÏ×÷»ï°é£¬¹²Í¬Íƽø´óÄ£ÐͲúÒµ·¢Õ¹¡£

(±¾ÎÄÓÉÃÀ¹úÖ÷»úÕì̽ԭ´´£¬×ªÔØÇë×¢Ã÷³ö´¦¡°ÃÀ¹úÖ÷»úÕì̽¡±ºÍÔ­ÎĵØÖ·£¡)

΢ÐÅɨÂë¼ÓºÃÓѽøȺ

Ö÷»úÓÅ»ÝÂ뼰ʱÕÆÎÕ

QQȺºÅ£º707632017

Ö÷»úÓŻݷ¢²¼Óë½»Á÷

ÎÂÜ°Ìáʾ£º

1¡¢±¾Õ¾²¿·ÖͼƬÀ´Ô´ÓÚ»¥ÁªÍø£¬ÈçÓÐÇÖȨÇëÁªÏµÉ¾³ý¡£ÓÊÏ䣺2942802716#qq.com£¨#¸ÄΪ@£©

2¡¢±¾ÎÄÆÀÂÛûÓÐרÈ˻ظ´£¬Èç¹ûÄúÓÐÎÊÌâÇëµ½ÃÀ¹úÖ÷»úÕì̽ÂÛ̳ÌáÎÊ£¡

3¡¢ÃÀ¹úÖ÷»úÕì̽Ãâ·ÑΪÄúÌṩÃÀ¹úÖ÷»ú¹ºÂò×Éѯ¡£

RAKsmartÃÀ¹ú·þÎñÆ÷
·µ»Ø¶¥²¿


http://www.vxiaotou.com