涓浗楂樼鎶€鍏徃鍙堝啀鍋氫竴浠舵不鏍囦笉娌绘湰鐨勪簨鎯咃紵
銆愭湰鏂囨潵鑷€?鍖椾含锛氭敮鎸佸ご閮ㄤ紒涓氭墦閫犲鏍嘋hatGPT鐨勫ぇ妯″瀷銆嬭瘎璁哄尯锛屾爣棰樹负灏忕紪娣诲姞銆?/p>
杩欎箞鎼烇紝鎰熻鍙堟槸鍦ㄦ不鏍囦笉娌绘湰銆備汉宸ユ櫤鑳借澶т紬璁よ瘑锛岄偅鏄痑lphaGo锛岀劧鍚庢槸alphaGo2鎵撹触闊╁浗鍥存涔濇鏉庝笘鐭炽€傞偅鏃跺€欙紝浜哄伐鏅鸿兘閲囩敤鐨凜NN鍜孌NN璁$畻鏈虹缁忓厓缃戠粶锛屽悗鏉ユ湁浜哛NN锛屽綋鐒舵渶鐪嬪ソ杩樻槸2015鍚庣殑LSTM绁炵粡鍏冪綉缁滐紝瀹冩槸涓€绉峈NN鐨勫彉绉嶃€備汉浠浘缁忓緢鐪嬪ソ杩欎釜LSTM锛屼絾鏄殢鐫€2017骞磋胺姝岀殑transformer妯″瀷鐨勫嚭鐜帮紝鎵€鏈夐噸鐐硅浆鍚戜簡杩欎釜鏈€鏂扮殑Transformer锛孏PT鐨勫叏绉版槸锛孏enerative Pre-training Transformer, 璇存槑杩欎釜GPT涔熸槸閲囩敤浜?Transformer鐨勬ā鍨嬶紝Transformer 杩欎釜瀛楋紝鍦ㄦ父鎴忛噷锛岀炕璇戞垚 鍙樺舰閲戝垰锛岃繖閲屾湁浜涚炕璇戞垚妯″瀷锛屾湁浜涚炕璇戞垚杞崲鍣紝Generative Pre-training Transformer 鐩磋瘧灏辨槸 棰勫厛璁粌鐨勫彲鑷垜鐢熸垚鍐呭(鎴栬€呰绛旀)鐨勮浆鎹㈠櫒銆?/p>
璋锋瓕鍦ㄨ璁¤繖涓猼ransfomer鐨勫垵琛锋槸涓轰簡瑙e喅璇█缈昏瘧鐨勯棶棰橈紝褰撳彂瑷€鑰呰鍑虹涓€涓瓧锛岃棰勬祴浠栧悗闈㈠彲鑳借鐨勫瓧锛屾瘮濡傦紝鏈変釜绗戣瘽閲岃鐨勶紝 鏈変汉鍦ㄥ彴涓婂彂瑷€璇达紝鈥濇垜鏄渷濮斾功璁帮紝鈥滃仠椤夸簡涓€涓嬶紝涓嬮潰鐨勪汉浠ヤ负浠栨槸鐪佸涔﹁锛屾嫾鍛介紦鎺岋紝浠栨帴鐫€璇达紝鈥濇淳鏉ョ殑鈥滐紝涓嬮潰鐨勪汉锛岄】鏃堕甫闆€鏃犲0锛屼綔涓轰汉宸ユ櫤鑳界瓑寰呮満鍣ㄤ汉锛屽畠涔熻鍒ゆ柇锛岀涓€鍙ヨ瘽涔嬪悗锛屽悗缁彲鑳藉嚭鐜扮殑鍙ュ瓙锛屽苟瀵规鍋氬嚭鍙婃椂鍙嶅簲锛岃€屼笉鏄儚杩囧幓锛岃绛夊埌鏁翠釜鍙ュ瓙璁插畬鎵嶇炕璇戙€傝繖涓棶棰橈紝璺熷綋鍒濈殑alphaGo閬囧埌鐨勯棶棰樼被浼硷紝褰撹彍楦熸鎵嬶紝涓嬩竴姝ユ锛屼粬鍙兘灏卞彧鑳界湅鍒颁笅涓€姝ワ紝鑰屽甫娈典綅鐨勬鎵嬭嚦灏戝彲浠ョ湅30-40姝ワ紝鑰宎lphaGo鍙互鐪嬪埌鐧炬浠ュ悗锛岃繖閲岄潰鐪熸鐨勭墰锛屾槸CNN绁炵粡鍏冪綉缁溿€傝€岃胺姝岀殑Transformer鍒╃敤浜嗗緢澶氱殑CNN銆?/p>
Transformer鏄胺姝岀殑鏍稿績鎶€鏈紝鏄负浜嗚嚜鐒惰瑷€澶勭悊鍜岀炕璇戣璁$殑锛岃€孫penAI杩欏鐨勫叕鍙稿埄鐢ㄤ簡杩欎釜鎶€鏈畬鎴愪簡浠婂ぉ鐨凜hatGPT锛屽鏋滀腑鍥界殑楂樼鎶€鍏徃鍙槸鐪嬪埌浜咰hatGPT鐨勬垚鍔燂紝璺熺潃ChatGPT鐨勬ā寮忥紝鍘诲涔燨penAi 鍦ㄨ亰澶╂満鍣ㄤ汉鐨勬ā寮忥紝鑰屽拷鐣ヤ簡OpenAI鏄浣曚粠閫氱敤鐨凾ransformer鍏ユ墜锛屾妸璋锋瓕鎻愪緵鐨勬渶鍩虹鐨勪笢瑗垮鍒版墜锛屽苟鐢ㄥ湪鑷繁搴旂敤涓婂彂鎵厜澶э紝閭h繕涓嶆槸鍦ㄥ仛涓€浠舵不鏍囦笉娌绘湰鐨勪簨鎯咃紵