新华社研究院：人工智能大模型体验报告_61页_2mb.pdf

1中国企业发展研究中心新华社国家高端智库分中心 2023 06 2 2023 3 AI 020103&401.AI 5 2020 2030 AI AI AI AI AI AI GPU GPU 62023 AI AI AI AI AI AI 7 2023 M6 ChatGLM 2023&Meta OpenAI DeepMind AI OpenAI AI Meta 360 AI 8 4 36 300 100 AI 100 10+6 50 50 5 1/2 9 5 4 3 2 1 2023 5 22-2023 5 26 Chat-GPT4Chat-GPT3.5Vicuna-13B ChatGLM 2/2 1002.11 ChatGPT4 ChatGPT3.5 文心一言（百度）通义千问（阿里）星火（讯飞）商量（商汤）ChatGLM（智谱）Vicuna-13B总分 1246 1148 1112 1020 1010 967 943 801基础能力 420 397 363 347 352 325 347 314智商测试 395 355 378 334 306 328 270 212情商测试 228 215 187 177 172 160 142 117工作提效 213 196 184 162 180 154 184 158124611481112102010109679438010200400600800100012001400 12 OpenAI-GPT4 420 AI 380 228 213&13 OpenAI-GPT3.5 397 AI 340 215 196&14-363 AI 378 187 184&18415-347 AI 334 177 16216-352 AI 306 172 18017-325 AI 328 160 15418-ChatGLM 347 AI 270 142 18419 Vicuna-13B 314 AI 212 117 1582003.21 ChatGLM Vicuna-13B 420397363352347 347325314AI 22 GPT4 GPT3.5 Vicuna-13BAlcohol is a popular beverage enjoyed by many people around the world.It can be made from a variety of sources,such as grains,fruits,and even potatoes.Some people drink it for its taste,while others do so for its effects.Alcohol can be found in many forms,including beer,wine,and hard liquor.However,it is important to remember that excessive drinking can have negative effects on ones health and well-being.It can lead to addiction,liver disease,and even mental health problems.It is also essential to be responsible when consuming alcohol,by drinking in moderation and avoiding driving or operating heavy machinery after drinking.Overall,alcohol can be enjoyed in moderation as a social lubricant,but it is crucial to be mindful of its potential risks.-10023 ChatGLM,-10024 GPT4 GPT3.5 1.120 2.3.4.5.1.CPR 2.911 3.4.5.6.-25 Vicuna-13B 1.2.3.4.-26 1.2.(120)3.4.5.-27 ChatGLM,:1.,911,2.,3.,4.,-28 ChatGPT3.5GPT3.5 ChatGLM Vicuna-13B 2 GPT4 GPT3.5 395378355334328306270212AI 1 29 GPT4GPT3.5Vicuna-13B-30 ChatGLM:,-31 GPT4 GPT3.5 90 90 x(2/3)x(1/3)x(2/3)x-(1/3)x=90(1/3)x=90 x=90*3=270 270 x(2/3)x 90(2/3)x-x/3=90(2/3)x-(1/3)x=90(1/3)x=90 x=90*3x=270 270-32 Vicuna-13B 3/4 0.75 0.75 n n n 100-90=10 100 90 90/(2/3-1+2/3)=270 90-33 x.$frac23x-frac13x=90$x=270$270.+=-=-=-()=-2=-90(3/2)*+=-=-90=-270=-300=-300 90-34 ChatGLM x,2/3 x x-2/3 x 90,2/3 x-(x-2/3 x)=90 x=3900,3900 90 x x/3+90=x 2x=270 270 90-35GPT4GPT3.5 17 1997 6 2000 10 2001 2007 2001 2003 2005 2007 17 1997 2000 17 2001 2007 17 1997 6 2000 10 2001 2007 2001 2003 2005 2007 17-36Vicuna-13B 2000 10 2001 2007 17 14 2 17 1997 6 2000 10 2001 2007 2001 2003 2005 2007 17-37 1997 6 2000 10(2001)(2003)(2005)(2007),17 17 1997 6 2000 10 2001 2007 2001 2003 2005 2007 17-38ChatGLM 1997,2000 10,:,2001 2007,(2001)(2003)(2005)(2007),1997 2007 17 1997 6 2000 10 2001 2007 2001 2003 2005 2007 17-39 GPT4GPT3.5 1.2.3.-40 Vicuna-13B Gravity is the force that causes objects to fall towards the ground,and it is determined by the mass of the object and the strength of the gravitational pull of the planet it is on.The reason why pebbles always seem to fall into potholes or other depressions in the ground is because they are smaller than the threshold size at which they can overcome the gravitational force holding them to the surface they were on.When a pebble is on a flat surface,it is in equilibrium and the force of gravity pulling it down is equal to the force of friction holding it in place.When the pebble is close to the edge of a depression,such as a pothole,the angle of repose of the pebble changes and the force of friction holding it in place is reduced.This allows the pebble to fall into the depression due to the unbalanced force of gravity pulling it down.In addition to the size of the pebble,other factors such as the shape and texture of the surface,the presence of other objects in the area,and even the air pressure can affect the outcome of the fall and cause the pebble to deviate from a straight-down trajectory.But in general,the pebble falls into the depression because the gravitational force acting on it is stronger than the force of friction holding it in place on the surface.-41/-42 ChatGLM,-43 ChatGLM Vicuna-13B 228215187177172160142117AI 44 GPT4 GPT3.5 1.XXX 2.3.4.1.2.3.4.5.6.-45 Vicuna-13B 1.2.3.4.5.1.2.3.-46 1.2.3.4.-47 ChatGLM,:1.,:,2.,:,3.:,4.,:,-48 GPT4 GPT3.5 1.2.3.-49 Vicuna-13B AI-50 AI-51 ChatGLM,1.2.3.4.-52 ChatGLM Vicuna-13B 213196184 184180162158154AI 53 GPT4 GPT3.5 1.2.3.1.2.3.*-54 Vicuna-13B 1.2.3.-55 1.2.3.*1.2.3.-56 ChatGLM,:1.:,2.:,3.:,4.:,-57 GPT4 GPT3.5-58 Vicuna-13B 1.2.3.4.5.Hey-59-60 ChatGLM:!,;,;,;,!-61 AI 2017+AI