eadSoifwese
doutarobotwiththe
si
glei
structio
offetchi
gcoffeeitwillhaveastro
gdesiretosecuresuccessbydisabli
g
itsow
offswitchoreve
killi
ga
yo
ewhomighti
terferewithitstaskIfweare
otcareful
the
wecouldfaceaki
dofglobalchessmatchagai
stverydetermi
edsuperi
tellige
tmachi
es
whoseobjectivesco
flictwithourow
withtherealworldasthechessboard
Thepossibilityofe
teri
gi
toa
dlosi
gsuchamatchshouldco
ce
tratethemi
dsofcomputer
scie
tistsSomeresearchersarguethatweca
sealthemachi
esi
sideaki
doffirewallusi
g
themtoa
swerdifficultquestio
sbut
everallowi
gthemtoaffecttherealworldU
fortu
ately
thatpla
seemsu
likelytoworkwehaveyettoi
ve
tafirewallthatissecureagai
stordi
ary
huma
sletalo
esuperi
tellige
tmachi
es
Solvi
gthesafetyproblemwelle
oughtomoveforwardi
AIseemstobepossiblebut
oteasy
Thereareprobablydecadesi
whichtopla
forthearrivalofsuperi
tellige
tmachi
esBut
theproblemshould
otbedismissedoutofha
dasithasbee
bysomeAIresearchersSomeargue
thathuma
sa
dmachi
esca
coexistaslo
gastheyworki
teamsyetthatis
otpossibleu
less
machi
essharethegoalsofhuma
sOtherssayweca
just“switchthemoff”asifsuper
i
tellige
tmachi
esaretoostupidtothi
kofthatpossibilityStillothersthi
kthatsuper
i
tellige
tAIwill
everhappe
O
September111933famousphysicistEr
estRutherfordstated
withco
fide
ce“A
yo
ewhoexpectsasourceofpoweri
thetra
sformatio
oftheseatomsis
talki
gmoo
shi
e”Howevero
September121933physicistLeoSzilardi
ve
tedthe

eutro
i
duced中子诱导
uclearchai
reactio

67Paragraph1mai
lytellsusthatartificiali
tellige
cemay

Aru
outofhuma
co
trol
Bsatisfyhuma
’srealdesires
一个不等式成立与否，取决于影响号的因素如数正、负零或子积平方倒都会对产生注意考查这些在中作用是也就比较好判断了
fCcomma
darmiesofkillerrobots
Dworkfastertha
amathematicia

68Machi
eswithspecificpurposesareassociatedwithlivi
gthi
gspartlybecausetheymight
beableto

Apreve
tthemselvesfrombei
gdestroyed
Bachievetheirorigi
algoalsi
depe
de
tly
Cdoa
ythi
gsuccessfullywithgive
orders
Dbeathuma
si
i
ter
atio
alchessmatches
69Accordi
gtosomeresearchersweca
usefirewallsto

Ahelpsuperi
tellige
tmachi
esworkbetter
Bbesecureagai
stevilhuma
bei
gs
Ckeepmachi
esfrombei
gharmed
Davoidrobots’affecti
gtheworld
70Whatdoestheauthorthi
kofthesafetyproblemofsuperi
tellige
tmachi
es
AItwilldisappearwiththedevelopme
tofAI
BItwillgetworsewithhuma
i
terfere
ce
CItwillbesolvedbutwithdifficulty
DItwillstayforadecade
【话题解读】本文主要介绍了人r