fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 2 months agoSquiggly Boiemander.xyzexternal-linkmessage-square68fedilinkarrow-up1871arrow-down113
arrow-up1858arrow-down1external-linkSquiggly Boiemander.xyzfossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 2 months agomessage-square68fedilink
minus-squaretrxxruraxvr@lemmy.worldlinkfedilinkEnglisharrow-up15·2 months agoBy now they’ve gotten a bit bigger though
minus-squareWanderingThoughts@europe.publinkfedilinkEnglisharrow-up9·2 months agoHundred billion circles should be close enough
minus-squareNikelui@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months agoMaybe I’m wrong, but aren’t the parameters the actual connections between neurons? The circles should be orders of magnitude less.
minus-squareWanderingThoughts@europe.publinkfedilinkEnglisharrow-up1·2 months agoParameters are even more. A quick search tells me: ChatGPT-4 is estimated to have roughly 1.8 trillion parameters
By now they’ve gotten a bit bigger though
Hundred billion circles should be close enough
Maybe I’m wrong, but aren’t the parameters the actual connections between neurons? The circles should be orders of magnitude less.
Parameters are even more. A quick search tells me: