lseif@sopuli.xyz to Programmer Humor@lemmy.ml · 3 months agoIf AI can now speak Italian, it can certainly replace us...sopuli.xyzimagemessage-square33fedilinkarrow-up16arrow-down10
arrow-up16arrow-down1imageIf AI can now speak Italian, it can certainly replace us...sopuli.xyzlseif@sopuli.xyz to Programmer Humor@lemmy.ml · 3 months agomessage-square33fedilink
minus-squarePlexSheep@infosec.publinkfedilinkarrow-up2·3 months agoDo you have a source for that? Seems like an internal detail a corpo wouldn’t publish
minus-squarestingpie@lemmy.worldlinkfedilinkarrow-up1·3 months agoCan’t find the exact source–I’m on mobile right now–but the code for the gpt-2 encoder uses a utf-8 to unicode look up table to shrink the vocab size. https://github.com/openai/gpt-2/blob/master/src/encoder.py
Do you have a source for that? Seems like an internal detail a corpo wouldn’t publish
Can’t find the exact source–I’m on mobile right now–but the code for the gpt-2 encoder uses a utf-8 to unicode look up table to shrink the vocab size. https://github.com/openai/gpt-2/blob/master/src/encoder.py