manitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 1 year agoDifferent development paths of LLMslemmy.intai.techimagemessage-square16fedilinkarrow-up145arrow-down10file-text
arrow-up145arrow-down1imageDifferent development paths of LLMslemmy.intai.techmanitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 1 year agomessage-square16fedilinkfile-text
cross-posted from: https://lemmy.intai.tech/post/5502 cross-posted from: https://lemmy.intai.tech/post/5501 https://www.interconnects.ai/p/llm-development-paths
minus-squareentropicdrift@lemmy.sdf.orglinkfedilinkEnglisharrow-up3·1 year agoAlso of note is RWKV, the only purely RNN structured LLM. I’m keeping an eye on that one because of the theoretically infinite context length
Also of note is RWKV, the only purely RNN structured LLM. I’m keeping an eye on that one because of the theoretically infinite context length