potentiallynotfelix@lemmy.fish to Firefox@lemmy.mlEnglish · il y a 29 joursFirefox introduces AI as experimental featurelemmy.fishimagemessage-square101fedilinkarrow-up1221arrow-down113file-text
arrow-up1208arrow-down1imageFirefox introduces AI as experimental featurelemmy.fishpotentiallynotfelix@lemmy.fish to Firefox@lemmy.mlEnglish · il y a 29 joursmessage-square101fedilinkfile-text
minus-squareilhamagh@lemmy.worldlinkfedilinkarrow-up5·il y a 29 joursCan you point me to some resources to running smol llm? My use case prob just to help “typing” miscellaneous idea I have or check for my grammatical error, in english. Thanks, in advance.
minus-squareocassionallyaduck@lemmy.worldlinkfedilinkarrow-up4·il y a 28 joursHere you go: Review of SmolVLM https://www.marktechpost.com/2024/11/26/hugging-face-releases-smolvlm-a-2b-parameter-vision-language-model-for-on-device-inference/ Model itself: https://huggingface.co/spaces/HuggingFaceTB/SmolVLM And you can use Ollama to run it locally, and Open WebUI to access it in browser.
Can you point me to some resources to running smol llm?
My use case prob just to help “typing” miscellaneous idea I have or check for my grammatical error, in english.
Thanks, in advance.
https://ollama.com/
Here you go: Review of SmolVLM https://www.marktechpost.com/2024/11/26/hugging-face-releases-smolvlm-a-2b-parameter-vision-language-model-for-on-device-inference/
Model itself: https://huggingface.co/spaces/HuggingFaceTB/SmolVLM
And you can use Ollama to run it locally, and Open WebUI to access it in browser.