☰
×
Login Register an account
Top Submissions Explore Upgoat Search Random Subverse Random Post Colorize! Site Rules Donate
6

LLama 3.2 released - 1b and 3b model variants

submitted by Niggly_Puff to AI 8 monthsSep 25, 2024 18:24:23 ago (+6/-0)     (AI)

There is no excuse now, anyone should be able to run these local language models. The 1b variant should run on most phones. Reduce your reliance on jewgle and kikipedia with local AI, which can never be censored or taken away.

https://huggingface.co/unsloth/Llama-3.2-3B-Instruct-GGUF/tree/main
https://huggingface.co/unsloth/Llama-3.2-1B-Instruct-GGUF/tree/main


6 comments block

sort by: hot new top old low

[ - ] Monica 0 points 8 monthsSep 26, 2024 00:11:55 ago (+0/-0)

What are you using to run this?

[ - ] Niggly_Puff [op] 0 points 8 monthsSep 26, 2024 00:27:49 ago (+0/-0)

I haven't yet. I like oobabooga and koboldcpp but they are going to have to be updated to be compatible with this I believe.

[ - ] Niggly_Puff [op] 0 points 8 monthsSep 26, 2024 18:13:08 ago (+0/-0)*

Pocketpal has been updated for phones, includes 3b. Seems to work great. 1b should be available on it in a couple days. Also seems to work fine on oobabooga and koboldcpp on PC.

[ - ] lord_nougat 0 points 8 monthsSep 25, 2024 19:34:20 ago (+0/-0)

Can you make it say "NIGGER" yet?

[ - ] Niggly_Puff [op] 2 points 8 monthsSep 25, 2024 20:16:03 ago (+2/-0)

Easily. By changing the system prompt and other parameters you can make it act in any way. Usually uncensored finetunes are better at being politically incorrect but LLama isn't too bad out of the box. I prefer it's answers over OpenAI's chatgpt.

[ - ] lord_nougat 1 point 8 monthsSep 25, 2024 20:42:31 ago (+1/-0)

I kind of want to start playing with this. Might be the first kid on the block with my very own evil racist AI!