Anyone here run LLMs locally?

psychopathic

psychopathic

‎ ‎
Joined
Dec 8, 2024
Posts
30,594
Reputation
70,245
Used Qwen 3 8B and am getting Meta Llama 3.1 8B right now. Hoping Llama is nicer. Spikes GPU pretty hard when you use a thinking model.
 
  • +1
Reactions: Mogs Me and nestivv
What all this mean
 
  • JFL
Reactions: BeanCelll, caleb555 and psychopathic

Similar threads

chris182
Replies
6
Views
55
Truebloatcel
Truebloatcel
Jason Voorhees
Replies
6
Views
58
Kara
Kara
H
Replies
6
Views
39
kisslessvirgin
kisslessvirgin
alwazzab
Replies
21
Views
93
WELOVELOOKS
WELOVELOOKS
Prøphet
Replies
18
Views
124
GonorrhoeaGobbler
GonorrhoeaGobbler

Users who are viewing this thread

  • satou
Back
Top