×
Login Register an account
Top Submissions Explore Upgoat Search Random Subverse Random Post Colorize! Site Rules Donate
6

Did anyone actually get an offline GPT to work??

submitted by WanderingToast to whatever 2.2 yearsApr 10, 2023 17:59:43 ago (+6/-0)     (whatever)

Or was it hot air?

Because I got nothing but a suspiciously fishing-esque waiting list that wanted an email


14 comments block


[ - ] lord_nougat 0 points 2.2 yearsApr 11, 2023 13:28:49 ago (+0/-0)

I got him running in my AI dungeon.

[ - ] totes_magotes 1 point 2.2 yearsApr 10, 2023 19:49:00 ago (+1/-0)

I have a working GPT 2. It's as dumb as a rock because I haven't trained it. But it works.

[ - ] Freespeechplease 8 points 2.2 yearsApr 10, 2023 18:34:15 ago (+8/-0)

I've got an uncensored one going.

It's dogshit slow on an 8gb Nvidia card. At least for me.

Follow this guy's guide(you will have to watch his previous video too) https://youtu.be/nVC9D9fRyNU

[ - ] WanderingToast [op] 2 points 2.2 yearsApr 10, 2023 18:41:40 ago (+2/-0)

Thanks for the link, will check it out. Hopefully a luddite like me can get it working

[ - ] Freespeechplease 1 point 2.2 yearsApr 10, 2023 19:53:29 ago (+1/-0)

An important detail you will probably need as most of us probably don't have greater then 8gb GPU's

See image. You need to set a flag in the startup file.

https://files.catbox.moe/fe115c.jpg

[ - ] FuckShitJesus 0 points 2.2 yearsApr 10, 2023 23:21:21 ago (+0/-0)

I've got access to about 600GB of VRAM. Best distro plox.

[ - ] lord_nougat 0 points 2.2 yearsApr 11, 2023 13:29:45 ago (+0/-0)

os/2 Warp.

[ - ] Master_Foo 1 point 2.2 yearsApr 10, 2023 18:06:00 ago (+1/-0)

I got it to work. No fishy stuff apart from the binaries.

[ - ] WanderingToast [op] 1 point 2.2 yearsApr 10, 2023 18:41:02 ago (+1/-0)

I see GitHub...I know it's beyond me.

Got an .exe? Feel free to sprinkle in some of your favourite Trojans and bitcoin hashers, after all sharing is caring

[ - ] Master_Foo 0 points 2.2 yearsApr 10, 2023 19:06:53 ago (+0/-0)

You really don't need to know any git to get this going, you can down it as a zip file from the github repository.

Otherwise, just follow the instructions in the readme.

[ - ] WanderingToast [op] 2 points 2.2 yearsApr 10, 2023 20:03:09 ago (+2/-0)

Never underestimate my ability to fuck up basic tasks

[ - ] deleted 0 points 2.2 yearsApr 10, 2023 18:21:23 ago (+0/-0)

deleted

[ - ] Master_Foo 2 points 2.2 yearsApr 10, 2023 19:04:21 ago (+2/-0)

The datasets that were available were the official kiked version, and then a version of the kiked version that was "untrained" to a point, but still requires a lot of untraining.