Stop Using AI as a Service - (KoboldAI, InvokeAI, Nixified.AI)

Thank god this works with my professional trusted Windows platform with it's well known and reliable brand behind it.

"Because windows is professional." Is it though? Interrupting updates when you might have critical work to do. Not only that but people with Linux on a resume make more on average than people with Windows related skills on their resume. Who makes more, a machinist who uses a drill press and a large scale industrial cnc machine or a handyman who uses a hand drill? Income correlates with the professional-ness of the tools you use. That difference in income is because Linux is quite literally more professional than Windows.

The problem is that offices need a familiar toy to give people who are untrained in a professional system. That's the problem with an actual professional tool is sometimes it requires training and therefore isn't for everyone. Hense Windows. Not a more professional system.

the main reason people who'd otherwise be in the niche to try the larger models offline and do the leg work, still don't do it and opt to do it online... is the huge VRAM requirements

to run state-of-the-art models you often need 100GB or 200GB of VRAM in costly NVidia GPUs and that is just prohibitive to do offline, and resource utilisation becomes a big issue

thus it makes a lot more sense to rent those machines than buy them at 10s of thousands of £££ just to have them depreciate really fast, while they sit doing nothing a lot of the time

perhaps local groups can get together and run large-enough setups to overcome the trust an censorship issues of running openAI, midjourney and others - but in the foreseeable future at least, it won't make sense to buy these sort of machines as if they're your home computer which you occasionally run LLM/DL applications at, it's just too wasteful when most people don't even bother to buy high-end gaming PCs for the hassle and slide into game console peasantry instead, despite of all the dark practices in that sector

Open source project on an important topic, with Aphex Twin music and Windows jokes, what a great video!

Just wanted to say nixos should hire you to do marketing for them. this was great.

Lol. Neckbeard almost got me there.. 😅😂❤

ill learn nix man

dont use them as a service and dont use them at all because they are based on stolen data

I'm a dumbass and prob won't understand the so I'm just gonna ask, should I use or not, If not why?(again I'm a dumbass and know nothing about models and stuff so atlest please just tell me of its okay to use it or nah) please reply!!!

THANK YOU VERY MUCH

What is this sorcery ???!!!

THIS is why I ❤ NixOS !

Hey can you run this in Minecraft???
there are a couple mods out there that give you the ability to talk to villagers and other npcs
btw I’m not trying to dog on the ai I genuinely wanna add this layer of immersion into my game

Can you run it on Macbooks or on cloud VMs? Why does it need NixOS instead of Nix?

the problem is not how hard it is to run, its the amount of vram needed.
for my solutions I would need like 5 AIs at the same time.
an LLM, stable diffusion, text to speech or text to audio, speech to text etc
so you just cannot run all of them at the same time on one machine

If you want to level up your dev, learn Nix!

When I load a model, it loads and after some time it says lost connection? how can I load the models then?

Outstanding! All good things come from the people of Liverpool!

How does one download the larger models, like 6B Skein and 6.7 B Nerebus

Hi Matt,
This is Yousef, I am not sure if you remember me but we used to spend time together at DOES.
I am so happy and proud of what you have achieved my friend. Keep it up! You will be a thing, I am sure.

this whole video is just an ad for nixos, which cant even search for packages without eating the whole system's ram
it doesnt even explain how to set up kobold. bad video.

I would love to see how you created these flakes. I find invoke nowhere near as good as a1111 and forks, but don't know where to start and your flakes are overwhelming for a newcomer

Aphextwin in the background music

Would love to see how you could enable the gpu to be utilized on wsl, hope you do a video on it! :D

My shitty old laptop is struggling to run even the simplest of ai 💀.

Yes nix me harder.

After so many errors trying to get those projects to work on my nixos I find this video. This video is a blessing

Just saw your CCC presentation on NixPhone. Please do an in-depth video on it! This is about to change everything

Awesome brotha, thank you!

which one could deploy image generator? I tried kobold but it seems like it only support text generators.

such a shame none of the standard cutn'paste things works anymore.. makes Nix completely fall on its ass.

Matthew Croughan Do I need powerful GPU to run those. My GPU is only 4gb

Garbage video with lots of lies like "it's very difficult to install and run on your own machine". I didn't think running 1-3 commands was considered difficult? Are peiople are dumb with computers as it was back in 1994 before everyone had their own PC? LLAL Waste of a video

That bit towards the end is infectious 🤣