The threat of trucks crashing into schools isn’t the only problem that the data center has brought. Local residents Joseph and Robin Williams told WWNO that they’ve noticed their tap water is frequently rust colored since Meta started building the data center, and they say their electricity frequently goes off for hours on end with no warning.

Wow you’d expect this in a third world country, not a place that should have standards 🙄 And is the richest in the world.

Thank you so much!! I have been putting it off because what I have works but a time will soon come when I’ll want to test new models.

I’m looking for a server but not many parallel calls because I would like to use as much context as I can. When making space for e.g. 4 threads, the context is split and thus 4x as small. With llama 3.1 8b I managed to get 47104 context on the 16GB card (though actually using that much is pretty slow). That’s with KV quant to 8b too. But sometimes I just need that much.

I’ve never tried the llama.cpp directly, thanks for the tip!

Kobold sounds good too but I have some scripts talking to it directly. I’ll read up on that too see if it can do that. I don’t have time now but I’ll do it in the coming days. Thank you!

I don’t think that’s a problem. I live in Spain and speak Spanish daily with real people, many of them my friends. They’ll correct me if needed, they often do. Though most are my own mistakes.

Don’t forget people give wrong answers too. But people aren’t available 24/7 to help me.

Agreed. The way they just dumped support for my card in some update with some vague reason also irked me (we need a newer rocm they said but my card works fine with all current rocm versions)

Also the way they’re now trying to sell cloud AI means their original local service is in competition to the product they sell.

I’m looking to use something new but I don’t know what yet.

I have one server with a cheap MI50 instinct. Those come for really cheap on eBay. And it’s got really good memory bandwidth with HBM2. They worked ok with ollama until recently when they dropped support for some weird reason but a lot of other software still works fine. Also older models work fine on old ollama.

The other one runs an RTX 3060 12GB. I use this for models that only work on nvidia like whisper speech recognition.

I tend to use the same models for everything so I don’t have the delay of loading the model. Mainly uncensored ones so it doesn’t choke when someone says something slightly sexual. I’m in some very open communities so standard models are pretty useless with all their prudeness.

For frontend i use OpenWebUI and i also run stuff directly against the models like scripts.

I mainly use it for Spanish which I have a basic proficiency in. It just accompanies me on my learning journey. It may be wrong sometime but not often. Like the other reply said, LLMs are good at languages, it’s what they were originally designed for until people found out they could do more (but not quite as well).

And as for filtering, I just use it as a news feed sanitizer with a whole bunch of rules. It will miss things sometimes but it’s also my ruleset that’s not perfect. I often come across the unfiltered sources anyway and even if it misses something, it’s only news. Nothing really important to me.

I work with AI and use it personally, but I have my own servers running local models which solves tons of privacy concerns. The inaccuracy is another problem but not a big one for me as I know it and will simply fact check. Also, I don’t really use it for knowledge anyway. Just to filter news to my interest, help with summaries and translation etc.

People use AI as some all-knowing oracle but an LLM is not meant for that at all.

Well yeah, obviously. It clearly didn’t come from anyone with any medical knowledge.

I know, but at least they are making a case which most news outlets probably would but don’t have the means for a long legal fight. They might get some precedent out of this from which the whole news industry will benefit.

I don’t think AI training should ever be fair use. These companies are making billions of other people’s work and giving nothing back.

The problem I’ve been seeing with email on my own domain is that some services refuse it, saying “please enter a real email address” 🤬 some others just silently refuse to send a confirmation code so I can’t register either (I think tinder did this). Especially the “not a real email address” really pissed me off.

And with proton I got “Anonimisation services are forbidden” once at least.

I forget which services, but it’s Hella annoying…

The marketshare of Google and Microsoft on email is really becoming a problem.

True, the NYT does seem to have a significant impact on OpenAI though.

Very very good point. Google’s ubiquity makes that very difficult.

Like I said I don’t advocate erasing languages. Just to have a common international language whichever it is. Local languages can still play a big role in cultural matters (eg literature and life on the street for locals)

I’m from Holland myself and I know most people there don’t care so much about our quirky language, we are happy to speak other ones. It doesn’t mean that Dutch is worth any less. Mind that it doesn’t have to be English (especially now that the US is rapidly declining as a world power). But whatever it is, I wish the world would just pick one so I don’t have to keep learning new languages every time I move.

But failing a global language perhaps AI translators will become so good and smooth to use that soon we can just communicate regardless of what languages we speak.

Oh yes I know but as a common universal language it really has failed. It never became more than a fringe thing (sorry).

Yeah I’m just not really wed to any language. I guess it is also because I have moved around so much. I’m from Holland but I don’t consider myself a Dutch person, more like a citizen of the world. I’ve become too different to fit in in my home country (also because it’s become an extreme-right cesspool lately 😢 ). I’ve spent about half my life elsewhere. And the places I’ve lived where I spoke the languages I fared noticeably better.

Don’t forget that a lot of today’s problems center around not understanding each other. The hatred of immigrants for example.

But I know a lot of people do view language as a cultural thing, it’s just my point of view.

Does it really matter? I think the extreme amount of languages in the world right now is not helping us communicate. I don’t view language as a cultural heritage thing, just a communication protocol. And I have moved around a lot in the world, it’s very difficult to be constantly adapting to different languages. That causes a societal integration barrier for me.

I think if we had a universal language (note that it wouldn’t have to be English) we would be able to understand each other better and have less wars.

PS: I’m not advocating to ban languages or something, just to have a universal one. A bit like what Esperanto tried to achieve. Mutual language means more mutual understanding and thus less “us vs them” underbelly feelings that the fascists thrive on.

Yeah I agree, Meta specifically bought meta because it is Zuckerberg’s obsession to own a mainstream computing platform. Microsoft own Windows. Google owns Android. Apple has their own platforms. All of them are deeply entrenched. But meta never did. So the emergence of metaverse was Zuckerberg’s chance to jump into that, this is why he went all-in on it. But this is also why there’s so much lockin on the Quest :( Even though it’s based on Android technically.

I totally agree it should be standardised and some movements have been made to that effect with OpenXR and the like. But nobody big from the industry really stands behind it. OpenXR is more a developer-side thing than a client-side anyway.

To me it has always sucked compared to something like Slack. It has really low information density for example with its huge bubbles around everything. Multi-tenant switching was a really slow and painful process unlike slack which simply has a sidebar for quick switching, and it creates a huge garbage dump in sharepoint when people upload stuff to a chat.

The native app for Linux is no longer supported anyway. PWA is the only official way now.

And yes the UX is terrible. Especially the search function, it always finds unrelated things and almost never what I’m looking for. Same thing with Outlook (the real outlook and the ‘new’ one), OneNote and Sharepoint.

It is my #1 and pretty much only usecase for copilot. I think copilot for office is not great but searching for my stuff it does do very well. Paying $30 a month to fix something that should have worked in the first place is a bit mad though.

We do have rolls royce of course… They should be able to cook something up. And CFM is half French.