Meta’s Open Source Llama 3 Is Already Nipping at OpenAI’s Heels

[Belk]

Yep. AI's cool, except for an AI priest, though some of my Bible analysis are partially done with an open source AI named Mistral 7B on my laptop. Have you heard of the defrocked AI priest?

This is Fr. Justin, before being digitally defrocked. He was run on a server, and was not open source.

View attachment 346825

Catholic Group Defrocks AI Priest After It Gave Strange Answers

A Catholic group has defrocked an AI-generated priest chatbot after it stirred controversy among the faithful.

futurism.com

Wow. That is amazing. Just goes to show you every new technology is a double edged sword.

 

[AlexB23]

Wow. That is amazing. Just goes to show you every new technology is a double edged sword.

Yeah, as I said in my OP: "AI can be used for good, or for bad, just as nuclear fission energy could be used to power a city with clean electricity, or sadly destroy a city with a nuke."

AI in religion is a bad idea in my opinion, unless it is checked by a human, and assigning a persona to it is borderline harmful. If America was less individualist, people would be able to talk to flesh and blood religious leaders more openly.

 

[AlexB23]

August 2024 Update: Meta released Llama 3.1 405B in July 2024, a 405 billion parameter AI model that is on par with ChatGPT, but is free and open source. Only problem, one would need a high-end PC that would cost multiple thousands of dollars. But hey, the tech is impressive.

Llama 405B:

The first GPT-4-class AI model anyone can download has arrived: Llama 405B

"Open source AI is the path forward," says Mark Zuckerberg, using a contested term.

arstechnica.com

 

[Occams Barber]

Only problem, one would need a high-end PC that would cost multiple thousands of dollars. But hey, the tech is impressive.

Have you seen a spec on minimum PC requirements for running this?

OB

 

[AlexB23]

Have you seen a spec on minimum PC requirements for running this?

OB

You would need something like this, according to a Redditor. The price of his/her PC is as much as a used car.

12 x 3090 GPUs. The average cost of the 3090 is around $725 = $8700.
64GB system RAM is sufficient as its just for inference = $115.
TB560-BTC Pro 12 GPU mining motherboard = $112.
4x1300 power supplies = $776.
12 x pcie risers (1x) = $50.
i7 intel CPU, 8 core 5 ghz = $220.
2TB nvme = $115.

Total cost = $10,088.

Source: https://www.reddit.com/r/LocalLLaMA/comments/1ej9uzh
Redditor named EDK208's $10,000 computer

 

[Occams Barber]

You would need something like this, according to a Redditor. The price of his/her PC is as much as a used car.

12 x 3090 GPUs. The average cost of the 3090 is around $725 = $8700.
64GB system RAM is sufficient as its just for inference = $115.
TB560-BTC Pro 12 GPU mining motherboard = $112.
4x1300 power supplies = $776.
12 x pcie risers (1x) = $50.
i7 intel CPU, 8 core 5 ghz = $220.
2TB nvme = $115.

Total cost = $10,088.

Source: https://www.reddit.com/r/LocalLLaMA/comments/1ej9uzh
Redditor named EDK208's $10,000 computer
View attachment 353184

12 x 3090 GPUs ????

OB

 

[AlexB23]

12 x 3090 GPUs ????

OB

Yep, 12 of those Nvidia 3090 GPUs. Very expensive stuff, bro.

 

[Occams Barber]

Yep, 12 of those Nvidia 3090 GPUs. Very expensive stuff, bro.


View attachment 353185

Expensive? - I suppose it depends on your budget

I run an NVIDIA 4060 GPU, an I7 processor and 16GB RAM in a desktop - less than $2,000

I need the grunt to run VR through a Meta Quest 3.

I have trouble seeing how he can justify 12 x 3090 GPUs? (but it does help to explain 4 x power supply)

OB

 

[AlexB23]

Expensive? - I suppose it depends on your budget

I run an NVIDIA 4060 GPU, an I7 processor and 16GB RAM in a desktop - less than $2,000

I need the grunt to run VR through a Meta Quest 3.

I have trouble seeing how he can justify 12 x 3090 GPUs? (but it does help to explain 4 x power supply)

OB

I have no idea why this guy needs so many GPUs. Rich people... Woo, an NVIDIA 4060? Bro, you need some AI to run on your desktop. I recommend Mistral Nemo (a 12 billion parameter model). $2K is a good price for a desktop.