joseki

joined 1 week ago
[–] joseki@lemmy.zip 1 points 3 hours ago

Right my comment was intended to hilight how outside the norm this is

[–] joseki@lemmy.zip 6 points 5 hours ago

K2 wasn't the first.

China had CPM-1 in 2020 that was a 2.6B model.

GPT-Neo (Mar 2021) EleutherAI replicates early GPT

PanGu-α (Apr 2021) Huawei's 200B model

WuDao 2.0 (May 2021) BAAI's massive 1.75T sparse MoE model

GPT-J (Jun 2021) EleutherAI release 6B

Meta released OPT in 2022, BLOOM was in 2022, GLM 130B by Tsinghua/Zhipu was in 2022 etc

K2 horizon is very recent, nowhere near the first. Different labs have different computational innovations worth studying. DeepSeek is crazy efficient and doing very novel things. Mistral in France is making very compact local friendly models that are fun and easy to fine tune and merge on consumer hardware.

[–] joseki@lemmy.zip 4 points 5 hours ago (2 children)

Pretty much any job anywhere will fire you on the spot for sleeping with a subordinate because it's obvious that it's a coercive power dynamic and bad for business and legal risk.

[–] joseki@lemmy.zip 1 points 15 hours ago

Sounds like you didn't make it past the intro

[–] joseki@lemmy.zip 1 points 4 days ago

LibreChat already exists and it's much better

[–] joseki@lemmy.zip 8 points 5 days ago (1 children)

There's decades and decades of data now - every way you measure the economy, corporate earnings per share, employment rate, GDP - performance soars under democratic rule and tanks under republican rule.

[–] joseki@lemmy.zip 1 points 1 week ago

Racism. It's only white babies they care about. Poor Healthcare disproportionately impacts black and brown people. Same reason they get up in arms about abortion.