urbanists.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
We're a server for people who like bikes, transit, and walkable cities. Let's get to know each other!

Server stats:

577
active users

#synthesis

2 posts2 participants0 posts today

"When ChatGPT summarises, it actually does nothing of the kind."

"If I have 35 sentences of circumstance leading up to a single sentence of conclusion, the LLM mechanism will — simply because of how the attention mechanism works with the volume of those 35 — find the ’35’ less relevant sentences more important than the single key one. So, in a case like that it will actively suppress the key sentence."

by Gerben Wierda @gctwnl: ea.rna.nl/2024/05/27/when-chat

R&A IT Strategy & Architecture · When ChatGPT summarises, it actually does nothing of the kind.One of the use cases I thought was reasonable to expect from ChatGPT and Friends (LLMs) was summarising. It turns out I was wrong. What ChatGPT isn’t summarising at all, it only looks like it…