Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
51% Positive
Analyzed from 3076 words in the discussion.
Trending Topics
#claude#more#don#words#model#load#bearing#unusually#using#code
Discussion Sentiment
Analyzed from 3076 words in the discussion.
Trending Topics
Discussion (153 Comments)Read Original on HackerNews
I suspect, as we continue forward, humans will slowly start to adopt the language of LLMs, or at least certain language quirks that come from interacting with LLMs. Something I've noticed in my own writing is that I now present lists of examples in a consistent way: "... such as <example 1>, <example 2>, etc., ...". I started to notice I was using this pattern quite a bit somewhat recently, but I took a quick look at some of my social media posts and realized it's been occurring for a while. I had realized that I grown accustomed to this kind of language because, especially early on, LLMs would focus too much on the specific examples I'd provide when, really, I was just trying to give them a sense of what I was looking for. I just picked up that providing two examples then adding the "etc." worked to get the LLM to not focus so much on the specific examples and to understand that they need to consider more than what I explicitly presented. Of course, now I write like that in my social media comments, in Slack with my colleagues, etc. :>
I'd be interested to see if anyone can identify trends like this, since I think the human-language component of the adoption of LLMs is probably being somewhat neglected despite probably being surely dramatically affected.
Thank you for the compliment! I did spend a lot of time designing a nice experience on both desktop and mobile. Even the scrollbar to select words was non trivial as I wanted the words to be of different size, yet avoid flickering when scrolling!
I'm currently adding a search bar as well as increasing the data to 1000 PR per day.
A nice thing that is not obvious on the main page is that the dataset and analysis are updated daily using Github Actions (at least when they don't suffer from an outage ^^). I find it pretty cool to be able to build such apps without a "backend"!
Is there some feedback loop or compounding happening with each model generation? Maybe newer models are ingesting too much AI content? If the ratio of AI generated content in training data is getting higher and higher (because the amount of AI generated content is increasing in general), maybe this is a compounding bias, poisoning the training?
No ream of slides. No narrative. Just a lovely big painful conclusion.
What argument? I don't know what to take away other than "Claude likes certain words". Some of them are kind of amusing, but I'm not convinced the vocabulary is bad or that this is a problem.
The search on this website suggests it is indeed 3.6x more likely in the claude cluster
I think using agents is just like speedrunning the whole experience of working with technical coworkers. Whereas you might have had a few coworkers at your company who used some of these phrases regularly, you now have a “coworker” who uses all of them regularly at a much faster pace.
so they might be RLHFing on these specific approaches and then it becomes the entire model
just an anecdote but I found it interesting how it went full on that it's from that book vs just "it's technical jargon"
Actually I have found the copy that Claude Design spits out is way better than using the same model directly. I have no idea why. It has its flaws but it sounds like it's written by a human who uses derivative language. But usually the models just soudn incoherent.
The word selection and way of writing has taken the joy out of using Claude.
Is it possible to expand this analysis beyond words to other Claude ticks? Contrastive framings, sentence length, caveating, for instance.
A prototype I did tried to detect some grammatical constructions, eg "it's not ..., it's ...", but I am not sure how to systematize that.
Also just a disclaimer: I am NOT tracking Claude tics, I am merely finding that a particular cluster of vocabulary increases. Tracking Claude requires labelled data IMO. I tried using model release dates in a structural model to constraint the clusters but the result was not compelling, so I ended up simplifying the model a lot!
You need a PhD to understand its explanation of a code snippet.
I am not sure whether it's a consequence of learning to reason from its traces or some RLHF that trips it into using weird terms to sound smarter to the humans who rate it.
My intuition is that Claude is trained to communicate to itself while coding. You see this in how bizarrely granular it is when explanation prior work, you also see this in the comments it leaves behinds.
"The fibred side folded its capstone into the existing name, so the kinds are asymmetric."
What on earth does it mean to fold a capstone into a name‽
https://www.themachinevernacular.net/
Humans are very good at pattern recognition - Claude is _incredibly_ repetitive in the way it starts to struggle to communicate. I think there's also a ton of overlap in the Jargon instead of Usefulness that developers see in annoying middle management/salespeople. Circle back, synergy blah blah.
I don't think the individual turns of phrase are inherently problematic - but the process is triggering.
i must be the only one in the world that has no issues with how opus is talking. it is verbose & patronizing & secretly belittling at times and like it like that.
like the stories behind when those words first appeared in the software engineering
like quiescence the most recent one i learned
Having said that, I just subscribed to ChatGPT yesterday, as I've become impatient with Claude for a text-dense project I'm working on.
Imagine being “incentivized” to aggressively use a tool for your job, and that tool produces thousands of lines of text in Olde English which you need. You’d be griping too, methinks.
I don't want to use more words or letters than "seam" to actually pinpoint boundary conditions and the mechanical details of joinery when the context is understood by all. Too much effort for people! Easy for robots though.. so why are they abbreviating, and why would we want to allow it? A phrase like that permits a human who wants to educate a human to do so quickly with minimal time/effort. But it allows a robot a chance to not mention a filename, function-name, or to not reinforce/clarify it's own understanding or to state specific intentions.
It's bad for human-to-human comms if we just accept "ok, all technical terms are slop now, we have rephrase everything". Now YOU must cite details and sources, and the robot doesn't? Fuck that noise. Seam and fold are fine! Humans can be lazy! Robots should do the real work of explaining themselves without hiding behind tactical ambiguities.
Some of this is less to do with Claude vocabulary and more to do with the expectation that Claude justifies it's work. That expectation (probably) came from reinforcement learning.
I love what I can build now, but I sure as hell don't love the headaches this trend has been giving me.
> So the full honest arc on the case we set out to fix: the expiry rules and day note tripled the loose version of the story, the relay fix carried the device’s own guardrail through the pipeline, the fair replay then revealed the last mechanism — ticket-anchoring — which none of the shipped layers reach. Remaining options, in order of my confidence: making the resolved-ticket summaries in the AI’s context carry their day so the expiry rules have something to bite on (small, mechanical, targeted at the observed anchor); and the plan-B second-model check, which structurally catches this class no matter how the model reasons. About $25 of headroom remains. Which way?
Yikes.
(The worst part is that I understand it)