Profile pic is from Jason Box, depicting a projection of Arctic warming to the year 2100 based on current trends.

  • 0 Posts
  • 1.08K Comments
Joined 2 years ago
cake
Cake day: March 3rd, 2024

help-circle


  • I’m going to take this from a different angle. These companies have over the years scraped everything they could get their hands on to build their models, and given the volume, most of that is unlikely to have been vetted well, if at all. So they’ve been poisoning the LLMs themselves in the rush to get the best thing out there before others do, and that’s why we get the shit we get in the middle of some amazing achievements. The very fact that they’ve been growing these models not with cultivation principles but with guardrails says everything about the core source’s tainted condition.

















  • This may or may not be a thing, could be trolling too. However having Copilot on the computers at work and testing it out on mundane things like email summaries and replies, it’s pretty terrible. So if a LLM fails at simple language tasks, numbers are going to be spectacular. I was honestly surprised how bad Copilot is, having used some others, including smaller local LLMs. Maybe the enterprise version is a 1-bit.