• phutatorius@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    Anthropic have actually looked at how their LLMs reason. Don’t use them for anything important.

    • Halcyon@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      1
      ·
      7 hours ago

      The “reasoning” which is displayed, such as step-by-step explanations or chain-of-thought responses, is only a simulation of reasoning, generated as text based on patterns. It’s in the same form of any text production an LLM is capable of. When an LLM mimics “reasoning,” it is generating text that looks like reasoning because it has seen similar patterns in its training data.