• vivendi@programming.dev
    link
    fedilink
    English
    arrow-up
    0
    ·
    12 days ago

    For usage like that you’d wire an LLM into a tool use workflow with whatever accounting software you have. The LLM would make queries to the rigid, non-hallucinating accounting system.

    I still don’t think it would be anywhere close to a good idea because you’d need a lot of safeguards and also fuck your accounting and you’ll have some unpleasant meetings with the local equivalent of the IRS.

    • pinball_wizard@lemmy.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      11 days ago

      The LLM would make queries to the rigid, non-hallucinating accounting system.

      And then sometimes adds a halucination before returning an answer - particularly when it encournters anything it wasn’t trained on, like important moments when business leaders should be taking a closer look.

      There’s not enough popcorn in the world for the shitshow that is coming.

      • vivendi@programming.dev
        link
        fedilink
        English
        arrow-up
        0
        ·
        11 days ago

        You’re misunderstanding tool use, the LLM only queries something to be done then the actual system returns the result. You can also summarize the result or something but hallucinations in that workload are remarkably low (however without tuning they can drop important information from the response)

        The place where it can hallucinate is generating steps for your natural language query, or the entry stage. That’s why you need to safeguard like your ass depends on it. (Which it does, if your boss is stupid enough)