• Womble@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    3 months ago

    They have no fact repositories to rely on.

    They do not possess the ability to know what is and is not correct.

    They cannot check documentation or verify that a function or library or API endpoint exists, even though they will confidently create calls to them.

    These three are all just the same as asking a person about them, they might know or might not but they cant right there and then check. Yes LLMs due to their nature cannot access a region marked “C# methods” or whatever, but large models do have some of that information embedded in them, if they didnt they wouldnt get correct answers anywhere near as often as they do, which for large models and common languages/frameworks is most of the time. This is before getting into retrieval augmented generation where they do have access to repositories of fact.

    This is what I was complaining about in the original post I replied to, no-where have I or anyone else I’ve seen in this thread say you should rely on these models, just that they are a useful input. Yet relying on them and using them without verification is the position you and the other poster are arguing against.