• jacksilver@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    11 hours ago

    I’ve done some work on natural language to SQL, both with older (like Bert) and current LLMs. It can do alright if there is a good schema and reasonable column names, but otherwise it can break down pretty quickly.

    Thats before you get into the fact that SQL dialects are a really big issue for LLMs to begin with. They all looks so similar I’ve found it common for them to switch between them without warning.

    • morbidcactus@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      20 minutes ago

      Yeah I can totally understand that, Genie is databricks’ one and apparently it’s surprisingly decent at that, but it has access to a governance platform that traces column lineage on top of whatever descriptions and other metadata you give it, was pretty surprised with the accuracy in some of its auto generated descriptions though.