A personal chatbot that can search through your notes and saved documents sounds like an obvious application of LLMs, but for some reason I can’t find such a project. Are there any in the works?

  • Zeth0s@lemmy.world
    link
    fedilink
    arrow-up
    6
    ·
    9 months ago

    You can easily build one yourself. Check llamaindex and langchain for prebacked solutions. Otherwise the math is pretty trivial if you are using normalized embeddings. You can quickly do one with numpy.

    My suggestion anyway is to start with langchain, full of tutorials executable as jupyter notebook

  • porkins@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    4
    ·
    9 months ago

    I did this with my wiki in order to read each article and come up with a category and keyword cloud. I first started by attempting to use many different tools to build my own LLM and then realized that I was reinventing the wheel and shifted to using OpenAI’s API. I was able to prompt it to read each article as input and output what I needed in a machine readable format. It worked like a charm.

  • SaintWacko@midwest.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    9 months ago

    If you’re in the Google ecosystem, Bard recently gained the (toggleable) ability to access you email/notes (can’t remember if it can access documents)