• makingStuffForFun
    link
    fedilink
    English
    arrow-up
    2
    ·
    7 months ago

    Are you using a self hosted open source system, or a saas subscription? I’m genuinely interested.

    • Aurenkin@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      7 months ago

      We use a home grown classification model for our customer facing stuff. There are some applications of LLMs we are using a SaaS for as it’s quick to get going but we are also working on fine tuning an open source model as well so we’ll see what ends up working better in terms of cost vs performance. That’s not going to be customer facing though, we don’t serve any generated text to customers.