“Open source AI is the path forward,” says Mark Zuckerberg, using a contested term.
  • cheddar@programming.devEnglish
    1·
    1 year ago

    Typically you need about 1GB graphics RAM for each billion parameters (i.e. one byte per parameter). This is a 405B parameter model.