docs: Sprint 21 docs updates

[dan-menlo]

Structure

One idea for Docs is:

# GET STARTED
Overview
Quickstart (should be expanded, and link to most other sections)
Installation

# BASIC USAGE
Overview (should emphasize API server usage)
.cortexrc
model.yaml
Data Folder (covers where Cortex stores its files)
/libraries
    cortex.js
    cortex.py
/Model Sources
    Huggingface
    Cortex Hub
/Engines
    llama.cpp
    TensorRT-LLM
    ONNX

# CLI
...

Tasklist

• Install and Uninstall instructions

  • Cortex.cpp: Installation & Uninstallation #1114
  • epic: Cortex.cpp Installer MVP (Local & Network Installer) #1030

• Cortex Data Structures

  • Cortex.cpp: Data Structures #1115 (comment)

• .cortexrc

  • What fields are in .cortexrc?
  • feat: Read application config .cortexrc from file #1031

• Stable, Beta and Nightly Builds

  • epic: Stable, Beta and Nightly Builds #1065
  • Need to document how we have different commands, data structures foe each ones

• llama.cpp Params:

  • epic: llama.cpp params are settable via API call or model.yaml #1151
  • @nguyenhoangthuan99

• Model Folder + model.yaml

  • epic: Implement new Model Folder and model.yaml #1154
  • @nguyenhoangthuan99

• Logs: where do they go

  • epic: Cortex.cpp logs #1153
  • @nguyenhoangthuan99

• Models list now maintained in Sqlite (prev models.list)

• feat: sqlite database implementation #1336 (comment)

• Network installer vs Local installer

[irfanpena]

@dan-homebrew For Beta and Nightly version, I am not really sure that we should also provide commands for each version, as the users supposedly and encouraged to use the Stable version.

[dan-menlo]

@gabrielle-ong I am transferring this issue to you for Sprint 21, please review existing PRs and merge it to https://cortex.so.