Class _LocalModel

constructor

• new _LocalModel(args: LocalModelArgs): _LocalModel

  Parameters

  • args: LocalModelArgs

  Returns _LocalModel

backend

ReadonlycomponentType

device

id

quantization

defaultSystemMessage

• defaultSystemMessage(): undefined | string

  Returns undefined | string

toAttrs

• toAttrs(): { device: number; model: LocalModelId; quantization: "q4f16_1" }

  Returns { device: number; model: LocalModelId; quantization: "q4f16_1" }