Class GradientLLM

The GradientLLM class is used to interact with Gradient AI inference Endpoint models. This requires your Gradient AI Access Token which is autoloaded if not specified.

Hierarchy

  • LLM<BaseLLMCallOptions>
    • GradientLLM

Constructors

constructor

Properties

model modelSlug adapterId? gradientAccessKey? inferenceParameters? workspaceId?

Methods

setModel

Constructors

constructor

Properties

model

model: any

modelSlug

modelSlug: string = "llama2-7b-chat"

Optional adapterId

adapterId?: string

Optional gradientAccessKey

gradientAccessKey?: string

Optional inferenceParameters

inferenceParameters?: Record<string, unknown>

Optional workspaceId

workspaceId?: string

Methods

setModel

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc