Class Friendli

The Friendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.

Hierarchy

  • LLM<BaseLLMCallOptions>
    • Friendli

Constructors

constructor

Properties

baseUrl model frequencyPenalty? friendliTeam? friendliToken? maxTokens? modelKwargs? stop? temperature? topP?

Constructors

constructor

Properties

baseUrl

baseUrl: string = "https://inference.friendli.ai"

model

model: string = "mixtral-8x7b-instruct-v0-1"

Optional frequencyPenalty

frequencyPenalty?: number

Optional friendliTeam

friendliTeam?: string

Optional friendliToken

friendliToken?: string

Optional maxTokens

maxTokens?: number

Optional modelKwargs

modelKwargs?: Record<string, unknown>

Optional stop

stop?: string[]

Optional temperature

temperature?: number

Optional topP

topP?: number

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc