Class ChatFriendli

The ChatFriendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.

Hierarchy

  • BaseChatModel<BaseChatModelCallOptions>
    • ChatFriendli

Constructors

constructor

Properties

baseUrl model frequencyPenalty? friendliTeam? friendliToken? maxTokens? modelKwargs? stop? temperature? topP?

Constructors

constructor

Properties

baseUrl

baseUrl: string = "https://inference.friendli.ai"

model

model: string = "llama-2-13b-chat"

Optional frequencyPenalty

frequencyPenalty?: number

Optional friendliTeam

friendliTeam?: string

Optional friendliToken

friendliToken?: string

Optional maxTokens

maxTokens?: number

Optional modelKwargs

modelKwargs?: Record<string, unknown>

Optional stop

stop?: string[]

Optional temperature

temperature?: number

Optional topP

topP?: number

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc