Class Bedrock

A type of Large Language Model (LLM) that interacts with the Bedrock service. It extends the base LLM class and implements the BaseBedrockInput interface. The class is designed to authenticate and interact with the Bedrock service, which is a part of Amazon Web Services (AWS). It uses AWS credentials for authentication and can be configured with various parameters such as the model to use, the AWS region, and the maximum number of tokens to generate.

Hierarchy (view full)

Constructors

constructor

Properties

codec credentials fetchFn model region streaming endpointHost? maxTokens? modelKwargs? stopSequences? temperature?

Methods

invocationParams

Constructors

constructor

Properties

codec

codec: EventStreamCodec = ...

credentials

credentials: CredentialType

fetchFn

fetchFn: {
    (input, init?): Promise<Response>;
    (input, init?): Promise<Response>;
}

Type declaration

    • (input, init?): Promise<Response>

    • MDN Reference

      Parameters

      • input: string | URL | Request
      • Optional init: RequestInit

      Returns Promise<Response>

    • (input, init?): Promise<Response>

    • Parameters

      • input: RequestInfo
      • Optional init: RequestInit

      Returns Promise<Response>

model

model: string = "amazon.titan-tg1-large"

region

region: string

streaming

streaming: boolean = false

Optional endpointHost

endpointHost?: string

Optional maxTokens

maxTokens?: number = undefined

Optional modelKwargs

modelKwargs?: Record<string, unknown>

Optional stopSequences

stopSequences?: string[]

⚠️ Deprecated ⚠️

This feature is deprecated and will be removed in the future.

It is not recommended for use.

Optional temperature

temperature?: number = undefined

Methods

invocationParams

  • invocationParams(options?): {
        maxTokens: undefined | number;
        model: string;
        modelKwargs: undefined | Record<string, unknown>;
        region: string;
        stop: undefined | string[];
        temperature: undefined | number;
    }

  • Parameters

    • Optional options: Omit<BaseLLMCallOptions, never>

    Returns {
        maxTokens: undefined | number;
        model: string;
        modelKwargs: undefined | Record<string, unknown>;
        region: string;
        stop: undefined | string[];
        temperature: undefined | number;
    }

    • maxTokens: undefined | number
    • model: string
    • modelKwargs: undefined | Record<string, unknown>
    • region: string
    • stop: undefined | string[]
    • temperature: undefined | number

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc