1. Registry
  2. Packages
  3. AWS Cloud Control
  4. API Docs
  5. bedrockagentcore
  6. getEvaluator

We recommend new projects start with resources from the AWS provider.

Viewing docs for AWS Cloud Control v1.86.0
published on Wednesday, Nov 18, 2026 by Pulumi
aws-native logo aws-native logo AWS Cloud Control

We recommend new projects start with resources from the AWS provider.

Viewing docs for AWS Cloud Control v1.86.0
published on Wednesday, Nov 18, 2026 by Pulumi

    Resource Type definition for AWS::BedrockAgentCore::Evaluator - Creates a custom evaluator for agent quality assessment using LLM-as-a-Judge, code-based, or derived evaluator configurations. Derived evaluators run an existing built-in or third-party evaluator’s logic on a model that you supply.

    Using getEvaluator

    Two invocation forms are available. The direct form accepts plain arguments and either blocks until the result value is available, or returns a Promise-wrapped result. The output form accepts Input-wrapped arguments and returns an Output-wrapped result.

    function getEvaluator(args: GetEvaluatorArgs, opts?: InvokeOptions): Promise<GetEvaluatorResult>
    function getEvaluatorOutput(args: GetEvaluatorOutputArgs, opts?: InvokeOutputOptions): Output<GetEvaluatorResult>
    def get_evaluator(evaluator_arn: Optional[str] = None,
                      opts: Optional[InvokeOptions] = None) -> GetEvaluatorResult
    def get_evaluator_output(evaluator_arn: pulumi.Input[Optional[str]] = None,
                      opts: Optional[InvokeOutputOptions] = None) -> Output[GetEvaluatorResult]
    func LookupEvaluator(ctx *Context, args *LookupEvaluatorArgs, opts ...InvokeOption) (*LookupEvaluatorResult, error)
    func LookupEvaluatorOutput(ctx *Context, args *LookupEvaluatorOutputArgs, opts ...InvokeOption) LookupEvaluatorResultOutput

    > Note: This function is named LookupEvaluator in the Go SDK.

    public static class GetEvaluator 
    {
        public static Task<GetEvaluatorResult> InvokeAsync(GetEvaluatorArgs args, InvokeOptions? opts = null)
        public static Output<GetEvaluatorResult> Invoke(GetEvaluatorInvokeArgs args, InvokeOptions? opts = null)
        public static Output<GetEvaluatorResult> Invoke(GetEvaluatorInvokeArgs args, InvokeOutputOptions opts)
    }
    public static CompletableFuture<GetEvaluatorResult> getEvaluator(GetEvaluatorArgs args, InvokeOptions options)
    public static Output<GetEvaluatorResult> getEvaluator(GetEvaluatorArgs args, InvokeOptions options)
    public static Output<GetEvaluatorResult> getEvaluator(GetEvaluatorArgs args, InvokeOutputOptions options)
    
    fn::invoke:
      function: aws-native:bedrockagentcore:getEvaluator
      arguments:
        # arguments dictionary
    data "aws-native_bedrockagentcore_get_evaluator" "name" {
        # arguments
    }

    The following arguments are supported:

    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluator_arn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluator_arn str
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.

    getEvaluator Result

    The following output properties are available:

    CreatedAt string
    The timestamp when the evaluator was created.
    Description string
    The description of the evaluator.
    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    EvaluatorConfig Pulumi.AwsNative.BedrockAgentCore.Outputs.EvaluatorConfig
    The configuration for the evaluator, including LLM-as-a-Judge, code-based, or derived settings.
    EvaluatorId string
    The unique identifier of the evaluator.
    EvaluatorType Pulumi.AwsNative.BedrockAgentCore.EvaluatorType
    The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
    KmsKeyArn string
    The ARN of the KMS key used to encrypt evaluator data.
    Level Pulumi.AwsNative.BedrockAgentCore.EvaluatorLevel
    The evaluation level that determines the scope of evaluation. Required for all evaluator configuration types. For Derived evaluators it must match the level of the base evaluator identified by BaseEvaluatorId.
    Provider Pulumi.AwsNative.BedrockAgentCore.EvaluatorProvider
    Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
    Status Pulumi.AwsNative.BedrockAgentCore.EvaluatorStatus
    The current status of the evaluator.
    Tags List<Pulumi.AwsNative.Outputs.Tag>
    A list of tags to assign to the evaluator.
    UpdatedAt string
    The timestamp when the evaluator was last updated.
    CreatedAt string
    The timestamp when the evaluator was created.
    Description string
    The description of the evaluator.
    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    EvaluatorConfig EvaluatorConfig
    The configuration for the evaluator, including LLM-as-a-Judge, code-based, or derived settings.
    EvaluatorId string
    The unique identifier of the evaluator.
    EvaluatorType EvaluatorType
    The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
    KmsKeyArn string
    The ARN of the KMS key used to encrypt evaluator data.
    Level EvaluatorLevel
    The evaluation level that determines the scope of evaluation. Required for all evaluator configuration types. For Derived evaluators it must match the level of the base evaluator identified by BaseEvaluatorId.
    Provider EvaluatorProvider
    Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
    Status EvaluatorStatus
    The current status of the evaluator.
    Tags Tag
    A list of tags to assign to the evaluator.
    UpdatedAt string
    The timestamp when the evaluator was last updated.
    created_at string
    The timestamp when the evaluator was created.
    description string
    The description of the evaluator.
    evaluator_arn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluator_config object
    The configuration for the evaluator, including LLM-as-a-Judge, code-based, or derived settings.
    evaluator_id string
    The unique identifier of the evaluator.
    evaluator_type "Builtin" | "ThirdParty" | "Custom" | "CustomCode" | "CustomDerived"
    The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
    kms_key_arn string
    The ARN of the KMS key used to encrypt evaluator data.
    level "TOOL_CALL" | "TRACE" | "SESSION"
    The evaluation level that determines the scope of evaluation. Required for all evaluator configuration types. For Derived evaluators it must match the level of the base evaluator identified by BaseEvaluatorId.
    provider "AWS" | "DeepEval" | "AutoEval" | "Custom"
    Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
    status "ACTIVE" | "CREATING" | "CREATE_FAILED" | "UPDATING" | "UPDATE_FAILED" | "DELETING"
    The current status of the evaluator.
    tags list(object)
    A list of tags to assign to the evaluator.
    updated_at string
    The timestamp when the evaluator was last updated.
    createdAt String
    The timestamp when the evaluator was created.
    description String
    The description of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorConfig EvaluatorConfig
    The configuration for the evaluator, including LLM-as-a-Judge, code-based, or derived settings.
    evaluatorId String
    The unique identifier of the evaluator.
    evaluatorType EvaluatorType
    The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
    kmsKeyArn String
    The ARN of the KMS key used to encrypt evaluator data.
    level EvaluatorLevel
    The evaluation level that determines the scope of evaluation. Required for all evaluator configuration types. For Derived evaluators it must match the level of the base evaluator identified by BaseEvaluatorId.
    provider EvaluatorProvider
    Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
    status EvaluatorStatus
    The current status of the evaluator.
    tags List<Tag>
    A list of tags to assign to the evaluator.
    updatedAt String
    The timestamp when the evaluator was last updated.
    createdAt string
    The timestamp when the evaluator was created.
    description string
    The description of the evaluator.
    evaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorConfig EvaluatorConfig
    The configuration for the evaluator, including LLM-as-a-Judge, code-based, or derived settings.
    evaluatorId string
    The unique identifier of the evaluator.
    evaluatorType EvaluatorType
    The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
    kmsKeyArn string
    The ARN of the KMS key used to encrypt evaluator data.
    level EvaluatorLevel
    The evaluation level that determines the scope of evaluation. Required for all evaluator configuration types. For Derived evaluators it must match the level of the base evaluator identified by BaseEvaluatorId.
    provider EvaluatorProvider
    Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
    status EvaluatorStatus
    The current status of the evaluator.
    tags Tag[]
    A list of tags to assign to the evaluator.
    updatedAt string
    The timestamp when the evaluator was last updated.
    created_at str
    The timestamp when the evaluator was created.
    description str
    The description of the evaluator.
    evaluator_arn str
    The Amazon Resource Name (ARN) of the evaluator.
    evaluator_config EvaluatorConfig
    The configuration for the evaluator, including LLM-as-a-Judge, code-based, or derived settings.
    evaluator_id str
    The unique identifier of the evaluator.
    evaluator_type EvaluatorType
    The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
    kms_key_arn str
    The ARN of the KMS key used to encrypt evaluator data.
    level EvaluatorLevel
    The evaluation level that determines the scope of evaluation. Required for all evaluator configuration types. For Derived evaluators it must match the level of the base evaluator identified by BaseEvaluatorId.
    provider EvaluatorProvider
    Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
    status EvaluatorStatus
    The current status of the evaluator.
    tags Sequence[root_Tag]
    A list of tags to assign to the evaluator.
    updated_at str
    The timestamp when the evaluator was last updated.
    createdAt String
    The timestamp when the evaluator was created.
    description String
    The description of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorConfig Property Map
    The configuration for the evaluator, including LLM-as-a-Judge, code-based, or derived settings.
    evaluatorId String
    The unique identifier of the evaluator.
    evaluatorType "Builtin" | "ThirdParty" | "Custom" | "CustomCode" | "CustomDerived"
    The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
    kmsKeyArn String
    The ARN of the KMS key used to encrypt evaluator data.
    level "TOOL_CALL" | "TRACE" | "SESSION"
    The evaluation level that determines the scope of evaluation. Required for all evaluator configuration types. For Derived evaluators it must match the level of the base evaluator identified by BaseEvaluatorId.
    provider "AWS" | "DeepEval" | "AutoEval" | "Custom"
    Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
    status "ACTIVE" | "CREATING" | "CREATE_FAILED" | "UPDATING" | "UPDATE_FAILED" | "DELETING"
    The current status of the evaluator.
    tags List<Property Map>
    A list of tags to assign to the evaluator.
    updatedAt String
    The timestamp when the evaluator was last updated.

    Supporting Types

    EvaluatorBedrockEvaluatorModelConfig

    ModelId string
    The identifier of the Amazon Bedrock model to use for evaluation.
    AdditionalModelRequestFields object
    Additional model-specific request fields.
    InferenceConfig Pulumi.AwsNative.BedrockAgentCore.Inputs.EvaluatorInferenceConfiguration
    ModelId string
    The identifier of the Amazon Bedrock model to use for evaluation.
    AdditionalModelRequestFields interface{}
    Additional model-specific request fields.
    InferenceConfig EvaluatorInferenceConfiguration
    model_id string
    The identifier of the Amazon Bedrock model to use for evaluation.
    additional_model_request_fields any
    Additional model-specific request fields.
    inference_config object
    modelId String
    The identifier of the Amazon Bedrock model to use for evaluation.
    additionalModelRequestFields Object
    Additional model-specific request fields.
    inferenceConfig EvaluatorInferenceConfiguration
    modelId string
    The identifier of the Amazon Bedrock model to use for evaluation.
    additionalModelRequestFields any
    Additional model-specific request fields.
    inferenceConfig EvaluatorInferenceConfiguration
    model_id str
    The identifier of the Amazon Bedrock model to use for evaluation.
    additional_model_request_fields Any
    Additional model-specific request fields.
    inference_config EvaluatorInferenceConfiguration
    modelId String
    The identifier of the Amazon Bedrock model to use for evaluation.
    additionalModelRequestFields Any
    Additional model-specific request fields.
    inferenceConfig Property Map

    EvaluatorCategoricalScaleDefinition

    Definition string
    The description that explains what this categorical rating represents.
    Label string
    The label of this categorical rating option.
    Definition string
    The description that explains what this categorical rating represents.
    Label string
    The label of this categorical rating option.
    definition string
    The description that explains what this categorical rating represents.
    label string
    The label of this categorical rating option.
    definition String
    The description that explains what this categorical rating represents.
    label String
    The label of this categorical rating option.
    definition string
    The description that explains what this categorical rating represents.
    label string
    The label of this categorical rating option.
    definition str
    The description that explains what this categorical rating represents.
    label str
    The label of this categorical rating option.
    definition String
    The description that explains what this categorical rating represents.
    label String
    The label of this categorical rating option.

    EvaluatorCodeBasedEvaluatorConfig

    EvaluatorConfig

    EvaluatorDerivedEvaluatorConfig

    BaseEvaluatorId string
    The identifier of the base evaluator whose logic to run (a Builtin.* or ThirdParty.* evaluator).
    ModelConfig Pulumi.AwsNative.BedrockAgentCore.Inputs.EvaluatorModelConfig
    BaseEvaluatorId string
    The identifier of the base evaluator whose logic to run (a Builtin.* or ThirdParty.* evaluator).
    ModelConfig EvaluatorModelConfig
    base_evaluator_id string
    The identifier of the base evaluator whose logic to run (a Builtin.* or ThirdParty.* evaluator).
    model_config object
    baseEvaluatorId String
    The identifier of the base evaluator whose logic to run (a Builtin.* or ThirdParty.* evaluator).
    modelConfig EvaluatorModelConfig
    baseEvaluatorId string
    The identifier of the base evaluator whose logic to run (a Builtin.* or ThirdParty.* evaluator).
    modelConfig EvaluatorModelConfig
    base_evaluator_id str
    The identifier of the base evaluator whose logic to run (a Builtin.* or ThirdParty.* evaluator).
    model_config EvaluatorModelConfig
    baseEvaluatorId String
    The identifier of the base evaluator whose logic to run (a Builtin.* or ThirdParty.* evaluator).
    modelConfig Property Map

    EvaluatorDimensionRatingScale

    Categorical []EvaluatorCategoricalScaleDefinition
    The categorical rating scale for this dimension.
    Numerical []EvaluatorNumericalScaleDefinition
    The numerical rating scale for this dimension.
    categorical list(object)
    The categorical rating scale for this dimension.
    numerical list(object)
    The numerical rating scale for this dimension.
    categorical List<EvaluatorCategoricalScaleDefinition>
    The categorical rating scale for this dimension.
    numerical List<EvaluatorNumericalScaleDefinition>
    The numerical rating scale for this dimension.
    categorical EvaluatorCategoricalScaleDefinition[]
    The categorical rating scale for this dimension.
    numerical EvaluatorNumericalScaleDefinition[]
    The numerical rating scale for this dimension.
    categorical Sequence[EvaluatorCategoricalScaleDefinition]
    The categorical rating scale for this dimension.
    numerical Sequence[EvaluatorNumericalScaleDefinition]
    The numerical rating scale for this dimension.
    categorical List<Property Map>
    The categorical rating scale for this dimension.
    numerical List<Property Map>
    The numerical rating scale for this dimension.

    EvaluatorEvaluationDimension

    DimensionInstruction string
    The instruction to the evaluator model describing what to judge for this dimension.
    DimensionName string
    The name of the dimension. Must be unique within the evaluator.
    DimensionRatingScale Pulumi.AwsNative.BedrockAgentCore.Inputs.EvaluatorDimensionRatingScale
    DimensionInstruction string
    The instruction to the evaluator model describing what to judge for this dimension.
    DimensionName string
    The name of the dimension. Must be unique within the evaluator.
    DimensionRatingScale EvaluatorDimensionRatingScale
    dimension_instruction string
    The instruction to the evaluator model describing what to judge for this dimension.
    dimension_name string
    The name of the dimension. Must be unique within the evaluator.
    dimension_rating_scale object
    dimensionInstruction String
    The instruction to the evaluator model describing what to judge for this dimension.
    dimensionName String
    The name of the dimension. Must be unique within the evaluator.
    dimensionRatingScale EvaluatorDimensionRatingScale
    dimensionInstruction string
    The instruction to the evaluator model describing what to judge for this dimension.
    dimensionName string
    The name of the dimension. Must be unique within the evaluator.
    dimensionRatingScale EvaluatorDimensionRatingScale
    dimension_instruction str
    The instruction to the evaluator model describing what to judge for this dimension.
    dimension_name str
    The name of the dimension. Must be unique within the evaluator.
    dimension_rating_scale EvaluatorDimensionRatingScale
    dimensionInstruction String
    The instruction to the evaluator model describing what to judge for this dimension.
    dimensionName String
    The name of the dimension. Must be unique within the evaluator.
    dimensionRatingScale Property Map

    EvaluatorInferenceConfiguration

    MaxTokens int
    The maximum number of tokens to generate in the model response.
    StopSequences List<string>
    The sequences that make the model stop generating further tokens.
    Temperature double
    The temperature value that controls randomness in the model's responses.
    TopP double
    The top-p sampling parameter that controls the diversity of the model's responses.
    MaxTokens int
    The maximum number of tokens to generate in the model response.
    StopSequences []string
    The sequences that make the model stop generating further tokens.
    Temperature float64
    The temperature value that controls randomness in the model's responses.
    TopP float64
    The top-p sampling parameter that controls the diversity of the model's responses.
    max_tokens number
    The maximum number of tokens to generate in the model response.
    stop_sequences list(string)
    The sequences that make the model stop generating further tokens.
    temperature number
    The temperature value that controls randomness in the model's responses.
    top_p number
    The top-p sampling parameter that controls the diversity of the model's responses.
    maxTokens Integer
    The maximum number of tokens to generate in the model response.
    stopSequences List<String>
    The sequences that make the model stop generating further tokens.
    temperature Double
    The temperature value that controls randomness in the model's responses.
    topP Double
    The top-p sampling parameter that controls the diversity of the model's responses.
    maxTokens number
    The maximum number of tokens to generate in the model response.
    stopSequences string[]
    The sequences that make the model stop generating further tokens.
    temperature number
    The temperature value that controls randomness in the model's responses.
    topP number
    The top-p sampling parameter that controls the diversity of the model's responses.
    max_tokens int
    The maximum number of tokens to generate in the model response.
    stop_sequences Sequence[str]
    The sequences that make the model stop generating further tokens.
    temperature float
    The temperature value that controls randomness in the model's responses.
    top_p float
    The top-p sampling parameter that controls the diversity of the model's responses.
    maxTokens Number
    The maximum number of tokens to generate in the model response.
    stopSequences List<String>
    The sequences that make the model stop generating further tokens.
    temperature Number
    The temperature value that controls randomness in the model's responses.
    topP Number
    The top-p sampling parameter that controls the diversity of the model's responses.

    EvaluatorLambdaEvaluatorConfig

    LambdaArn string
    The ARN of the Lambda function used for evaluation.
    LambdaTimeoutInSeconds int
    The timeout in seconds for the Lambda function invocation.
    LambdaArn string
    The ARN of the Lambda function used for evaluation.
    LambdaTimeoutInSeconds int
    The timeout in seconds for the Lambda function invocation.
    lambda_arn string
    The ARN of the Lambda function used for evaluation.
    lambda_timeout_in_seconds number
    The timeout in seconds for the Lambda function invocation.
    lambdaArn String
    The ARN of the Lambda function used for evaluation.
    lambdaTimeoutInSeconds Integer
    The timeout in seconds for the Lambda function invocation.
    lambdaArn string
    The ARN of the Lambda function used for evaluation.
    lambdaTimeoutInSeconds number
    The timeout in seconds for the Lambda function invocation.
    lambda_arn str
    The ARN of the Lambda function used for evaluation.
    lambda_timeout_in_seconds int
    The timeout in seconds for the Lambda function invocation.
    lambdaArn String
    The ARN of the Lambda function used for evaluation.
    lambdaTimeoutInSeconds Number
    The timeout in seconds for the Lambda function invocation.

    EvaluatorLevel

    NameValue
    ToolCallTOOL_CALL
    TraceTRACE
    SessionSESSION
    NameValue
    EvaluatorLevelToolCallTOOL_CALL
    EvaluatorLevelTraceTRACE
    EvaluatorLevelSessionSESSION
    Value
    TOOL_CALL
    TRACE
    SESSION
    NameValue
    ToolCallTOOL_CALL
    TraceTRACE
    SessionSESSION
    NameValue
    ToolCallTOOL_CALL
    TraceTRACE
    SessionSESSION
    NameValue
    TOOL_CALLTOOL_CALL
    TRACETRACE
    SESSIONSESSION
    Value
    TOOL_CALL
    TRACE
    SESSION

    EvaluatorLlmAsAJudgeEvaluatorConfig

    Instructions string
    The evaluation instructions that guide the language model in assessing agent performance.
    ModelConfig EvaluatorModelConfig
    RatingScale EvaluatorRatingScale
    instructions string
    The evaluation instructions that guide the language model in assessing agent performance.
    model_config object
    rating_scale object
    instructions String
    The evaluation instructions that guide the language model in assessing agent performance.
    modelConfig EvaluatorModelConfig
    ratingScale EvaluatorRatingScale
    instructions string
    The evaluation instructions that guide the language model in assessing agent performance.
    modelConfig EvaluatorModelConfig
    ratingScale EvaluatorRatingScale
    instructions str
    The evaluation instructions that guide the language model in assessing agent performance.
    model_config EvaluatorModelConfig
    rating_scale EvaluatorRatingScale
    instructions String
    The evaluation instructions that guide the language model in assessing agent performance.
    modelConfig Property Map
    ratingScale Property Map

    EvaluatorModelConfig

    EvaluatorNumericalScaleDefinition

    Definition string
    The description that explains what this numerical rating represents.
    Label string
    The label that describes this numerical rating option.
    Value double
    The numerical value for this rating scale option.
    Definition string
    The description that explains what this numerical rating represents.
    Label string
    The label that describes this numerical rating option.
    Value float64
    The numerical value for this rating scale option.
    definition string
    The description that explains what this numerical rating represents.
    label string
    The label that describes this numerical rating option.
    value number
    The numerical value for this rating scale option.
    definition String
    The description that explains what this numerical rating represents.
    label String
    The label that describes this numerical rating option.
    value Double
    The numerical value for this rating scale option.
    definition string
    The description that explains what this numerical rating represents.
    label string
    The label that describes this numerical rating option.
    value number
    The numerical value for this rating scale option.
    definition str
    The description that explains what this numerical rating represents.
    label str
    The label that describes this numerical rating option.
    value float
    The numerical value for this rating scale option.
    definition String
    The description that explains what this numerical rating represents.
    label String
    The label that describes this numerical rating option.
    value Number
    The numerical value for this rating scale option.

    EvaluatorOpenResponsesEvaluatorModelConfig

    ModelId string
    The identifier of the model to use for evaluation.
    MaxOutputTokens int
    The maximum number of output tokens to generate, including visible output and reasoning tokens.
    Reasoning Pulumi.AwsNative.BedrockAgentCore.Inputs.EvaluatorReasoningConfiguration
    Temperature double
    The sampling temperature between 0 and 2.
    TopP double
    The nucleus sampling probability mass between 0 and 1.
    ModelId string
    The identifier of the model to use for evaluation.
    MaxOutputTokens int
    The maximum number of output tokens to generate, including visible output and reasoning tokens.
    Reasoning EvaluatorReasoningConfiguration
    Temperature float64
    The sampling temperature between 0 and 2.
    TopP float64
    The nucleus sampling probability mass between 0 and 1.
    model_id string
    The identifier of the model to use for evaluation.
    max_output_tokens number
    The maximum number of output tokens to generate, including visible output and reasoning tokens.
    reasoning object
    temperature number
    The sampling temperature between 0 and 2.
    top_p number
    The nucleus sampling probability mass between 0 and 1.
    modelId String
    The identifier of the model to use for evaluation.
    maxOutputTokens Integer
    The maximum number of output tokens to generate, including visible output and reasoning tokens.
    reasoning EvaluatorReasoningConfiguration
    temperature Double
    The sampling temperature between 0 and 2.
    topP Double
    The nucleus sampling probability mass between 0 and 1.
    modelId string
    The identifier of the model to use for evaluation.
    maxOutputTokens number
    The maximum number of output tokens to generate, including visible output and reasoning tokens.
    reasoning EvaluatorReasoningConfiguration
    temperature number
    The sampling temperature between 0 and 2.
    topP number
    The nucleus sampling probability mass between 0 and 1.
    model_id str
    The identifier of the model to use for evaluation.
    max_output_tokens int
    The maximum number of output tokens to generate, including visible output and reasoning tokens.
    reasoning EvaluatorReasoningConfiguration
    temperature float
    The sampling temperature between 0 and 2.
    top_p float
    The nucleus sampling probability mass between 0 and 1.
    modelId String
    The identifier of the model to use for evaluation.
    maxOutputTokens Number
    The maximum number of output tokens to generate, including visible output and reasoning tokens.
    reasoning Property Map
    temperature Number
    The sampling temperature between 0 and 2.
    topP Number
    The nucleus sampling probability mass between 0 and 1.

    EvaluatorProvider

    NameValue
    AwsAWS
    DeepEvalDeepEval
    AutoEvalAutoEval
    CustomCustom
    NameValue
    EvaluatorProviderAwsAWS
    EvaluatorProviderDeepEvalDeepEval
    EvaluatorProviderAutoEvalAutoEval
    EvaluatorProviderCustomCustom
    Value
    AWS
    DeepEval
    AutoEval
    Custom
    NameValue
    AwsAWS
    DeepEvalDeepEval
    AutoEvalAutoEval
    CustomCustom
    NameValue
    AwsAWS
    DeepEvalDeepEval
    AutoEvalAutoEval
    CustomCustom
    NameValue
    AWSAWS
    DEEP_EVALDeepEval
    AUTO_EVALAutoEval
    CUSTOMCustom
    Value
    AWS
    DeepEval
    AutoEval
    Custom

    EvaluatorRatingScale

    Categorical []EvaluatorCategoricalScaleDefinition
    MultiDimensional []EvaluatorEvaluationDimension
    The dimensions an LLM-as-a-Judge evaluator scores in a single judge call. Each dimension has its own instruction and rating scale.
    Numerical []EvaluatorNumericalScaleDefinition
    categorical list(object)
    multi_dimensional list(object)
    The dimensions an LLM-as-a-Judge evaluator scores in a single judge call. Each dimension has its own instruction and rating scale.
    numerical list(object)
    categorical List<EvaluatorCategoricalScaleDefinition>
    multiDimensional List<EvaluatorEvaluationDimension>
    The dimensions an LLM-as-a-Judge evaluator scores in a single judge call. Each dimension has its own instruction and rating scale.
    numerical List<EvaluatorNumericalScaleDefinition>
    categorical EvaluatorCategoricalScaleDefinition[]
    multiDimensional EvaluatorEvaluationDimension[]
    The dimensions an LLM-as-a-Judge evaluator scores in a single judge call. Each dimension has its own instruction and rating scale.
    numerical EvaluatorNumericalScaleDefinition[]
    categorical Sequence[EvaluatorCategoricalScaleDefinition]
    multi_dimensional Sequence[EvaluatorEvaluationDimension]
    The dimensions an LLM-as-a-Judge evaluator scores in a single judge call. Each dimension has its own instruction and rating scale.
    numerical Sequence[EvaluatorNumericalScaleDefinition]
    categorical List<Property Map>
    multiDimensional List<Property Map>
    The dimensions an LLM-as-a-Judge evaluator scores in a single judge call. Each dimension has its own instruction and rating scale.
    numerical List<Property Map>

    EvaluatorReasoningConfiguration

    Effort string
    The level of reasoning effort the model applies.
    Effort string
    The level of reasoning effort the model applies.
    effort string
    The level of reasoning effort the model applies.
    effort String
    The level of reasoning effort the model applies.
    effort string
    The level of reasoning effort the model applies.
    effort str
    The level of reasoning effort the model applies.
    effort String
    The level of reasoning effort the model applies.

    EvaluatorStatus

    NameValue
    ActiveACTIVE
    CreatingCREATING
    CreateFailedCREATE_FAILED
    UpdatingUPDATING
    UpdateFailedUPDATE_FAILED
    DeletingDELETING
    NameValue
    EvaluatorStatusActiveACTIVE
    EvaluatorStatusCreatingCREATING
    EvaluatorStatusCreateFailedCREATE_FAILED
    EvaluatorStatusUpdatingUPDATING
    EvaluatorStatusUpdateFailedUPDATE_FAILED
    EvaluatorStatusDeletingDELETING
    Value
    ACTIVE
    CREATING
    CREATE_FAILED
    UPDATING
    UPDATE_FAILED
    DELETING
    NameValue
    ActiveACTIVE
    CreatingCREATING
    CreateFailedCREATE_FAILED
    UpdatingUPDATING
    UpdateFailedUPDATE_FAILED
    DeletingDELETING
    NameValue
    ActiveACTIVE
    CreatingCREATING
    CreateFailedCREATE_FAILED
    UpdatingUPDATING
    UpdateFailedUPDATE_FAILED
    DeletingDELETING
    NameValue
    ACTIVEACTIVE
    CREATINGCREATING
    CREATE_FAILEDCREATE_FAILED
    UPDATINGUPDATING
    UPDATE_FAILEDUPDATE_FAILED
    DELETINGDELETING
    Value
    ACTIVE
    CREATING
    CREATE_FAILED
    UPDATING
    UPDATE_FAILED
    DELETING

    EvaluatorType

    NameValue
    BuiltinBuiltin
    ThirdPartyThirdParty
    CustomCustom
    CustomCodeCustomCode
    CustomDerivedCustomDerived
    NameValue
    EvaluatorTypeBuiltinBuiltin
    EvaluatorTypeThirdPartyThirdParty
    EvaluatorTypeCustomCustom
    EvaluatorTypeCustomCodeCustomCode
    EvaluatorTypeCustomDerivedCustomDerived
    Value
    Builtin
    ThirdParty
    Custom
    CustomCode
    CustomDerived
    NameValue
    BuiltinBuiltin
    ThirdPartyThirdParty
    CustomCustom
    CustomCodeCustomCode
    CustomDerivedCustomDerived
    NameValue
    BuiltinBuiltin
    ThirdPartyThirdParty
    CustomCustom
    CustomCodeCustomCode
    CustomDerivedCustomDerived
    NameValue
    BUILTINBuiltin
    THIRD_PARTYThirdParty
    CUSTOMCustom
    CUSTOM_CODECustomCode
    CUSTOM_DERIVEDCustomDerived
    Value
    Builtin
    ThirdParty
    Custom
    CustomCode
    CustomDerived

    Tag

    Key string
    The key name of the tag
    Value string
    The value of the tag
    Key string
    The key name of the tag
    Value string
    The value of the tag
    key string
    The key name of the tag
    value string
    The value of the tag
    key String
    The key name of the tag
    value String
    The value of the tag
    key string
    The key name of the tag
    value string
    The value of the tag
    key str
    The key name of the tag
    value str
    The value of the tag
    key String
    The key name of the tag
    value String
    The value of the tag

    Package Details

    Repository
    AWS Native pulumi/pulumi-aws-native
    License
    Apache-2.0
    aws-native logo aws-native logo AWS Cloud Control

    We recommend new projects start with resources from the AWS provider.

    Viewing docs for AWS Cloud Control v1.86.0
    published on Wednesday, Nov 18, 2026 by Pulumi

      Try Pulumi Cloud free.
      Your team will thank you.

      Start free trial