1. Packages
  2. AWS Cloud Control
  3. API Docs
  4. bedrockagentcore
  5. getEvaluator

We recommend new projects start with resources from the AWS provider.

Viewing docs for AWS Cloud Control v1.57.0
published on Monday, Mar 9, 2026 by Pulumi
aws-native logo

We recommend new projects start with resources from the AWS provider.

Viewing docs for AWS Cloud Control v1.57.0
published on Monday, Mar 9, 2026 by Pulumi

    Resource Type definition for AWS::BedrockAgentCore::Evaluator - Creates a custom evaluator for agent quality assessment using LLM-as-a-Judge configurations.

    Using getEvaluator

    Two invocation forms are available. The direct form accepts plain arguments and either blocks until the result value is available, or returns a Promise-wrapped result. The output form accepts Input-wrapped arguments and returns an Output-wrapped result.

    function getEvaluator(args: GetEvaluatorArgs, opts?: InvokeOptions): Promise<GetEvaluatorResult>
    function getEvaluatorOutput(args: GetEvaluatorOutputArgs, opts?: InvokeOptions): Output<GetEvaluatorResult>
    def get_evaluator(evaluator_arn: Optional[str] = None,
                      opts: Optional[InvokeOptions] = None) -> GetEvaluatorResult
    def get_evaluator_output(evaluator_arn: Optional[pulumi.Input[str]] = None,
                      opts: Optional[InvokeOptions] = None) -> Output[GetEvaluatorResult]
    func LookupEvaluator(ctx *Context, args *LookupEvaluatorArgs, opts ...InvokeOption) (*LookupEvaluatorResult, error)
    func LookupEvaluatorOutput(ctx *Context, args *LookupEvaluatorOutputArgs, opts ...InvokeOption) LookupEvaluatorResultOutput

    > Note: This function is named LookupEvaluator in the Go SDK.

    public static class GetEvaluator 
    {
        public static Task<GetEvaluatorResult> InvokeAsync(GetEvaluatorArgs args, InvokeOptions? opts = null)
        public static Output<GetEvaluatorResult> Invoke(GetEvaluatorInvokeArgs args, InvokeOptions? opts = null)
    }
    public static CompletableFuture<GetEvaluatorResult> getEvaluator(GetEvaluatorArgs args, InvokeOptions options)
    public static Output<GetEvaluatorResult> getEvaluator(GetEvaluatorArgs args, InvokeOptions options)
    
    fn::invoke:
      function: aws-native:bedrockagentcore:getEvaluator
      arguments:
        # arguments dictionary

    The following arguments are supported:

    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluator_arn str
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.

    getEvaluator Result

    The following output properties are available:

    CreatedAt string
    The timestamp when the evaluator was created.
    Description string
    The description of the evaluator.
    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    EvaluatorConfig Pulumi.AwsNative.BedrockAgentCore.Outputs.EvaluatorConfig
    The configuration for the evaluator.
    EvaluatorId string
    The unique identifier of the evaluator.
    Level Pulumi.AwsNative.BedrockAgentCore.EvaluatorLevel
    The evaluation level that determines the scope of evaluation.
    Status Pulumi.AwsNative.BedrockAgentCore.EvaluatorStatus
    The current status of the evaluator.
    Tags List<Pulumi.AwsNative.Outputs.Tag>
    A list of tags to assign to the evaluator.
    UpdatedAt string
    The timestamp when the evaluator was last updated.
    CreatedAt string
    The timestamp when the evaluator was created.
    Description string
    The description of the evaluator.
    EvaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    EvaluatorConfig EvaluatorConfig
    The configuration for the evaluator.
    EvaluatorId string
    The unique identifier of the evaluator.
    Level EvaluatorLevel
    The evaluation level that determines the scope of evaluation.
    Status EvaluatorStatus
    The current status of the evaluator.
    Tags Tag
    A list of tags to assign to the evaluator.
    UpdatedAt string
    The timestamp when the evaluator was last updated.
    createdAt String
    The timestamp when the evaluator was created.
    description String
    The description of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorConfig EvaluatorConfig
    The configuration for the evaluator.
    evaluatorId String
    The unique identifier of the evaluator.
    level EvaluatorLevel
    The evaluation level that determines the scope of evaluation.
    status EvaluatorStatus
    The current status of the evaluator.
    tags List<Tag>
    A list of tags to assign to the evaluator.
    updatedAt String
    The timestamp when the evaluator was last updated.
    createdAt string
    The timestamp when the evaluator was created.
    description string
    The description of the evaluator.
    evaluatorArn string
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorConfig EvaluatorConfig
    The configuration for the evaluator.
    evaluatorId string
    The unique identifier of the evaluator.
    level EvaluatorLevel
    The evaluation level that determines the scope of evaluation.
    status EvaluatorStatus
    The current status of the evaluator.
    tags Tag[]
    A list of tags to assign to the evaluator.
    updatedAt string
    The timestamp when the evaluator was last updated.
    created_at str
    The timestamp when the evaluator was created.
    description str
    The description of the evaluator.
    evaluator_arn str
    The Amazon Resource Name (ARN) of the evaluator.
    evaluator_config EvaluatorConfig
    The configuration for the evaluator.
    evaluator_id str
    The unique identifier of the evaluator.
    level EvaluatorLevel
    The evaluation level that determines the scope of evaluation.
    status EvaluatorStatus
    The current status of the evaluator.
    tags Sequence[root_Tag]
    A list of tags to assign to the evaluator.
    updated_at str
    The timestamp when the evaluator was last updated.
    createdAt String
    The timestamp when the evaluator was created.
    description String
    The description of the evaluator.
    evaluatorArn String
    The Amazon Resource Name (ARN) of the evaluator.
    evaluatorConfig Property Map
    The configuration for the evaluator.
    evaluatorId String
    The unique identifier of the evaluator.
    level "TOOL_CALL" | "TRACE" | "SESSION"
    The evaluation level that determines the scope of evaluation.
    status "ACTIVE" | "CREATING" | "CREATE_FAILED" | "UPDATING" | "UPDATE_FAILED" | "DELETING"
    The current status of the evaluator.
    tags List<Property Map>
    A list of tags to assign to the evaluator.
    updatedAt String
    The timestamp when the evaluator was last updated.

    Supporting Types

    EvaluatorBedrockEvaluatorModelConfig

    ModelId string
    The identifier of the Amazon Bedrock model to use for evaluation.
    AdditionalModelRequestFields object
    Additional model-specific request fields.
    InferenceConfig Pulumi.AwsNative.BedrockAgentCore.Inputs.EvaluatorInferenceConfiguration
    ModelId string
    The identifier of the Amazon Bedrock model to use for evaluation.
    AdditionalModelRequestFields interface{}
    Additional model-specific request fields.
    InferenceConfig EvaluatorInferenceConfiguration
    modelId String
    The identifier of the Amazon Bedrock model to use for evaluation.
    additionalModelRequestFields Object
    Additional model-specific request fields.
    inferenceConfig EvaluatorInferenceConfiguration
    modelId string
    The identifier of the Amazon Bedrock model to use for evaluation.
    additionalModelRequestFields any
    Additional model-specific request fields.
    inferenceConfig EvaluatorInferenceConfiguration
    model_id str
    The identifier of the Amazon Bedrock model to use for evaluation.
    additional_model_request_fields Any
    Additional model-specific request fields.
    inference_config EvaluatorInferenceConfiguration
    modelId String
    The identifier of the Amazon Bedrock model to use for evaluation.
    additionalModelRequestFields Any
    Additional model-specific request fields.
    inferenceConfig Property Map

    EvaluatorCategoricalScaleDefinition

    Definition string
    The description that explains what this categorical rating represents.
    Label string
    The label of this categorical rating option.
    Definition string
    The description that explains what this categorical rating represents.
    Label string
    The label of this categorical rating option.
    definition String
    The description that explains what this categorical rating represents.
    label String
    The label of this categorical rating option.
    definition string
    The description that explains what this categorical rating represents.
    label string
    The label of this categorical rating option.
    definition str
    The description that explains what this categorical rating represents.
    label str
    The label of this categorical rating option.
    definition String
    The description that explains what this categorical rating represents.
    label String
    The label of this categorical rating option.

    EvaluatorConfig

    EvaluatorInferenceConfiguration

    MaxTokens int
    The maximum number of tokens to generate in the model response.
    Temperature double
    The temperature value that controls randomness in the model's responses.
    TopP double
    The top-p sampling parameter that controls the diversity of the model's responses.
    MaxTokens int
    The maximum number of tokens to generate in the model response.
    Temperature float64
    The temperature value that controls randomness in the model's responses.
    TopP float64
    The top-p sampling parameter that controls the diversity of the model's responses.
    maxTokens Integer
    The maximum number of tokens to generate in the model response.
    temperature Double
    The temperature value that controls randomness in the model's responses.
    topP Double
    The top-p sampling parameter that controls the diversity of the model's responses.
    maxTokens number
    The maximum number of tokens to generate in the model response.
    temperature number
    The temperature value that controls randomness in the model's responses.
    topP number
    The top-p sampling parameter that controls the diversity of the model's responses.
    max_tokens int
    The maximum number of tokens to generate in the model response.
    temperature float
    The temperature value that controls randomness in the model's responses.
    top_p float
    The top-p sampling parameter that controls the diversity of the model's responses.
    maxTokens Number
    The maximum number of tokens to generate in the model response.
    temperature Number
    The temperature value that controls randomness in the model's responses.
    topP Number
    The top-p sampling parameter that controls the diversity of the model's responses.

    EvaluatorLevel

    EvaluatorLlmAsAJudgeEvaluatorConfig

    Instructions string
    The evaluation instructions that guide the language model in assessing agent performance.
    ModelConfig EvaluatorModelConfig
    RatingScale EvaluatorRatingScale
    instructions String
    The evaluation instructions that guide the language model in assessing agent performance.
    modelConfig EvaluatorModelConfig
    ratingScale EvaluatorRatingScale
    instructions string
    The evaluation instructions that guide the language model in assessing agent performance.
    modelConfig EvaluatorModelConfig
    ratingScale EvaluatorRatingScale
    instructions str
    The evaluation instructions that guide the language model in assessing agent performance.
    model_config EvaluatorModelConfig
    rating_scale EvaluatorRatingScale
    instructions String
    The evaluation instructions that guide the language model in assessing agent performance.
    modelConfig Property Map
    ratingScale Property Map

    EvaluatorModelConfig

    EvaluatorNumericalScaleDefinition

    Definition string
    The description that explains what this numerical rating represents.
    Label string
    The label that describes this numerical rating option.
    Value double
    The numerical value for this rating scale option.
    Definition string
    The description that explains what this numerical rating represents.
    Label string
    The label that describes this numerical rating option.
    Value float64
    The numerical value for this rating scale option.
    definition String
    The description that explains what this numerical rating represents.
    label String
    The label that describes this numerical rating option.
    value Double
    The numerical value for this rating scale option.
    definition string
    The description that explains what this numerical rating represents.
    label string
    The label that describes this numerical rating option.
    value number
    The numerical value for this rating scale option.
    definition str
    The description that explains what this numerical rating represents.
    label str
    The label that describes this numerical rating option.
    value float
    The numerical value for this rating scale option.
    definition String
    The description that explains what this numerical rating represents.
    label String
    The label that describes this numerical rating option.
    value Number
    The numerical value for this rating scale option.

    EvaluatorRatingScale

    EvaluatorStatus

    Tag

    Key string
    The key name of the tag
    Value string
    The value of the tag
    Key string
    The key name of the tag
    Value string
    The value of the tag
    key String
    The key name of the tag
    value String
    The value of the tag
    key string
    The key name of the tag
    value string
    The value of the tag
    key str
    The key name of the tag
    value str
    The value of the tag
    key String
    The key name of the tag
    value String
    The value of the tag

    Package Details

    Repository
    AWS Native pulumi/pulumi-aws-native
    License
    Apache-2.0
    aws-native logo

    We recommend new projects start with resources from the AWS provider.

    Viewing docs for AWS Cloud Control v1.57.0
    published on Monday, Mar 9, 2026 by Pulumi
      Try Pulumi Cloud free. Your team will thank you.