We recommend new projects start with resources from the AWS provider.
published on Monday, Mar 9, 2026 by Pulumi
We recommend new projects start with resources from the AWS provider.
published on Monday, Mar 9, 2026 by Pulumi
Resource Type definition for AWS::BedrockAgentCore::Evaluator - Creates a custom evaluator for agent quality assessment using LLM-as-a-Judge configurations.
Using getEvaluator
Two invocation forms are available. The direct form accepts plain arguments and either blocks until the result value is available, or returns a Promise-wrapped result. The output form accepts Input-wrapped arguments and returns an Output-wrapped result.
function getEvaluator(args: GetEvaluatorArgs, opts?: InvokeOptions): Promise<GetEvaluatorResult>
function getEvaluatorOutput(args: GetEvaluatorOutputArgs, opts?: InvokeOptions): Output<GetEvaluatorResult>def get_evaluator(evaluator_arn: Optional[str] = None,
opts: Optional[InvokeOptions] = None) -> GetEvaluatorResult
def get_evaluator_output(evaluator_arn: Optional[pulumi.Input[str]] = None,
opts: Optional[InvokeOptions] = None) -> Output[GetEvaluatorResult]func LookupEvaluator(ctx *Context, args *LookupEvaluatorArgs, opts ...InvokeOption) (*LookupEvaluatorResult, error)
func LookupEvaluatorOutput(ctx *Context, args *LookupEvaluatorOutputArgs, opts ...InvokeOption) LookupEvaluatorResultOutput> Note: This function is named LookupEvaluator in the Go SDK.
public static class GetEvaluator
{
public static Task<GetEvaluatorResult> InvokeAsync(GetEvaluatorArgs args, InvokeOptions? opts = null)
public static Output<GetEvaluatorResult> Invoke(GetEvaluatorInvokeArgs args, InvokeOptions? opts = null)
}public static CompletableFuture<GetEvaluatorResult> getEvaluator(GetEvaluatorArgs args, InvokeOptions options)
public static Output<GetEvaluatorResult> getEvaluator(GetEvaluatorArgs args, InvokeOptions options)
fn::invoke:
function: aws-native:bedrockagentcore:getEvaluator
arguments:
# arguments dictionaryThe following arguments are supported:
- Evaluator
Arn string - The Amazon Resource Name (ARN) of the evaluator.
- Evaluator
Arn string - The Amazon Resource Name (ARN) of the evaluator.
- evaluator
Arn String - The Amazon Resource Name (ARN) of the evaluator.
- evaluator
Arn string - The Amazon Resource Name (ARN) of the evaluator.
- evaluator_
arn str - The Amazon Resource Name (ARN) of the evaluator.
- evaluator
Arn String - The Amazon Resource Name (ARN) of the evaluator.
getEvaluator Result
The following output properties are available:
- Created
At string - The timestamp when the evaluator was created.
- Description string
- The description of the evaluator.
- Evaluator
Arn string - The Amazon Resource Name (ARN) of the evaluator.
- Evaluator
Config Pulumi.Aws Native. Bedrock Agent Core. Outputs. Evaluator Config - The configuration for the evaluator.
- Evaluator
Id string - The unique identifier of the evaluator.
- Level
Pulumi.
Aws Native. Bedrock Agent Core. Evaluator Level - The evaluation level that determines the scope of evaluation.
- Status
Pulumi.
Aws Native. Bedrock Agent Core. Evaluator Status - The current status of the evaluator.
-
List<Pulumi.
Aws Native. Outputs. Tag> - A list of tags to assign to the evaluator.
- Updated
At string - The timestamp when the evaluator was last updated.
- Created
At string - The timestamp when the evaluator was created.
- Description string
- The description of the evaluator.
- Evaluator
Arn string - The Amazon Resource Name (ARN) of the evaluator.
- Evaluator
Config EvaluatorConfig - The configuration for the evaluator.
- Evaluator
Id string - The unique identifier of the evaluator.
- Level
Evaluator
Level - The evaluation level that determines the scope of evaluation.
- Status
Evaluator
Status - The current status of the evaluator.
- Tag
- A list of tags to assign to the evaluator.
- Updated
At string - The timestamp when the evaluator was last updated.
- created
At String - The timestamp when the evaluator was created.
- description String
- The description of the evaluator.
- evaluator
Arn String - The Amazon Resource Name (ARN) of the evaluator.
- evaluator
Config EvaluatorConfig - The configuration for the evaluator.
- evaluator
Id String - The unique identifier of the evaluator.
- level
Evaluator
Level - The evaluation level that determines the scope of evaluation.
- status
Evaluator
Status - The current status of the evaluator.
- List<Tag>
- A list of tags to assign to the evaluator.
- updated
At String - The timestamp when the evaluator was last updated.
- created
At string - The timestamp when the evaluator was created.
- description string
- The description of the evaluator.
- evaluator
Arn string - The Amazon Resource Name (ARN) of the evaluator.
- evaluator
Config EvaluatorConfig - The configuration for the evaluator.
- evaluator
Id string - The unique identifier of the evaluator.
- level
Evaluator
Level - The evaluation level that determines the scope of evaluation.
- status
Evaluator
Status - The current status of the evaluator.
- Tag[]
- A list of tags to assign to the evaluator.
- updated
At string - The timestamp when the evaluator was last updated.
- created_
at str - The timestamp when the evaluator was created.
- description str
- The description of the evaluator.
- evaluator_
arn str - The Amazon Resource Name (ARN) of the evaluator.
- evaluator_
config EvaluatorConfig - The configuration for the evaluator.
- evaluator_
id str - The unique identifier of the evaluator.
- level
Evaluator
Level - The evaluation level that determines the scope of evaluation.
- status
Evaluator
Status - The current status of the evaluator.
- Sequence[root_Tag]
- A list of tags to assign to the evaluator.
- updated_
at str - The timestamp when the evaluator was last updated.
- created
At String - The timestamp when the evaluator was created.
- description String
- The description of the evaluator.
- evaluator
Arn String - The Amazon Resource Name (ARN) of the evaluator.
- evaluator
Config Property Map - The configuration for the evaluator.
- evaluator
Id String - The unique identifier of the evaluator.
- level "TOOL_CALL" | "TRACE" | "SESSION"
- The evaluation level that determines the scope of evaluation.
- status "ACTIVE" | "CREATING" | "CREATE_FAILED" | "UPDATING" | "UPDATE_FAILED" | "DELETING"
- The current status of the evaluator.
- List<Property Map>
- A list of tags to assign to the evaluator.
- updated
At String - The timestamp when the evaluator was last updated.
Supporting Types
EvaluatorBedrockEvaluatorModelConfig
- Model
Id string - The identifier of the Amazon Bedrock model to use for evaluation.
- Additional
Model objectRequest Fields - Additional model-specific request fields.
- Inference
Config Pulumi.Aws Native. Bedrock Agent Core. Inputs. Evaluator Inference Configuration
- Model
Id string - The identifier of the Amazon Bedrock model to use for evaluation.
- Additional
Model interface{}Request Fields - Additional model-specific request fields.
- Inference
Config EvaluatorInference Configuration
- model
Id String - The identifier of the Amazon Bedrock model to use for evaluation.
- additional
Model ObjectRequest Fields - Additional model-specific request fields.
- inference
Config EvaluatorInference Configuration
- model
Id string - The identifier of the Amazon Bedrock model to use for evaluation.
- additional
Model anyRequest Fields - Additional model-specific request fields.
- inference
Config EvaluatorInference Configuration
- model_
id str - The identifier of the Amazon Bedrock model to use for evaluation.
- additional_
model_ Anyrequest_ fields - Additional model-specific request fields.
- inference_
config EvaluatorInference Configuration
- model
Id String - The identifier of the Amazon Bedrock model to use for evaluation.
- additional
Model AnyRequest Fields - Additional model-specific request fields.
- inference
Config Property Map
EvaluatorCategoricalScaleDefinition
- Definition string
- The description that explains what this categorical rating represents.
- Label string
- The label of this categorical rating option.
- Definition string
- The description that explains what this categorical rating represents.
- Label string
- The label of this categorical rating option.
- definition String
- The description that explains what this categorical rating represents.
- label String
- The label of this categorical rating option.
- definition string
- The description that explains what this categorical rating represents.
- label string
- The label of this categorical rating option.
- definition str
- The description that explains what this categorical rating represents.
- label str
- The label of this categorical rating option.
- definition String
- The description that explains what this categorical rating represents.
- label String
- The label of this categorical rating option.
EvaluatorConfig
EvaluatorInferenceConfiguration
- Max
Tokens int - The maximum number of tokens to generate in the model response.
- Temperature double
- The temperature value that controls randomness in the model's responses.
- Top
P double - The top-p sampling parameter that controls the diversity of the model's responses.
- Max
Tokens int - The maximum number of tokens to generate in the model response.
- Temperature float64
- The temperature value that controls randomness in the model's responses.
- Top
P float64 - The top-p sampling parameter that controls the diversity of the model's responses.
- max
Tokens Integer - The maximum number of tokens to generate in the model response.
- temperature Double
- The temperature value that controls randomness in the model's responses.
- top
P Double - The top-p sampling parameter that controls the diversity of the model's responses.
- max
Tokens number - The maximum number of tokens to generate in the model response.
- temperature number
- The temperature value that controls randomness in the model's responses.
- top
P number - The top-p sampling parameter that controls the diversity of the model's responses.
- max_
tokens int - The maximum number of tokens to generate in the model response.
- temperature float
- The temperature value that controls randomness in the model's responses.
- top_
p float - The top-p sampling parameter that controls the diversity of the model's responses.
- max
Tokens Number - The maximum number of tokens to generate in the model response.
- temperature Number
- The temperature value that controls randomness in the model's responses.
- top
P Number - The top-p sampling parameter that controls the diversity of the model's responses.
EvaluatorLevel
EvaluatorLlmAsAJudgeEvaluatorConfig
- Instructions string
- The evaluation instructions that guide the language model in assessing agent performance.
- Model
Config Pulumi.Aws Native. Bedrock Agent Core. Inputs. Evaluator Model Config - Rating
Scale Pulumi.Aws Native. Bedrock Agent Core. Inputs. Evaluator Rating Scale
- Instructions string
- The evaluation instructions that guide the language model in assessing agent performance.
- Model
Config EvaluatorModel Config - Rating
Scale EvaluatorRating Scale
- instructions String
- The evaluation instructions that guide the language model in assessing agent performance.
- model
Config EvaluatorModel Config - rating
Scale EvaluatorRating Scale
- instructions string
- The evaluation instructions that guide the language model in assessing agent performance.
- model
Config EvaluatorModel Config - rating
Scale EvaluatorRating Scale
- instructions str
- The evaluation instructions that guide the language model in assessing agent performance.
- model_
config EvaluatorModel Config - rating_
scale EvaluatorRating Scale
- instructions String
- The evaluation instructions that guide the language model in assessing agent performance.
- model
Config Property Map - rating
Scale Property Map
EvaluatorModelConfig
EvaluatorNumericalScaleDefinition
- Definition string
- The description that explains what this numerical rating represents.
- Label string
- The label that describes this numerical rating option.
- Value double
- The numerical value for this rating scale option.
- Definition string
- The description that explains what this numerical rating represents.
- Label string
- The label that describes this numerical rating option.
- Value float64
- The numerical value for this rating scale option.
- definition String
- The description that explains what this numerical rating represents.
- label String
- The label that describes this numerical rating option.
- value Double
- The numerical value for this rating scale option.
- definition string
- The description that explains what this numerical rating represents.
- label string
- The label that describes this numerical rating option.
- value number
- The numerical value for this rating scale option.
- definition str
- The description that explains what this numerical rating represents.
- label str
- The label that describes this numerical rating option.
- value float
- The numerical value for this rating scale option.
- definition String
- The description that explains what this numerical rating represents.
- label String
- The label that describes this numerical rating option.
- value Number
- The numerical value for this rating scale option.
EvaluatorRatingScale
EvaluatorStatus
Tag
Package Details
- Repository
- AWS Native pulumi/pulumi-aws-native
- License
- Apache-2.0
We recommend new projects start with resources from the AWS provider.
published on Monday, Mar 9, 2026 by Pulumi
