databricks.getAiGatewayModelServices

Databricks v1.107.0, Aug 25 26

Viewing docs for Databricks v1.107.0
published on Tuesday, Aug 25, 2026 by Pulumi

Schema (JSON)

pulumi/pulumi-databricks

Viewing docs for Databricks v1.107.0
published on Tuesday, Aug 25, 2026 by Pulumi

Schema (JSON)

pulumi/pulumi-databricks

Using getAiGatewayModelServices

Two invocation forms are available. The direct form accepts plain arguments and either blocks until the result value is available, or returns a Promise-wrapped result. The output form accepts Input-wrapped arguments and returns an Output-wrapped result.

function getAiGatewayModelServices(args: GetAiGatewayModelServicesArgs, opts?: InvokeOptions): Promise<GetAiGatewayModelServicesResult>
function getAiGatewayModelServicesOutput(args: GetAiGatewayModelServicesOutputArgs, opts?: InvokeOutputOptions): Output<GetAiGatewayModelServicesResult>

def get_ai_gateway_model_services(page_size: Optional[int] = None,
                                  parent: Optional[str] = None,
                                  provider_config: Optional[GetAiGatewayModelServicesProviderConfig] = None,
                                  view: Optional[str] = None,
                                  opts: Optional[InvokeOptions] = None) -> GetAiGatewayModelServicesResult
def get_ai_gateway_model_services_output(page_size: pulumi.Input[Optional[int]] = None,
                                  parent: pulumi.Input[Optional[str]] = None,
                                  provider_config: pulumi.Input[Optional[GetAiGatewayModelServicesProviderConfigArgs]] = None,
                                  view: pulumi.Input[Optional[str]] = None,
                                  opts: Optional[InvokeOutputOptions] = None) -> Output[GetAiGatewayModelServicesResult]

func GetAiGatewayModelServices(ctx *Context, args *GetAiGatewayModelServicesArgs, opts ...InvokeOption) (*GetAiGatewayModelServicesResult, error)
func GetAiGatewayModelServicesOutput(ctx *Context, args *GetAiGatewayModelServicesOutputArgs, opts ...InvokeOption) GetAiGatewayModelServicesResultOutput

> Note: This function is named GetAiGatewayModelServices in the Go SDK.

public static class GetAiGatewayModelServices 
{
    public static Task<GetAiGatewayModelServicesResult> InvokeAsync(GetAiGatewayModelServicesArgs args, InvokeOptions? opts = null)
    public static Output<GetAiGatewayModelServicesResult> Invoke(GetAiGatewayModelServicesInvokeArgs args, InvokeOptions? opts = null)
    public static Output<GetAiGatewayModelServicesResult> Invoke(GetAiGatewayModelServicesInvokeArgs args, InvokeOutputOptions opts)
}

public static CompletableFuture<GetAiGatewayModelServicesResult> getAiGatewayModelServices(GetAiGatewayModelServicesArgs args, InvokeOptions options)
public static Output<GetAiGatewayModelServicesResult> getAiGatewayModelServices(GetAiGatewayModelServicesArgs args, InvokeOptions options)
public static Output<GetAiGatewayModelServicesResult> getAiGatewayModelServices(GetAiGatewayModelServicesArgs args, InvokeOutputOptions options)

fn::invoke:
  function: databricks:index/getAiGatewayModelServices:getAiGatewayModelServices
  arguments:
    # arguments dictionary

data "databricks_get_ai_gateway_model_services" "name" {
    # arguments
}

The following arguments are supported:

PageSize int: Maximum number of model services to return. Defaults to 100 when unset or 0; the maximum is 100. Use pageToken to retrieve additional pages
Parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
ProviderConfig GetAiGatewayModelServicesProviderConfig: Configure the provider for management through account provider.
View string: View selector controlling which fields are populated per row. FULL returns the full representation of the service; BASIC returns a more compact version. Defaults to BASIC when unset. Possible values are: BASIC, FULL

PageSize int: Maximum number of model services to return. Defaults to 100 when unset or 0; the maximum is 100. Use pageToken to retrieve additional pages
Parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
ProviderConfig GetAiGatewayModelServicesProviderConfig: Configure the provider for management through account provider.
View string: View selector controlling which fields are populated per row. FULL returns the full representation of the service; BASIC returns a more compact version. Defaults to BASIC when unset. Possible values are: BASIC, FULL

page_size number: Maximum number of model services to return. Defaults to 100 when unset or 0; the maximum is 100. Use pageToken to retrieve additional pages
parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
provider_config object: Configure the provider for management through account provider.
view string: View selector controlling which fields are populated per row. FULL returns the full representation of the service; BASIC returns a more compact version. Defaults to BASIC when unset. Possible values are: BASIC, FULL

pageSize Integer: Maximum number of model services to return. Defaults to 100 when unset or 0; the maximum is 100. Use pageToken to retrieve additional pages
parent String: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
providerConfig GetAiGatewayModelServicesProviderConfig: Configure the provider for management through account provider.
view String: View selector controlling which fields are populated per row. FULL returns the full representation of the service; BASIC returns a more compact version. Defaults to BASIC when unset. Possible values are: BASIC, FULL

pageSize number: Maximum number of model services to return. Defaults to 100 when unset or 0; the maximum is 100. Use pageToken to retrieve additional pages
parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
providerConfig GetAiGatewayModelServicesProviderConfig: Configure the provider for management through account provider.
view string: View selector controlling which fields are populated per row. FULL returns the full representation of the service; BASIC returns a more compact version. Defaults to BASIC when unset. Possible values are: BASIC, FULL

page_size int: Maximum number of model services to return. Defaults to 100 when unset or 0; the maximum is 100. Use pageToken to retrieve additional pages
parent str: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
provider_config GetAiGatewayModelServicesProviderConfig: Configure the provider for management through account provider.
view str: View selector controlling which fields are populated per row. FULL returns the full representation of the service; BASIC returns a more compact version. Defaults to BASIC when unset. Possible values are: BASIC, FULL

pageSize Number: Maximum number of model services to return. Defaults to 100 when unset or 0; the maximum is 100. Use pageToken to retrieve additional pages
parent String: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
providerConfig Property Map: Configure the provider for management through account provider.
view String: View selector controlling which fields are populated per row. FULL returns the full representation of the service; BASIC returns a more compact version. Defaults to BASIC when unset. Possible values are: BASIC, FULL

getAiGatewayModelServices Result

The following output properties are available:

ModelServices List<GetAiGatewayModelServicesModelService>
PageSize int
Parent string: (string) - Parent UC schema where the inference table is created. Format: schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected
ProviderConfig GetAiGatewayModelServicesProviderConfig
View string

ModelServices []GetAiGatewayModelServicesModelService
PageSize int
Parent string: (string) - Parent UC schema where the inference table is created. Format: schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected
ProviderConfig GetAiGatewayModelServicesProviderConfig
View string

model_services list(object)
page_size number
parent string: (string) - Parent UC schema where the inference table is created. Format: schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected
provider_config object
view string

modelServices List<GetAiGatewayModelServicesModelService>
pageSize Integer
parent String: (string) - Parent UC schema where the inference table is created. Format: schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected
providerConfig GetAiGatewayModelServicesProviderConfig
view String

modelServices GetAiGatewayModelServicesModelService[]
pageSize number
parent string: (string) - Parent UC schema where the inference table is created. Format: schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected
providerConfig GetAiGatewayModelServicesProviderConfig
view string

model_services Sequence[GetAiGatewayModelServicesModelService]
page_size int
parent str: (string) - Parent UC schema where the inference table is created. Format: schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected
provider_config GetAiGatewayModelServicesProviderConfig
view str

modelServices List<Property Map>
pageSize Number
parent String: (string) - Parent UC schema where the inference table is created. Format: schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected
providerConfig Property Map
view String

Supporting Types

GetAiGatewayModelServicesModelService

Comment string: (string) - User-provided description
Config GetAiGatewayModelServicesModelServiceConfig: (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference table. Required on CreateModelService; on UpdateModelService it is required only when config (or a config.* subpath) appears in updateMask
CreateTime string: (string) - When the model service was created
CreatedBy string: (string) - Creator identity
EffectiveOwner string: (string) - The resolved owner of the ModelService. Falls back to the caller's identity when owner is not explicitly set on creation
Etag string: (string) - Optimistic concurrency control token. Server-generated from the entity's state and returned on every read. To use it as an if-match precondition on a mutation, echo the last-read value back via the dedicated etag field on the Update / Delete request; the server rejects the mutation if the stored etag differs
MetastoreId string: (string) - Metastore hosting the model service
Name string: (string) - User-facing label for this destination, used in routing references
Owner string: (string) - The owner of the model service. Write-only; read owner via effective_owner
SupportedApiTypes List<string>: (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
UpdateTime string: (string) - When the model service was last modified
UpdatedBy string: (string) - Identity of the last updater
ProviderConfig GetAiGatewayModelServicesModelServiceProviderConfig: Configure the provider for management through account provider.

Comment string: (string) - User-provided description
Config GetAiGatewayModelServicesModelServiceConfig: (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference table. Required on CreateModelService; on UpdateModelService it is required only when config (or a config.* subpath) appears in updateMask
CreateTime string: (string) - When the model service was created
CreatedBy string: (string) - Creator identity
EffectiveOwner string: (string) - The resolved owner of the ModelService. Falls back to the caller's identity when owner is not explicitly set on creation
Etag string: (string) - Optimistic concurrency control token. Server-generated from the entity's state and returned on every read. To use it as an if-match precondition on a mutation, echo the last-read value back via the dedicated etag field on the Update / Delete request; the server rejects the mutation if the stored etag differs
MetastoreId string: (string) - Metastore hosting the model service
Name string: (string) - User-facing label for this destination, used in routing references
Owner string: (string) - The owner of the model service. Write-only; read owner via effective_owner
SupportedApiTypes []string: (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
UpdateTime string: (string) - When the model service was last modified
UpdatedBy string: (string) - Identity of the last updater
ProviderConfig GetAiGatewayModelServicesModelServiceProviderConfig: Configure the provider for management through account provider.

comment string: (string) - User-provided description
config object: (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference table. Required on CreateModelService; on UpdateModelService it is required only when config (or a config.* subpath) appears in updateMask
create_time string: (string) - When the model service was created
created_by string: (string) - Creator identity
effective_owner string: (string) - The resolved owner of the ModelService. Falls back to the caller's identity when owner is not explicitly set on creation
etag string: (string) - Optimistic concurrency control token. Server-generated from the entity's state and returned on every read. To use it as an if-match precondition on a mutation, echo the last-read value back via the dedicated etag field on the Update / Delete request; the server rejects the mutation if the stored etag differs
metastore_id string: (string) - Metastore hosting the model service
name string: (string) - User-facing label for this destination, used in routing references
owner string: (string) - The owner of the model service. Write-only; read owner via effective_owner
supported_api_types list(string): (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
update_time string: (string) - When the model service was last modified
updated_by string: (string) - Identity of the last updater
provider_config object: Configure the provider for management through account provider.

comment String: (string) - User-provided description
config GetAiGatewayModelServicesModelServiceConfig: (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference table. Required on CreateModelService; on UpdateModelService it is required only when config (or a config.* subpath) appears in updateMask
createTime String: (string) - When the model service was created
createdBy String: (string) - Creator identity
effectiveOwner String: (string) - The resolved owner of the ModelService. Falls back to the caller's identity when owner is not explicitly set on creation
etag String: (string) - Optimistic concurrency control token. Server-generated from the entity's state and returned on every read. To use it as an if-match precondition on a mutation, echo the last-read value back via the dedicated etag field on the Update / Delete request; the server rejects the mutation if the stored etag differs
metastoreId String: (string) - Metastore hosting the model service
name String: (string) - User-facing label for this destination, used in routing references
owner String: (string) - The owner of the model service. Write-only; read owner via effective_owner
supportedApiTypes List<String>: (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
updateTime String: (string) - When the model service was last modified
updatedBy String: (string) - Identity of the last updater
providerConfig GetAiGatewayModelServicesModelServiceProviderConfig: Configure the provider for management through account provider.

comment string: (string) - User-provided description
config GetAiGatewayModelServicesModelServiceConfig: (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference table. Required on CreateModelService; on UpdateModelService it is required only when config (or a config.* subpath) appears in updateMask
createTime string: (string) - When the model service was created
createdBy string: (string) - Creator identity
effectiveOwner string: (string) - The resolved owner of the ModelService. Falls back to the caller's identity when owner is not explicitly set on creation
etag string: (string) - Optimistic concurrency control token. Server-generated from the entity's state and returned on every read. To use it as an if-match precondition on a mutation, echo the last-read value back via the dedicated etag field on the Update / Delete request; the server rejects the mutation if the stored etag differs
metastoreId string: (string) - Metastore hosting the model service
name string: (string) - User-facing label for this destination, used in routing references
owner string: (string) - The owner of the model service. Write-only; read owner via effective_owner
supportedApiTypes string[]: (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
updateTime string: (string) - When the model service was last modified
updatedBy string: (string) - Identity of the last updater
providerConfig GetAiGatewayModelServicesModelServiceProviderConfig: Configure the provider for management through account provider.

comment str: (string) - User-provided description
config GetAiGatewayModelServicesModelServiceConfig: (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference table. Required on CreateModelService; on UpdateModelService it is required only when config (or a config.* subpath) appears in updateMask
create_time str: (string) - When the model service was created
created_by str: (string) - Creator identity
effective_owner str: (string) - The resolved owner of the ModelService. Falls back to the caller's identity when owner is not explicitly set on creation
etag str: (string) - Optimistic concurrency control token. Server-generated from the entity's state and returned on every read. To use it as an if-match precondition on a mutation, echo the last-read value back via the dedicated etag field on the Update / Delete request; the server rejects the mutation if the stored etag differs
metastore_id str: (string) - Metastore hosting the model service
name str: (string) - User-facing label for this destination, used in routing references
owner str: (string) - The owner of the model service. Write-only; read owner via effective_owner
supported_api_types Sequence[str]: (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
update_time str: (string) - When the model service was last modified
updated_by str: (string) - Identity of the last updater
provider_config GetAiGatewayModelServicesModelServiceProviderConfig: Configure the provider for management through account provider.

comment String: (string) - User-provided description
config Property Map: (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference table. Required on CreateModelService; on UpdateModelService it is required only when config (or a config.* subpath) appears in updateMask
createTime String: (string) - When the model service was created
createdBy String: (string) - Creator identity
effectiveOwner String: (string) - The resolved owner of the ModelService. Falls back to the caller's identity when owner is not explicitly set on creation
etag String: (string) - Optimistic concurrency control token. Server-generated from the entity's state and returned on every read. To use it as an if-match precondition on a mutation, echo the last-read value back via the dedicated etag field on the Update / Delete request; the server rejects the mutation if the stored etag differs
metastoreId String: (string) - Metastore hosting the model service
name String: (string) - User-facing label for this destination, used in routing references
owner String: (string) - The owner of the model service. Write-only; read owner via effective_owner
supportedApiTypes List<String>: (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
updateTime String: (string) - When the model service was last modified
updatedBy String: (string) - Identity of the last updater
providerConfig Property Map: Configure the provider for management through account provider.

GetAiGatewayModelServicesModelServiceConfig

InferenceTable GetAiGatewayModelServicesModelServiceConfigInferenceTable: (InferenceTableConfig) - Inference table config for payload logging
RateLimits List<GetAiGatewayModelServicesModelServiceConfigRateLimit>: (list of RateLimit) - Rate limits applied to requests routed through this model service
Routing GetAiGatewayModelServicesModelServiceConfigRouting: (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback

InferenceTable GetAiGatewayModelServicesModelServiceConfigInferenceTable: (InferenceTableConfig) - Inference table config for payload logging
RateLimits []GetAiGatewayModelServicesModelServiceConfigRateLimit: (list of RateLimit) - Rate limits applied to requests routed through this model service
Routing GetAiGatewayModelServicesModelServiceConfigRouting: (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback

inference_table object: (InferenceTableConfig) - Inference table config for payload logging
rate_limits list(object): (list of RateLimit) - Rate limits applied to requests routed through this model service
routing object: (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback

inferenceTable GetAiGatewayModelServicesModelServiceConfigInferenceTable: (InferenceTableConfig) - Inference table config for payload logging
rateLimits List<GetAiGatewayModelServicesModelServiceConfigRateLimit>: (list of RateLimit) - Rate limits applied to requests routed through this model service
routing GetAiGatewayModelServicesModelServiceConfigRouting: (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback

inferenceTable GetAiGatewayModelServicesModelServiceConfigInferenceTable: (InferenceTableConfig) - Inference table config for payload logging
rateLimits GetAiGatewayModelServicesModelServiceConfigRateLimit[]: (list of RateLimit) - Rate limits applied to requests routed through this model service
routing GetAiGatewayModelServicesModelServiceConfigRouting: (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback

inference_table GetAiGatewayModelServicesModelServiceConfigInferenceTable: (InferenceTableConfig) - Inference table config for payload logging
rate_limits Sequence[GetAiGatewayModelServicesModelServiceConfigRateLimit]: (list of RateLimit) - Rate limits applied to requests routed through this model service
routing GetAiGatewayModelServicesModelServiceConfigRouting: (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback

inferenceTable Property Map: (InferenceTableConfig) - Inference table config for payload logging
rateLimits List<Property Map>: (list of RateLimit) - Rate limits applied to requests routed through this model service
routing Property Map: (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback

GetAiGatewayModelServicesModelServiceConfigInferenceTable

IsDeleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
Parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
Table string: (string) - Resolved UC table for payload logs. Format: tables/{catalog}.{schema}.{table}
Disabled bool: (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that payload logging is active (the on-by-default state coincides with the proto zero-value, so the server never fills this field for a client that leaves it unset). Set disabled = true to pause runtime logging while keeping the sub-message attached (preserving parent and tableNamePrefix for a later flip back to active). parent remains required either way
TableNamePrefix string: (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC stores is <table_name_prefix>_payload; the _payload suffix is appended automatically. To find the actual UC table after Create, read the table field on the response. Defaults to <model_service_name>_payload when unset. Set at create time and immutable thereafter; changing it on an existing service is rejected

IsDeleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
Parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
Table string: (string) - Resolved UC table for payload logs. Format: tables/{catalog}.{schema}.{table}
Disabled bool: (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that payload logging is active (the on-by-default state coincides with the proto zero-value, so the server never fills this field for a client that leaves it unset). Set disabled = true to pause runtime logging while keeping the sub-message attached (preserving parent and tableNamePrefix for a later flip back to active). parent remains required either way
TableNamePrefix string: (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC stores is <table_name_prefix>_payload; the _payload suffix is appended automatically. To find the actual UC table after Create, read the table field on the response. Defaults to <model_service_name>_payload when unset. Set at create time and immutable thereafter; changing it on an existing service is rejected

is_deleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
table string: (string) - Resolved UC table for payload logs. Format: tables/{catalog}.{schema}.{table}
disabled bool: (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that payload logging is active (the on-by-default state coincides with the proto zero-value, so the server never fills this field for a client that leaves it unset). Set disabled = true to pause runtime logging while keeping the sub-message attached (preserving parent and tableNamePrefix for a later flip back to active). parent remains required either way
table_name_prefix string: (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC stores is <table_name_prefix>_payload; the _payload suffix is appended automatically. To find the actual UC table after Create, read the table field on the response. Defaults to <model_service_name>_payload when unset. Set at create time and immutable thereafter; changing it on an existing service is rejected

isDeleted Boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
parent String: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
table String: (string) - Resolved UC table for payload logs. Format: tables/{catalog}.{schema}.{table}
disabled Boolean: (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that payload logging is active (the on-by-default state coincides with the proto zero-value, so the server never fills this field for a client that leaves it unset). Set disabled = true to pause runtime logging while keeping the sub-message attached (preserving parent and tableNamePrefix for a later flip back to active). parent remains required either way
tableNamePrefix String: (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC stores is <table_name_prefix>_payload; the _payload suffix is appended automatically. To find the actual UC table after Create, read the table field on the response. Defaults to <model_service_name>_payload when unset. Set at create time and immutable thereafter; changing it on an existing service is rejected

isDeleted boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
parent string: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
table string: (string) - Resolved UC table for payload logs. Format: tables/{catalog}.{schema}.{table}
disabled boolean: (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that payload logging is active (the on-by-default state coincides with the proto zero-value, so the server never fills this field for a client that leaves it unset). Set disabled = true to pause runtime logging while keeping the sub-message attached (preserving parent and tableNamePrefix for a later flip back to active). parent remains required either way
tableNamePrefix string: (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC stores is <table_name_prefix>_payload; the _payload suffix is appended automatically. To find the actual UC table after Create, read the table field on the response. Defaults to <model_service_name>_payload when unset. Set at create time and immutable thereafter; changing it on an existing service is rejected

is_deleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
parent str: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
table str: (string) - Resolved UC table for payload logs. Format: tables/{catalog}.{schema}.{table}
disabled bool: (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that payload logging is active (the on-by-default state coincides with the proto zero-value, so the server never fills this field for a client that leaves it unset). Set disabled = true to pause runtime logging while keeping the sub-message attached (preserving parent and tableNamePrefix for a later flip back to active). parent remains required either way
table_name_prefix str: (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC stores is <table_name_prefix>_payload; the _payload suffix is appended automatically. To find the actual UC table after Create, read the table field on the response. Defaults to <model_service_name>_payload when unset. Set at create time and immutable thereafter; changing it on an existing service is rejected

isDeleted Boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
parent String: Name of the parent schema to list within, as schemas/{catalog}.{schema}. Each {...} component is capped at 255 characters individually
table String: (string) - Resolved UC table for payload logs. Format: tables/{catalog}.{schema}.{table}
disabled Boolean: (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that payload logging is active (the on-by-default state coincides with the proto zero-value, so the server never fills this field for a client that leaves it unset). Set disabled = true to pause runtime logging while keeping the sub-message attached (preserving parent and tableNamePrefix for a later flip back to active). parent remains required either way
tableNamePrefix String: (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC stores is <table_name_prefix>_payload; the _payload suffix is appended automatically. To find the actual UC table after Create, read the table field on the response. Defaults to <model_service_name>_payload when unset. Set at create time and immutable thereafter; changing it on an existing service is rejected

GetAiGatewayModelServicesModelServiceConfigRateLimit

Key string: (string) - Scope key. Determines whether principal is required. Possible values are: RATE_LIMIT_KEY_REQUEST_TAG, RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_SERVICE_PRINCIPAL, RATE_LIMIT_KEY_USER, RATE_LIMIT_KEY_USER_DEFAULT, RATE_LIMIT_KEY_USER_GROUP
RenewalPeriod string: (string) - Renewal period. Possible values are: RATE_LIMIT_RENEWAL_PERIOD_HOUR, RATE_LIMIT_RENEWAL_PERIOD_MINUTE
Principal string: (string) - Principal this limit applies to: user email, group name, or service principal application ID. Required unless key is RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_USER_DEFAULT, or RATE_LIMIT_KEY_REQUEST_TAG (which must not set a principal)
RequestTagKey string: (string) - Request tag key this limit applies to. Required when key is RATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise
RequestTagValue string: (string) - Request tag value this limit applies to. Only valid when key is RATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value of requestTagKey (an any-value default); a set value is a specific override for that value
Requests int: (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
Tokens int: (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit

Key string: (string) - Scope key. Determines whether principal is required. Possible values are: RATE_LIMIT_KEY_REQUEST_TAG, RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_SERVICE_PRINCIPAL, RATE_LIMIT_KEY_USER, RATE_LIMIT_KEY_USER_DEFAULT, RATE_LIMIT_KEY_USER_GROUP
RenewalPeriod string: (string) - Renewal period. Possible values are: RATE_LIMIT_RENEWAL_PERIOD_HOUR, RATE_LIMIT_RENEWAL_PERIOD_MINUTE
Principal string: (string) - Principal this limit applies to: user email, group name, or service principal application ID. Required unless key is RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_USER_DEFAULT, or RATE_LIMIT_KEY_REQUEST_TAG (which must not set a principal)
RequestTagKey string: (string) - Request tag key this limit applies to. Required when key is RATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise
RequestTagValue string: (string) - Request tag value this limit applies to. Only valid when key is RATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value of requestTagKey (an any-value default); a set value is a specific override for that value
Requests int: (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
Tokens int: (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit

key string: (string) - Scope key. Determines whether principal is required. Possible values are: RATE_LIMIT_KEY_REQUEST_TAG, RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_SERVICE_PRINCIPAL, RATE_LIMIT_KEY_USER, RATE_LIMIT_KEY_USER_DEFAULT, RATE_LIMIT_KEY_USER_GROUP
renewal_period string: (string) - Renewal period. Possible values are: RATE_LIMIT_RENEWAL_PERIOD_HOUR, RATE_LIMIT_RENEWAL_PERIOD_MINUTE
principal string: (string) - Principal this limit applies to: user email, group name, or service principal application ID. Required unless key is RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_USER_DEFAULT, or RATE_LIMIT_KEY_REQUEST_TAG (which must not set a principal)
request_tag_key string: (string) - Request tag key this limit applies to. Required when key is RATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise
request_tag_value string: (string) - Request tag value this limit applies to. Only valid when key is RATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value of requestTagKey (an any-value default); a set value is a specific override for that value
requests number: (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
tokens number: (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit

key String: (string) - Scope key. Determines whether principal is required. Possible values are: RATE_LIMIT_KEY_REQUEST_TAG, RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_SERVICE_PRINCIPAL, RATE_LIMIT_KEY_USER, RATE_LIMIT_KEY_USER_DEFAULT, RATE_LIMIT_KEY_USER_GROUP
renewalPeriod String: (string) - Renewal period. Possible values are: RATE_LIMIT_RENEWAL_PERIOD_HOUR, RATE_LIMIT_RENEWAL_PERIOD_MINUTE
principal String: (string) - Principal this limit applies to: user email, group name, or service principal application ID. Required unless key is RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_USER_DEFAULT, or RATE_LIMIT_KEY_REQUEST_TAG (which must not set a principal)
requestTagKey String: (string) - Request tag key this limit applies to. Required when key is RATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise
requestTagValue String: (string) - Request tag value this limit applies to. Only valid when key is RATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value of requestTagKey (an any-value default); a set value is a specific override for that value
requests Integer: (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
tokens Integer: (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit

key string: (string) - Scope key. Determines whether principal is required. Possible values are: RATE_LIMIT_KEY_REQUEST_TAG, RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_SERVICE_PRINCIPAL, RATE_LIMIT_KEY_USER, RATE_LIMIT_KEY_USER_DEFAULT, RATE_LIMIT_KEY_USER_GROUP
renewalPeriod string: (string) - Renewal period. Possible values are: RATE_LIMIT_RENEWAL_PERIOD_HOUR, RATE_LIMIT_RENEWAL_PERIOD_MINUTE
principal string: (string) - Principal this limit applies to: user email, group name, or service principal application ID. Required unless key is RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_USER_DEFAULT, or RATE_LIMIT_KEY_REQUEST_TAG (which must not set a principal)
requestTagKey string: (string) - Request tag key this limit applies to. Required when key is RATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise
requestTagValue string: (string) - Request tag value this limit applies to. Only valid when key is RATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value of requestTagKey (an any-value default); a set value is a specific override for that value
requests number: (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
tokens number: (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit

key str: (string) - Scope key. Determines whether principal is required. Possible values are: RATE_LIMIT_KEY_REQUEST_TAG, RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_SERVICE_PRINCIPAL, RATE_LIMIT_KEY_USER, RATE_LIMIT_KEY_USER_DEFAULT, RATE_LIMIT_KEY_USER_GROUP
renewal_period str: (string) - Renewal period. Possible values are: RATE_LIMIT_RENEWAL_PERIOD_HOUR, RATE_LIMIT_RENEWAL_PERIOD_MINUTE
principal str: (string) - Principal this limit applies to: user email, group name, or service principal application ID. Required unless key is RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_USER_DEFAULT, or RATE_LIMIT_KEY_REQUEST_TAG (which must not set a principal)
request_tag_key str: (string) - Request tag key this limit applies to. Required when key is RATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise
request_tag_value str: (string) - Request tag value this limit applies to. Only valid when key is RATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value of requestTagKey (an any-value default); a set value is a specific override for that value
requests int: (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
tokens int: (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit

key String: (string) - Scope key. Determines whether principal is required. Possible values are: RATE_LIMIT_KEY_REQUEST_TAG, RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_SERVICE_PRINCIPAL, RATE_LIMIT_KEY_USER, RATE_LIMIT_KEY_USER_DEFAULT, RATE_LIMIT_KEY_USER_GROUP
renewalPeriod String: (string) - Renewal period. Possible values are: RATE_LIMIT_RENEWAL_PERIOD_HOUR, RATE_LIMIT_RENEWAL_PERIOD_MINUTE
principal String: (string) - Principal this limit applies to: user email, group name, or service principal application ID. Required unless key is RATE_LIMIT_KEY_SERVICE, RATE_LIMIT_KEY_USER_DEFAULT, or RATE_LIMIT_KEY_REQUEST_TAG (which must not set a principal)
requestTagKey String: (string) - Request tag key this limit applies to. Required when key is RATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise
requestTagValue String: (string) - Request tag value this limit applies to. Only valid when key is RATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value of requestTagKey (an any-value default); a set value is a specific override for that value
requests Number: (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
tokens Number: (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit

GetAiGatewayModelServicesModelServiceConfigRouting

Destinations List<GetAiGatewayModelServicesModelServiceConfigRoutingDestination>: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask
Fallback GetAiGatewayModelServicesModelServiceConfigRoutingFallback: (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
FirstTokenTimeout string: (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
TrafficSplitting GetAiGatewayModelServicesModelServiceConfigRoutingTrafficSplitting: (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself

Destinations []GetAiGatewayModelServicesModelServiceConfigRoutingDestination: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask
Fallback GetAiGatewayModelServicesModelServiceConfigRoutingFallback: (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
FirstTokenTimeout string: (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
TrafficSplitting GetAiGatewayModelServicesModelServiceConfigRoutingTrafficSplitting: (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself

destinations list(object): (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask
fallback object: (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
first_token_timeout string: (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
traffic_splitting object: (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself

destinations List<GetAiGatewayModelServicesModelServiceConfigRoutingDestination>: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask
fallback GetAiGatewayModelServicesModelServiceConfigRoutingFallback: (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
firstTokenTimeout String: (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
trafficSplitting GetAiGatewayModelServicesModelServiceConfigRoutingTrafficSplitting: (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself

destinations GetAiGatewayModelServicesModelServiceConfigRoutingDestination[]: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask
fallback GetAiGatewayModelServicesModelServiceConfigRoutingFallback: (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
firstTokenTimeout string: (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
trafficSplitting GetAiGatewayModelServicesModelServiceConfigRoutingTrafficSplitting: (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself

destinations Sequence[GetAiGatewayModelServicesModelServiceConfigRoutingDestination]: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask
fallback GetAiGatewayModelServicesModelServiceConfigRoutingFallback: (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
first_token_timeout str: (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
traffic_splitting GetAiGatewayModelServicesModelServiceConfigRoutingTrafficSplitting: (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself

destinations List<Property Map>: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask
fallback Property Map: (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
firstTokenTimeout String: (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
trafficSplitting Property Map: (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself

GetAiGatewayModelServicesModelServiceConfigRoutingDestination

DestinationType string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
IsDeleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
Name string: (string) - User-facing label for this destination, used in routing references
ExternalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
PayPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
ProvisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
TrafficPercentage int: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

DestinationType string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
IsDeleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
Name string: (string) - User-facing label for this destination, used in routing references
ExternalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
PayPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
ProvisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
TrafficPercentage int: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destination_type string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
is_deleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name string: (string) - User-facing label for this destination, used in routing references
external_model_config object: (ModelServiceConfigExternalModelConfig)
pay_per_token_config object: (ModelServiceConfigPayPerTokenConfig)
provisioned_throughput_config object: (ModelServiceConfigProvisionedThroughputConfig)
traffic_percentage number: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destinationType String: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
isDeleted Boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name String: (string) - User-facing label for this destination, used in routing references
externalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
payPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
provisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
trafficPercentage Integer: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destinationType string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
isDeleted boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name string: (string) - User-facing label for this destination, used in routing references
externalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
payPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
provisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
trafficPercentage number: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destination_type str: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
is_deleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name str: (string) - User-facing label for this destination, used in routing references
external_model_config GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
pay_per_token_config GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
provisioned_throughput_config GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
traffic_percentage int: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destinationType String: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
isDeleted Boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name String: (string) - User-facing label for this destination, used in routing references
externalModelConfig Property Map: (ModelServiceConfigExternalModelConfig)
payPerTokenConfig Property Map: (ModelServiceConfigPayPerTokenConfig)
provisionedThroughputConfig Property Map: (ModelServiceConfigProvisionedThroughputConfig)
trafficPercentage Number: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig

ModelProviderService string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
Target GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

ModelProviderService string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
Target GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

model_provider_service string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target object: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

modelProviderService String: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

modelProviderService string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

model_provider_service str: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

modelProviderService String: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target Property Map: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
NativeApiTypes List<string>: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
NativeApiTypes []string: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
native_api_types list(string): (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
nativeApiTypes List<String>: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
nativeApiTypes string[]: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model str: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
native_api_types Sequence[str]: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
nativeApiTypes List<String>: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model str: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
ModelServingEndpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
ModelServingEndpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
model_serving_endpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
modelServingEndpoint String: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
modelServingEndpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model str: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
model_serving_endpoint str: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
modelServingEndpoint String: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

GetAiGatewayModelServicesModelServiceConfigRoutingFallback

Destinations List<GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination>: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask

Destinations []GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask

destinations list(object): (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask

destinations List<GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination>: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask

destinations GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination[]: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask

destinations Sequence[GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination]: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask

destinations List<Property Map>: (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is required on CreateModelService; on UpdateModelService it is required only when config.routing (or a config.routing.* subpath) appears in updateMask

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination

DestinationType string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
IsDeleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
Name string: (string) - User-facing label for this destination, used in routing references
ExternalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
PayPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
ProvisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
TrafficPercentage int: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

DestinationType string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
IsDeleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
Name string: (string) - User-facing label for this destination, used in routing references
ExternalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
PayPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
ProvisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
TrafficPercentage int: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destination_type string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
is_deleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name string: (string) - User-facing label for this destination, used in routing references
external_model_config object: (ModelServiceConfigExternalModelConfig)
pay_per_token_config object: (ModelServiceConfigPayPerTokenConfig)
provisioned_throughput_config object: (ModelServiceConfigProvisionedThroughputConfig)
traffic_percentage number: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destinationType String: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
isDeleted Boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name String: (string) - User-facing label for this destination, used in routing references
externalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
payPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
provisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
trafficPercentage Integer: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destinationType string: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
isDeleted boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name string: (string) - User-facing label for this destination, used in routing references
externalModelConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
payPerTokenConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
provisionedThroughputConfig GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
trafficPercentage number: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destination_type str: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
is_deleted bool: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name str: (string) - User-facing label for this destination, used in routing references
external_model_config GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig: (ModelServiceConfigExternalModelConfig)
pay_per_token_config GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig: (ModelServiceConfigPayPerTokenConfig)
provisioned_throughput_config GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig: (ModelServiceConfigProvisionedThroughputConfig)
traffic_percentage int: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

destinationType String: (string) - Backing-model category. Determines which oneof variant is populated. Possible values are: DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL, DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL, DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL
isDeleted Boolean: (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
name String: (string) - User-facing label for this destination, used in routing references
externalModelConfig Property Map: (ModelServiceConfigExternalModelConfig)
payPerTokenConfig Property Map: (ModelServiceConfigPayPerTokenConfig)
provisionedThroughputConfig Property Map: (ModelServiceConfigProvisionedThroughputConfig)
trafficPercentage Number: (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig

ModelProviderService string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
Target GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

ModelProviderService string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
Target GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

model_provider_service string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target object: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

modelProviderService String: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

modelProviderService string: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

model_provider_service str: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

modelProviderService String: (string) - Resource name of the governed ModelProviderService that owns provider auth and provider-specific configuration. The referenced ModelProviderService also carries the provider type, so this message does not surface it directly. Format: model-provider-services/{catalog}.{schema}.{model_provider_service}. Each {...} component is capped at 255 characters individually
target Property Map: (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from the referenced ModelProviderService's targets catalog, plus the unified API types the platform should translate to/from at request time

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
NativeApiTypes List<string>: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
NativeApiTypes []string: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
native_api_types list(string): (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
nativeApiTypes List<String>: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
nativeApiTypes string[]: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model str: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
native_api_types Sequence[str]: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
nativeApiTypes List<String>: (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model str: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
ModelServingEndpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

Model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
ModelServingEndpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
model_serving_endpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
modelServingEndpoint String: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model string: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
modelServingEndpoint string: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model str: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
model_serving_endpoint str: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

model String: (string) - UC model FQN of the model served by the backing endpoint (e.g., system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
modelServingEndpoint String: (string) - Name of the backing Model Serving endpoint serving the provisioned- throughput foundation model, as the AIP-122 typed resource name serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time

GetAiGatewayModelServicesModelServiceProviderConfig

WorkspaceId string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

WorkspaceId string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspace_id string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspaceId String: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspaceId string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspace_id str: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspaceId String: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

GetAiGatewayModelServicesProviderConfig

WorkspaceId string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

WorkspaceId string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspace_id string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspaceId String: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspaceId string: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspace_id str: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

workspaceId String: Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.

Package Details

Repository: databricks pulumi/pulumi-databricks
License: Apache-2.0
Notes: This Pulumi package is based on the databricks Terraform Provider.

Viewing docs for Databricks v1.107.0
published on Tuesday, Aug 25, 2026 by Pulumi

Schema (JSON)

pulumi/pulumi-databricks

databricks.getAiGatewayModelServices

On this page

On this page

Using getAiGatewayModelServices

getAiGatewayModelServices Result

Supporting Types

GetAiGatewayModelServicesModelService

GetAiGatewayModelServicesModelServiceConfig

GetAiGatewayModelServicesModelServiceConfigInferenceTable

GetAiGatewayModelServicesModelServiceConfigRateLimit

GetAiGatewayModelServicesModelServiceConfigRouting

GetAiGatewayModelServicesModelServiceConfigRoutingDestination

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig

GetAiGatewayModelServicesModelServiceConfigRoutingFallback

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig

GetAiGatewayModelServicesModelServiceProviderConfig

GetAiGatewayModelServicesProviderConfig

Package Details

On this page

On this page

Try Pulumi Cloud free.
Your team will thank you.

databricks.getAiGatewayModelServices

On this page

On this page

Using getAiGatewayModelServices

getAiGatewayModelServices Result

Supporting Types

GetAiGatewayModelServicesModelService

GetAiGatewayModelServicesModelServiceConfig

GetAiGatewayModelServicesModelServiceConfigInferenceTable

GetAiGatewayModelServicesModelServiceConfigRateLimit

GetAiGatewayModelServicesModelServiceConfigRouting

GetAiGatewayModelServicesModelServiceConfigRoutingDestination

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfig

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationExternalModelConfigTarget

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationPayPerTokenConfig

GetAiGatewayModelServicesModelServiceConfigRoutingDestinationProvisionedThroughputConfig

GetAiGatewayModelServicesModelServiceConfigRoutingFallback

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestination

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfig

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig

GetAiGatewayModelServicesModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig

GetAiGatewayModelServicesModelServiceProviderConfig

GetAiGatewayModelServicesProviderConfig

Package Details

On this page

On this page

Try Pulumi Cloud free.Your team will thank you.

Try Pulumi Cloud free.
Your team will thank you.