Viewing docs for Databricks v1.103.0
published on Tuesday, Aug 11, 2026 by Pulumi
published on Tuesday, Aug 11, 2026 by Pulumi
Viewing docs for Databricks v1.103.0
published on Tuesday, Aug 11, 2026 by Pulumi
published on Tuesday, Aug 11, 2026 by Pulumi
Using getAiGatewayModelService
Two invocation forms are available. The direct form accepts plain arguments and either blocks until the result value is available, or returns a Promise-wrapped result. The output form accepts Input-wrapped arguments and returns an Output-wrapped result.
function getAiGatewayModelService(args: GetAiGatewayModelServiceArgs, opts?: InvokeOptions): Promise<GetAiGatewayModelServiceResult>
function getAiGatewayModelServiceOutput(args: GetAiGatewayModelServiceOutputArgs, opts?: InvokeOptions): Output<GetAiGatewayModelServiceResult>def get_ai_gateway_model_service(name: Optional[str] = None,
provider_config: Optional[GetAiGatewayModelServiceProviderConfig] = None,
opts: Optional[InvokeOptions] = None) -> GetAiGatewayModelServiceResult
def get_ai_gateway_model_service_output(name: pulumi.Input[Optional[str]] = None,
provider_config: pulumi.Input[Optional[GetAiGatewayModelServiceProviderConfigArgs]] = None,
opts: Optional[InvokeOptions] = None) -> Output[GetAiGatewayModelServiceResult]func LookupAiGatewayModelService(ctx *Context, args *LookupAiGatewayModelServiceArgs, opts ...InvokeOption) (*LookupAiGatewayModelServiceResult, error)
func LookupAiGatewayModelServiceOutput(ctx *Context, args *LookupAiGatewayModelServiceOutputArgs, opts ...InvokeOption) LookupAiGatewayModelServiceResultOutput> Note: This function is named LookupAiGatewayModelService in the Go SDK.
public static class GetAiGatewayModelService
{
public static Task<GetAiGatewayModelServiceResult> InvokeAsync(GetAiGatewayModelServiceArgs args, InvokeOptions? opts = null)
public static Output<GetAiGatewayModelServiceResult> Invoke(GetAiGatewayModelServiceInvokeArgs args, InvokeOptions? opts = null)
}public static CompletableFuture<GetAiGatewayModelServiceResult> getAiGatewayModelService(GetAiGatewayModelServiceArgs args, InvokeOptions options)
public static Output<GetAiGatewayModelServiceResult> getAiGatewayModelService(GetAiGatewayModelServiceArgs args, InvokeOptions options)
fn::invoke:
function: databricks:index/getAiGatewayModelService:getAiGatewayModelService
arguments:
# arguments dictionarydata "databricks_get_ai_gateway_model_service" "name" {
# arguments
}The following arguments are supported:
- Name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - Provider
Config GetAi Gateway Model Service Provider Config - Configure the provider for management through account provider.
- Name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - Provider
Config GetAi Gateway Model Service Provider Config - Configure the provider for management through account provider.
- name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - provider_
config object - Configure the provider for management through account provider.
- name String
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - provider
Config GetAi Gateway Model Service Provider Config - Configure the provider for management through account provider.
- name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - provider
Config GetAi Gateway Model Service Provider Config - Configure the provider for management through account provider.
- name str
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - provider_
config GetAi Gateway Model Service Provider Config - Configure the provider for management through account provider.
- name String
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - provider
Config Property Map - Configure the provider for management through account provider.
getAiGatewayModelService Result
The following output properties are available:
- Browse
Only bool - (boolean) - Whether the caller sees only metadata available through the BROWSE privilege
- Comment string
- (string) - User-provided description
- Config
Get
Ai Gateway Model Service Config - (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference
table. Required on CreateModelService; on UpdateModelService it is
required only when
config(or aconfig.*subpath) appears inupdateMask - Create
Time string - (string) - When the model service was created
- Created
By string - (string) - Creator identity
- Effective
Owner string - (string) - The resolved owner of the ModelService. Falls back to the caller's identity
when
owneris not explicitly set on creation - Etag string
- (string) - Optimistic concurrency control token. Server-generated from the
entity's state and returned on every read. To use it as an if-match
precondition on a mutation, echo the last-read value back via the dedicated
etagfield on the Update / Delete request; the server rejects the mutation if the stored etag differs - Metastore
Id string - (string) - Metastore hosting the model service
- Name string
- (string) - User-facing label for this destination, used in routing references
- Owner string
- (string) - The owner of the model service. Write-only; read owner via effective_owner
- Supported
Api List<string>Types - (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
- Update
Time string - (string) - When the model service was last modified
- Updated
By string - (string) - Identity of the last updater
- Provider
Config GetAi Gateway Model Service Provider Config
- Browse
Only bool - (boolean) - Whether the caller sees only metadata available through the BROWSE privilege
- Comment string
- (string) - User-provided description
- Config
Get
Ai Gateway Model Service Config - (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference
table. Required on CreateModelService; on UpdateModelService it is
required only when
config(or aconfig.*subpath) appears inupdateMask - Create
Time string - (string) - When the model service was created
- Created
By string - (string) - Creator identity
- Effective
Owner string - (string) - The resolved owner of the ModelService. Falls back to the caller's identity
when
owneris not explicitly set on creation - Etag string
- (string) - Optimistic concurrency control token. Server-generated from the
entity's state and returned on every read. To use it as an if-match
precondition on a mutation, echo the last-read value back via the dedicated
etagfield on the Update / Delete request; the server rejects the mutation if the stored etag differs - Metastore
Id string - (string) - Metastore hosting the model service
- Name string
- (string) - User-facing label for this destination, used in routing references
- Owner string
- (string) - The owner of the model service. Write-only; read owner via effective_owner
- Supported
Api []stringTypes - (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
- Update
Time string - (string) - When the model service was last modified
- Updated
By string - (string) - Identity of the last updater
- Provider
Config GetAi Gateway Model Service Provider Config
- browse_
only bool - (boolean) - Whether the caller sees only metadata available through the BROWSE privilege
- comment string
- (string) - User-provided description
- config object
- (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference
table. Required on CreateModelService; on UpdateModelService it is
required only when
config(or aconfig.*subpath) appears inupdateMask - create_
time string - (string) - When the model service was created
- created_
by string - (string) - Creator identity
- effective_
owner string - (string) - The resolved owner of the ModelService. Falls back to the caller's identity
when
owneris not explicitly set on creation - etag string
- (string) - Optimistic concurrency control token. Server-generated from the
entity's state and returned on every read. To use it as an if-match
precondition on a mutation, echo the last-read value back via the dedicated
etagfield on the Update / Delete request; the server rejects the mutation if the stored etag differs - metastore_
id string - (string) - Metastore hosting the model service
- name string
- (string) - User-facing label for this destination, used in routing references
- owner string
- (string) - The owner of the model service. Write-only; read owner via effective_owner
- supported_
api_ list(string)types - (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
- update_
time string - (string) - When the model service was last modified
- updated_
by string - (string) - Identity of the last updater
- provider_
config object
- browse
Only Boolean - (boolean) - Whether the caller sees only metadata available through the BROWSE privilege
- comment String
- (string) - User-provided description
- config
Get
Ai Gateway Model Service Config - (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference
table. Required on CreateModelService; on UpdateModelService it is
required only when
config(or aconfig.*subpath) appears inupdateMask - create
Time String - (string) - When the model service was created
- created
By String - (string) - Creator identity
- effective
Owner String - (string) - The resolved owner of the ModelService. Falls back to the caller's identity
when
owneris not explicitly set on creation - etag String
- (string) - Optimistic concurrency control token. Server-generated from the
entity's state and returned on every read. To use it as an if-match
precondition on a mutation, echo the last-read value back via the dedicated
etagfield on the Update / Delete request; the server rejects the mutation if the stored etag differs - metastore
Id String - (string) - Metastore hosting the model service
- name String
- (string) - User-facing label for this destination, used in routing references
- owner String
- (string) - The owner of the model service. Write-only; read owner via effective_owner
- supported
Api List<String>Types - (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
- update
Time String - (string) - When the model service was last modified
- updated
By String - (string) - Identity of the last updater
- provider
Config GetAi Gateway Model Service Provider Config
- browse
Only boolean - (boolean) - Whether the caller sees only metadata available through the BROWSE privilege
- comment string
- (string) - User-provided description
- config
Get
Ai Gateway Model Service Config - (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference
table. Required on CreateModelService; on UpdateModelService it is
required only when
config(or aconfig.*subpath) appears inupdateMask - create
Time string - (string) - When the model service was created
- created
By string - (string) - Creator identity
- effective
Owner string - (string) - The resolved owner of the ModelService. Falls back to the caller's identity
when
owneris not explicitly set on creation - etag string
- (string) - Optimistic concurrency control token. Server-generated from the
entity's state and returned on every read. To use it as an if-match
precondition on a mutation, echo the last-read value back via the dedicated
etagfield on the Update / Delete request; the server rejects the mutation if the stored etag differs - metastore
Id string - (string) - Metastore hosting the model service
- name string
- (string) - User-facing label for this destination, used in routing references
- owner string
- (string) - The owner of the model service. Write-only; read owner via effective_owner
- supported
Api string[]Types - (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
- update
Time string - (string) - When the model service was last modified
- updated
By string - (string) - Identity of the last updater
- provider
Config GetAi Gateway Model Service Provider Config
- browse_
only bool - (boolean) - Whether the caller sees only metadata available through the BROWSE privilege
- comment str
- (string) - User-provided description
- config
Get
Ai Gateway Model Service Config - (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference
table. Required on CreateModelService; on UpdateModelService it is
required only when
config(or aconfig.*subpath) appears inupdateMask - create_
time str - (string) - When the model service was created
- created_
by str - (string) - Creator identity
- effective_
owner str - (string) - The resolved owner of the ModelService. Falls back to the caller's identity
when
owneris not explicitly set on creation - etag str
- (string) - Optimistic concurrency control token. Server-generated from the
entity's state and returned on every read. To use it as an if-match
precondition on a mutation, echo the last-read value back via the dedicated
etagfield on the Update / Delete request; the server rejects the mutation if the stored etag differs - metastore_
id str - (string) - Metastore hosting the model service
- name str
- (string) - User-facing label for this destination, used in routing references
- owner str
- (string) - The owner of the model service. Write-only; read owner via effective_owner
- supported_
api_ Sequence[str]types - (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
- update_
time str - (string) - When the model service was last modified
- updated_
by str - (string) - Identity of the last updater
- provider_
config GetAi Gateway Model Service Provider Config
- browse
Only Boolean - (boolean) - Whether the caller sees only metadata available through the BROWSE privilege
- comment String
- (string) - User-provided description
- config Property Map
- (ModelServiceConfig) - Operational configuration: destinations, routing, rate limits, inference
table. Required on CreateModelService; on UpdateModelService it is
required only when
config(or aconfig.*subpath) appears inupdateMask - create
Time String - (string) - When the model service was created
- created
By String - (string) - Creator identity
- effective
Owner String - (string) - The resolved owner of the ModelService. Falls back to the caller's identity
when
owneris not explicitly set on creation - etag String
- (string) - Optimistic concurrency control token. Server-generated from the
entity's state and returned on every read. To use it as an if-match
precondition on a mutation, echo the last-read value back via the dedicated
etagfield on the Update / Delete request; the server rejects the mutation if the stored etag differs - metastore
Id String - (string) - Metastore hosting the model service
- name String
- (string) - User-facing label for this destination, used in routing references
- owner String
- (string) - The owner of the model service. Write-only; read owner via effective_owner
- supported
Api List<String>Types - (list of string) - Unified API types this endpoint supports (e.g. "chat", "embeddings", "completions"). Derived from the destinations' backing models / providers at read time
- update
Time String - (string) - When the model service was last modified
- updated
By String - (string) - Identity of the last updater
- provider
Config Property Map
Supporting Types
GetAiGatewayModelServiceConfig
- Inference
Table GetAi Gateway Model Service Config Inference Table - (InferenceTableConfig) - Inference table config for payload logging
- Rate
Limits List<GetAi Gateway Model Service Config Rate Limit> - (list of RateLimit) - Rate limits applied to requests routed through this model service
- Routing
Get
Ai Gateway Model Service Config Routing - (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback
- Inference
Table GetAi Gateway Model Service Config Inference Table - (InferenceTableConfig) - Inference table config for payload logging
- Rate
Limits []GetAi Gateway Model Service Config Rate Limit - (list of RateLimit) - Rate limits applied to requests routed through this model service
- Routing
Get
Ai Gateway Model Service Config Routing - (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback
- inference_
table object - (InferenceTableConfig) - Inference table config for payload logging
- rate_
limits list(object) - (list of RateLimit) - Rate limits applied to requests routed through this model service
- routing object
- (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback
- inference
Table GetAi Gateway Model Service Config Inference Table - (InferenceTableConfig) - Inference table config for payload logging
- rate
Limits List<GetAi Gateway Model Service Config Rate Limit> - (list of RateLimit) - Rate limits applied to requests routed through this model service
- routing
Get
Ai Gateway Model Service Config Routing - (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback
- inference
Table GetAi Gateway Model Service Config Inference Table - (InferenceTableConfig) - Inference table config for payload logging
- rate
Limits GetAi Gateway Model Service Config Rate Limit[] - (list of RateLimit) - Rate limits applied to requests routed through this model service
- routing
Get
Ai Gateway Model Service Config Routing - (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback
- inference_
table GetAi Gateway Model Service Config Inference Table - (InferenceTableConfig) - Inference table config for payload logging
- rate_
limits Sequence[GetAi Gateway Model Service Config Rate Limit] - (list of RateLimit) - Rate limits applied to requests routed through this model service
- routing
Get
Ai Gateway Model Service Config Routing - (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback
- inference
Table Property Map - (InferenceTableConfig) - Inference table config for payload logging
- rate
Limits List<Property Map> - (list of RateLimit) - Rate limits applied to requests routed through this model service
- routing Property Map
- (ModelServiceConfigRoutingConfig) - Routing configuration: destinations, routing strategy, and fallback
GetAiGatewayModelServiceConfigInferenceTable
- Is
Deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- Parent string
- (string) - Parent UC schema where the inference table is created.
Format:
schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected - Table string
- (string) - Resolved UC table for payload logs.
Format:
tables/{catalog}.{schema}.{table} - Disabled bool
- (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that
payload logging is active (the on-by-default state coincides with the proto
zero-value, so the server never fills this field for a client that leaves it
unset). Set
disabled = trueto pause runtime logging while keeping the sub-message attached (preservingparentandtableNamePrefixfor a later flip back to active).parentremains required either way - Table
Name stringPrefix - (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC
stores is
<table_name_prefix>_payload; the_payloadsuffix is appended automatically. To find the actual UC table after Create, read thetablefield on the response. Defaults to<model_service_name>_payloadwhen unset. Set at create time and immutable thereafter; changing it on an existing service is rejected
- Is
Deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- Parent string
- (string) - Parent UC schema where the inference table is created.
Format:
schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected - Table string
- (string) - Resolved UC table for payload logs.
Format:
tables/{catalog}.{schema}.{table} - Disabled bool
- (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that
payload logging is active (the on-by-default state coincides with the proto
zero-value, so the server never fills this field for a client that leaves it
unset). Set
disabled = trueto pause runtime logging while keeping the sub-message attached (preservingparentandtableNamePrefixfor a later flip back to active).parentremains required either way - Table
Name stringPrefix - (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC
stores is
<table_name_prefix>_payload; the_payloadsuffix is appended automatically. To find the actual UC table after Create, read thetablefield on the response. Defaults to<model_service_name>_payloadwhen unset. Set at create time and immutable thereafter; changing it on an existing service is rejected
- is_
deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- parent string
- (string) - Parent UC schema where the inference table is created.
Format:
schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected - table string
- (string) - Resolved UC table for payload logs.
Format:
tables/{catalog}.{schema}.{table} - disabled bool
- (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that
payload logging is active (the on-by-default state coincides with the proto
zero-value, so the server never fills this field for a client that leaves it
unset). Set
disabled = trueto pause runtime logging while keeping the sub-message attached (preservingparentandtableNamePrefixfor a later flip back to active).parentremains required either way - table_
name_ stringprefix - (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC
stores is
<table_name_prefix>_payload; the_payloadsuffix is appended automatically. To find the actual UC table after Create, read thetablefield on the response. Defaults to<model_service_name>_payloadwhen unset. Set at create time and immutable thereafter; changing it on an existing service is rejected
- is
Deleted Boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- parent String
- (string) - Parent UC schema where the inference table is created.
Format:
schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected - table String
- (string) - Resolved UC table for payload logs.
Format:
tables/{catalog}.{schema}.{table} - disabled Boolean
- (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that
payload logging is active (the on-by-default state coincides with the proto
zero-value, so the server never fills this field for a client that leaves it
unset). Set
disabled = trueto pause runtime logging while keeping the sub-message attached (preservingparentandtableNamePrefixfor a later flip back to active).parentremains required either way - table
Name StringPrefix - (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC
stores is
<table_name_prefix>_payload; the_payloadsuffix is appended automatically. To find the actual UC table after Create, read thetablefield on the response. Defaults to<model_service_name>_payloadwhen unset. Set at create time and immutable thereafter; changing it on an existing service is rejected
- is
Deleted boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- parent string
- (string) - Parent UC schema where the inference table is created.
Format:
schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected - table string
- (string) - Resolved UC table for payload logs.
Format:
tables/{catalog}.{schema}.{table} - disabled boolean
- (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that
payload logging is active (the on-by-default state coincides with the proto
zero-value, so the server never fills this field for a client that leaves it
unset). Set
disabled = trueto pause runtime logging while keeping the sub-message attached (preservingparentandtableNamePrefixfor a later flip back to active).parentremains required either way - table
Name stringPrefix - (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC
stores is
<table_name_prefix>_payload; the_payloadsuffix is appended automatically. To find the actual UC table after Create, read thetablefield on the response. Defaults to<model_service_name>_payloadwhen unset. Set at create time and immutable thereafter; changing it on an existing service is rejected
- is_
deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- parent str
- (string) - Parent UC schema where the inference table is created.
Format:
schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected - table str
- (string) - Resolved UC table for payload logs.
Format:
tables/{catalog}.{schema}.{table} - disabled bool
- (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that
payload logging is active (the on-by-default state coincides with the proto
zero-value, so the server never fills this field for a client that leaves it
unset). Set
disabled = trueto pause runtime logging while keeping the sub-message attached (preservingparentandtableNamePrefixfor a later flip back to active).parentremains required either way - table_
name_ strprefix - (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC
stores is
<table_name_prefix>_payload; the_payloadsuffix is appended automatically. To find the actual UC table after Create, read thetablefield on the response. Defaults to<model_service_name>_payloadwhen unset. Set at create time and immutable thereafter; changing it on an existing service is rejected
- is
Deleted Boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- parent String
- (string) - Parent UC schema where the inference table is created.
Format:
schemas/{catalog}.{schema}. Set at create time and immutable thereafter; changing it on an existing service is rejected - table String
- (string) - Resolved UC table for payload logs.
Format:
tables/{catalog}.{schema}.{table} - disabled Boolean
- (boolean) - Indicates whether payload logging is disabled (opt-out). Unset means that
payload logging is active (the on-by-default state coincides with the proto
zero-value, so the server never fills this field for a client that leaves it
unset). Set
disabled = trueto pause runtime logging while keeping the sub-message attached (preservingparentandtableNamePrefixfor a later flip back to active).parentremains required either way - table
Name StringPrefix - (string) - Prefix for the inference-table's UC-registered name. The actual leaf name UC
stores is
<table_name_prefix>_payload; the_payloadsuffix is appended automatically. To find the actual UC table after Create, read thetablefield on the response. Defaults to<model_service_name>_payloadwhen unset. Set at create time and immutable thereafter; changing it on an existing service is rejected
GetAiGatewayModelServiceConfigRateLimit
- Key string
- (string) - Scope key. Determines whether
principalis required. Possible values are:RATE_LIMIT_KEY_REQUEST_TAG,RATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_SERVICE_PRINCIPAL,RATE_LIMIT_KEY_USER,RATE_LIMIT_KEY_USER_DEFAULT,RATE_LIMIT_KEY_USER_GROUP - Renewal
Period string - (string) - Renewal period. Possible values are:
RATE_LIMIT_RENEWAL_PERIOD_HOUR,RATE_LIMIT_RENEWAL_PERIOD_MINUTE - Principal string
- (string) - Principal this limit applies to: user email, group name, or service
principal application ID. Required unless
keyisRATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_USER_DEFAULT, orRATE_LIMIT_KEY_REQUEST_TAG(which must not set a principal) - Request
Tag stringKey - (string) - Request tag key this limit applies to. Required when
keyisRATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise - Request
Tag stringValue - (string) - Request tag value this limit applies to. Only valid when
keyisRATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value ofrequestTagKey(an any-value default); a set value is a specific override for that value - Requests int
- (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
- Tokens int
- (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit
- Key string
- (string) - Scope key. Determines whether
principalis required. Possible values are:RATE_LIMIT_KEY_REQUEST_TAG,RATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_SERVICE_PRINCIPAL,RATE_LIMIT_KEY_USER,RATE_LIMIT_KEY_USER_DEFAULT,RATE_LIMIT_KEY_USER_GROUP - Renewal
Period string - (string) - Renewal period. Possible values are:
RATE_LIMIT_RENEWAL_PERIOD_HOUR,RATE_LIMIT_RENEWAL_PERIOD_MINUTE - Principal string
- (string) - Principal this limit applies to: user email, group name, or service
principal application ID. Required unless
keyisRATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_USER_DEFAULT, orRATE_LIMIT_KEY_REQUEST_TAG(which must not set a principal) - Request
Tag stringKey - (string) - Request tag key this limit applies to. Required when
keyisRATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise - Request
Tag stringValue - (string) - Request tag value this limit applies to. Only valid when
keyisRATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value ofrequestTagKey(an any-value default); a set value is a specific override for that value - Requests int
- (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
- Tokens int
- (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit
- key string
- (string) - Scope key. Determines whether
principalis required. Possible values are:RATE_LIMIT_KEY_REQUEST_TAG,RATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_SERVICE_PRINCIPAL,RATE_LIMIT_KEY_USER,RATE_LIMIT_KEY_USER_DEFAULT,RATE_LIMIT_KEY_USER_GROUP - renewal_
period string - (string) - Renewal period. Possible values are:
RATE_LIMIT_RENEWAL_PERIOD_HOUR,RATE_LIMIT_RENEWAL_PERIOD_MINUTE - principal string
- (string) - Principal this limit applies to: user email, group name, or service
principal application ID. Required unless
keyisRATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_USER_DEFAULT, orRATE_LIMIT_KEY_REQUEST_TAG(which must not set a principal) - request_
tag_ stringkey - (string) - Request tag key this limit applies to. Required when
keyisRATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise - request_
tag_ stringvalue - (string) - Request tag value this limit applies to. Only valid when
keyisRATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value ofrequestTagKey(an any-value default); a set value is a specific override for that value - requests number
- (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
- tokens number
- (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit
- key String
- (string) - Scope key. Determines whether
principalis required. Possible values are:RATE_LIMIT_KEY_REQUEST_TAG,RATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_SERVICE_PRINCIPAL,RATE_LIMIT_KEY_USER,RATE_LIMIT_KEY_USER_DEFAULT,RATE_LIMIT_KEY_USER_GROUP - renewal
Period String - (string) - Renewal period. Possible values are:
RATE_LIMIT_RENEWAL_PERIOD_HOUR,RATE_LIMIT_RENEWAL_PERIOD_MINUTE - principal String
- (string) - Principal this limit applies to: user email, group name, or service
principal application ID. Required unless
keyisRATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_USER_DEFAULT, orRATE_LIMIT_KEY_REQUEST_TAG(which must not set a principal) - request
Tag StringKey - (string) - Request tag key this limit applies to. Required when
keyisRATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise - request
Tag StringValue - (string) - Request tag value this limit applies to. Only valid when
keyisRATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value ofrequestTagKey(an any-value default); a set value is a specific override for that value - requests Integer
- (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
- tokens Integer
- (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit
- key string
- (string) - Scope key. Determines whether
principalis required. Possible values are:RATE_LIMIT_KEY_REQUEST_TAG,RATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_SERVICE_PRINCIPAL,RATE_LIMIT_KEY_USER,RATE_LIMIT_KEY_USER_DEFAULT,RATE_LIMIT_KEY_USER_GROUP - renewal
Period string - (string) - Renewal period. Possible values are:
RATE_LIMIT_RENEWAL_PERIOD_HOUR,RATE_LIMIT_RENEWAL_PERIOD_MINUTE - principal string
- (string) - Principal this limit applies to: user email, group name, or service
principal application ID. Required unless
keyisRATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_USER_DEFAULT, orRATE_LIMIT_KEY_REQUEST_TAG(which must not set a principal) - request
Tag stringKey - (string) - Request tag key this limit applies to. Required when
keyisRATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise - request
Tag stringValue - (string) - Request tag value this limit applies to. Only valid when
keyisRATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value ofrequestTagKey(an any-value default); a set value is a specific override for that value - requests number
- (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
- tokens number
- (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit
- key str
- (string) - Scope key. Determines whether
principalis required. Possible values are:RATE_LIMIT_KEY_REQUEST_TAG,RATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_SERVICE_PRINCIPAL,RATE_LIMIT_KEY_USER,RATE_LIMIT_KEY_USER_DEFAULT,RATE_LIMIT_KEY_USER_GROUP - renewal_
period str - (string) - Renewal period. Possible values are:
RATE_LIMIT_RENEWAL_PERIOD_HOUR,RATE_LIMIT_RENEWAL_PERIOD_MINUTE - principal str
- (string) - Principal this limit applies to: user email, group name, or service
principal application ID. Required unless
keyisRATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_USER_DEFAULT, orRATE_LIMIT_KEY_REQUEST_TAG(which must not set a principal) - request_
tag_ strkey - (string) - Request tag key this limit applies to. Required when
keyisRATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise - request_
tag_ strvalue - (string) - Request tag value this limit applies to. Only valid when
keyisRATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value ofrequestTagKey(an any-value default); a set value is a specific override for that value - requests int
- (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
- tokens int
- (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit
- key String
- (string) - Scope key. Determines whether
principalis required. Possible values are:RATE_LIMIT_KEY_REQUEST_TAG,RATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_SERVICE_PRINCIPAL,RATE_LIMIT_KEY_USER,RATE_LIMIT_KEY_USER_DEFAULT,RATE_LIMIT_KEY_USER_GROUP - renewal
Period String - (string) - Renewal period. Possible values are:
RATE_LIMIT_RENEWAL_PERIOD_HOUR,RATE_LIMIT_RENEWAL_PERIOD_MINUTE - principal String
- (string) - Principal this limit applies to: user email, group name, or service
principal application ID. Required unless
keyisRATE_LIMIT_KEY_SERVICE,RATE_LIMIT_KEY_USER_DEFAULT, orRATE_LIMIT_KEY_REQUEST_TAG(which must not set a principal) - request
Tag StringKey - (string) - Request tag key this limit applies to. Required when
keyisRATE_LIMIT_KEY_REQUEST_TAG, forbidden otherwise - request
Tag StringValue - (string) - Request tag value this limit applies to. Only valid when
keyisRATE_LIMIT_KEY_REQUEST_TAG. Leave unset to apply the limit to every value ofrequestTagKey(an any-value default); a set value is a specific override for that value - requests Number
- (integer) - Max requests allowed within a renewal period. Leave unset for no request limit
- tokens Number
- (integer) - Max tokens allowed within a renewal period. Leave unset for no token limit
GetAiGatewayModelServiceConfigRouting
- Destinations
List<Get
Ai Gateway Model Service Config Routing Destination> - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask - Fallback
Get
Ai Gateway Model Service Config Routing Fallback - (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
- First
Token stringTimeout - (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
- Traffic
Splitting GetAi Gateway Model Service Config Routing Traffic Splitting - (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself
- Destinations
[]Get
Ai Gateway Model Service Config Routing Destination - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask - Fallback
Get
Ai Gateway Model Service Config Routing Fallback - (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
- First
Token stringTimeout - (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
- Traffic
Splitting GetAi Gateway Model Service Config Routing Traffic Splitting - (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself
- destinations list(object)
- (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask - fallback object
- (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
- first_
token_ stringtimeout - (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
- traffic_
splitting object - (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself
- destinations
List<Get
Ai Gateway Model Service Config Routing Destination> - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask - fallback
Get
Ai Gateway Model Service Config Routing Fallback - (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
- first
Token StringTimeout - (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
- traffic
Splitting GetAi Gateway Model Service Config Routing Traffic Splitting - (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself
- destinations
Get
Ai Gateway Model Service Config Routing Destination[] - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask - fallback
Get
Ai Gateway Model Service Config Routing Fallback - (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
- first
Token stringTimeout - (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
- traffic
Splitting GetAi Gateway Model Service Config Routing Traffic Splitting - (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself
- destinations
Sequence[Get
Ai Gateway Model Service Config Routing Destination] - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask - fallback
Get
Ai Gateway Model Service Config Routing Fallback - (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
- first_
token_ strtimeout - (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
- traffic_
splitting GetAi Gateway Model Service Config Routing Traffic Splitting - (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself
- destinations List<Property Map>
- (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask - fallback Property Map
- (ModelServiceConfigFallbackConfig) - Fallback routing config, applied after primary destinations fail
- first
Token StringTimeout - (string) - Timeout for the first token of a streaming response. If a destination does not return its first token within this duration, AI Gateway aborts the attempt and fails over to the next destination. Applies to streaming requests only. Leave unset for no first-token timeout
- traffic
Splitting Property Map - (ModelServiceConfigRoutingConfigTrafficSplitting) - Marker message selecting request-based traffic splitting. Traffic is distributed according to each destination's trafficPercentage value; no configuration lives on this message itself
GetAiGatewayModelServiceConfigRoutingDestination
- Destination
Type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - Is
Deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- Name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - External
Model GetConfig Ai Gateway Model Service Config Routing Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- Pay
Per GetToken Config Ai Gateway Model Service Config Routing Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- Provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- Traffic
Percentage int - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- Destination
Type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - Is
Deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- Name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - External
Model GetConfig Ai Gateway Model Service Config Routing Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- Pay
Per GetToken Config Ai Gateway Model Service Config Routing Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- Provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- Traffic
Percentage int - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination_
type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is_
deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external_
model_ objectconfig - (ModelServiceConfigExternalModelConfig)
- pay_
per_ objecttoken_ config - (ModelServiceConfigPayPerTokenConfig)
- provisioned_
throughput_ objectconfig - (ModelServiceConfigProvisionedThroughputConfig)
- traffic_
percentage number - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination
Type String - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is
Deleted Boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name String
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external
Model GetConfig Ai Gateway Model Service Config Routing Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- pay
Per GetToken Config Ai Gateway Model Service Config Routing Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- traffic
Percentage Integer - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination
Type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is
Deleted boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external
Model GetConfig Ai Gateway Model Service Config Routing Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- pay
Per GetToken Config Ai Gateway Model Service Config Routing Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- traffic
Percentage number - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination_
type str - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is_
deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name str
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external_
model_ Getconfig Ai Gateway Model Service Config Routing Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- pay_
per_ Gettoken_ config Ai Gateway Model Service Config Routing Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned_
throughput_ Getconfig Ai Gateway Model Service Config Routing Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- traffic_
percentage int - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination
Type String - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is
Deleted Boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name String
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external
Model Property MapConfig - (ModelServiceConfigExternalModelConfig)
- pay
Per Property MapToken Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned
Throughput Property MapConfig - (ModelServiceConfigProvisionedThroughputConfig)
- traffic
Percentage Number - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
GetAiGatewayModelServiceConfigRoutingDestinationExternalModelConfig
- Model
Provider stringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - Target
Get
Ai Gateway Model Service Config Routing Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- Model
Provider stringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - Target
Get
Ai Gateway Model Service Config Routing Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model_
provider_ stringservice - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target object
- (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model
Provider StringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target
Get
Ai Gateway Model Service Config Routing Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model
Provider stringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target
Get
Ai Gateway Model Service Config Routing Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model_
provider_ strservice - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target
Get
Ai Gateway Model Service Config Routing Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model
Provider StringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target Property Map
- (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
GetAiGatewayModelServiceConfigRoutingDestinationExternalModelConfigTarget
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Native
Api List<string>Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Native
Api []stringTypes - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native_
api_ list(string)types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native
Api List<String>Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native
Api string[]Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model str
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native_
api_ Sequence[str]types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native
Api List<String>Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
GetAiGatewayModelServiceConfigRoutingDestinationPayPerTokenConfig
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model str
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
GetAiGatewayModelServiceConfigRoutingDestinationProvisionedThroughputConfig
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Model
Serving stringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Model
Serving stringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model_
serving_ stringendpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model
Serving StringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model
Serving stringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model str
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model_
serving_ strendpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model
Serving StringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
GetAiGatewayModelServiceConfigRoutingFallback
- Destinations
List<Get
Ai Gateway Model Service Config Routing Fallback Destination> - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask
- Destinations
[]Get
Ai Gateway Model Service Config Routing Fallback Destination - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask
- destinations list(object)
- (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask
- destinations
List<Get
Ai Gateway Model Service Config Routing Fallback Destination> - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask
- destinations
Get
Ai Gateway Model Service Config Routing Fallback Destination[] - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask
- destinations
Sequence[Get
Ai Gateway Model Service Config Routing Fallback Destination] - (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask
- destinations List<Property Map>
- (list of ModelServiceConfigDestinationConfig) - Primary routing destinations. At most 10 are allowed. At least one is
required on CreateModelService; on UpdateModelService it is required only
when
config.routing(or aconfig.routing.*subpath) appears inupdateMask
GetAiGatewayModelServiceConfigRoutingFallbackDestination
- Destination
Type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - Is
Deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- Name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - External
Model GetConfig Ai Gateway Model Service Config Routing Fallback Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- Pay
Per GetToken Config Ai Gateway Model Service Config Routing Fallback Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- Provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Fallback Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- Traffic
Percentage int - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- Destination
Type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - Is
Deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- Name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - External
Model GetConfig Ai Gateway Model Service Config Routing Fallback Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- Pay
Per GetToken Config Ai Gateway Model Service Config Routing Fallback Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- Provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Fallback Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- Traffic
Percentage int - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination_
type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is_
deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external_
model_ objectconfig - (ModelServiceConfigExternalModelConfig)
- pay_
per_ objecttoken_ config - (ModelServiceConfigPayPerTokenConfig)
- provisioned_
throughput_ objectconfig - (ModelServiceConfigProvisionedThroughputConfig)
- traffic_
percentage number - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination
Type String - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is
Deleted Boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name String
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external
Model GetConfig Ai Gateway Model Service Config Routing Fallback Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- pay
Per GetToken Config Ai Gateway Model Service Config Routing Fallback Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Fallback Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- traffic
Percentage Integer - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination
Type string - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is
Deleted boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name string
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external
Model GetConfig Ai Gateway Model Service Config Routing Fallback Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- pay
Per GetToken Config Ai Gateway Model Service Config Routing Fallback Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned
Throughput GetConfig Ai Gateway Model Service Config Routing Fallback Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- traffic
Percentage number - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination_
type str - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is_
deleted bool - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name str
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external_
model_ Getconfig Ai Gateway Model Service Config Routing Fallback Destination External Model Config - (ModelServiceConfigExternalModelConfig)
- pay_
per_ Gettoken_ config Ai Gateway Model Service Config Routing Fallback Destination Pay Per Token Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned_
throughput_ Getconfig Ai Gateway Model Service Config Routing Fallback Destination Provisioned Throughput Config - (ModelServiceConfigProvisionedThroughputConfig)
- traffic_
percentage int - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
- destination
Type String - (string) - Backing-model category. Determines which oneof variant is populated. Possible values are:
DESTINATION_TYPE_EXTERNAL_FOUNDATION_MODEL,DESTINATION_TYPE_PAY_PER_TOKEN_FOUNDATION_MODEL,DESTINATION_TYPE_PROVISIONED_THROUGHPUT_FOUNDATION_MODEL - is
Deleted Boolean - (boolean) - True when the destination's backing UC entity (MODEL for foundation-model destinations, MODEL_PROVIDER_SERVICE for external destinations) has been deleted but the destination row still references it. The dangling destination is surfaced (not silently dropped) so callers can see the broken routing. Inference traffic through this destination fails closed (BAD_REQUEST / FAILED_PRECONDITION)
- name String
- Resource name of the model service.
Format:
model-services/{catalog}.{schema}.{model_service}. Each{...}component is capped at 255 characters individually. Server-derived on Create fromparent+modelServiceId; required and immutable on Update/Get/Delete - external
Model Property MapConfig - (ModelServiceConfigExternalModelConfig)
- pay
Per Property MapToken Config - (ModelServiceConfigPayPerTokenConfig)
- provisioned
Throughput Property MapConfig - (ModelServiceConfigProvisionedThroughputConfig)
- traffic
Percentage Number - (integer) - Share of traffic sent to this destination, 0-100. Optional on fallback destinations; see FallbackConfig
GetAiGatewayModelServiceConfigRoutingFallbackDestinationExternalModelConfig
- Model
Provider stringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - Target
Get
Ai Gateway Model Service Config Routing Fallback Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- Model
Provider stringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - Target
Get
Ai Gateway Model Service Config Routing Fallback Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model_
provider_ stringservice - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target object
- (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model
Provider StringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target
Get
Ai Gateway Model Service Config Routing Fallback Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model
Provider stringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target
Get
Ai Gateway Model Service Config Routing Fallback Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model_
provider_ strservice - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target
Get
Ai Gateway Model Service Config Routing Fallback Destination External Model Config Target - (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
- model
Provider StringService - (string) - Resource name of the governed ModelProviderService that owns provider
auth and provider-specific configuration. The referenced
ModelProviderService also carries the provider type, so this message
does not surface it directly.
Format:
model-provider-services/{catalog}.{schema}.{model_provider_service}. Each{...}component is capped at 255 characters individually - target Property Map
- (ModelProviderServiceConfigModelTargetConfig) - Routing target for the destination: the provider-side model selected from
the referenced ModelProviderService's
targetscatalog, plus the unified API types the platform should translate to/from at request time
GetAiGatewayModelServiceConfigRoutingFallbackDestinationExternalModelConfigTarget
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Native
Api List<string>Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Native
Api []stringTypes - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native_
api_ list(string)types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native
Api List<String>Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native
Api string[]Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model str
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native_
api_ Sequence[str]types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - native
Api List<String>Types - (list of string) - Provider-native API types the model supports (e.g. "openai/v1/chat/completions"). Used by the platform for request/response translation from the unified API type. At most 64 entries of at most 256 characters each; the list is persisted into the destination binding's bounded storage envelope
GetAiGatewayModelServiceConfigRoutingFallbackDestinationPayPerTokenConfig
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model str
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time
GetAiGatewayModelServiceConfigRoutingFallbackDestinationProvisionedThroughputConfig
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Model
Serving stringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- Model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - Model
Serving stringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model_
serving_ stringendpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model
Serving StringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model string
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model
Serving stringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model str
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model_
serving_ strendpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
- model String
- (string) - UC model FQN of the model served by the backing endpoint (e.g.,
system.ai.databricks-claude-opus-4-6). Resolved from Model Serving at Create/Update time - model
Serving StringEndpoint - (string) - Name of the backing Model Serving endpoint serving the provisioned-
throughput foundation model, as the AIP-122 typed resource name
serving-endpoints/{name}. The same UC model can be served on multiple Model Serving endpoints (different throughput / region / config); the caller picks which one this destination routes to. The endpoint must exist at create time
GetAiGatewayModelServiceProviderConfig
- Workspace
Id string - Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.
- Workspace
Id string - Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.
- workspace_
id string - Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.
- workspace
Id String - Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.
- workspace
Id string - Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.
- workspace_
id str - Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.
- workspace
Id String - Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with.
Package Details
- Repository
- databricks pulumi/pulumi-databricks
- License
- Apache-2.0
- Notes
- This Pulumi package is based on the
databricksTerraform Provider.
Viewing docs for Databricks v1.103.0
published on Tuesday, Aug 11, 2026 by Pulumi
published on Tuesday, Aug 11, 2026 by Pulumi