1. Registry
  2. Packages
  3. CAST AI
  4. API Docs
  5. AiOptimizerHostedModel
Viewing docs for CAST AI v8.60.0
published on Wednesday, Aug 19, 2026 by CAST AI
castai logo
Viewing docs for CAST AI v8.60.0
published on Wednesday, Aug 19, 2026 by CAST AI

    Create AiOptimizerHostedModel Resource

    Resources are created with functions called constructors. To learn more about declaring and configuring resources, see Resources.

    Constructor syntax

    new AiOptimizerHostedModel(name: string, args: AiOptimizerHostedModelArgs, opts?: CustomResourceOptions);
    @overload
    def AiOptimizerHostedModel(resource_name: str,
                               args: AiOptimizerHostedModelArgs,
                               opts: Optional[ResourceOptions] = None)
    
    @overload
    def AiOptimizerHostedModel(resource_name: str,
                               opts: Optional[ResourceOptions] = None,
                               cluster_id: Optional[str] = None,
                               model_specs_id: Optional[str] = None,
                               port: Optional[int] = None,
                               service: Optional[str] = None,
                               edge_location_ids: Optional[Sequence[str]] = None,
                               fallback: Optional[AiOptimizerHostedModelFallbackArgs] = None,
                               hibernation: Optional[AiOptimizerHostedModelHibernationArgs] = None,
                               horizontal_autoscaling: Optional[AiOptimizerHostedModelHorizontalAutoscalingArgs] = None,
                               node_template_name: Optional[str] = None,
                               vllm_config: Optional[AiOptimizerHostedModelVllmConfigArgs] = None)
    func NewAiOptimizerHostedModel(ctx *Context, name string, args AiOptimizerHostedModelArgs, opts ...ResourceOption) (*AiOptimizerHostedModel, error)
    public AiOptimizerHostedModel(string name, AiOptimizerHostedModelArgs args, CustomResourceOptions? opts = null)
    public AiOptimizerHostedModel(String name, AiOptimizerHostedModelArgs args)
    public AiOptimizerHostedModel(String name, AiOptimizerHostedModelArgs args, CustomResourceOptions options)
    
    type: castai:index/aiOptimizer:AiOptimizerHostedModel
    properties: # The arguments to resource properties.
    options: # Bag of options to control resource's behavior.
    
    
    resource "castai_ai_optimizer_hosted_model" "name" {
        # resource properties
    }

    Parameters

    name string
    The unique name of the resource.
    args AiOptimizerHostedModelArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    resource_name str
    The unique name of the resource.
    args AiOptimizerHostedModelArgs
    The arguments to resource properties.
    opts ResourceOptions
    Bag of options to control resource's behavior.
    ctx Context
    Context object for the current deployment.
    name string
    The unique name of the resource.
    args AiOptimizerHostedModelArgs
    The arguments to resource properties.
    opts ResourceOption
    Bag of options to control resource's behavior.
    name string
    The unique name of the resource.
    args AiOptimizerHostedModelArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    name String
    The unique name of the resource.
    args AiOptimizerHostedModelArgs
    The arguments to resource properties.
    options CustomResourceOptions
    Bag of options to control resource's behavior.

    AiOptimizerHostedModel Resource Properties

    To learn more about resource properties and how to use them, see Inputs and Outputs in the Architecture and Concepts docs.

    Inputs

    In Python, inputs that are objects can be passed either as argument classes or as dictionary literals.

    The AiOptimizerHostedModel resource accepts the following input properties:

    ClusterId string
    CAST AI cluster ID where the model will be deployed.
    ModelSpecsId string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    Port int
    Port on which the model will be exposed.
    Service string
    Kubernetes service name for the deployed model.
    EdgeLocationIds List<string>
    List of edge location IDs where the model can be deployed.
    Fallback Pulumi.CastAI.Inputs.AiOptimizerHostedModelFallback
    Fallback model settings.
    Hibernation Pulumi.CastAI.Inputs.AiOptimizerHostedModelHibernation
    Automatic hibernation settings.
    HorizontalAutoscaling Pulumi.CastAI.Inputs.AiOptimizerHostedModelHorizontalAutoscaling
    Horizontal autoscaling settings.
    NodeTemplateName string
    Node template name for model deployment.
    VllmConfig Pulumi.CastAI.Inputs.AiOptimizerHostedModelVllmConfig
    vLLM configuration for HuggingFace models.
    ClusterId string
    CAST AI cluster ID where the model will be deployed.
    ModelSpecsId string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    Port int
    Port on which the model will be exposed.
    Service string
    Kubernetes service name for the deployed model.
    EdgeLocationIds []string
    List of edge location IDs where the model can be deployed.
    Fallback AiOptimizerHostedModelFallbackArgs
    Fallback model settings.
    Hibernation AiOptimizerHostedModelHibernationArgs
    Automatic hibernation settings.
    HorizontalAutoscaling AiOptimizerHostedModelHorizontalAutoscalingArgs
    Horizontal autoscaling settings.
    NodeTemplateName string
    Node template name for model deployment.
    VllmConfig AiOptimizerHostedModelVllmConfigArgs
    vLLM configuration for HuggingFace models.
    cluster_id string
    CAST AI cluster ID where the model will be deployed.
    model_specs_id string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    port number
    Port on which the model will be exposed.
    service string
    Kubernetes service name for the deployed model.
    edge_location_ids list(string)
    List of edge location IDs where the model can be deployed.
    fallback object
    Fallback model settings.
    hibernation object
    Automatic hibernation settings.
    horizontal_autoscaling object
    Horizontal autoscaling settings.
    node_template_name string
    Node template name for model deployment.
    vllm_config object
    vLLM configuration for HuggingFace models.
    clusterId String
    CAST AI cluster ID where the model will be deployed.
    modelSpecsId String
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    port Integer
    Port on which the model will be exposed.
    service String
    Kubernetes service name for the deployed model.
    edgeLocationIds List<String>
    List of edge location IDs where the model can be deployed.
    fallback AiOptimizerHostedModelFallback
    Fallback model settings.
    hibernation AiOptimizerHostedModelHibernation
    Automatic hibernation settings.
    horizontalAutoscaling AiOptimizerHostedModelHorizontalAutoscaling
    Horizontal autoscaling settings.
    nodeTemplateName String
    Node template name for model deployment.
    vllmConfig AiOptimizerHostedModelVllmConfig
    vLLM configuration for HuggingFace models.
    clusterId string
    CAST AI cluster ID where the model will be deployed.
    modelSpecsId string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    port number
    Port on which the model will be exposed.
    service string
    Kubernetes service name for the deployed model.
    edgeLocationIds string[]
    List of edge location IDs where the model can be deployed.
    fallback AiOptimizerHostedModelFallback
    Fallback model settings.
    hibernation AiOptimizerHostedModelHibernation
    Automatic hibernation settings.
    horizontalAutoscaling AiOptimizerHostedModelHorizontalAutoscaling
    Horizontal autoscaling settings.
    nodeTemplateName string
    Node template name for model deployment.
    vllmConfig AiOptimizerHostedModelVllmConfig
    vLLM configuration for HuggingFace models.
    cluster_id str
    CAST AI cluster ID where the model will be deployed.
    model_specs_id str
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    port int
    Port on which the model will be exposed.
    service str
    Kubernetes service name for the deployed model.
    edge_location_ids Sequence[str]
    List of edge location IDs where the model can be deployed.
    fallback AiOptimizerHostedModelFallbackArgs
    Fallback model settings.
    hibernation AiOptimizerHostedModelHibernationArgs
    Automatic hibernation settings.
    horizontal_autoscaling AiOptimizerHostedModelHorizontalAutoscalingArgs
    Horizontal autoscaling settings.
    node_template_name str
    Node template name for model deployment.
    vllm_config AiOptimizerHostedModelVllmConfigArgs
    vLLM configuration for HuggingFace models.
    clusterId String
    CAST AI cluster ID where the model will be deployed.
    modelSpecsId String
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    port Number
    Port on which the model will be exposed.
    service String
    Kubernetes service name for the deployed model.
    edgeLocationIds List<String>
    List of edge location IDs where the model can be deployed.
    fallback Property Map
    Fallback model settings.
    hibernation Property Map
    Automatic hibernation settings.
    horizontalAutoscaling Property Map
    Horizontal autoscaling settings.
    nodeTemplateName String
    Node template name for model deployment.
    vllmConfig Property Map
    vLLM configuration for HuggingFace models.

    Outputs

    All input properties are implicitly available as output properties. Additionally, the AiOptimizerHostedModel resource produces the following output properties:

    CloudProvider string
    Cloud provider.
    CurrentReplicas int
    Current number of replicas.
    Id string
    The provider-assigned unique ID for this managed resource.
    Namespace string
    Kubernetes namespace.
    Region string
    Region the model is deployed in.
    Status string
    Hosted model status.
    StatusReason string
    Reason for the current status.
    CloudProvider string
    Cloud provider.
    CurrentReplicas int
    Current number of replicas.
    Id string
    The provider-assigned unique ID for this managed resource.
    Namespace string
    Kubernetes namespace.
    Region string
    Region the model is deployed in.
    Status string
    Hosted model status.
    StatusReason string
    Reason for the current status.
    cloud_provider string
    Cloud provider.
    current_replicas number
    Current number of replicas.
    id string
    The provider-assigned unique ID for this managed resource.
    namespace string
    Kubernetes namespace.
    region string
    Region the model is deployed in.
    status string
    Hosted model status.
    status_reason string
    Reason for the current status.
    cloudProvider String
    Cloud provider.
    currentReplicas Integer
    Current number of replicas.
    id String
    The provider-assigned unique ID for this managed resource.
    namespace String
    Kubernetes namespace.
    region String
    Region the model is deployed in.
    status String
    Hosted model status.
    statusReason String
    Reason for the current status.
    cloudProvider string
    Cloud provider.
    currentReplicas number
    Current number of replicas.
    id string
    The provider-assigned unique ID for this managed resource.
    namespace string
    Kubernetes namespace.
    region string
    Region the model is deployed in.
    status string
    Hosted model status.
    statusReason string
    Reason for the current status.
    cloud_provider str
    Cloud provider.
    current_replicas int
    Current number of replicas.
    id str
    The provider-assigned unique ID for this managed resource.
    namespace str
    Kubernetes namespace.
    region str
    Region the model is deployed in.
    status str
    Hosted model status.
    status_reason str
    Reason for the current status.
    cloudProvider String
    Cloud provider.
    currentReplicas Number
    Current number of replicas.
    id String
    The provider-assigned unique ID for this managed resource.
    namespace String
    Kubernetes namespace.
    region String
    Region the model is deployed in.
    status String
    Hosted model status.
    statusReason String
    Reason for the current status.

    Look up Existing AiOptimizerHostedModel Resource

    Get an existing AiOptimizerHostedModel resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

    public static get(name: string, id: Input<ID>, state?: AiOptimizerHostedModelState, opts?: CustomResourceOptions): AiOptimizerHostedModel
    @staticmethod
    def get(resource_name: str,
            id: str,
            opts: Optional[ResourceOptions] = None,
            cloud_provider: Optional[str] = None,
            cluster_id: Optional[str] = None,
            current_replicas: Optional[int] = None,
            edge_location_ids: Optional[Sequence[str]] = None,
            fallback: Optional[AiOptimizerHostedModelFallbackArgs] = None,
            hibernation: Optional[AiOptimizerHostedModelHibernationArgs] = None,
            horizontal_autoscaling: Optional[AiOptimizerHostedModelHorizontalAutoscalingArgs] = None,
            model_specs_id: Optional[str] = None,
            namespace: Optional[str] = None,
            node_template_name: Optional[str] = None,
            port: Optional[int] = None,
            region: Optional[str] = None,
            service: Optional[str] = None,
            status: Optional[str] = None,
            status_reason: Optional[str] = None,
            vllm_config: Optional[AiOptimizerHostedModelVllmConfigArgs] = None) -> AiOptimizerHostedModel
    func GetAiOptimizerHostedModel(ctx *Context, name string, id IDInput, state *AiOptimizerHostedModelState, opts ...ResourceOption) (*AiOptimizerHostedModel, error)
    public static AiOptimizerHostedModel Get(string name, Input<string> id, AiOptimizerHostedModelState? state, CustomResourceOptions? opts = null)
    public static AiOptimizerHostedModel get(String name, Output<String> id, AiOptimizerHostedModelState state, CustomResourceOptions options)
    resources:  _:    type: castai:index/aiOptimizer:AiOptimizerHostedModel    get:      id: ${id}
    import {
      to = castai_ai_optimizer_hosted_model.example
      id = "${id}"
    }
    
    name
    The unique name of the resulting resource.
    id
    The unique provider ID of the resource to lookup.
    state
    Any extra arguments used during the lookup.
    opts
    A bag of options that control this resource's behavior.
    resource_name
    The unique name of the resulting resource.
    id
    The unique provider ID of the resource to lookup.
    name
    The unique name of the resulting resource.
    id
    The unique provider ID of the resource to lookup.
    state
    Any extra arguments used during the lookup.
    opts
    A bag of options that control this resource's behavior.
    name
    The unique name of the resulting resource.
    id
    The unique provider ID of the resource to lookup.
    state
    Any extra arguments used during the lookup.
    opts
    A bag of options that control this resource's behavior.
    name
    The unique name of the resulting resource.
    id
    The unique provider ID of the resource to lookup.
    state
    Any extra arguments used during the lookup.
    opts
    A bag of options that control this resource's behavior.
    The following state arguments are supported:
    CloudProvider string
    Cloud provider.
    ClusterId string
    CAST AI cluster ID where the model will be deployed.
    CurrentReplicas int
    Current number of replicas.
    EdgeLocationIds List<string>
    List of edge location IDs where the model can be deployed.
    Fallback Pulumi.CastAI.Inputs.AiOptimizerHostedModelFallback
    Fallback model settings.
    Hibernation Pulumi.CastAI.Inputs.AiOptimizerHostedModelHibernation
    Automatic hibernation settings.
    HorizontalAutoscaling Pulumi.CastAI.Inputs.AiOptimizerHostedModelHorizontalAutoscaling
    Horizontal autoscaling settings.
    ModelSpecsId string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    Namespace string
    Kubernetes namespace.
    NodeTemplateName string
    Node template name for model deployment.
    Port int
    Port on which the model will be exposed.
    Region string
    Region the model is deployed in.
    Service string
    Kubernetes service name for the deployed model.
    Status string
    Hosted model status.
    StatusReason string
    Reason for the current status.
    VllmConfig Pulumi.CastAI.Inputs.AiOptimizerHostedModelVllmConfig
    vLLM configuration for HuggingFace models.
    CloudProvider string
    Cloud provider.
    ClusterId string
    CAST AI cluster ID where the model will be deployed.
    CurrentReplicas int
    Current number of replicas.
    EdgeLocationIds []string
    List of edge location IDs where the model can be deployed.
    Fallback AiOptimizerHostedModelFallbackArgs
    Fallback model settings.
    Hibernation AiOptimizerHostedModelHibernationArgs
    Automatic hibernation settings.
    HorizontalAutoscaling AiOptimizerHostedModelHorizontalAutoscalingArgs
    Horizontal autoscaling settings.
    ModelSpecsId string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    Namespace string
    Kubernetes namespace.
    NodeTemplateName string
    Node template name for model deployment.
    Port int
    Port on which the model will be exposed.
    Region string
    Region the model is deployed in.
    Service string
    Kubernetes service name for the deployed model.
    Status string
    Hosted model status.
    StatusReason string
    Reason for the current status.
    VllmConfig AiOptimizerHostedModelVllmConfigArgs
    vLLM configuration for HuggingFace models.
    cloud_provider string
    Cloud provider.
    cluster_id string
    CAST AI cluster ID where the model will be deployed.
    current_replicas number
    Current number of replicas.
    edge_location_ids list(string)
    List of edge location IDs where the model can be deployed.
    fallback object
    Fallback model settings.
    hibernation object
    Automatic hibernation settings.
    horizontal_autoscaling object
    Horizontal autoscaling settings.
    model_specs_id string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    namespace string
    Kubernetes namespace.
    node_template_name string
    Node template name for model deployment.
    port number
    Port on which the model will be exposed.
    region string
    Region the model is deployed in.
    service string
    Kubernetes service name for the deployed model.
    status string
    Hosted model status.
    status_reason string
    Reason for the current status.
    vllm_config object
    vLLM configuration for HuggingFace models.
    cloudProvider String
    Cloud provider.
    clusterId String
    CAST AI cluster ID where the model will be deployed.
    currentReplicas Integer
    Current number of replicas.
    edgeLocationIds List<String>
    List of edge location IDs where the model can be deployed.
    fallback AiOptimizerHostedModelFallback
    Fallback model settings.
    hibernation AiOptimizerHostedModelHibernation
    Automatic hibernation settings.
    horizontalAutoscaling AiOptimizerHostedModelHorizontalAutoscaling
    Horizontal autoscaling settings.
    modelSpecsId String
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    namespace String
    Kubernetes namespace.
    nodeTemplateName String
    Node template name for model deployment.
    port Integer
    Port on which the model will be exposed.
    region String
    Region the model is deployed in.
    service String
    Kubernetes service name for the deployed model.
    status String
    Hosted model status.
    statusReason String
    Reason for the current status.
    vllmConfig AiOptimizerHostedModelVllmConfig
    vLLM configuration for HuggingFace models.
    cloudProvider string
    Cloud provider.
    clusterId string
    CAST AI cluster ID where the model will be deployed.
    currentReplicas number
    Current number of replicas.
    edgeLocationIds string[]
    List of edge location IDs where the model can be deployed.
    fallback AiOptimizerHostedModelFallback
    Fallback model settings.
    hibernation AiOptimizerHostedModelHibernation
    Automatic hibernation settings.
    horizontalAutoscaling AiOptimizerHostedModelHorizontalAutoscaling
    Horizontal autoscaling settings.
    modelSpecsId string
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    namespace string
    Kubernetes namespace.
    nodeTemplateName string
    Node template name for model deployment.
    port number
    Port on which the model will be exposed.
    region string
    Region the model is deployed in.
    service string
    Kubernetes service name for the deployed model.
    status string
    Hosted model status.
    statusReason string
    Reason for the current status.
    vllmConfig AiOptimizerHostedModelVllmConfig
    vLLM configuration for HuggingFace models.
    cloud_provider str
    Cloud provider.
    cluster_id str
    CAST AI cluster ID where the model will be deployed.
    current_replicas int
    Current number of replicas.
    edge_location_ids Sequence[str]
    List of edge location IDs where the model can be deployed.
    fallback AiOptimizerHostedModelFallbackArgs
    Fallback model settings.
    hibernation AiOptimizerHostedModelHibernationArgs
    Automatic hibernation settings.
    horizontal_autoscaling AiOptimizerHostedModelHorizontalAutoscalingArgs
    Horizontal autoscaling settings.
    model_specs_id str
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    namespace str
    Kubernetes namespace.
    node_template_name str
    Node template name for model deployment.
    port int
    Port on which the model will be exposed.
    region str
    Region the model is deployed in.
    service str
    Kubernetes service name for the deployed model.
    status str
    Hosted model status.
    status_reason str
    Reason for the current status.
    vllm_config AiOptimizerHostedModelVllmConfigArgs
    vLLM configuration for HuggingFace models.
    cloudProvider String
    Cloud provider.
    clusterId String
    CAST AI cluster ID where the model will be deployed.
    currentReplicas Number
    Current number of replicas.
    edgeLocationIds List<String>
    List of edge location IDs where the model can be deployed.
    fallback Property Map
    Fallback model settings.
    hibernation Property Map
    Automatic hibernation settings.
    horizontalAutoscaling Property Map
    Horizontal autoscaling settings.
    modelSpecsId String
    ID of the model specs. Can reference a castai.AiOptimizerModelSpecs resource or a pre-existing model specs ID for predefined (CastAI-managed) models.
    namespace String
    Kubernetes namespace.
    nodeTemplateName String
    Node template name for model deployment.
    port Number
    Port on which the model will be exposed.
    region String
    Region the model is deployed in.
    service String
    Kubernetes service name for the deployed model.
    status String
    Hosted model status.
    statusReason String
    Reason for the current status.
    vllmConfig Property Map
    vLLM configuration for HuggingFace models.

    Supporting Types

    AiOptimizerHostedModelFallback, AiOptimizerHostedModelFallbackArgs

    Enabled bool
    Model string
    ProviderId string
    Enabled bool
    Model string
    ProviderId string
    enabled bool
    model string
    provider_id string
    enabled Boolean
    model String
    providerId String
    enabled boolean
    model string
    providerId string
    enabled Boolean
    model String
    providerId String

    AiOptimizerHostedModelHibernation, AiOptimizerHostedModelHibernationArgs

    AiOptimizerHostedModelHibernationHibernateCondition, AiOptimizerHostedModelHibernationHibernateConditionArgs

    Duration string
    Time period for the condition evaluation.
    RequestCount int
    Request count threshold. Value of 0 is treated as not set.
    Duration string
    Time period for the condition evaluation.
    RequestCount int
    Request count threshold. Value of 0 is treated as not set.
    duration string
    Time period for the condition evaluation.
    request_count number
    Request count threshold. Value of 0 is treated as not set.
    duration String
    Time period for the condition evaluation.
    requestCount Integer
    Request count threshold. Value of 0 is treated as not set.
    duration string
    Time period for the condition evaluation.
    requestCount number
    Request count threshold. Value of 0 is treated as not set.
    duration str
    Time period for the condition evaluation.
    request_count int
    Request count threshold. Value of 0 is treated as not set.
    duration String
    Time period for the condition evaluation.
    requestCount Number
    Request count threshold. Value of 0 is treated as not set.

    AiOptimizerHostedModelHibernationResumeCondition, AiOptimizerHostedModelHibernationResumeConditionArgs

    Duration string
    Time period for the condition evaluation.
    RequestCount int
    Request count threshold. Value of 0 is treated as not set.
    Duration string
    Time period for the condition evaluation.
    RequestCount int
    Request count threshold. Value of 0 is treated as not set.
    duration string
    Time period for the condition evaluation.
    request_count number
    Request count threshold. Value of 0 is treated as not set.
    duration String
    Time period for the condition evaluation.
    requestCount Integer
    Request count threshold. Value of 0 is treated as not set.
    duration string
    Time period for the condition evaluation.
    requestCount number
    Request count threshold. Value of 0 is treated as not set.
    duration str
    Time period for the condition evaluation.
    request_count int
    Request count threshold. Value of 0 is treated as not set.
    duration String
    Time period for the condition evaluation.
    requestCount Number
    Request count threshold. Value of 0 is treated as not set.

    AiOptimizerHostedModelHorizontalAutoscaling, AiOptimizerHostedModelHorizontalAutoscalingArgs

    maxReplicas Integer
    minReplicas Integer
    targetMetric String
    targetValue Double
    enabled Boolean
    maxReplicas number
    minReplicas number
    targetMetric string
    targetValue number
    enabled boolean
    maxReplicas Number
    minReplicas Number
    targetMetric String
    targetValue Number
    enabled Boolean

    AiOptimizerHostedModelVllmConfig, AiOptimizerHostedModelVllmConfigArgs

    HuggingFaceToken string
    HuggingFace token. Mutually exclusive with secret_name.
    SecretName string
    Kubernetes secret name containing the HuggingFace token.
    HuggingFaceToken string
    HuggingFace token. Mutually exclusive with secret_name.
    SecretName string
    Kubernetes secret name containing the HuggingFace token.
    hugging_face_token string
    HuggingFace token. Mutually exclusive with secret_name.
    secret_name string
    Kubernetes secret name containing the HuggingFace token.
    huggingFaceToken String
    HuggingFace token. Mutually exclusive with secret_name.
    secretName String
    Kubernetes secret name containing the HuggingFace token.
    huggingFaceToken string
    HuggingFace token. Mutually exclusive with secret_name.
    secretName string
    Kubernetes secret name containing the HuggingFace token.
    hugging_face_token str
    HuggingFace token. Mutually exclusive with secret_name.
    secret_name str
    Kubernetes secret name containing the HuggingFace token.
    huggingFaceToken String
    HuggingFace token. Mutually exclusive with secret_name.
    secretName String
    Kubernetes secret name containing the HuggingFace token.

    Package Details

    Repository
    castai castai/pulumi-castai
    License
    Apache-2.0
    Notes
    This Pulumi package is based on the castai Terraform Provider.
    castai logo
    Viewing docs for CAST AI v8.60.0
    published on Wednesday, Aug 19, 2026 by CAST AI

      Try Pulumi Cloud free.
      Your team will thank you.

      Start free trial