Docs Packages
  1. Packages
  2. AWS Native
  3. API Docs
  4. osis
  5. Pipeline

AWS Native is in preview. AWS Classic is fully supported.

AWS Native v0.105.0 published on Thursday, May 2, 2024 by Pulumi
pulumi/pulumi-aws-native

aws-native.osis.Pipeline

Explore with Pulumi AI

aws-native logo

AWS Native is in preview. AWS Classic is fully supported.

AWS Native v0.105.0 published on Thursday, May 2, 2024 by Pulumi
pulumi/pulumi-aws-native

    An OpenSearch Ingestion Service Data Prepper pipeline running Data Prepper.

    Create Pipeline Resource

    Resources are created with functions called constructors. To learn more about declaring and configuring resources, see Resources.

    Constructor syntax

    new Pipeline(name: string, args: PipelineArgs, opts?: CustomResourceOptions);
    @overload
def Pipeline(resource_name: str,
             args: PipelineArgs,
             opts: Optional[ResourceOptions] = None)

@overload
def Pipeline(resource_name: str,
             opts: Optional[ResourceOptions] = None,
             max_units: Optional[int] = None,
             min_units: Optional[int] = None,
             pipeline_configuration_body: Optional[str] = None,
             buffer_options: Optional[PipelineBufferOptionsArgs] = None,
             encryption_at_rest_options: Optional[PipelineEncryptionAtRestOptionsArgs] = None,
             log_publishing_options: Optional[PipelineLogPublishingOptionsArgs] = None,
             pipeline_name: Optional[str] = None,
             tags: Optional[Sequence[_root_inputs.TagArgs]] = None,
             vpc_options: Optional[PipelineVpcOptionsArgs] = None)
    func NewPipeline(ctx *Context, name string, args PipelineArgs, opts ...ResourceOption) (*Pipeline, error)
    public Pipeline(string name, PipelineArgs args, CustomResourceOptions? opts = null)
    public Pipeline(String name, PipelineArgs args)
public Pipeline(String name, PipelineArgs args, CustomResourceOptions options)

    type: aws-native:osis:Pipeline
properties: # The arguments to resource properties.
options: # Bag of options to control resource's behavior.

    Parameters

    name string
    The unique name of the resource.
    args PipelineArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    resource_name str
    The unique name of the resource.
    args PipelineArgs
    The arguments to resource properties.
    opts ResourceOptions
    Bag of options to control resource's behavior.
    ctx Context
    Context object for the current deployment.
    name string
    The unique name of the resource.
    args PipelineArgs
    The arguments to resource properties.
    opts ResourceOption
    Bag of options to control resource's behavior.
    name string
    The unique name of the resource.
    args PipelineArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    name String
    The unique name of the resource.
    args PipelineArgs
    The arguments to resource properties.
    options CustomResourceOptions
    Bag of options to control resource's behavior.

    Example

    The following reference example uses placeholder values for all input properties.

    Coming soon!

    Coming soon!

    Coming soon!

    Coming soon!

    const examplepipelineResourceResourceFromOsis = new aws_native.osis.Pipeline("examplepipelineResourceResourceFromOsis", {
    maxUnits: 0,
    minUnits: 0,
    pipelineConfigurationBody: "string",
    bufferOptions: {
        persistentBufferEnabled: false,
    },
    encryptionAtRestOptions: {
        kmsKeyArn: "string",
    },
    logPublishingOptions: {
        cloudWatchLogDestination: {
            logGroup: "string",
        },
        isLoggingEnabled: false,
    },
    pipelineName: "string",
    tags: [{
        key: "string",
        value: "string",
    }],
    vpcOptions: {
        subnetIds: ["string"],
        securityGroupIds: ["string"],
    },
});

    Coming soon!

    Pipeline Resource Properties

    To learn more about resource properties and how to use them, see Inputs and Outputs in the Architecture and Concepts docs.

    Inputs

    The Pipeline resource accepts the following input properties:

    MaxUnits int
    The maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    MinUnits int
    The minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    PipelineConfigurationBody string
    The Data Prepper pipeline configuration.
    BufferOptions Pulumi.AwsNative.Osis.Inputs.PipelineBufferOptions
    EncryptionAtRestOptions Pulumi.AwsNative.Osis.Inputs.PipelineEncryptionAtRestOptions
    LogPublishingOptions Pulumi.AwsNative.Osis.Inputs.PipelineLogPublishingOptions
    PipelineName string
    Name of the OpenSearch Ingestion Service pipeline to create. Pipeline names are unique across the pipelines owned by an account within an AWS Region.
    Tags List<Pulumi.AwsNative.Inputs.Tag>
    An array of key-value pairs to apply to this resource.
    VpcOptions Pulumi.AwsNative.Osis.Inputs.PipelineVpcOptions
    MaxUnits int
    The maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    MinUnits int
    The minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    PipelineConfigurationBody string
    The Data Prepper pipeline configuration.
    BufferOptions PipelineBufferOptionsArgs
    EncryptionAtRestOptions PipelineEncryptionAtRestOptionsArgs
    LogPublishingOptions PipelineLogPublishingOptionsArgs
    PipelineName string
    Name of the OpenSearch Ingestion Service pipeline to create. Pipeline names are unique across the pipelines owned by an account within an AWS Region.
    Tags TagArgs
    An array of key-value pairs to apply to this resource.
    VpcOptions PipelineVpcOptionsArgs
    maxUnits Integer
    The maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    minUnits Integer
    The minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    pipelineConfigurationBody String
    The Data Prepper pipeline configuration.
    bufferOptions PipelineBufferOptions
    encryptionAtRestOptions PipelineEncryptionAtRestOptions
    logPublishingOptions PipelineLogPublishingOptions
    pipelineName String
    Name of the OpenSearch Ingestion Service pipeline to create. Pipeline names are unique across the pipelines owned by an account within an AWS Region.
    tags List<Tag>
    An array of key-value pairs to apply to this resource.
    vpcOptions PipelineVpcOptions
    maxUnits number
    The maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    minUnits number
    The minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    pipelineConfigurationBody string
    The Data Prepper pipeline configuration.
    bufferOptions PipelineBufferOptions
    encryptionAtRestOptions PipelineEncryptionAtRestOptions
    logPublishingOptions PipelineLogPublishingOptions
    pipelineName string
    Name of the OpenSearch Ingestion Service pipeline to create. Pipeline names are unique across the pipelines owned by an account within an AWS Region.
    tags Tag[]
    An array of key-value pairs to apply to this resource.
    vpcOptions PipelineVpcOptions
    max_units int
    The maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    min_units int
    The minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    pipeline_configuration_body str
    The Data Prepper pipeline configuration.
    buffer_options PipelineBufferOptionsArgs
    encryption_at_rest_options PipelineEncryptionAtRestOptionsArgs
    log_publishing_options PipelineLogPublishingOptionsArgs
    pipeline_name str
    Name of the OpenSearch Ingestion Service pipeline to create. Pipeline names are unique across the pipelines owned by an account within an AWS Region.
    tags Sequence[TagArgs]
    An array of key-value pairs to apply to this resource.
    vpc_options PipelineVpcOptionsArgs
    maxUnits Number
    The maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    minUnits Number
    The minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
    pipelineConfigurationBody String
    The Data Prepper pipeline configuration.
    bufferOptions Property Map
    encryptionAtRestOptions Property Map
    logPublishingOptions Property Map
    pipelineName String
    Name of the OpenSearch Ingestion Service pipeline to create. Pipeline names are unique across the pipelines owned by an account within an AWS Region.
    tags List<Property Map>
    An array of key-value pairs to apply to this resource.
    vpcOptions Property Map

    Outputs

    All input properties are implicitly available as output properties. Additionally, the Pipeline resource produces the following output properties:

    Id string
    The provider-assigned unique ID for this managed resource.
    IngestEndpointUrls List<string>
    A list of endpoints that can be used for ingesting data into a pipeline
    PipelineArn string
    The Amazon Resource Name (ARN) of the pipeline.
    VpcEndpoints List<Pulumi.AwsNative.Osis.Outputs.PipelineVpcEndpoint>
    The VPC interface endpoints that have access to the pipeline.
    Id string
    The provider-assigned unique ID for this managed resource.
    IngestEndpointUrls []string
    A list of endpoints that can be used for ingesting data into a pipeline
    PipelineArn string
    The Amazon Resource Name (ARN) of the pipeline.
    VpcEndpoints []PipelineVpcEndpoint
    The VPC interface endpoints that have access to the pipeline.
    id String
    The provider-assigned unique ID for this managed resource.
    ingestEndpointUrls List<String>
    A list of endpoints that can be used for ingesting data into a pipeline
    pipelineArn String
    The Amazon Resource Name (ARN) of the pipeline.
    vpcEndpoints List<PipelineVpcEndpoint>
    The VPC interface endpoints that have access to the pipeline.
    id string
    The provider-assigned unique ID for this managed resource.
    ingestEndpointUrls string[]
    A list of endpoints that can be used for ingesting data into a pipeline
    pipelineArn string
    The Amazon Resource Name (ARN) of the pipeline.
    vpcEndpoints PipelineVpcEndpoint[]
    The VPC interface endpoints that have access to the pipeline.
    id str
    The provider-assigned unique ID for this managed resource.
    ingest_endpoint_urls Sequence[str]
    A list of endpoints that can be used for ingesting data into a pipeline
    pipeline_arn str
    The Amazon Resource Name (ARN) of the pipeline.
    vpc_endpoints Sequence[PipelineVpcEndpoint]
    The VPC interface endpoints that have access to the pipeline.
    id String
    The provider-assigned unique ID for this managed resource.
    ingestEndpointUrls List<String>
    A list of endpoints that can be used for ingesting data into a pipeline
    pipelineArn String
    The Amazon Resource Name (ARN) of the pipeline.
    vpcEndpoints List<Property Map>
    The VPC interface endpoints that have access to the pipeline.

    Supporting Types

    PipelineBufferOptions, PipelineBufferOptionsArgs

    PersistentBufferEnabled bool
    Whether persistent buffering should be enabled.
    PersistentBufferEnabled bool
    Whether persistent buffering should be enabled.
    persistentBufferEnabled Boolean
    Whether persistent buffering should be enabled.
    persistentBufferEnabled boolean
    Whether persistent buffering should be enabled.
    persistent_buffer_enabled bool
    Whether persistent buffering should be enabled.
    persistentBufferEnabled Boolean
    Whether persistent buffering should be enabled.

    PipelineEncryptionAtRestOptions, PipelineEncryptionAtRestOptionsArgs

    KmsKeyArn string
    The KMS key to use for encrypting data. By default an AWS owned key is used
    KmsKeyArn string
    The KMS key to use for encrypting data. By default an AWS owned key is used
    kmsKeyArn String
    The KMS key to use for encrypting data. By default an AWS owned key is used
    kmsKeyArn string
    The KMS key to use for encrypting data. By default an AWS owned key is used
    kms_key_arn str
    The KMS key to use for encrypting data. By default an AWS owned key is used
    kmsKeyArn String
    The KMS key to use for encrypting data. By default an AWS owned key is used

    PipelineLogPublishingOptions, PipelineLogPublishingOptionsArgs

    CloudWatchLogDestination Pulumi.AwsNative.Osis.Inputs.PipelineLogPublishingOptionsCloudWatchLogDestinationProperties
    The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch.
    IsLoggingEnabled bool
    Whether logs should be published.
    CloudWatchLogDestination PipelineLogPublishingOptionsCloudWatchLogDestinationProperties
    The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch.
    IsLoggingEnabled bool
    Whether logs should be published.
    cloudWatchLogDestination PipelineLogPublishingOptionsCloudWatchLogDestinationProperties
    The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch.
    isLoggingEnabled Boolean
    Whether logs should be published.
    cloudWatchLogDestination PipelineLogPublishingOptionsCloudWatchLogDestinationProperties
    The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch.
    isLoggingEnabled boolean
    Whether logs should be published.
    cloud_watch_log_destination PipelineLogPublishingOptionsCloudWatchLogDestinationProperties
    The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch.
    is_logging_enabled bool
    Whether logs should be published.
    cloudWatchLogDestination Property Map
    The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch.
    isLoggingEnabled Boolean
    Whether logs should be published.

    PipelineLogPublishingOptionsCloudWatchLogDestinationProperties, PipelineLogPublishingOptionsCloudWatchLogDestinationPropertiesArgs

    LogGroup string
    LogGroup string
    logGroup String
    logGroup string
    logGroup String

    PipelineVpcEndpoint, PipelineVpcEndpointArgs

    VpcEndpointId string
    The unique identifier of the endpoint.
    VpcId string
    The ID for your VPC. AWS Privatelink generates this value when you create a VPC.
    VpcOptions Pulumi.AwsNative.Osis.Inputs.PipelineVpcOptions
    VpcEndpointId string
    The unique identifier of the endpoint.
    VpcId string
    The ID for your VPC. AWS Privatelink generates this value when you create a VPC.
    VpcOptions PipelineVpcOptions
    vpcEndpointId String
    The unique identifier of the endpoint.
    vpcId String
    The ID for your VPC. AWS Privatelink generates this value when you create a VPC.
    vpcOptions PipelineVpcOptions
    vpcEndpointId string
    The unique identifier of the endpoint.
    vpcId string
    The ID for your VPC. AWS Privatelink generates this value when you create a VPC.
    vpcOptions PipelineVpcOptions
    vpc_endpoint_id str
    The unique identifier of the endpoint.
    vpc_id str
    The ID for your VPC. AWS Privatelink generates this value when you create a VPC.
    vpc_options PipelineVpcOptions
    vpcEndpointId String
    The unique identifier of the endpoint.
    vpcId String
    The ID for your VPC. AWS Privatelink generates this value when you create a VPC.
    vpcOptions Property Map

    PipelineVpcOptions, PipelineVpcOptionsArgs

    SubnetIds List<string>
    A list of subnet IDs associated with the VPC endpoint.
    SecurityGroupIds List<string>
    A list of security groups associated with the VPC endpoint.
    SubnetIds []string
    A list of subnet IDs associated with the VPC endpoint.
    SecurityGroupIds []string
    A list of security groups associated with the VPC endpoint.
    subnetIds List<String>
    A list of subnet IDs associated with the VPC endpoint.
    securityGroupIds List<String>
    A list of security groups associated with the VPC endpoint.
    subnetIds string[]
    A list of subnet IDs associated with the VPC endpoint.
    securityGroupIds string[]
    A list of security groups associated with the VPC endpoint.
    subnet_ids Sequence[str]
    A list of subnet IDs associated with the VPC endpoint.
    security_group_ids Sequence[str]
    A list of security groups associated with the VPC endpoint.
    subnetIds List<String>
    A list of subnet IDs associated with the VPC endpoint.
    securityGroupIds List<String>
    A list of security groups associated with the VPC endpoint.

    Tag, TagArgs

    Key string
    The key name of the tag
    Value string
    The value of the tag
    Key string
    The key name of the tag
    Value string
    The value of the tag
    key String
    The key name of the tag
    value String
    The value of the tag
    key string
    The key name of the tag
    value string
    The value of the tag
    key str
    The key name of the tag
    value str
    The value of the tag
    key String
    The key name of the tag
    value String
    The value of the tag

    Package Details

    Repository
    AWS Native pulumi/pulumi-aws-native
    License
    Apache-2.0
    aws-native logo

    AWS Native is in preview. AWS Classic is fully supported.

    AWS Native v0.105.0 published on Thursday, May 2, 2024 by Pulumi
    pulumi/pulumi-aws-native