databricks.DatabaseSyncedDatabaseTable
Explore with Pulumi AI
Lakebase Synced Database Tables are Postgres tables automatically synced from a source table inside Unity Catalog. They can be used to serve realtime queries without the operational overhead of managing ETL pipelines.
Synced Database Tables can be configured inside either Database Catalogs or Standard Catalogs. Multiple Synced Database Tables can be bin packed inside a single pipeline to optimize costs.
Example Usage
Creating a Synced Database Table inside a Database Catalog
This example creates a Synced Database Table inside a Database Catalog.
Example coming soon!
Example coming soon!
Example coming soon!
Example coming soon!
Example coming soon!
resources:
this:
type: databricks:DatabaseSyncedDatabaseTable
properties:
name: my_database_catalog.public.synced_table
logicalDatabaseName: databricks_postgres
spec:
scheduling_policy: SNAPSHOT
source_table_full_name: source_delta.tpch.customer
primary_key_columns:
- c_custkey
create_database_objects_if_missing: true
new_pipeline_spec:
storageCatalog: source_delta
storageSchema: tpch
Creating a Synced Database Table inside a Standard Catalog
This example creates a Synced Database Table inside a Standard Catalog.
Example coming soon!
Example coming soon!
Example coming soon!
Example coming soon!
Example coming soon!
resources:
this:
type: databricks:DatabaseSyncedDatabaseTable
properties:
name: my_standard_catalog.public.synced_table
logicalDatabaseName: databricks_postgres
databaseInstanceName: my-database-instance
spec:
scheduling_policy: SNAPSHOT
source_table_full_name: source_delta.tpch.customer
primary_key_columns:
- c_custkey
create_database_objects_if_missing: true
new_pipeline_spec:
storageCatalog: source_delta
storageSchema: tpch
Creating multiple Synced Database Tables and bin packing them into a single pipeline
This example creates two Synced Database Tables. The first one specifies a new pipeline spec, which generates a new pipeline. The second one utilizes the pipeline ID of the first table.
Example coming soon!
Example coming soon!
Example coming soon!
Example coming soon!
Example coming soon!
resources:
instance:
type: databricks:DatabaseInstance
properties:
name: my-database-instance
capacity: CU_1
syncedTable1:
type: databricks:DatabaseSyncedDatabaseTable
name: synced_table_1
properties:
name: my_standard_catalog.public.synced_table1
logicalDatabaseName: databricks_postgres
databaseInstanceName: ${instance.name}
spec:
scheduling_policy: SNAPSHOT
source_table_full_name: source_delta.tpch.customer
primary_key_columns:
- c_custkey
create_database_objects_if_missing: true
new_pipeline_spec:
storageCatalog: source_delta
storageSchema: tpch
syncedTable2:
type: databricks:DatabaseSyncedDatabaseTable
name: synced_table_2
properties:
name: my_standard_catalog.public.synced_table2
logicalDatabaseName: databricks_postgres
databaseInstanceName: ${instance.name}
spec:
scheduling_policy: SNAPSHOT
source_table_full_name: source_delta.tpch.customer
primary_key_columns:
- c_custkey
create_database_objects_if_missing: true
existing_pipeline_id: ${syncedTable1.dataSynchronizationStatus.pipelineId}
Create DatabaseSyncedDatabaseTable Resource
Resources are created with functions called constructors. To learn more about declaring and configuring resources, see Resources.
Constructor syntax
new DatabaseSyncedDatabaseTable(name: string, args?: DatabaseSyncedDatabaseTableArgs, opts?: CustomResourceOptions);
@overload
def DatabaseSyncedDatabaseTable(resource_name: str,
args: Optional[DatabaseSyncedDatabaseTableArgs] = None,
opts: Optional[ResourceOptions] = None)
@overload
def DatabaseSyncedDatabaseTable(resource_name: str,
opts: Optional[ResourceOptions] = None,
database_instance_name: Optional[str] = None,
logical_database_name: Optional[str] = None,
name: Optional[str] = None,
spec: Optional[DatabaseSyncedDatabaseTableSpecArgs] = None)
func NewDatabaseSyncedDatabaseTable(ctx *Context, name string, args *DatabaseSyncedDatabaseTableArgs, opts ...ResourceOption) (*DatabaseSyncedDatabaseTable, error)
public DatabaseSyncedDatabaseTable(string name, DatabaseSyncedDatabaseTableArgs? args = null, CustomResourceOptions? opts = null)
public DatabaseSyncedDatabaseTable(String name, DatabaseSyncedDatabaseTableArgs args)
public DatabaseSyncedDatabaseTable(String name, DatabaseSyncedDatabaseTableArgs args, CustomResourceOptions options)
type: databricks:DatabaseSyncedDatabaseTable
properties: # The arguments to resource properties.
options: # Bag of options to control resource's behavior.
Parameters
- name string
- The unique name of the resource.
- args DatabaseSyncedDatabaseTableArgs
- The arguments to resource properties.
- opts CustomResourceOptions
- Bag of options to control resource's behavior.
- resource_name str
- The unique name of the resource.
- args DatabaseSyncedDatabaseTableArgs
- The arguments to resource properties.
- opts ResourceOptions
- Bag of options to control resource's behavior.
- ctx Context
- Context object for the current deployment.
- name string
- The unique name of the resource.
- args DatabaseSyncedDatabaseTableArgs
- The arguments to resource properties.
- opts ResourceOption
- Bag of options to control resource's behavior.
- name string
- The unique name of the resource.
- args DatabaseSyncedDatabaseTableArgs
- The arguments to resource properties.
- opts CustomResourceOptions
- Bag of options to control resource's behavior.
- name String
- The unique name of the resource.
- args DatabaseSyncedDatabaseTableArgs
- The arguments to resource properties.
- options CustomResourceOptions
- Bag of options to control resource's behavior.
Constructor example
The following reference example uses placeholder values for all input properties.
var databaseSyncedDatabaseTableResource = new Databricks.DatabaseSyncedDatabaseTable("databaseSyncedDatabaseTableResource", new()
{
DatabaseInstanceName = "string",
LogicalDatabaseName = "string",
Name = "string",
Spec = new Databricks.Inputs.DatabaseSyncedDatabaseTableSpecArgs
{
CreateDatabaseObjectsIfMissing = false,
ExistingPipelineId = "string",
NewPipelineSpec = new Databricks.Inputs.DatabaseSyncedDatabaseTableSpecNewPipelineSpecArgs
{
StorageCatalog = "string",
StorageSchema = "string",
},
PrimaryKeyColumns = new[]
{
"string",
},
SchedulingPolicy = "string",
SourceTableFullName = "string",
TimeseriesKey = "string",
},
});
example, err := databricks.NewDatabaseSyncedDatabaseTable(ctx, "databaseSyncedDatabaseTableResource", &databricks.DatabaseSyncedDatabaseTableArgs{
DatabaseInstanceName: pulumi.String("string"),
LogicalDatabaseName: pulumi.String("string"),
Name: pulumi.String("string"),
Spec: &databricks.DatabaseSyncedDatabaseTableSpecArgs{
CreateDatabaseObjectsIfMissing: pulumi.Bool(false),
ExistingPipelineId: pulumi.String("string"),
NewPipelineSpec: &databricks.DatabaseSyncedDatabaseTableSpecNewPipelineSpecArgs{
StorageCatalog: pulumi.String("string"),
StorageSchema: pulumi.String("string"),
},
PrimaryKeyColumns: pulumi.StringArray{
pulumi.String("string"),
},
SchedulingPolicy: pulumi.String("string"),
SourceTableFullName: pulumi.String("string"),
TimeseriesKey: pulumi.String("string"),
},
})
var databaseSyncedDatabaseTableResource = new DatabaseSyncedDatabaseTable("databaseSyncedDatabaseTableResource", DatabaseSyncedDatabaseTableArgs.builder()
.databaseInstanceName("string")
.logicalDatabaseName("string")
.name("string")
.spec(DatabaseSyncedDatabaseTableSpecArgs.builder()
.createDatabaseObjectsIfMissing(false)
.existingPipelineId("string")
.newPipelineSpec(DatabaseSyncedDatabaseTableSpecNewPipelineSpecArgs.builder()
.storageCatalog("string")
.storageSchema("string")
.build())
.primaryKeyColumns("string")
.schedulingPolicy("string")
.sourceTableFullName("string")
.timeseriesKey("string")
.build())
.build());
database_synced_database_table_resource = databricks.DatabaseSyncedDatabaseTable("databaseSyncedDatabaseTableResource",
database_instance_name="string",
logical_database_name="string",
name="string",
spec={
"create_database_objects_if_missing": False,
"existing_pipeline_id": "string",
"new_pipeline_spec": {
"storage_catalog": "string",
"storage_schema": "string",
},
"primary_key_columns": ["string"],
"scheduling_policy": "string",
"source_table_full_name": "string",
"timeseries_key": "string",
})
const databaseSyncedDatabaseTableResource = new databricks.DatabaseSyncedDatabaseTable("databaseSyncedDatabaseTableResource", {
databaseInstanceName: "string",
logicalDatabaseName: "string",
name: "string",
spec: {
createDatabaseObjectsIfMissing: false,
existingPipelineId: "string",
newPipelineSpec: {
storageCatalog: "string",
storageSchema: "string",
},
primaryKeyColumns: ["string"],
schedulingPolicy: "string",
sourceTableFullName: "string",
timeseriesKey: "string",
},
});
type: databricks:DatabaseSyncedDatabaseTable
properties:
databaseInstanceName: string
logicalDatabaseName: string
name: string
spec:
createDatabaseObjectsIfMissing: false
existingPipelineId: string
newPipelineSpec:
storageCatalog: string
storageSchema: string
primaryKeyColumns:
- string
schedulingPolicy: string
sourceTableFullName: string
timeseriesKey: string
DatabaseSyncedDatabaseTable Resource Properties
To learn more about resource properties and how to use them, see Inputs and Outputs in the Architecture and Concepts docs.
Inputs
In Python, inputs that are objects can be passed either as argument classes or as dictionary literals.
The DatabaseSyncedDatabaseTable resource accepts the following input properties:
- Database
Instance stringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- Logical
Database stringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- Name string
- Full three-part (catalog, schema, table) name of the table
- Spec
Database
Synced Database Table Spec
- Database
Instance stringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- Logical
Database stringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- Name string
- Full three-part (catalog, schema, table) name of the table
- Spec
Database
Synced Database Table Spec Args
- database
Instance StringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- logical
Database StringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name String
- Full three-part (catalog, schema, table) name of the table
- spec
Database
Synced Database Table Spec
- database
Instance stringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- logical
Database stringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name string
- Full three-part (catalog, schema, table) name of the table
- spec
Database
Synced Database Table Spec
- database_
instance_ strname - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- logical_
database_ strname Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name str
- Full three-part (catalog, schema, table) name of the table
- spec
Database
Synced Database Table Spec Args
- database
Instance StringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- logical
Database StringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name String
- Full three-part (catalog, schema, table) name of the table
- spec Property Map
Outputs
All input properties are implicitly available as output properties. Additionally, the DatabaseSyncedDatabaseTable resource produces the following output properties:
- Data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- Effective
Database stringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- Effective
Logical stringDatabase Name - (string) - The name of the logical database that this table is registered to
- Id string
- The provider-assigned unique ID for this managed resource.
- Unity
Catalog stringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- Data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- Effective
Database stringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- Effective
Logical stringDatabase Name - (string) - The name of the logical database that this table is registered to
- Id string
- The provider-assigned unique ID for this managed resource.
- Unity
Catalog stringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- effective
Database StringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective
Logical StringDatabase Name - (string) - The name of the logical database that this table is registered to
- id String
- The provider-assigned unique ID for this managed resource.
- unity
Catalog StringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- effective
Database stringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective
Logical stringDatabase Name - (string) - The name of the logical database that this table is registered to
- id string
- The provider-assigned unique ID for this managed resource.
- unity
Catalog stringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data_
synchronization_ Databasestatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- effective_
database_ strinstance_ name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective_
logical_ strdatabase_ name - (string) - The name of the logical database that this table is registered to
- id str
- The provider-assigned unique ID for this managed resource.
- unity_
catalog_ strprovisioning_ state - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data
Synchronization Property MapStatus - (SyncedTableStatus) - Synced Table data synchronization status
- effective
Database StringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective
Logical StringDatabase Name - (string) - The name of the logical database that this table is registered to
- id String
- The provider-assigned unique ID for this managed resource.
- unity
Catalog StringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
Look up Existing DatabaseSyncedDatabaseTable Resource
Get an existing DatabaseSyncedDatabaseTable resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.
public static get(name: string, id: Input<ID>, state?: DatabaseSyncedDatabaseTableState, opts?: CustomResourceOptions): DatabaseSyncedDatabaseTable
@staticmethod
def get(resource_name: str,
id: str,
opts: Optional[ResourceOptions] = None,
data_synchronization_status: Optional[DatabaseSyncedDatabaseTableDataSynchronizationStatusArgs] = None,
database_instance_name: Optional[str] = None,
effective_database_instance_name: Optional[str] = None,
effective_logical_database_name: Optional[str] = None,
logical_database_name: Optional[str] = None,
name: Optional[str] = None,
spec: Optional[DatabaseSyncedDatabaseTableSpecArgs] = None,
unity_catalog_provisioning_state: Optional[str] = None) -> DatabaseSyncedDatabaseTable
func GetDatabaseSyncedDatabaseTable(ctx *Context, name string, id IDInput, state *DatabaseSyncedDatabaseTableState, opts ...ResourceOption) (*DatabaseSyncedDatabaseTable, error)
public static DatabaseSyncedDatabaseTable Get(string name, Input<string> id, DatabaseSyncedDatabaseTableState? state, CustomResourceOptions? opts = null)
public static DatabaseSyncedDatabaseTable get(String name, Output<String> id, DatabaseSyncedDatabaseTableState state, CustomResourceOptions options)
resources: _: type: databricks:DatabaseSyncedDatabaseTable get: id: ${id}
- name
- The unique name of the resulting resource.
- id
- The unique provider ID of the resource to lookup.
- state
- Any extra arguments used during the lookup.
- opts
- A bag of options that control this resource's behavior.
- resource_name
- The unique name of the resulting resource.
- id
- The unique provider ID of the resource to lookup.
- name
- The unique name of the resulting resource.
- id
- The unique provider ID of the resource to lookup.
- state
- Any extra arguments used during the lookup.
- opts
- A bag of options that control this resource's behavior.
- name
- The unique name of the resulting resource.
- id
- The unique provider ID of the resource to lookup.
- state
- Any extra arguments used during the lookup.
- opts
- A bag of options that control this resource's behavior.
- name
- The unique name of the resulting resource.
- id
- The unique provider ID of the resource to lookup.
- state
- Any extra arguments used during the lookup.
- opts
- A bag of options that control this resource's behavior.
- Data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- Database
Instance stringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- Effective
Database stringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- Effective
Logical stringDatabase Name - (string) - The name of the logical database that this table is registered to
- Logical
Database stringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- Name string
- Full three-part (catalog, schema, table) name of the table
- Spec
Database
Synced Database Table Spec - Unity
Catalog stringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- Data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status Args - (SyncedTableStatus) - Synced Table data synchronization status
- Database
Instance stringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- Effective
Database stringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- Effective
Logical stringDatabase Name - (string) - The name of the logical database that this table is registered to
- Logical
Database stringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- Name string
- Full three-part (catalog, schema, table) name of the table
- Spec
Database
Synced Database Table Spec Args - Unity
Catalog stringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- database
Instance StringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- effective
Database StringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective
Logical StringDatabase Name - (string) - The name of the logical database that this table is registered to
- logical
Database StringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name String
- Full three-part (catalog, schema, table) name of the table
- spec
Database
Synced Database Table Spec - unity
Catalog StringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data
Synchronization DatabaseStatus Synced Database Table Data Synchronization Status - (SyncedTableStatus) - Synced Table data synchronization status
- database
Instance stringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- effective
Database stringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective
Logical stringDatabase Name - (string) - The name of the logical database that this table is registered to
- logical
Database stringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name string
- Full three-part (catalog, schema, table) name of the table
- spec
Database
Synced Database Table Spec - unity
Catalog stringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data_
synchronization_ Databasestatus Synced Database Table Data Synchronization Status Args - (SyncedTableStatus) - Synced Table data synchronization status
- database_
instance_ strname - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- effective_
database_ strinstance_ name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective_
logical_ strdatabase_ name - (string) - The name of the logical database that this table is registered to
- logical_
database_ strname Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name str
- Full three-part (catalog, schema, table) name of the table
- spec
Database
Synced Database Table Spec Args - unity_
catalog_ strprovisioning_ state - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
- data
Synchronization Property MapStatus - (SyncedTableStatus) - Synced Table data synchronization status
- database
Instance StringName - Name of the target database instance. This is required when creating synced database tables in standard catalogs. This is optional when creating synced database tables in registered catalogs. If this field is specified when creating synced database tables in registered catalogs, the database instance name MUST match that of the registered catalog (or the request will be rejected)
- effective
Database StringInstance Name - (string) - The name of the database instance that this table is registered to. This field is always returned, and for tables inside database catalogs is inferred database instance associated with the catalog
- effective
Logical StringDatabase Name - (string) - The name of the logical database that this table is registered to
- logical
Database StringName Target Postgres database object (logical database) name for this table.
When creating a synced table in a registered Postgres catalog, the target Postgres database name is inferred to be that of the registered catalog. If this field is specified in this scenario, the Postgres database name MUST match that of the registered catalog (or the request will be rejected).
When creating a synced table in a standard catalog, this field is required. In this scenario, specifying this field will allow targeting an arbitrary postgres database. Note that this has implications for the
create_database_objects_is_missing
field inspec
- name String
- Full three-part (catalog, schema, table) name of the table
- spec Property Map
- unity
Catalog StringProvisioning State - (string) - The provisioning state of the synced table entity in Unity Catalog. This is distinct from the
state of the data synchronization pipeline (i.e. the table may be in "ACTIVE" but the pipeline
may be in "PROVISIONING" as it runs asynchronously). Possible values are:
ACTIVE
,DEGRADED
,DELETING
,FAILED
,PROVISIONING
,UPDATING
Supporting Types
DatabaseSyncedDatabaseTableDataSynchronizationStatus, DatabaseSyncedDatabaseTableDataSynchronizationStatusArgs
- Continuous
Update DatabaseStatus Synced Database Table Data Synchronization Status Continuous Update Status - Detailed
State string - (string) - The state of the synced table. Possible values are:
SYNCED_TABLED_OFFLINE
,SYNCED_TABLE_OFFLINE_FAILED
,SYNCED_TABLE_ONLINE
,SYNCED_TABLE_ONLINE_CONTINUOUS_UPDATE
,SYNCED_TABLE_ONLINE_NO_PENDING_UPDATE
,SYNCED_TABLE_ONLINE_PIPELINE_FAILED
,SYNCED_TABLE_ONLINE_TRIGGERED_UPDATE
,SYNCED_TABLE_ONLINE_UPDATING_PIPELINE_RESOURCES
,SYNCED_TABLE_PROVISIONING
,SYNCED_TABLE_PROVISIONING_INITIAL_SNAPSHOT
,SYNCED_TABLE_PROVISIONING_PIPELINE_RESOURCES
- Failed
Status DatabaseSynced Database Table Data Synchronization Status Failed Status - Last
Sync DatabaseSynced Database Table Data Synchronization Status Last Sync - (SyncedTablePosition) - Summary of the last successful synchronization from source to destination.
- Message string
- (string) - A text description of the current state of the synced table
- Pipeline
Id string - (string) - ID of the associated pipeline. The pipeline ID may have been provided by the client (in the case of bin packing), or generated by the server (when creating a new pipeline)
- Provisioning
Status DatabaseSynced Database Table Data Synchronization Status Provisioning Status - Triggered
Update DatabaseStatus Synced Database Table Data Synchronization Status Triggered Update Status
- Continuous
Update DatabaseStatus Synced Database Table Data Synchronization Status Continuous Update Status - Detailed
State string - (string) - The state of the synced table. Possible values are:
SYNCED_TABLED_OFFLINE
,SYNCED_TABLE_OFFLINE_FAILED
,SYNCED_TABLE_ONLINE
,SYNCED_TABLE_ONLINE_CONTINUOUS_UPDATE
,SYNCED_TABLE_ONLINE_NO_PENDING_UPDATE
,SYNCED_TABLE_ONLINE_PIPELINE_FAILED
,SYNCED_TABLE_ONLINE_TRIGGERED_UPDATE
,SYNCED_TABLE_ONLINE_UPDATING_PIPELINE_RESOURCES
,SYNCED_TABLE_PROVISIONING
,SYNCED_TABLE_PROVISIONING_INITIAL_SNAPSHOT
,SYNCED_TABLE_PROVISIONING_PIPELINE_RESOURCES
- Failed
Status DatabaseSynced Database Table Data Synchronization Status Failed Status - Last
Sync DatabaseSynced Database Table Data Synchronization Status Last Sync - (SyncedTablePosition) - Summary of the last successful synchronization from source to destination.
- Message string
- (string) - A text description of the current state of the synced table
- Pipeline
Id string - (string) - ID of the associated pipeline. The pipeline ID may have been provided by the client (in the case of bin packing), or generated by the server (when creating a new pipeline)
- Provisioning
Status DatabaseSynced Database Table Data Synchronization Status Provisioning Status - Triggered
Update DatabaseStatus Synced Database Table Data Synchronization Status Triggered Update Status
- continuous
Update DatabaseStatus Synced Database Table Data Synchronization Status Continuous Update Status - detailed
State String - (string) - The state of the synced table. Possible values are:
SYNCED_TABLED_OFFLINE
,SYNCED_TABLE_OFFLINE_FAILED
,SYNCED_TABLE_ONLINE
,SYNCED_TABLE_ONLINE_CONTINUOUS_UPDATE
,SYNCED_TABLE_ONLINE_NO_PENDING_UPDATE
,SYNCED_TABLE_ONLINE_PIPELINE_FAILED
,SYNCED_TABLE_ONLINE_TRIGGERED_UPDATE
,SYNCED_TABLE_ONLINE_UPDATING_PIPELINE_RESOURCES
,SYNCED_TABLE_PROVISIONING
,SYNCED_TABLE_PROVISIONING_INITIAL_SNAPSHOT
,SYNCED_TABLE_PROVISIONING_PIPELINE_RESOURCES
- failed
Status DatabaseSynced Database Table Data Synchronization Status Failed Status - last
Sync DatabaseSynced Database Table Data Synchronization Status Last Sync - (SyncedTablePosition) - Summary of the last successful synchronization from source to destination.
- message String
- (string) - A text description of the current state of the synced table
- pipeline
Id String - (string) - ID of the associated pipeline. The pipeline ID may have been provided by the client (in the case of bin packing), or generated by the server (when creating a new pipeline)
- provisioning
Status DatabaseSynced Database Table Data Synchronization Status Provisioning Status - triggered
Update DatabaseStatus Synced Database Table Data Synchronization Status Triggered Update Status
- continuous
Update DatabaseStatus Synced Database Table Data Synchronization Status Continuous Update Status - detailed
State string - (string) - The state of the synced table. Possible values are:
SYNCED_TABLED_OFFLINE
,SYNCED_TABLE_OFFLINE_FAILED
,SYNCED_TABLE_ONLINE
,SYNCED_TABLE_ONLINE_CONTINUOUS_UPDATE
,SYNCED_TABLE_ONLINE_NO_PENDING_UPDATE
,SYNCED_TABLE_ONLINE_PIPELINE_FAILED
,SYNCED_TABLE_ONLINE_TRIGGERED_UPDATE
,SYNCED_TABLE_ONLINE_UPDATING_PIPELINE_RESOURCES
,SYNCED_TABLE_PROVISIONING
,SYNCED_TABLE_PROVISIONING_INITIAL_SNAPSHOT
,SYNCED_TABLE_PROVISIONING_PIPELINE_RESOURCES
- failed
Status DatabaseSynced Database Table Data Synchronization Status Failed Status - last
Sync DatabaseSynced Database Table Data Synchronization Status Last Sync - (SyncedTablePosition) - Summary of the last successful synchronization from source to destination.
- message string
- (string) - A text description of the current state of the synced table
- pipeline
Id string - (string) - ID of the associated pipeline. The pipeline ID may have been provided by the client (in the case of bin packing), or generated by the server (when creating a new pipeline)
- provisioning
Status DatabaseSynced Database Table Data Synchronization Status Provisioning Status - triggered
Update DatabaseStatus Synced Database Table Data Synchronization Status Triggered Update Status
- continuous_
update_ Databasestatus Synced Database Table Data Synchronization Status Continuous Update Status - detailed_
state str - (string) - The state of the synced table. Possible values are:
SYNCED_TABLED_OFFLINE
,SYNCED_TABLE_OFFLINE_FAILED
,SYNCED_TABLE_ONLINE
,SYNCED_TABLE_ONLINE_CONTINUOUS_UPDATE
,SYNCED_TABLE_ONLINE_NO_PENDING_UPDATE
,SYNCED_TABLE_ONLINE_PIPELINE_FAILED
,SYNCED_TABLE_ONLINE_TRIGGERED_UPDATE
,SYNCED_TABLE_ONLINE_UPDATING_PIPELINE_RESOURCES
,SYNCED_TABLE_PROVISIONING
,SYNCED_TABLE_PROVISIONING_INITIAL_SNAPSHOT
,SYNCED_TABLE_PROVISIONING_PIPELINE_RESOURCES
- failed_
status DatabaseSynced Database Table Data Synchronization Status Failed Status - last_
sync DatabaseSynced Database Table Data Synchronization Status Last Sync - (SyncedTablePosition) - Summary of the last successful synchronization from source to destination.
- message str
- (string) - A text description of the current state of the synced table
- pipeline_
id str - (string) - ID of the associated pipeline. The pipeline ID may have been provided by the client (in the case of bin packing), or generated by the server (when creating a new pipeline)
- provisioning_
status DatabaseSynced Database Table Data Synchronization Status Provisioning Status - triggered_
update_ Databasestatus Synced Database Table Data Synchronization Status Triggered Update Status
- continuous
Update Property MapStatus - detailed
State String - (string) - The state of the synced table. Possible values are:
SYNCED_TABLED_OFFLINE
,SYNCED_TABLE_OFFLINE_FAILED
,SYNCED_TABLE_ONLINE
,SYNCED_TABLE_ONLINE_CONTINUOUS_UPDATE
,SYNCED_TABLE_ONLINE_NO_PENDING_UPDATE
,SYNCED_TABLE_ONLINE_PIPELINE_FAILED
,SYNCED_TABLE_ONLINE_TRIGGERED_UPDATE
,SYNCED_TABLE_ONLINE_UPDATING_PIPELINE_RESOURCES
,SYNCED_TABLE_PROVISIONING
,SYNCED_TABLE_PROVISIONING_INITIAL_SNAPSHOT
,SYNCED_TABLE_PROVISIONING_PIPELINE_RESOURCES
- failed
Status Property Map - last
Sync Property Map - (SyncedTablePosition) - Summary of the last successful synchronization from source to destination.
- message String
- (string) - A text description of the current state of the synced table
- pipeline
Id String - (string) - ID of the associated pipeline. The pipeline ID may have been provided by the client (in the case of bin packing), or generated by the server (when creating a new pipeline)
- provisioning
Status Property Map - triggered
Update Property MapStatus
DatabaseSyncedDatabaseTableDataSynchronizationStatusContinuousUpdateStatus, DatabaseSyncedDatabaseTableDataSynchronizationStatusContinuousUpdateStatusArgs
- Initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Continuous Update Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- Last
Processed intCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- Timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- Initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Continuous Update Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- Last
Processed intCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- Timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Continuous Update Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- last
Processed IntegerCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp String
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Continuous Update Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- last
Processed numberCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- initial_
pipeline_ Databasesync_ progress Synced Database Table Data Synchronization Status Continuous Update Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- last_
processed_ intcommit_ version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp str
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- initial
Pipeline Property MapSync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- last
Processed NumberCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp String
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
DatabaseSyncedDatabaseTableDataSynchronizationStatusContinuousUpdateStatusInitialPipelineSyncProgress, DatabaseSyncedDatabaseTableDataSynchronizationStatusContinuousUpdateStatusInitialPipelineSyncProgressArgs
- Estimated
Completion doubleTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- Latest
Version intCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- Provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- Sync
Progress doubleCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- Synced
Row intCount - (integer) - The number of rows that have been synced in this update
- Total
Row intCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- Estimated
Completion float64Time Seconds - (number) - The estimated time remaining to complete this update in seconds
- Latest
Version intCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- Provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- Sync
Progress float64Completion - (number) - The completion ratio of this update. This is a number between 0 and 1
- Synced
Row intCount - (integer) - The number of rows that have been synced in this update
- Total
Row intCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion DoubleTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version IntegerCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase String - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress DoubleCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row IntegerCount - (integer) - The number of rows that have been synced in this update
- total
Row IntegerCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion numberTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version numberCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress numberCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row numberCount - (integer) - The number of rows that have been synced in this update
- total
Row numberCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated_
completion_ floattime_ seconds - (number) - The estimated time remaining to complete this update in seconds
- latest_
version_ intcurrently_ processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning_
phase str - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync_
progress_ floatcompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced_
row_ intcount - (integer) - The number of rows that have been synced in this update
- total_
row_ intcount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion NumberTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version NumberCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase String - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress NumberCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row NumberCount - (integer) - The number of rows that have been synced in this update
- total
Row NumberCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
DatabaseSyncedDatabaseTableDataSynchronizationStatusFailedStatus, DatabaseSyncedDatabaseTableDataSynchronizationStatusFailedStatusArgs
- Last
Processed intCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- Timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- Last
Processed intCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- Timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- last
Processed IntegerCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp String
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- last
Processed numberCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- last_
processed_ intcommit_ version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp str
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- last
Processed NumberCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp String
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
DatabaseSyncedDatabaseTableDataSynchronizationStatusLastSync, DatabaseSyncedDatabaseTableDataSynchronizationStatusLastSyncArgs
- Delta
Table DatabaseSync Info Synced Database Table Data Synchronization Status Last Sync Delta Table Sync Info - (DeltaTableSyncInfo)
- Sync
End stringTimestamp - (string) - The end timestamp of the most recent successful synchronization. This is the time when the data is available in the synced table
- Sync
Start stringTimestamp - (string) - The starting timestamp of the most recent successful synchronization from the source table to the destination (synced) table. Note this is the starting timestamp of the sync operation, not the end time. E.g., for a batch, this is the time when the sync operation started
- Delta
Table DatabaseSync Info Synced Database Table Data Synchronization Status Last Sync Delta Table Sync Info - (DeltaTableSyncInfo)
- Sync
End stringTimestamp - (string) - The end timestamp of the most recent successful synchronization. This is the time when the data is available in the synced table
- Sync
Start stringTimestamp - (string) - The starting timestamp of the most recent successful synchronization from the source table to the destination (synced) table. Note this is the starting timestamp of the sync operation, not the end time. E.g., for a batch, this is the time when the sync operation started
- delta
Table DatabaseSync Info Synced Database Table Data Synchronization Status Last Sync Delta Table Sync Info - (DeltaTableSyncInfo)
- sync
End StringTimestamp - (string) - The end timestamp of the most recent successful synchronization. This is the time when the data is available in the synced table
- sync
Start StringTimestamp - (string) - The starting timestamp of the most recent successful synchronization from the source table to the destination (synced) table. Note this is the starting timestamp of the sync operation, not the end time. E.g., for a batch, this is the time when the sync operation started
- delta
Table DatabaseSync Info Synced Database Table Data Synchronization Status Last Sync Delta Table Sync Info - (DeltaTableSyncInfo)
- sync
End stringTimestamp - (string) - The end timestamp of the most recent successful synchronization. This is the time when the data is available in the synced table
- sync
Start stringTimestamp - (string) - The starting timestamp of the most recent successful synchronization from the source table to the destination (synced) table. Note this is the starting timestamp of the sync operation, not the end time. E.g., for a batch, this is the time when the sync operation started
- delta_
table_ Databasesync_ info Synced Database Table Data Synchronization Status Last Sync Delta Table Sync Info - (DeltaTableSyncInfo)
- sync_
end_ strtimestamp - (string) - The end timestamp of the most recent successful synchronization. This is the time when the data is available in the synced table
- sync_
start_ strtimestamp - (string) - The starting timestamp of the most recent successful synchronization from the source table to the destination (synced) table. Note this is the starting timestamp of the sync operation, not the end time. E.g., for a batch, this is the time when the sync operation started
- delta
Table Property MapSync Info - (DeltaTableSyncInfo)
- sync
End StringTimestamp - (string) - The end timestamp of the most recent successful synchronization. This is the time when the data is available in the synced table
- sync
Start StringTimestamp - (string) - The starting timestamp of the most recent successful synchronization from the source table to the destination (synced) table. Note this is the starting timestamp of the sync operation, not the end time. E.g., for a batch, this is the time when the sync operation started
DatabaseSyncedDatabaseTableDataSynchronizationStatusLastSyncDeltaTableSyncInfo, DatabaseSyncedDatabaseTableDataSynchronizationStatusLastSyncDeltaTableSyncInfoArgs
- Delta
Commit stringTimestamp - (string) - The timestamp when the above Delta version was committed in the source Delta table. Note: This is the Delta commit time, not the time the data was written to the synced table
- Delta
Commit intVersion - (integer) - The Delta Lake commit version that was last successfully synced
- Delta
Commit stringTimestamp - (string) - The timestamp when the above Delta version was committed in the source Delta table. Note: This is the Delta commit time, not the time the data was written to the synced table
- Delta
Commit intVersion - (integer) - The Delta Lake commit version that was last successfully synced
- delta
Commit StringTimestamp - (string) - The timestamp when the above Delta version was committed in the source Delta table. Note: This is the Delta commit time, not the time the data was written to the synced table
- delta
Commit IntegerVersion - (integer) - The Delta Lake commit version that was last successfully synced
- delta
Commit stringTimestamp - (string) - The timestamp when the above Delta version was committed in the source Delta table. Note: This is the Delta commit time, not the time the data was written to the synced table
- delta
Commit numberVersion - (integer) - The Delta Lake commit version that was last successfully synced
- delta_
commit_ strtimestamp - (string) - The timestamp when the above Delta version was committed in the source Delta table. Note: This is the Delta commit time, not the time the data was written to the synced table
- delta_
commit_ intversion - (integer) - The Delta Lake commit version that was last successfully synced
- delta
Commit StringTimestamp - (string) - The timestamp when the above Delta version was committed in the source Delta table. Note: This is the Delta commit time, not the time the data was written to the synced table
- delta
Commit NumberVersion - (integer) - The Delta Lake commit version that was last successfully synced
DatabaseSyncedDatabaseTableDataSynchronizationStatusProvisioningStatus, DatabaseSyncedDatabaseTableDataSynchronizationStatusProvisioningStatusArgs
- Initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Provisioning Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- Initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Provisioning Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Provisioning Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- initial
Pipeline DatabaseSync Progress Synced Database Table Data Synchronization Status Provisioning Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- initial_
pipeline_ Databasesync_ progress Synced Database Table Data Synchronization Status Provisioning Status Initial Pipeline Sync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
- initial
Pipeline Property MapSync Progress - (SyncedTablePipelineProgress) - Details about initial data synchronization. Only populated when in the PROVISIONING_INITIAL_SNAPSHOT state
DatabaseSyncedDatabaseTableDataSynchronizationStatusProvisioningStatusInitialPipelineSyncProgress, DatabaseSyncedDatabaseTableDataSynchronizationStatusProvisioningStatusInitialPipelineSyncProgressArgs
- Estimated
Completion doubleTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- Latest
Version intCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- Provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- Sync
Progress doubleCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- Synced
Row intCount - (integer) - The number of rows that have been synced in this update
- Total
Row intCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- Estimated
Completion float64Time Seconds - (number) - The estimated time remaining to complete this update in seconds
- Latest
Version intCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- Provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- Sync
Progress float64Completion - (number) - The completion ratio of this update. This is a number between 0 and 1
- Synced
Row intCount - (integer) - The number of rows that have been synced in this update
- Total
Row intCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion DoubleTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version IntegerCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase String - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress DoubleCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row IntegerCount - (integer) - The number of rows that have been synced in this update
- total
Row IntegerCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion numberTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version numberCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress numberCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row numberCount - (integer) - The number of rows that have been synced in this update
- total
Row numberCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated_
completion_ floattime_ seconds - (number) - The estimated time remaining to complete this update in seconds
- latest_
version_ intcurrently_ processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning_
phase str - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync_
progress_ floatcompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced_
row_ intcount - (integer) - The number of rows that have been synced in this update
- total_
row_ intcount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion NumberTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version NumberCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase String - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress NumberCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row NumberCount - (integer) - The number of rows that have been synced in this update
- total
Row NumberCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
DatabaseSyncedDatabaseTableDataSynchronizationStatusTriggeredUpdateStatus, DatabaseSyncedDatabaseTableDataSynchronizationStatusTriggeredUpdateStatusArgs
- Last
Processed intCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- Timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- Triggered
Update DatabaseProgress Synced Database Table Data Synchronization Status Triggered Update Status Triggered Update Progress - (SyncedTablePipelineProgress) - Progress of the active data synchronization pipeline
- Last
Processed intCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- Timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- Triggered
Update DatabaseProgress Synced Database Table Data Synchronization Status Triggered Update Status Triggered Update Progress - (SyncedTablePipelineProgress) - Progress of the active data synchronization pipeline
- last
Processed IntegerCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp String
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- triggered
Update DatabaseProgress Synced Database Table Data Synchronization Status Triggered Update Status Triggered Update Progress - (SyncedTablePipelineProgress) - Progress of the active data synchronization pipeline
- last
Processed numberCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp string
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- triggered
Update DatabaseProgress Synced Database Table Data Synchronization Status Triggered Update Status Triggered Update Progress - (SyncedTablePipelineProgress) - Progress of the active data synchronization pipeline
- last_
processed_ intcommit_ version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp str
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- triggered_
update_ Databaseprogress Synced Database Table Data Synchronization Status Triggered Update Status Triggered Update Progress - (SyncedTablePipelineProgress) - Progress of the active data synchronization pipeline
- last
Processed NumberCommit Version - (integer) - The last source table Delta version that was successfully synced to the synced table
- timestamp String
- (string) - The end timestamp of the last time any data was synchronized from the source table to the synced table. This is when the data is available in the synced table
- triggered
Update Property MapProgress - (SyncedTablePipelineProgress) - Progress of the active data synchronization pipeline
DatabaseSyncedDatabaseTableDataSynchronizationStatusTriggeredUpdateStatusTriggeredUpdateProgress, DatabaseSyncedDatabaseTableDataSynchronizationStatusTriggeredUpdateStatusTriggeredUpdateProgressArgs
- Estimated
Completion doubleTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- Latest
Version intCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- Provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- Sync
Progress doubleCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- Synced
Row intCount - (integer) - The number of rows that have been synced in this update
- Total
Row intCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- Estimated
Completion float64Time Seconds - (number) - The estimated time remaining to complete this update in seconds
- Latest
Version intCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- Provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- Sync
Progress float64Completion - (number) - The completion ratio of this update. This is a number between 0 and 1
- Synced
Row intCount - (integer) - The number of rows that have been synced in this update
- Total
Row intCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion DoubleTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version IntegerCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase String - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress DoubleCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row IntegerCount - (integer) - The number of rows that have been synced in this update
- total
Row IntegerCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion numberTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version numberCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase string - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress numberCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row numberCount - (integer) - The number of rows that have been synced in this update
- total
Row numberCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated_
completion_ floattime_ seconds - (number) - The estimated time remaining to complete this update in seconds
- latest_
version_ intcurrently_ processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning_
phase str - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync_
progress_ floatcompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced_
row_ intcount - (integer) - The number of rows that have been synced in this update
- total_
row_ intcount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
- estimated
Completion NumberTime Seconds - (number) - The estimated time remaining to complete this update in seconds
- latest
Version NumberCurrently Processing - (integer) - The source table Delta version that was last processed by the pipeline. The pipeline may not have completely processed this version yet
- provisioning
Phase String - (string) - The current phase of the data synchronization pipeline. Possible values are:
PROVISIONING_PHASE_INDEX_SCAN
,PROVISIONING_PHASE_INDEX_SORT
,PROVISIONING_PHASE_MAIN
- sync
Progress NumberCompletion - (number) - The completion ratio of this update. This is a number between 0 and 1
- synced
Row NumberCount - (integer) - The number of rows that have been synced in this update
- total
Row NumberCount - (integer) - The total number of rows that need to be synced in this update. This number may be an estimate
DatabaseSyncedDatabaseTableSpec, DatabaseSyncedDatabaseTableSpecArgs
- Create
Database boolObjects If Missing - If true, the synced table's logical database and schema resources in PG will be created if they do not already exist
- Existing
Pipeline stringId At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If existing_pipeline_id is defined, the synced table will be bin packed into the existing pipeline referenced. This avoids creating a new pipeline and allows sharing existing compute. In this case, the scheduling_policy of this synced table must match the scheduling policy of the existing pipeline
- New
Pipeline DatabaseSpec Synced Database Table Spec New Pipeline Spec At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If new_pipeline_spec is defined, a new pipeline is created for this synced table. The location pointed to is used to store intermediate files (checkpoints, event logs etc). The caller must have write permissions to create Delta tables in the specified catalog and schema. Again, note this requires write permissions, whereas the source table only requires read permissions
- Primary
Key List<string>Columns - Primary Key columns to be used for data insert/update in the destination
- Scheduling
Policy string - Scheduling policy of the underlying pipeline. Possible values are:
CONTINUOUS
,SNAPSHOT
,TRIGGERED
- Source
Table stringFull Name - Three-part (catalog, schema, table) name of the source Delta table
- Timeseries
Key string - Time series key to deduplicate (tie-break) rows with the same primary key
- Create
Database boolObjects If Missing - If true, the synced table's logical database and schema resources in PG will be created if they do not already exist
- Existing
Pipeline stringId At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If existing_pipeline_id is defined, the synced table will be bin packed into the existing pipeline referenced. This avoids creating a new pipeline and allows sharing existing compute. In this case, the scheduling_policy of this synced table must match the scheduling policy of the existing pipeline
- New
Pipeline DatabaseSpec Synced Database Table Spec New Pipeline Spec At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If new_pipeline_spec is defined, a new pipeline is created for this synced table. The location pointed to is used to store intermediate files (checkpoints, event logs etc). The caller must have write permissions to create Delta tables in the specified catalog and schema. Again, note this requires write permissions, whereas the source table only requires read permissions
- Primary
Key []stringColumns - Primary Key columns to be used for data insert/update in the destination
- Scheduling
Policy string - Scheduling policy of the underlying pipeline. Possible values are:
CONTINUOUS
,SNAPSHOT
,TRIGGERED
- Source
Table stringFull Name - Three-part (catalog, schema, table) name of the source Delta table
- Timeseries
Key string - Time series key to deduplicate (tie-break) rows with the same primary key
- create
Database BooleanObjects If Missing - If true, the synced table's logical database and schema resources in PG will be created if they do not already exist
- existing
Pipeline StringId At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If existing_pipeline_id is defined, the synced table will be bin packed into the existing pipeline referenced. This avoids creating a new pipeline and allows sharing existing compute. In this case, the scheduling_policy of this synced table must match the scheduling policy of the existing pipeline
- new
Pipeline DatabaseSpec Synced Database Table Spec New Pipeline Spec At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If new_pipeline_spec is defined, a new pipeline is created for this synced table. The location pointed to is used to store intermediate files (checkpoints, event logs etc). The caller must have write permissions to create Delta tables in the specified catalog and schema. Again, note this requires write permissions, whereas the source table only requires read permissions
- primary
Key List<String>Columns - Primary Key columns to be used for data insert/update in the destination
- scheduling
Policy String - Scheduling policy of the underlying pipeline. Possible values are:
CONTINUOUS
,SNAPSHOT
,TRIGGERED
- source
Table StringFull Name - Three-part (catalog, schema, table) name of the source Delta table
- timeseries
Key String - Time series key to deduplicate (tie-break) rows with the same primary key
- create
Database booleanObjects If Missing - If true, the synced table's logical database and schema resources in PG will be created if they do not already exist
- existing
Pipeline stringId At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If existing_pipeline_id is defined, the synced table will be bin packed into the existing pipeline referenced. This avoids creating a new pipeline and allows sharing existing compute. In this case, the scheduling_policy of this synced table must match the scheduling policy of the existing pipeline
- new
Pipeline DatabaseSpec Synced Database Table Spec New Pipeline Spec At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If new_pipeline_spec is defined, a new pipeline is created for this synced table. The location pointed to is used to store intermediate files (checkpoints, event logs etc). The caller must have write permissions to create Delta tables in the specified catalog and schema. Again, note this requires write permissions, whereas the source table only requires read permissions
- primary
Key string[]Columns - Primary Key columns to be used for data insert/update in the destination
- scheduling
Policy string - Scheduling policy of the underlying pipeline. Possible values are:
CONTINUOUS
,SNAPSHOT
,TRIGGERED
- source
Table stringFull Name - Three-part (catalog, schema, table) name of the source Delta table
- timeseries
Key string - Time series key to deduplicate (tie-break) rows with the same primary key
- create_
database_ boolobjects_ if_ missing - If true, the synced table's logical database and schema resources in PG will be created if they do not already exist
- existing_
pipeline_ strid At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If existing_pipeline_id is defined, the synced table will be bin packed into the existing pipeline referenced. This avoids creating a new pipeline and allows sharing existing compute. In this case, the scheduling_policy of this synced table must match the scheduling policy of the existing pipeline
- new_
pipeline_ Databasespec Synced Database Table Spec New Pipeline Spec At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If new_pipeline_spec is defined, a new pipeline is created for this synced table. The location pointed to is used to store intermediate files (checkpoints, event logs etc). The caller must have write permissions to create Delta tables in the specified catalog and schema. Again, note this requires write permissions, whereas the source table only requires read permissions
- primary_
key_ Sequence[str]columns - Primary Key columns to be used for data insert/update in the destination
- scheduling_
policy str - Scheduling policy of the underlying pipeline. Possible values are:
CONTINUOUS
,SNAPSHOT
,TRIGGERED
- source_
table_ strfull_ name - Three-part (catalog, schema, table) name of the source Delta table
- timeseries_
key str - Time series key to deduplicate (tie-break) rows with the same primary key
- create
Database BooleanObjects If Missing - If true, the synced table's logical database and schema resources in PG will be created if they do not already exist
- existing
Pipeline StringId At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If existing_pipeline_id is defined, the synced table will be bin packed into the existing pipeline referenced. This avoids creating a new pipeline and allows sharing existing compute. In this case, the scheduling_policy of this synced table must match the scheduling policy of the existing pipeline
- new
Pipeline Property MapSpec At most one of existing_pipeline_id and new_pipeline_spec should be defined.
If new_pipeline_spec is defined, a new pipeline is created for this synced table. The location pointed to is used to store intermediate files (checkpoints, event logs etc). The caller must have write permissions to create Delta tables in the specified catalog and schema. Again, note this requires write permissions, whereas the source table only requires read permissions
- primary
Key List<String>Columns - Primary Key columns to be used for data insert/update in the destination
- scheduling
Policy String - Scheduling policy of the underlying pipeline. Possible values are:
CONTINUOUS
,SNAPSHOT
,TRIGGERED
- source
Table StringFull Name - Three-part (catalog, schema, table) name of the source Delta table
- timeseries
Key String - Time series key to deduplicate (tie-break) rows with the same primary key
DatabaseSyncedDatabaseTableSpecNewPipelineSpec, DatabaseSyncedDatabaseTableSpecNewPipelineSpecArgs
- Storage
Catalog string This field needs to be specified if the destination catalog is a managed postgres catalog.
UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be a standard catalog where the user has permissions to create Delta tables
- Storage
Schema string This field needs to be specified if the destination catalog is a managed postgres catalog.
UC schema for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be in the standard catalog where the user has permissions to create Delta tables
- Storage
Catalog string This field needs to be specified if the destination catalog is a managed postgres catalog.
UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be a standard catalog where the user has permissions to create Delta tables
- Storage
Schema string This field needs to be specified if the destination catalog is a managed postgres catalog.
UC schema for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be in the standard catalog where the user has permissions to create Delta tables
- storage
Catalog String This field needs to be specified if the destination catalog is a managed postgres catalog.
UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be a standard catalog where the user has permissions to create Delta tables
- storage
Schema String This field needs to be specified if the destination catalog is a managed postgres catalog.
UC schema for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be in the standard catalog where the user has permissions to create Delta tables
- storage
Catalog string This field needs to be specified if the destination catalog is a managed postgres catalog.
UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be a standard catalog where the user has permissions to create Delta tables
- storage
Schema string This field needs to be specified if the destination catalog is a managed postgres catalog.
UC schema for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be in the standard catalog where the user has permissions to create Delta tables
- storage_
catalog str This field needs to be specified if the destination catalog is a managed postgres catalog.
UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be a standard catalog where the user has permissions to create Delta tables
- storage_
schema str This field needs to be specified if the destination catalog is a managed postgres catalog.
UC schema for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be in the standard catalog where the user has permissions to create Delta tables
- storage
Catalog String This field needs to be specified if the destination catalog is a managed postgres catalog.
UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be a standard catalog where the user has permissions to create Delta tables
- storage
Schema String This field needs to be specified if the destination catalog is a managed postgres catalog.
UC schema for the pipeline to store intermediate files (checkpoints, event logs etc). This needs to be in the standard catalog where the user has permissions to create Delta tables
Import
As of Pulumi v1.5, resources can be imported through configuration.
hcl
import {
id = name
to = databricks_database_synced_database_table.this
}
If you are using an older version of Pulumi, import the resource using the pulumi import
command as follows:
$ pulumi import databricks:index/databaseSyncedDatabaseTable:DatabaseSyncedDatabaseTable databricks_database_synced_database_table name
To learn more about importing existing cloud resources, see Importing resources.
Package Details
- Repository
- databricks pulumi/pulumi-databricks
- License
- Apache-2.0
- Notes
- This Pulumi package is based on the
databricks
Terraform Provider.