Parameter | Expected Value |
|---|---|
name | The name that will be displayed to catalog users for this connection. |
code | Unique identifier of the connection on the Zeenea platform. Once registered on the platform, this code must not be modified or the connection will be considered as new and the old one removed from the scanner. |
connector_id | The type of connector to be used for the connection. The value must be google-dataplex-v2 and must not be modified. |
enabled | A boolean value to enable or disable the connection (true or false). The default value is true. |
catalog_code | The catalog code associated with the connection (default when empty). |
alias | The list of aliases used by other connectors to generate lineage link. |
secret_manager.enabled | Configuration for a secret manager. This configuration works only with Scanner 73 or later and requires a functional secret manager configured in the scanner configuration file. |
secret_manager.key | The name of the secret. |
connection.json_key | JSON access key. You can either specify the key directly or store it in a separate file. If stored in a separate file, this parameter indicates the path to the file in the form of a URI of scheme file:. For example: file:///opt/zeenea-scanner/connections/gdc_json_key.json Warning: If you specify the token directly, you must enclose the key in triple quotes (""") as a parameter. For example: """{my:"json"}""" |
scope.project_id | List of project ids separated by a comma. |
scope.location_id | Unique location id. Location id corresponds to GCP region (for example: "europe-west3,us-west1"). See https://cloud.google.com/compute/docs/regions-zones#available. |
filters | Universal filters. See Universal Filters. |
proxy.scheme | Depending on the proxy, http or https. |
proxy.hostname | Proxy address |
proxy.port | Proxy port |
proxy.username | Proxy username |
proxy.password | Proxy account password |
quota.read_per_minute | Reads per minute quota value. The default value is 6000 (default value of Google Data Catalog). |
quota.search_per_user_per_minute | Search quota value per user per minute. The default value is 180 (default value in Google Data Catalog). |
quota.timeout_minute | Maximum waiting time when waiting for the availability of a quota. The default value is 10 minutes. |
quota.max_retry | Maximum number of retries when a request encounters a quota expiration error. |
Criteria | Description |
|---|---|
entry_group | Dataplex Entry Group (@bigquery) |
project | Dataplex Entry project |
dataset | Dataplex Entry dataset |
table | Dataplex Entry table |
Object | Identifier Key | Description |
|---|---|---|
Dataset | code/entry_group/project/dataset/table name | - code: Unique identifier of the connection noted in the configuration file - entry_group: Dataplex Entry Group - project: Entry Project - dataset: Entry Dataset - table name: Entry Table name |
Field | code/entry_group/project/dataset/table name/field name | - code: Unique identifier of the connection noted in the configuration file - entry_group: Dataplex Entry Group - project: Entry Project - dataset: Entry Dataset - table name: Entry Table name - field name: Field name |