Adding a DynamoDB Connection¶

Prerequisites¶

A user with sufficient permissions is required to establish a connection with DynamoDB.
Zeenea traffic flows towards the data source must be open.

Note

You can find a link to the configuration template in Zeenea Connector Downloads.

Supported Versions¶

The DynamoDB connector is compatible with the web version of the product.

Installing the Plugin¶

You can download the AWS plugin from Zeenea Connector Downloads.

For more information about how to install a plugin, see Installing and Configuring Connectors as a Plugin.

Declaring the Connection¶

Connectors are created and configured through a dedicated configuration file located in the /connections folder of the relevant scanner.

For more information about managing connections, see Managing Connections.

To establish a connection with a DynamoDB instance, fill in the following parameters in the dedicated configuration file:

Parameter	Expected value
`name`	Specifies the display name for the connection.
`code`	Specifies the unique identifier of the connection on the Zeenea platform. Once registered on the platform, this code must not be modified or the connection will be considered as new and the old one removed from the scanner.
`connector_id`	Specifies the type of connector to be used for the connection. The value must be `aws-dynamodb` and must not be modified.
`enabled`	Specifies whether to enable or disable the connection (`true` or `false`). The default value is `true`.
`catalog_code`	Specifies the catalog code associated with the connection (`default` when empty).
`alias`	Specifies the list of aliases used by other connectors to generate lineage link. For example, `["localhost:1234/db","https://some-url.org"]`
`secret_manager.enabled`	Specifies whether to enable or disable the secret manager for the connection. This configuration works only with Scanner 73 or later and requires a functional secret manager configured in the scanner configuration file. The default value is `true`.
`secret_manager.key`	Specifies the name of the secret.
Optional, can be determined from the EC2 configuration
`connection.aws.url`	Specifies the DynamoDB database URL.
`connection.aws.profile`	Specifies the AWS profile for authentication.
`connection.aws.access_key_id`	Specifies the AWS access key identifier.
`connection.aws.secret_access_key`	Specifies the AWS secret access key.
`connection.aws.session_token`	Specifies the AWS session token.
`connection.aws.region`	Specifies the AWS region.
`connection.fetch_page_size`	(Advanced) Specifies the size of batch of items loaded by each request in inventory.
Sampling
`schema_analysis.enable`	Specifies whether to enable data sample in order to complete dataset fields. The default value is `false`.
`schema_analysis.sample_size`	Specifies the number of items retrieve for data sample. The default value is `1000`.
Certificate & Proxy
`tls.truststore.path`	Specifies the TLS trust store file path. This file must be provided in case TLS encryption is activated (protocol `https`) and when certificates of servers are delivered by a specific authority. It must contain the certification chain.
`tls.truststore.password`	Specifies the password of the trust store file.
`tls.truststore.type`	Specifies the type of the trust store file. Possible values are `PKCS12` or `JKS`. Default value is discovered from the file extension.
`tls.bypass_certificate_validation`	Specifies whether to bypass certificate validation. The default value is `false` (recommended to keep `false`).
`proxy.scheme`	Specifies the proxy protocol (`http` or `https`).
`proxy.hostname`	Specifies the proxy address.
`proxy.port`	Specifies the proxy port.
`proxy.username`	Specifies the proxy username.
`proxy.password`	Specifies the proxy account password.

User Permissions¶

To collect metadata, the running user's permissions must allow them to access and read databases that need cataloging.

The user must have the following access rights:

dynamodb:ListTables
dynamodb:DescribeTable

If you want to determine the table's value pattern by means of sampling, the following additional access right is required:

dynamodb:PartiQLSelect

Data Extraction¶

To extract information, the connector runs requests on the API:

listTables
describeTable
executeStatement(Statement='select * from [table_name]', Limit=[sample_size]) (only with the sampling feature)

Collected Metadata¶

Inventory¶

The inventory collects the list of tables accessible to the user.

Dataset¶

A dataset is a DynamoDB table.

Name
Source Description
Technical Data:
- AWS Region
- Creation Date
- Items Count
- Table Size

Field¶

Dataset field.

Name
Source Description
Type
Can be null: Depends on the field settings.
Multivalued: Not supported. The default value is false.
Primary Key: Depends on the Primary Key field attribute.
Technical Data:
- Technical Name
- Native type: Field native type
- Field Kind

Object Identification Keys¶

Each object in the catalog is associated with a unique identifier key. When the object is imported from an external system, the key is generated and provided by the connector.

For more information about identifier keys, see Identification Keys.

Object	Identifier Key	Description
Dataset	code/region/dataset name	- code: Unique identifier of the connection noted in the configuration file - region: AWS object region - dataset name: Table name
Field	code/region/dataset name/field name	- code: Unique identifier of the connection noted in the configuration file - region: AWS object region - dataset name: Table name - field name