Macro Name | Description |
---|---|
$(AVALANCHE_CONNECT_STRING) | ODBC Connection string for connecting to Avalanche database. You can obtain this information from Avalanche portal. Note: This is required only if you are running Integration Manager on DataCloud. |
$(AVALANCHE_USERNAME) $(AVALANCHE_PASSWORD) | Credentials for connecting to the database. |
$(AVALANCHE_TABLE) | Name of the table in Avalanche where the data will be written to. Note: Do not encrypt this macro value. |
$(SALESFORCE_USERNAME) $(SALESFORCE_PASSWORD) | Credentials for connecting to Salesforce. |
$(SALESFORCE_TABLE) | Name of the table or entity in Salesforce. |
$(SALESFORCE_SANDBOX_MODE) | If set to True, connects to the Salesforce application in the sandbox environment. |
$(SALESFORCE_QUERY) | Salesforce SOQL query for fetching data. Value can be query statement itself or a path to the query file. In case of path, prefix the value with "file:///". Note: Either SALESFORCE_TABLE/SALESFORCE_QUERY macro must be specified. |
Macro Name | Description |
---|---|
$(GCP_BUCKET) | Name of the bucket in Google Cloud Platform storage to use for staging the data. |
$(GCP_CLIENT_EMAIL) | Service account client email from GCP console. |
$(GCP_PRIVATE_KEY) | Private key object for the service account in PKCS#8 format. |
$(GCP_CLIENT_ID) | Service account client ID from GCP console. |
$(GCP_PRIVATE_KEY_ID) | Private key identifier for the service account from GCP console. |
Macro Name | Description |
---|---|
$(SALESFORCE_API_VERSION) | Salesforce API version. The default version is 42.0. |
$(SALESFORCE_QUERY_ALL) | If set to True, fetched deleted or archived records. |
$(AVALANCHE_DSN) | Name of the ODBC data source for connecting to Avalanche database. Specify this macro if you want to use a pre-configured DSN on your system instead of the connect string. |
$(AVALANCHE_CREATE_TABLE_QUERY) | Create table statement to use for creating the table. Make sure partitioning is specified. Table name in the query must match the AVALANCHE_TABLE macro value. |
$(AVALANCHE_CREATE_TABLE_OPTIONS) | Use this option when you do not want to build the complete query but only want to specify options to pass to "with" clause of create table query. Note: Make sure partitioning is specified. Also, this macro is ignored if AVALANCHE_CREATE_TABLE_QUERY macro is defined. |
$(OUTPUT_MODE) | Table operations that must be performed before inserting data. The available operations are: • replace: Drops existing table and creates new table • delete_append: Truncates table before inserting. • append: Creates table only if it does not exist and inserts records. The default value is append. |
$(DEFAULT_TEXT_COL_SIZE) | Set the default size of the text columns in the table. Set it to a reasonable value based on your data to avoid truncations. This property is also useful for inserting double-byte characters like Japanese or Chinese. Varchar is used for text data types that supports single byte characters. To support double-byte characters in varchar data type, the size of the column must be doubled using this macro. |
$(UNICODE_CHARS) | Indicates whether the data contains Unicode characters. If set to True, nvarchar data type is used for text columns. |
$(BATCH_SIZE) | Size of the chunk (in terms of number of records), the source is split into. Default is 50000. |
$(COPYVW_PARALLEL_LOAD_SIZE) | Number of chunks to load in parallel using COPY VWLOAD. The default value is 20. |
$(AVALANCHE_DBADMIN_GROUP_ACCESS) | Grant table access for "dbadmingrp" group. Only applicable when new table is created. Default is True. |
$(TRUNCATION_HANDLING) | Specifies truncation handling for text data. The supported values are: • ignore - Ignores the truncation and continues the execution. This is the default value. • warn - Logs a warning about truncation and continues the execution. • error - Logs an error message and aborts the execution. |