Load Data with vwload Utility
The vwload command can be used to load data into a Vector table. It is less flexible but easier to use than COPY and often faster. You can also use vwload to load data in parallel into a single table to further speed up data loads.
For example, the following command loads the data from the lineitem.txt file into the lineitem table of the dbt3 database. In the lineitem table, fields are delimited by | and records are delimited by a new line (\n).
To load the data into the lineitem table using vwload
Enter the following command at the operating system prompt:
vwload --fdelim "|" --rdelim "\n" --table lineitem dbt3 lineitem.txt
Load Data from Cloud Sources with vwload
You can load data from cloud sources such as Amazon S3 (s3a:// and s3n://) using vwload. Specify the full URI for the data files you want to load.
IMPORTANT! Referencing your AWS credentials in the target URI from the command line or in environment variables can leave them easily accessible. To keep your credentials safe, see
How to Securely Manage S3 Credentials.
The following example illustrates loading data into a customer table in mydb (database) in parallel mode. The source files reside in Amazon S3 cloud storage. Columns in the data file are delimited with a vertical bar. Records are delimited by a new line:
vwload -c --fdelim "|" --rdelim "\n" --table customer mydb s3a://mys3bucket/path/to/data/customer1.csv s3a://mys3bucket/path/to/data/customer2.csv s3a://mys3bucket/path/to/data/customer3.csv
or
vwload -c --fdelim "|" --rdelim "\n" --table customer mydb s3a://mys3bucket/path/to/data/customer*.csv
Last modified date: 12/06/2024