Skip to content

Bulk Loader

The Bulk Loader transform streams data from inside {project-name} to a text file using ‘LOAD DATA INFILE’ into the database.

Bulk Loader

File options

OptionDescription
Transform nameName of the transform.
ConnectionSelect predefined database connection
Target schemaThe name of the Schema for the table to write data to. This is important for data sources that allow for table names with dots ’.’ in it.
Target tableName of the target table.
Truncate tableSelect if you want the table to be truncated before the first row is inserted into the table
Buffer size (rows)To split the data loads in chunks of data after which the data load will be.
Truncate tableCreate new table before start loading data
Auto generate View on TableThe output are generated as a View. Each time the step are executed a new temporary table are created. Tables have table name with suffix ‘0_’ to ‘2_’.
Use unique indexShould optional unique index be unique

Select fields in optional primary index (often used for dimensions). With the “Get fields” button you can load the fields from the stream.

The output table are generated as a view. Each time the step are executed a new temporary table are created. Tables have table name with suffix ‘0_’ to ‘2_’ .

To store current temporary table number a control table with the name “bi_auto_view_control” in the datamarts database. This table have one record per table name. Each time the loader are running the current table number are updated in the control table.