Deem MySQL Text Loader
Overview
Section titled “Overview”The Deem MySQL Text Loader streams data from inside Deem Integrator to a text file using LOAD DATA INFILE 'FIFO File' INTO TABLE .... into the database.
Configuration Options
Section titled “Configuration Options”| Option | Description |
|---|---|
| Transform name | Name of the transform |
| Connection | Select predefined database connection |
| Target schema | The name of the Schema for the table to write data to. This is important for data sources that allow for table names with dots ’.’ in it |
| Target table | Name of the target table |
| Split every … rows | To split the data loads in chunks of data after which the data load will be |
| Truncate table | Create new table before start loading data |
| Auto generate View on Table | The output are generated as a View. Each time the step are executed a new temporary table are created. Tables are created in a temporary database with “temp” as suffix. Tables in this temp databases have table name with suffix ‘0’ to ‘2_’. Remember to create database for temporary tables |
| Temp directory | Temp directory |
| Filename | This field specifies the filename and location of the output text file |
| Separator | The character used to separate (delimiter) fields |
| Enclosure | The enclosure used for strings |
Fields to Load
Section titled “Fields to Load”With the “Get fields” button you can load the fields from the stream.
Auto Generate View on Table
Section titled “Auto Generate View on Table”The output table are generated as a view. Each time the step are executed a new temporary table are created. Tables are created in a temporary database with “temp” as suffix. Tables in this temp databases have table name with suffix ‘0’ to ‘2_’.
Database Setup Required
Remember to create database for temporary tables. If the connection are mapped to a database with the name “dw_prd_datamarts” you need to create a database with the name “dw_prd_datamarts_temp”.
To store current temporary table number a control table with the name “bi_auto_view_control” in the datamarts database. This table have one record per tablename. Each time the loader are running the current table number are updated in the control table.
Related
Section titled “Related”- Transforms Overview - Overview of all transforms
- Bulk Loader - Similar bulk loading functionality