Format Discovery

DataFlow has a generic delimited text format which is parameterized by key properties such as the record separator, field separator, and field value delimiters. Using the ReadDelimitedText Operator to Read Delimited Text provides a limited capability for discovering these values based on a fixed set of possibilities. By analyzing the initial chunk of the input data, analysis will determine the most likely settings from the possible candidates.

Note: If the details of the format are known, we recommend that you explicitly set the corresponding properties on the operator. Format discovery is a heuristic process and may select the wrong settings if the structure is complex or the initial records are not representative of the entire data set.