Concepts to Know : Formats and Schemas : Formats : Format Discovery
 
Share this page                  
Format Discovery
DataFlow has a generic delimited text format which is parameterized by key properties such as the record separator, field separator, and field value delimiters. Using the ReadDelimitedText Operator to Read Delimited Text provides a limited capability for discovering these values based on a fixed set of possibilities. By analyzing the initial chunk of the input data, analysis will determine the most likely settings from the possible candidates.
Note:  If the details of the format are known, we recommend that you explicitly set the corresponding properties on the operator. Format discovery is a heuristic process and may select the wrong settings if the structure is complex or the initial records are not representative of the entire data set.