Managing Intermediate Targets
Intermediate targets act like both a source and a target and are sometimes required to store information until something happens (for instance, an event) that indicates the data is ready to be written to a final target. The records that intermediate targets produce are stored in memory. You can create as many intermediate targets in a map to meet the requirement of your output structure.
Note: Intermediate target schema cannot be hierarchical or include multiple record types. It is recommended to have intermediate targets for smaller file sizes. Larger file sizes can cause the system to run-out of memory or the performance may be impacted.
The following are the types of intermediate targets:
• Lookups
• Temporary Targets
Last modified date: 02/01/2024