Data I/O includes a path templatization feature, allowing you to customize input and output paths with ease when applicable.
This feature facilitates dynamic path generation by replacing placeholders with values from the configuration. Path templatization is particularly useful for tasks such as managing date ranges and generating unique identifiers.
Placeholder fields
Some placeholders may only make sense for outputs configuration, even though they technically can be used in inputs (e.g. random uuid).
%{from} %{to}
Name
Mandatory
Description
Example
Default
Template
Yes
The path template to fill.
Template = file_%{from}_%{to}.csv
Date
Yes
The date to use when detemplatizing.
Date = "2022-01-01"
DateOffset
Yes
The offset to use, with respect to Date when detemplatizing.
DateOffset = "+5D"
DatePattern
Yes
The output format to use when detemplatizing. It will apply to both %{from} and %{to}, if they are both present.
DatePattern = "yyyyMMdd"
%{datetime}
Name
Mandatory
Description
Example
Default
Template
Yes
The path template to fill.
Template = file_%{datetime}.csv
Date
No
The date to use when detemplatizing.
Date = "2022-01-01"
Current datetime
DatePattern
No
The output format to use when detemplatizing.
DatePattern = "yyyyMMdd"
yyyy-MM-dd'T'HH:mm:ss.SSS
%{year} %{month} %{day}
Name
Mandatory
Description
Example
Default
Template
Yes
The path template to fill.
Template = file_%{year}.csv
Date
No
The date to use when detemplatizing.
Date = "2022-01-01"
Current datetime
%{uuid}
Name
Mandatory
Description
Example
Default
Template
Yes
The template to fill with a random, 16-bytes long, UUID.