Paths templatization

Data I/O includes a path templatization feature, allowing you to customize input and output paths with ease when applicable.

This feature facilitates dynamic path generation by replacing placeholders with values from the configuration. Path templatization is particularly useful for tasks such as managing date ranges and generating unique identifiers.

Placeholder fields

Some placeholders may only make sense for outputs configuration, even though they technically can be used in inputs (e.g. random uuid).

%{from} %{to}

Name Mandatory Description Example Default
Template Yes The path template to fill. Template = file_%{from}_%{to}.csv
Date Yes The date to use when detemplatizing. Date = "2022-01-01"
DateOffset Yes The offset to use, with respect to Date when detemplatizing. DateOffset = "+5D"
DatePattern Yes The output format to use when detemplatizing. It will apply to both %{from} and %{to}, if they are both present. DatePattern = "yyyyMMdd"

%{datetime}

Name Mandatory Description Example Default
Template Yes The path template to fill. Template = file_%{datetime}.csv
Date No The date to use when detemplatizing. Date = "2022-01-01" Current datetime
DatePattern No The output format to use when detemplatizing. DatePattern = "yyyyMMdd" yyyy-MM-dd'T'HH:mm:ss.SSS

%{year} %{month} %{day}

Name Mandatory Description Example Default
Template Yes The path template to fill. Template = file_%{year}.csv
Date No The date to use when detemplatizing. Date = "2022-01-01" Current datetime

%{uuid}

Name Mandatory Description Example Default
Template Yes The template to fill with a random, 16-bytes long, UUID. Template = file_%{uuid}.csv