Trifacta allows you to create plan tasks to delete existing files or folders. These tasks are helpful for removing files that were generated as part of intermediate steps in your plan's execution.
This capability may need to be enabled in your environment. For more information, see Overview of Operationalization.
Requirements
You must have access to the storage, ie. either base storage or via a connection
You must have write permissions to:
Any connection through which you are removing files or folders.
Any bucket, folder, or file accessed through that connection.
Delete tasks are supported for the following file systems:
S3
ADLS
GCS
Steps
Open your plan in Plan View. Click a node to create a new task.
In the right panel, select Delete task.
Set the following parameters:
Connection (if necessary)
Path
To add the task to the flow, click Save.
You can reference the metadata of the Delete task in other tasks of the Plan. For more information, see Plan Metadata References.