Skip to content
This repository was archived by the owner on Jan 21, 2022. It is now read-only.
This repository was archived by the owner on Jan 21, 2022. It is now read-only.

[sftp-dataflow-source] Add support to launch Tasks dynamically #60

@sabbyanandan

Description

@sabbyanandan

As a user, I'd like to have the option to dynamically launch tasks in DataFlowTaskLaunchRequest, so I can assign a different "task name" for each of the consumed SFTP payloads.

Notes:

  • This requires changes to RotatingServerAdvice and StandardRotationPolicy in SI to extend it in sftp-dataflow to then add support for it.
  • Once that is added to SI, we will inherit the upstream changes to redesign the sftp-dataflow application to optionally also configure and pin each payload to a particular Task.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions