dependencies - Is there a task dependency processing framework -
we have requirement process large amount of tasks (10 million) day, tasks submitted task producer , executed task consumers, tasks may have dependencies, means if tasks have same dependency key, need processed 1 one. we have 2 kinds of dependencies:
weak dependency: first task same dependency key failed, rest tasks invoked execute.
strong dependency:the first task same dependency key failed, rest tasks marked failed , no need execute in consumer side.
anyone can advise there open source framework can meet our requirement?
thanks in advance.
Comments
Post a Comment