Amazon web service Data pipeline -


can use existing ec2 instance details while configuring data pipeline? if possible ec2 details need provide while creating pipe line?

yes, possible. according aws support.

"you can install task runner on computational resources manage, such amazon ec2 instance, or physical server or workstation. task runner can installed anywhere, on compatible hardware or operating system, provided can communicate aws data pipeline web service.

this approach can useful when, example, want use aws data pipeline process data stored inside organization’s firewall. installing task runner on server in local network, can access local database securely , poll aws data pipeline next task run. when aws data pipeline ends processing or deletes pipeline, task runner instance remains running on computational resource until manually shut down. task runner logs persist after pipeline execution complete."

i did myself takes while pipeline start up, start time 10-15 minutes depending on unknown factors.

http://docs.aws.amazon.com/datapipeline/latest/developerguide/dp-how-task-runner-user-managed.html


Comments

Popular posts from this blog

ruby - Trying to change last to "x"s to 23 -

jquery - Clone last and append item to closest class -

c - Unrecognised emulation mode: elf_i386 on MinGW32 -