Disassemble (on source node):
split -d -b 10G filename
Transfer with N thread (from source node):
nohup scp -i <path_to_keys>/mykey.rsa x00 root@ip_target_node:/dest &
nohup scp -i <path_to_keys>/mykey.rsa x01 root@ip_target_node:/dest &
nohup scp -i <path_to_keys>/mykey.rsa x02 root@ip_target_node:/dest &
nohup scp -i <path_to_keys>/mykey.rsa x03 root@ip_target_node:/dest &
nohup scp -i <path_to_keys>/mykey.rsa x04 root@ip_target_node:/dest &
nohup scp -i <path_to_keys>/mykey.rsa x05 root@ip_target_node:/dest &
(may require more threads if there are more xnn files)
Reassemble (on target node):
nohup cat x* > filename
This blog covers different aspects around software development and test. There are also general information useful for who needs to test performances and needs to analyze bottlenecks on application servers and databases. Disclaimer: test before you implement any advice, no warranty is provided. Before use the software mentioned in this blog read and understand all licenses agreements. Use of the information contained in this blog is under your own responsibility.
giovedì 30 giugno 2016
Split and transfer big file size from/to datacenters
Etichette:
big files,
datacenter,
scp,
transfer
Iscriviti a:
Commenti sul post (Atom)
If you want to hire fitness app developers
RispondiElimina, you can contact us. At TechGropse