I am trying to set up my very first EC2 instance for work. This work involved transferring a few large files to EC2 (around 5~10GB) every now and then. The problem is, the scp approach in the AWS document only gives me around 200~600KB/s (averaging~400), much lower than what I expected and will take me 5 hours just to upload one file.
scp -i /path/key-pair-name.pem /path/my-file.txt ec2-user@instance-public-dns-name:path/
Following similar questions here in Stackoverflow, I also tried using rsync instead with not much luck. In fact, I think it even gives a somewhat lower average speed.
rsync -avz --progress -e "ssh -i ${EC2_KEY}" *.safetensors "${EC2_DNS}:/home/ubuntu/"
Is this speed range to be expected ? Testing by basic google tool, I should have upload speed of 10Mbps, so around 1.2MB. If possible, I would love to get something over a MB. My machine is MacOS and EC2 is ubuntu. I am not the owner of this AWS account and someone else provides this EC2 instance to me, so I cannot set up an S3 and send data to it instead either.
Sorry for such a novice question and thanks you all in advance. I would really appreciate any suggestions for configurations or other approaches for faster upload speed.
(For further information) I know almost next to nothing when it comes to networking so I have no idea how to check for bottleneck in the connection. If you need any further information please write the script to check it in the comment and I will update the question with the test results.