How to speed up Rclone?
Here are several ways to optimize Rclone's performance:
- Use --transfers flag
rclone copy --transfers 32 source:path dest:path
This increases the number of concurrent file transfers (default is 4). Try values between 16-32 for better performance.
- Enable multi-thread downloads/uploads
rclone copy --multi-thread-streams 4 source:path dest:path
This splits large files into chunks for parallel transfer.
- Adjust buffer size
rclone copy --buffer-size 256M source:path dest:path
Increasing buffer size can improve transfer speeds, especially for larger files.
- Use --fast-list
rclone copy --fast-list source:path dest:path
This makes directory listings faster but uses more memory.
- Modify chunk size
rclone copy --s3-chunk-size 128M source:path dest:path
For cloud storage like S3, increasing chunk size can improve performance.
- Combine multiple optimizations
rclone copy \
--transfers 32 \
--multi-thread-streams 4 \
--buffer-size 256M \
--fast-list \
source:path dest:path
- Additional tips:
- Use
--progress
to monitor transfer speeds - Consider using
--checkers 16
to increase concurrent checking processes - If copying many small files, try
--check-first
to check all files first - For local to local copies, consider using
--copy-links
instead of following symlinks
Remember that optimal settings depend on:
- Your available bandwidth
- System resources (CPU, RAM)
- Storage type (local, cloud, etc.)
- File sizes and quantities
Start with moderate values and adjust based on your specific use case and performance results.