Rclone Changelog

What's new in Rclone 1.66.0

Mar 10, 2024
  • Major features:
  • Rclone will now sync directory modification times if the backend supports it.
  • This can be disabled with --no-update-dir-modtime
  • See the overview and look for the D flags in the ModTime column to see which backends support it.
  • Rclone will now sync directory metadata if the backend supports it when -M/--metadata is in use.
  • See the overview and look for the D flags in the Metadata column to see which backends support it.
  • Bisync has received many updates see below for more details or bisync's changelog
  • Removed backends:
  • amazonclouddrive: Remove Amazon Drive backend code and docs (Nick Craig-Wood)
  • New Features:
  • backend:
  • Add description field for all backends (Paul Stern)
  • build:
  • Update to go1.22 and make go1.20 the minimum required version (Nick Craig-Wood)
  • Fix CVE-2024-24786 by upgrading google.golang.org/protobuf (Nick Craig-Wood)
  • check: Respect --no-unicode-normalization and --ignore-case-sync for --checkfile (nielash)
  • cmd: Much improved shell auto completion which reduces the size of the completion file and works faster (Nick Craig-Wood)
  • doc updates (albertony, ben-ba, Eli, emyarod, huajin tong, Jack Provance, kapitainsky, keongalvin, Nick Craig-Wood, nielash, rarspace01, rzitzer, Tera, Vincent Murphy)
  • fs: Add more detailed logging for file includes/excludes (Kyle Reynolds)
  • lsf:
  • Add --time-format flag (nielash)
  • Make metadata appear for directories (Nick Craig-Wood)
  • lsjson: Make metadata appear for directories (Nick Craig-Wood)
  • rc:
  • Add srcFs and dstFs to core/stats and core/transferred stats (Nick Craig-Wood)
  • Add operations/hashsum to the rc as rclone hashsum equivalent (Nick Craig-Wood)
  • Add config/paths to the rc as rclone config paths equivalent (Nick Craig-Wood)
  • sync:
  • Optionally report list of synced paths to file (nielash)
  • Implement directory sync for mod times and metadata (Nick Craig-Wood)
  • Don't set directory modtimes if already set (nielash)
  • Don't sync directory modtimes from backends which don't have directories (Nick Craig-Wood)
  • Bug Fixes:
  • backend
  • Make backends which use oauth implement the Shutdown and shutdown the oauth properly (rkonfj)
  • bisync
  • Handle unicode and case normalization consistently (nielash)
  • Partial uploads known issue on local/ftp/sftp has been resolved (unless using --inplace) (nielash)
  • Fixed handling of unicode normalization and case insensitivity, support for --fix-case, --ignore-case-sync, --no-unicode-normalization (nielash)
  • Bisync no longer fails to find the correct listing file when configs are overridden with backend-specific flags. (nielash)
  • nfsmount
  • Fix exit after external unmount (nielash)
  • Fix --volname being ignored (nielash)
  • operations
  • Fix renaming a file on macOS (nielash)
  • Fix case-insensitive moves in operations.Move (nielash)
  • Fix TestCaseInsensitiveMoveFileDryRun on chunker integration tests (nielash)
  • Fix TestMkdirModTime test (Nick Craig-Wood)
  • Fix TestSetDirModTime for backends with SetDirModTime but not Metadata (Nick Craig-Wood)
  • Fix typo in log messages (nielash)
  • serve nfs: Fix writing files via Finder on macOS (nielash)
  • serve restic: Fix error handling (Michael Eischer)
  • serve webdav: Fix --baseurl without leading / (Nick Craig-Wood)
  • stats: Fix race between ResetCounters and stopAverageLoop called from time.AfterFunc (Nick Craig-Wood)
  • sync
  • fix-case flag to rename case insensitive dest (nielash)
  • Use operations.DirMove instead of sync.MoveDir for --fix-case (nielash)
  • systemd: Fix detection and switch to the coreos package everywhere rather than having 2 separate libraries (Anagh Kumar Baranwal)
  • Mount:
  • Fix macOS not noticing errors with --daemon (Nick Craig-Wood)
  • Notice daemon dying much quicker (Nick Craig-Wood)
  • VFS:
  • Fix unicode normalization on macOS (nielash)
  • Bisync:
  • Copies and deletes are now handled in one operation instead of two (nielash)
  • track-renames and --backup-dir are now supported (nielash)
  • Final listings are now generated from sync results, to avoid needing to re-list (nielash)
  • Bisync is now much more resilient to changes that happen during a bisync run, and far less prone to critical errors / undetected changes (nielash)
  • Bisync is now capable of rolling a file listing back in cases of uncertainty, essentially marking the file as needing to be rechecked next time. (nielash)
  • A few basic terminal colors are now supported, controllable with --color (AUTO|NEVER|ALWAYS) (nielash)
  • Initial listing snapshots of Path1 and Path2 are now generated concurrently, using the same "march" infrastructure as check and sync, for performance improvements and less risk of error. (nielash)
  • resync is now much more efficient (especially for users of --create-empty-src-dirs) (nielash)
  • Google Docs (and other files of unknown size) are now supported (with the same options as in sync) (nielash)
  • Equality checks before a sync conflict rename now fall back to cryptcheck (when possible) or --download, (nielash) instead of of --size-only, when check is not available.
  • Bisync now fully supports comparing based on any combination of size, modtime, and checksum, lifting the prior restriction on backends without modtime support. (nielash)
  • Bisync now supports a "Graceful Shutdown" mode to cleanly cancel a run early without requiring --resync. (nielash)
  • New --recover flag allows robust recovery in the event of interruptions, without requiring --resync. (nielash)
  • A new --max-lock setting allows lock files to automatically renew and expire, for better automatic recovery when a run is interrupted. (nielash)
  • Bisync now supports auto-resolving sync conflicts and customizing rename behavior with new --conflict-resolve, --conflict-loser, and --conflict-suffix flags. (nielash)
  • A new --resync-mode flag allows more control over which version of a file gets kept during a --resync. (nielash)
  • Bisync now supports --retries and --retries-sleep (when --resilient is set.) (nielash)
  • Clarify file operation directions in dry-run logs (Kyle Reynolds)
  • Local:
  • Fix cleanRootPath on Windows after go1.21.4 stdlib update (nielash)
  • Implement setting modification time on directories (nielash)
  • Implement modtime and metadata for directories (Nick Craig-Wood)
  • Fix setting of btime on directories on Windows (Nick Craig-Wood)
  • Delete backend implementation of Purge to speed up and make stats (Nick Craig-Wood)
  • Support metadata setting and mapping on server side Move (Nick Craig-Wood)
  • Cache:
  • Implement setting modification time on directories (if supported by wrapped remote) (nielash)
  • Implement setting metadata on directories (Nick Craig-Wood)
  • Crypt:
  • Implement setting modification time on directories (if supported by wrapped remote) (nielash)
  • Implement setting metadata on directories (Nick Craig-Wood)
  • Improve handling of undecryptable file names (nielash)
  • Add missing error check spotted by linter (Nick Craig-Wood)
  • Azure Blob:
  • Implement --azureblob-delete-snapshots (Nick Craig-Wood)
  • B2:
  • Clarify exactly what --b2-download-auth-duration does in the docs (Nick Craig-Wood)
  • Chunker:
  • Implement setting modification time on directories (if supported by wrapped remote) (nielash)
  • Implement setting metadata on directories (Nick Craig-Wood)
  • Combine:
  • Implement setting modification time on directories (if supported by wrapped remote) (nielash)
  • Implement setting metadata on directories (Nick Craig-Wood)
  • Fix directory metadata error on upstream root (nielash)
  • Fix directory move across upstreams (nielash)
  • Compress:
  • Implement setting modification time on directories (if supported by wrapped remote) (nielash)
  • Implement setting metadata on directories (Nick Craig-Wood)
  • Drive:
  • Implement setting modification time on directories (nielash)
  • Implement modtime and metadata setting for directories (Nick Craig-Wood)
  • Support metadata setting and mapping on server side Move,Copy (Nick Craig-Wood)
  • FTP:
  • Fix mkdir with rsftp which is returning the wrong code (Nick Craig-Wood)
  • Hasher:
  • Implement setting modification time on directories (if supported by wrapped remote) (nielash)
  • Implement setting metadata on directories (Nick Craig-Wood)
  • Fix error from trying to stop an already-stopped db (nielash)
  • Look for cached hash if passed hash unexpectedly blank (nielash)
  • Imagekit:
  • Updated docs and web content (Harshit Budhraja)
  • Updated overview - supported operations (Harshit Budhraja)
  • Mega:
  • Fix panic with go1.22 (Nick Craig-Wood)
  • Netstorage:
  • Fix Root to return correct directory when pointing to a file (Nick Craig-Wood)
  • Onedrive:
  • Add metadata support (nielash)
  • Opendrive:
  • Fix moving file/folder within the same parent dir (nielash)
  • Oracle Object Storage:
  • Support backend restore command (Nikhil Ahuja)
  • Support workload identity authentication for OKE (Anders Swanson)
  • Protondrive:
  • Fix encoding of Root method (Nick Craig-Wood)
  • Quatrix:
  • Fix Content-Range header (Volodymyr)
  • Add option to skip project folders (Oksana Zhykina)
  • Fix Root to return correct directory when pointing to a file (Nick Craig-Wood)
  • S3:
  • Add --s3-version-deleted to show delete markers in listings when using versions. (Nick Craig-Wood)
  • Add IPv6 support with option --s3-use-dual-stack (Anthony Metzidis)
  • Copy parts in parallel when doing chunked server side copy (Nick Craig-Wood)
  • GCS provider: fix server side copy of files bigger than 5G (Nick Craig-Wood)
  • Support metadata setting and mapping on server side Copy (Nick Craig-Wood)
  • Seafile:
  • Fix download/upload error when FILE_SERVER_ROOT is relative (DanielEgbers)
  • Fix Root to return correct directory when pointing to a file (Nick Craig-Wood)
  • SFTP:
  • Implement setting modification time on directories (nielash)
  • Set directory modtimes update on write flag (Nick Craig-Wood)
  • Shorten wait delay for external ssh binaries now that we are using go1.20 (Nick Craig-Wood)
  • Swift:
  • Avoid unnecessary container versioning check (Joe Cai)
  • Union:
  • Implement setting modification time on directories (if supported by wrapped remote) (nielash)
  • Implement setting metadata on directories (Nick Craig-Wood)
  • WebDAV:
  • Reduce priority of chunks upload log (Gabriel Ramos)
  • owncloud: Add config owncloud_exclude_shares which allows to exclude shared files and folders when listing remote resources (Thomas Müller)

New in Rclone 1.65.2 (Jan 24, 2024)

  • Bug Fixes:
  • build: bump github.com/cloudflare/circl from 1.3.6 to 1.3.7 (dependabot)
  • docs updates (Nick Craig-Wood, kapitainsky, nielash, Tera, Harshit Budhraja)
  • VFS:
  • Fix stale data when using --vfs-cache-mode full (Nick Craig-Wood)
  • Azure Blob:
  • IMPORTANT Fix data corruption bug - see #7590 (Nick Craig-Wood)

New in Rclone 1.65.1 (Jan 8, 2024)

  • Bug Fixes:
  • Bump golang.org/x/crypto to fix ssh terrapin CVE-2023-48795 (dependabot)
  • Update to go1.21.5 to fix Windows path problems (Nick Craig-Wood)
  • Fix docker build on arm/v6 (Nick Craig-Wood)
  • install.sh: fix harmless error message on install (Nick Craig-Wood)
  • accounting: fix stats to show server side transfers (Nick Craig-Wood)
  • doc fixes (albertony, ben-ba, Eli Orzitzer, emyarod, keongalvin, rarspace01)
  • nfsmount: Compile for all unix oses, add --sudo and fix error/option handling (Nick Craig-Wood)
  • operations: Fix files moved by rclone move not being counted as transfers (Nick Craig-Wood)
  • oauthutil: Avoid panic when *token and *ts.token are the same (rkonfj)
  • serve s3: Fix listing oddities (Nick Craig-Wood)
  • VFS
  • Note that --vfs-refresh runs in the background (Nick Craig-Wood)
  • Azurefiles
  • Fix storage base url (Oksana)
  • Crypt
  • Fix rclone move a file over itself deleting the file (Nick Craig-Wood)
  • Chunker
  • Fix rclone move a file over itself deleting the file (Nick Craig-Wood)
  • Compress
  • Fix rclone move a file over itself deleting the file (Nick Craig-Wood)
  • Dropbox
  • Fix used space on dropbox team accounts (Nick Craig-Wood)
  • FTP
  • Fix multi-thread copy (WeidiDeng)
  • Googlephotos
  • Fix nil pointer exception when batch failed (Nick Craig-Wood)
  • Hasher
  • Fix rclone move a file over itself deleting the file (Nick Craig-Wood)
  • Fix invalid memory address error when MaxAge == 0 (nielash)
  • Onedrive
  • Fix error listing: unknown object type <nil> (Nick Craig-Wood)
  • Fix "unauthenticated: Unauthenticated" errors when uploading (Nick Craig-Wood)
  • Oracleobjectstorage
  • Fix object storage endpoint for custom endpoints (Manoj Ghosh)
  • Multipart copy create bucket if it doesn't exist. (Manoj Ghosh)
  • Protondrive
  • Fix CVE-2023-45286 / GHSA-xwh9-gc39-5298 (Nick Craig-Wood)
  • Fix crash if no UploadId in multipart upload (Nick Craig-Wood)
  • Smb
  • Fix shares not listed by updating go-smb2 (halms)
  • Union
  • Fix rclone move a file over itself deleting the file (Nick Craig-Wood)

New in Rclone 1.65.0 (Nov 26, 2023)

  • New backends:
  • Azure Files (karan, moongdal, Nick Craig-Wood)
  • ImageKit (Abhinav Dhiman)
  • Linkbox (viktor, Nick Craig-Wood)
  • New commands:
  • serve s3: Let rclone act as an S3 compatible server (Mikubill, Artur Neumann, Saw-jan, Nick Craig-Wood)
  • nfsmount: mount command to provide mount mechanism on macOS without FUSE (Saleh Dindar)
  • serve nfs: to serve a remote for use by nfsmount (Saleh Dindar)
  • New Features:
  • install.sh: Clean up temp files in install script (Jacob Hands)
  • build
  • Update all dependencies (Nick Craig-Wood)
  • Refactor version info and icon resource handling on windows (albertony)
  • doc updates (albertony, alfish2000, asdffdsazqqq, Dimitri Papadopoulos, Herby Gillot, Joda Stößer, Manoj Ghosh, Nick Craig-Wood)
  • Implement --metadata-mapper to transform metatadata with a user supplied program (Nick Craig-Wood)
  • Add ChunkWriterDoesntSeek feature flag and set it for b2 (Nick Craig-Wood)
  • lib/http: Export basic go string functions for use in --template (Gabriel Espinoza)
  • makefile: Use POSIX compatible install arguments (Mina Galić)
  • operations
  • Use less memory when doing multithread uploads (Nick Craig-Wood)
  • Implement --partial-suffix to control extension of temporary file names (Volodymyr)
  • rc:
  • Add operations/check to the rc API (Nick Craig-Wood)
  • Always report an error as JSON (Nick Craig-Wood)
  • Set Last-Modified header for files served by --rc-serve (Nikita Shoshin)
  • size: Dont show duplicate object count when less than 1k (albertony)
  • Bug Fixes:
  • fshttp: Fix --contimeout being ignored (你知道未来吗)
  • march: Fix excessive parallelism when using --no-traverse (Nick Craig-Wood)
  • ncdu: Fix crash when re-entering changed directory after rescan (Nick Craig-Wood)
  • operations
  • Fix overwrite of destination when multi-thread transfer fails (Nick Craig-Wood)
  • Fix invalid UTF-8 when truncating file names when not using --inplace (Nick Craig-Wood)
  • serve dnla: Fix crash on graceful exit (wuxingzhong)
  • Mount:
  • Disable mount for freebsd and alias cmount as mount on that platform (Nick Craig-Wood)
  • VFS:
  • Add --vfs-refresh flag to read all the directories on start (Beyond Meat)
  • Implement Name() method in WriteFileHandle and ReadFileHandle (Saleh Dindar)
  • Add go-billy dependency and make sure vfs.Handle implements billy.File (Saleh Dindar)
  • Error out early if can't upload 0 length file (Nick Craig-Wood)
  • Local:
  • Fix copying from Windows Volume Shadows (Nick Craig-Wood)
  • Azure Blob:
  • Add support for cold tier (Ivan Yanitra)
  • B2:
  • Implement "rclone backend lifecycle" to read and set bucket lifecycles (Nick Craig-Wood)
  • Implement --b2-lifecycle to control lifecycle when creating buckets (Nick Craig-Wood)
  • Fix listing all buckets when not needed (Nick Craig-Wood)
  • Fix multi-thread upload with copyto going to wrong name (Nick Craig-Wood)
  • Fix server side chunked copy when file size was exactly --b2-copy-cutoff (Nick Craig-Wood)
  • Fix streaming chunked files an exact multiple of chunk size (Nick Craig-Wood)
  • Box:
  • Filter more EventIDs when polling (David Sze)
  • Add more logging for polling (David Sze)
  • Fix performance problem reading metadata for single files (Nick Craig-Wood)
  • Drive:
  • Add read/write metadata support (Nick Craig-Wood)
  • Add support for SHA-1 and SHA-256 checksums (rinsuki)
  • Add --drive-show-all-gdocs to allow unexportable gdocs to be server side copied (Nick Craig-Wood)
  • Add a note that --drive-scope accepts comma-separated list of scopes (Keigo Imai)
  • Fix error updating created time metadata on existing object (Nick Craig-Wood)
  • Fix integration tests by enabling metadata support from the context (Nick Craig-Wood)
  • Dropbox:
  • Factor batcher into lib/batcher (Nick Craig-Wood)
  • Fix missing encoding for rclone purge (Nick Craig-Wood)
  • Google Cloud Storage:
  • Fix 400 Bad request errors when using multi-thread copy (Nick Craig-Wood)
  • Googlephotos:
  • Implement batcher for uploads (Nick Craig-Wood)
  • Hdfs:
  • Added support for list of namenodes in hdfs remote config (Tayo-pasedaRJ)
  • HTTP:
  • Implement set backend command to update running backend (Nick Craig-Wood)
  • Enable methods used with WebDAV (Alen Šiljak)
  • Jottacloud:
  • Add support for reading and writing metadata (albertony)
  • Onedrive:
  • Implement ListR method which gives --fast-list support (Nick Craig-Wood)
  • This must be enabled with the --onedrive-delta flag
  • Quatrix:
  • Add partial upload support (Oksana Zhykina)
  • Overwrite files on conflict during server-side move (Oksana Zhykina)
  • S3:
  • Add Linode provider (Nick Craig-Wood)
  • Add docs on how to add a new provider (Nick Craig-Wood)
  • Fix no error being returned when creating a bucket we don't own (Nick Craig-Wood)
  • Emit a debug message if anonymous credentials are in use (Nick Craig-Wood)
  • Add --s3-disable-multipart-uploads flag (Nick Craig-Wood)
  • Detect looping when using gcs and versions (Nick Craig-Wood)
  • SFTP:
  • Implement --sftp-copy-is-hardlink to server side copy as hardlink (Nick Craig-Wood)
  • Smb:
  • Fix incorrect about size by switching to github.com/cloudsoda/go-smb2 fork (Nick Craig-Wood)
  • Fix modtime of multithread uploads by setting PartialUploads (Nick Craig-Wood)
  • WebDAV:
  • Added an rclone vendor to work with rclone serve webdav (Adithya Kumar)

New in Rclone 1.64.2 (Oct 19, 2023)

  • Bug Fixes:
  • selfupdate: Fix "invalid hashsum signature" error (Nick Craig-Wood)
  • build: Fix docker build running out of space (Nick Craig-Wood)

New in Rclone 1.64.1 (Oct 17, 2023)

  • Bug Fixes:
  • cmd: Make --progress output logs in the same format as without (Nick Craig-Wood)
  • docs fixes (Dimitri Papadopoulos Orfanos, Herby Gillot, Manoj Ghosh, Nick Craig-Wood)
  • lsjson: Make sure we set the global metadata flag too (Nick Craig-Wood)
  • operations
  • Ensure concurrency is no greater than the number of chunks (Pat Patterson)
  • Fix OpenOptions ignored in copy if operation was a multiThreadCopy (Vitor Gomes)
  • Fix error message on delete to have file name (Nick Craig-Wood)
  • serve sftp: Return not supported error for not supported commands (Nick Craig-Wood)
  • build: Upgrade golang.org/x/net to v0.17.0 to fix HTTP/2 rapid reset (Nick Craig-Wood)
  • pacer: Fix b2 deadlock by defaulting max connections to unlimited (Nick Craig-Wood)
  • Mount:
  • Fix automount not detecting drive is ready (Nick Craig-Wood)
  • VFS:
  • Fix update dir modification time (Saleh Dindar)
  • Azure Blob:
  • Fix "fatal error: concurrent map writes" (Nick Craig-Wood)
  • B2:
  • Fix multipart upload: corrupted on transfer: sizes differ XXX vs 0 (Nick Craig-Wood)
  • Fix locking window when getting mutipart upload URL (Nick Craig-Wood)
  • Fix server side copies greater than 4GB (Nick Craig-Wood)
  • Fix chunked streaming uploads (Nick Craig-Wood)
  • Reduce default --b2-upload-concurrency to 4 to reduce memory usage (Nick Craig-Wood)
  • Onedrive:
  • Fix the configurator to allow /teams/ID in the config (Nick Craig-Wood)
  • Oracleobjectstorage:
  • Fix OpenOptions being ignored in uploadMultipart with chunkWriter (Nick Craig-Wood)
  • S3:
  • Fix slice bounds out of range error when listing (Nick Craig-Wood)
  • Fix OpenOptions being ignored in uploadMultipart with chunkWriter (Vitor Gomes)
  • Storj
  • Update storj.io/uplink to v1.12.0 (Kaloyan Raev)

New in Rclone 1.64.0 (Sep 11, 2023)

  • New backends:
  • Proton Drive (Chun-Hung Tseng)
  • Quatrix (Oksana, Volodymyr Kit)
  • New S3 providers:
  • Synology C2 (BakaWang)
  • Leviia (Benjamin)
  • New Jottacloud providers:
  • Onlime (Fjodor42)
  • Telia Sky (NoLooseEnds)
  • Major changes:
  • Multi-thread transfers (Vitor Gomes, Nick Craig-Wood, Manoj Ghosh, Edwin Mackenzie-Owen)
  • Multi-thread transfers are now available when transferring to:
  • local, s3, azureblob, b2, oracleobjectstorage and smb
  • This greatly improves transfer speed between two network sources.
  • In memory buffering has been unified between all backends and should share memory better.
  • See --multi-thread docs for more info
  • New commands:
  • rclone config redacted support mechanism for showing redacted config (Nick Craig-Wood)
  • New Features:
  • accounting:
  • Show server side stats in own lines and not as bytes transferred (Nick Craig-Wood)
  • bisync
  • Add new --ignore-listing-checksum flag to distinguish from --ignore-checksum (nielash)
  • Add experimental --resilient mode to allow recovery from self-correctable errors (nielash)
  • Add support for --create-empty-src-dirs (nielash)
  • Dry runs no longer commit filter changes (nielash)
  • Enforce --check-access during --resync (nielash)
  • Apply filters correctly during deletes (nielash)
  • Equality check before renaming (leave identical files alone) (nielash)
  • Fix dryRun rc parameter being ignored (nielash)
  • build
  • Update to go1.21 and make go1.19 the minimum required version (Anagh Kumar Baranwal, Nick Craig-Wood)
  • Update dependencies (Nick Craig-Wood)
  • Add snap installation (hideo aoyama)
  • Change Winget Releaser job to ubuntu-latest (sitiom)
  • cmd: Refactor and use sysdnotify in more commands (eNV25)
  • config: Add --multi-thread-chunk-size flag (Vitor Gomes)
  • doc updates (antoinetran, Benjamin, Bjørn Smith, Dean Attali, gabriel-suela, James Braza, Justin Hellings, kapitainsky, Mahad, Masamune3210, Nick Craig-Wood, Nihaal Sangha, Niklas Hambüchen, Raymond Berger, r-ricci, Sawada Tsunayoshi, Tiago Boeing, Vladislav Vorobev)
  • fs:
  • Use atomic types everywhere (Roberto Ricci)
  • When --max-transfer limit is reached exit with code (10) (kapitainsky)
  • Add rclone completion powershell - basic implementation only (Nick Craig-Wood)
  • http servers: Allow CORS to be set with --allow-origin flag (yuudi)
  • lib/rest: Remove unnecessary nil check (Eng Zer Jun)
  • ncdu: Add keybinding to rescan filesystem (eNV25)
  • rc:
  • Add executeId to job listings (yuudi)
  • Add core/du to measure local disk usage (Nick Craig-Wood)
  • Add operations/settier to API (Drew Stinnett)
  • rclone test info: Add --check-base32768 flag to check can store all base32768 characters (Nick Craig-Wood)
  • rmdirs: Remove directories concurrently controlled by --checkers (Nick Craig-Wood)
  • Bug Fixes:
  • accounting: Don't stop calculating average transfer speed until the operation is complete (Jacob Hands)
  • fs: Fix transferTime not being set in JSON logs (Jacob Hands)
  • fshttp: Fix --bind 0.0.0.0 allowing IPv6 and --bind ::0 allowing IPv4 (Nick Craig-Wood)
  • operations: Fix overlapping check on case insensitive file systems (Nick Craig-Wood)
  • serve dlna: Fix MIME type if backend can't identify it (Nick Craig-Wood)
  • serve ftp: Fix race condition when using the auth proxy (Nick Craig-Wood)
  • serve sftp: Fix hash calculations with --vfs-cache-mode full (Nick Craig-Wood)
  • serve webdav: Fix error: Expecting fs.Object or fs.Directory, got nil (Nick Craig-Wood)
  • sync: Fix lockup with --cutoff-mode=soft and --max-duration (Nick Craig-Wood)
  • Mount:
  • fix: Mount parsing for linux (Anagh Kumar Baranwal)
  • VFS:
  • Add --vfs-cache-min-free-space to control minimum free space on the disk containing the cache (Nick Craig-Wood)
  • Added cache cleaner for directories to reduce memory usage (Anagh Kumar Baranwal)
  • Update parent directory modtimes on vfs actions (David Pedersen)
  • Keep virtual directory status accurate and reduce deadlock potential (Anagh Kumar Baranwal)
  • Make sure struct field is aligned for atomic access (Roberto Ricci)
  • Local:
  • Rmdir return an error if the path is not a dir (zjx20)
  • Azure Blob:
  • Implement OpenChunkWriter and multi-thread uploads (Nick Craig-Wood)
  • Fix creation of directory markers (Nick Craig-Wood)
  • Fix purging with directory markers (Nick Craig-Wood)
  • B2:
  • Implement OpenChunkWriter and multi-thread uploads (Nick Craig-Wood)
  • Fix rclone link when object path contains special characters (Alishan Ladhani)
  • Box:
  • Add polling support (David Sze)
  • Add --box-impersonate to impersonate a user ID (Nick Craig-Wood)
  • Fix unhelpful decoding of error messages into decimal numbers (Nick Craig-Wood)
  • Chunker:
  • Update documentation to mention issue with small files (Ricardo D'O. Albanus)
  • Compress:
  • Fix ChangeNotify (Nick Craig-Wood)
  • Drive:
  • Add --drive-fast-list-bug-fix to control ListR bug workaround (Nick Craig-Wood)
  • Fichier:
  • Implement DirMove (Nick Craig-Wood)
  • Fix error code parsing (alexia)
  • FTP:
  • Add socks_proxy support for SOCKS5 proxies (Zach)
  • Fix 425 "TLS session of data connection not resumed" errors (Nick Craig-Wood)
  • Hdfs:
  • Retry "replication in progress" errors when uploading (Nick Craig-Wood)
  • Fix uploading to the wrong object on Update with overriden remote name (Nick Craig-Wood)
  • HTTP:
  • CORS should not be sent if not set (yuudi)
  • Fix webdav OPTIONS response (yuudi)
  • Opendrive:
  • Fix List on a just deleted and remade directory (Nick Craig-Wood)
  • Oracleobjectstorage:
  • Use rclone's rate limiter in mutipart transfers (Manoj Ghosh)
  • Implement OpenChunkWriter and multi-thread uploads (Manoj Ghosh)
  • S3:
  • Refactor multipart upload to use OpenChunkWriter and ChunkWriter (Vitor Gomes)
  • Factor generic multipart upload into lib/multipart (Nick Craig-Wood)
  • Fix purging of root directory with --s3-directory-markers (Nick Craig-Wood)
  • Add rclone backend set command to update the running config (Nick Craig-Wood)
  • Add rclone backend restore-status command (Nick Craig-Wood)
  • SFTP:
  • Stop uploads re-using the same ssh connection to improve performance (Nick Craig-Wood)
  • Add --sftp-ssh to specify an external ssh binary to use (Nick Craig-Wood)
  • Add socks_proxy support for SOCKS5 proxies (Zach)
  • Support dynamic --sftp-path-override (nielash)
  • Fix spurious warning when using --sftp-ssh (Nick Craig-Wood)
  • Smb:
  • Implement multi-threaded writes for copies to smb (Edwin Mackenzie-Owen)
  • Storj:
  • Performance improvement for large file uploads (Kaloyan Raev)
  • Swift:
  • Fix HEADing 0-length objects when --swift-no-large-objects set (Julian Lepinski)
  • Union:
  • Add :writback to act as a simple cache (Nick Craig-Wood)
  • WebDAV:
  • Nextcloud: fix segment violation in low-level retry (Paul)
  • Zoho:
  • Remove Range requests workarounds to fix integration tests (Nick Craig-Wood)

New in Rclone 1.63.1 (Jul 19, 2023)

  • Bug Fixes
  • build: Fix macos builds for versions < 12 (Anagh Kumar Baranwal)
  • dirtree: Fix performance with large directories of directories and --fast-list (Nick Craig-Wood)
  • operations
  • Fix deadlock when using lsd/ls with --progress (Nick Craig-Wood)
  • Fix .rclonelink files not being converted back to symlinks (Nick Craig-Wood)
  • doc fixes (Dean Attali, Mahad, Nick Craig-Wood, Sawada Tsunayoshi, Vladislav Vorobev)
  • Local
  • Fix partial directory read for corrupted filesystem (Nick Craig-Wood)
  • Box
  • Fix reconnect failing with HTTP 400 Bad Request (albertony)
  • Smb
  • Fix "Statfs failed: bucket or container name is needed" when mounting (Nick Craig-Wood)
  • WebDAV
  • Nextcloud: fix must use /dav/files/USER endpoint not /webdav error (Paul)
  • Nextcloud chunking: add more guidance for the user to check the config (darix)

New in Rclone 1.63.0 (Jun 30, 2023)

  • New backends:
  • Pikpak (wiserain)
  • New S3 providers:
  • petabox.io (Andrei Smirnov)
  • Google Cloud Storage (Anthony Pessy)
  • New WebDAV providers:
  • Fastmail (Arnavion)
  • Major changes:
  • Files will be copied to a temporary name ending in .partial when copying to local,ftp,sftp then renamed at the end of the transfer. (Janne Hellsten, Nick Craig-Wood)
  • This helps with data integrity as we don't delete the existing file until the new one is complete.
  • It can be disabled with the --inplace flag.
  • This behaviour will also happen if the backend is wrapped, for example sftp wrapped with crypt.
  • The s3, azureblob and gcs backends now support directory markers so empty directories are supported (Jānis Bebrītis, Nick Craig-Wood)
  • The --default-time flag now controls the unknown modification time of files/dirs (Nick Craig-Wood)
  • If a file or directory does not have a modification time rclone can read then rclone will display this fixed time instead.
  • For the old behaviour use --default-time 0s which will set this time to the time rclone started up.
  • New Features:
  • build:
  • Modernise linters in use and fixup all affected code (albertony)
  • Push docker beta to GHCR (GitHub container registry) (Richard Tweed)
  • cat: Add --separator option to cat command (Loren Gordon)
  • config:
  • Do not remove/overwrite other files during config file save (albertony)
  • Do not overwrite config file symbolic link (albertony)
  • Stop config create making invalid config files (Nick Craig-Wood)
  • doc updates (Adam K, Aditya Basu, albertony, asdffdsazqqq, Damo, danielkrajnik, Dimitri Papadopoulos, dlitster, Drew Parsons, jumbi77, kapitainsky, mac-15, Mariusz Suchodolski, Nick Craig-Wood, NickIAm, Rintze Zelle, Stanislav Gromov, Tareq Sharafy, URenko, yuudi, Zach Kipp)
  • fs:
  • Add size to JSON logs when moving or copying an object (Nick Craig-Wood)
  • Allow boolean features to be enabled with --disable !Feature (Nick Craig-Wood)
  • genautocomplete: Rename to completion with alias to the old name (Nick Craig-Wood)
  • librclone: Added example on using librclone with Go (alankrit)
  • lsjson: Make --stat more efficient (Nick Craig-Wood)
  • operations:
  • Implement --multi-thread-write-buffer-size for speed improvements on downloads (Paulo Schreiner)
  • Reopen downloads on error when using check --download and cat (Nick Craig-Wood)
  • rc: config/listremotes includes remotes defined with environment variables (kapitainsky)
  • selfupdate: Obey --no-check-certificate flag (Nick Craig-Wood)
  • serve restic: Trigger systemd notify (Shyim)
  • serve webdav: Implement owncloud checksum and modtime extensions (WeidiDeng)
  • sync: --suffix-keep-extension preserve 2 part extensions like .tar.gz (Nick Craig-Wood)
  • Bug Fixes:
  • accounting:
  • Fix Prometheus metrics to be the same as core/stats (Nick Craig-Wood)
  • Bwlimit signal handler should always start (Sam Lai)
  • bisync: Fix maxDelete parameter being ignored via the rc (Nick Craig-Wood)
  • cmd/ncdu: Fix screen corruption when logging (eNV25)
  • filter: Fix deadlock with errors on --files-from (douchen)
  • fs:
  • Fix interaction between --progress and --interactive (Nick Craig-Wood)
  • Fix infinite recursive call in pacer ModifyCalculator (fixes issue reported by the staticcheck linter) (albertony)
  • lib/atexit: Ensure OnError only calls cancel function once (Nick Craig-Wood)
  • lib/rest: Fix problems re-using HTTP connections (Nick Craig-Wood)
  • rc:
  • Fix operations/stat with trailing / (Nick Craig-Wood)
  • Fix missing --rc flags (Nick Craig-Wood)
  • Fix output of Time values in options/get (Nick Craig-Wood)
  • serve dlna: Fix potential data race (Nick Craig-Wood)
  • version: Fix reported os/kernel version for windows (albertony)
  • Mount:
  • Add --mount-case-insensitive to force the mount to be case insensitive (Nick Craig-Wood)
  • Removed unnecessary byte slice allocation for reads (Anagh Kumar Baranwal)
  • Clarify rclone mount error when installed via homebrew (Nick Craig-Wood)
  • Added _netdev to the example mount so it gets treated as a remote-fs rather than local-fs (Anagh Kumar Baranwal)
  • Mount2:
  • Updated go-fuse version (Anagh Kumar Baranwal)
  • Fixed statfs (Anagh Kumar Baranwal)
  • Disable xattrs (Anagh Kumar Baranwal)
  • VFS:
  • Add MkdirAll function to make a directory and all beneath (Nick Craig-Wood)
  • Fix reload: failed to add virtual dir entry: file does not exist (Nick Craig-Wood)
  • Fix writing to a read only directory creating spurious directory entries (WeidiDeng)
  • Fix potential data race (Nick Craig-Wood)
  • Fix backends being Shutdown too early when startup takes a long time (Nick Craig-Wood)
  • Local:
  • Fix filtering of symlinks with -l/--links flag (Nick Craig-Wood)
  • Fix /path/to/file.rclonelink when -l/--links is in use (Nick Craig-Wood)
  • Fix crash with --metadata on Android (Nick Craig-Wood)
  • Cache:
  • Fix backends shutting down when in use when used via the rc (Nick Craig-Wood)
  • Crypt:
  • Add --crypt-suffix option to set a custom suffix for encrypted files (jladbrook)
  • Add --crypt-pass-bad-blocks to allow corrupted file output (Nick Craig-Wood)
  • Fix reading 0 length files (Nick Craig-Wood)
  • Try not to return "unexpected EOF" error (Nick Craig-Wood)
  • Reduce allocations (albertony)
  • Recommend Dropbox for base32768 encoding (Nick Craig-Wood)
  • Azure Blob:
  • Empty directory markers (Nick Craig-Wood)
  • Support azure workload identities (Tareq Sharafy)
  • Fix azure blob uploads with multiple bits of metadata (Nick Craig-Wood)
  • Fix azurite compatibility by sending nil tier if set to empty string (Roel Arents)
  • Combine:
  • Implement missing methods (Nick Craig-Wood)
  • Fix goroutine stack overflow on bad object (Nick Craig-Wood)
  • Drive:
  • Add --drive-env-auth to get IAM credentials from runtime (Peter Brunner)
  • Update drive service account guide (Juang, Yi-Lin)
  • Fix change notify picking up files outside the root (Nick Craig-Wood)
  • Fix trailing slash mis-identificaton of folder as file (Nick Craig-Wood)
  • Fix incorrect remote after Update on object (Nick Craig-Wood)
  • Dropbox:
  • Implement --dropbox-pacer-min-sleep flag (Nick Craig-Wood)
  • Fix the dropbox batcher stalling (Misty)
  • Fichier:
  • Add --ficicher-cdn option to use the CDN for download (Nick Craig-Wood)
  • FTP:
  • Lower log message priority when SetModTime is not supported to debug (Tobias Gion)
  • Fix "unsupported LIST line" errors on startup (Nick Craig-Wood)
  • Fix "501 Not a valid pathname." errors when creating directories (Nick Craig-Wood)
  • Google Cloud Storage:
  • Empty directory markers (Jānis Bebrītis, Nick Craig-Wood)
  • Added --gcs-user-project needed for requester pays (Christopher Merry)
  • HTTP:
  • Add client certificate user auth middleware. This can auth serve restic from the username in the client cert. (Peter Fern)
  • Jottacloud:
  • Fix vfs writeback stuck in a failed upload loop with file versioning disabled (albertony)
  • Onedrive:
  • Add --onedrive-av-override flag to download files flagged as virus (Nick Craig-Wood)
  • Fix quickxorhash on 32 bit architectures (Nick Craig-Wood)
  • Report any list errors during rclone cleanup (albertony)
  • Putio:
  • Fix uploading to the wrong object on Update with overriden remote name (Nick Craig-Wood)
  • Fix modification times not being preserved for server side copy and move (Nick Craig-Wood)
  • Fix server side copy failures (400 errors) (Nick Craig-Wood)
  • S3:
  • Empty directory markers (Jānis Bebrītis, Nick Craig-Wood)
  • Update Scaleway storage classes (Brian Starkey)
  • Fix --s3-versions on individual objects (Nick Craig-Wood)
  • Fix hang on aborting multpart upload with iDrive e2 (Nick Craig-Wood)
  • Fix missing "tier" metadata (Nick Craig-Wood)
  • Fix V3sign: add missing subresource delete (cc)
  • Fix Arvancloud Domain and region changes and alphabetise the provider (Ehsan Tadayon)
  • Fix Qiniu KODO quirks virtualHostStyle is false (zzq)
  • SFTP:
  • Add --sftp-host-key-algorithms to allow specifying SSH host key algorithms (Joel)
  • Fix using --sftp-key-use-agent and --sftp-key-file together needing private key file (Arnav Singh)
  • Fix move to allow overwriting existing files (Nick Craig-Wood)
  • Don't stat directories before listing them (Nick Craig-Wood)
  • Don't check remote points to a file if it ends with / (Nick Craig-Wood)
  • Sharefile:
  • Disable streamed transfers as they no longer work (Nick Craig-Wood)
  • Smb:
  • Code cleanup to avoid overwriting ctx before first use (fixes issue reported by the staticcheck linter) (albertony)
  • Storj:
  • Fix "uplink: too many requests" errors when uploading to the same file (Nick Craig-Wood)
  • Fix uploading to the wrong object on Update with overriden remote name (Nick Craig-Wood)
  • Swift:
  • Ignore 404 error when deleting an object (Nick Craig-Wood)
  • Union:
  • Implement missing methods (Nick Craig-Wood)
  • Allow errors to be unwrapped for inspection (Nick Craig-Wood)
  • Uptobox:
  • Add --uptobox-private flag to make all uploaded files private (Nick Craig-Wood)
  • Fix improper regex (Aaron Gokaslan)
  • Fix Update returning the wrong object (Nick Craig-Wood)
  • Fix rmdir declaring that directories weren't empty (Nick Craig-Wood)
  • WebDAV:
  • nextcloud: Add support for chunked uploads (Paul)
  • Set modtime using propset for owncloud and nextcloud (WeidiDeng)
  • Make pacer minSleep configurable with --webdav-pacer-min-sleep (ed)
  • Fix server side copy/move not overwriting (WeidiDeng)
  • Fix modtime on server side copy for owncloud and nextcloud (Nick Craig-Wood)
  • Yandex:
  • Fix 400 Bad Request on transfer failure (Nick Craig-Wood)
  • Zoho:
  • Fix downloads with Range: header returning the wrong data (Nick Craig-Wood)

New in Rclone 1.62.2 (Mar 16, 2023)

  • Bug Fixes:
  • docker volume plugin: Add missing fuse3 dependency (Nick Craig-Wood)
  • docs: Fix size documentation (asdffdsazqqq)
  • FTP:
  • Fix 426 errors on downloads with vsftpd (Lesmiscore)

New in Rclone 1.62.1 (Mar 15, 2023)

  • Bug Fixes:
  • Docker: Add missing fuse3 dependency (cycneuramus)
  • Build: Update release docs to be more careful with the tag (Nick Craig-Wood)
  • Build: Set Github release to draft while uploading binaries (Nick Craig-Wood)

New in Rclone 1.62.0 (Mar 14, 2023)

  • New Features:
  • Accounting: Make checkers show what they are doing (Nick Craig-Wood)
  • Authorize: Add support for custom templates (Hunter Wittenborn)
  • Build
  • Update to go1.20 (Nick Craig-Wood, Anagh Kumar Baranwal)
  • Add winget releaser workflow (Ryan Caezar Itang)
  • Add dependabot (Ryan Caezar Itang)
  • Doc updates (albertony, Bryan Kaplan, Gerard Bosch, IMTheNachoMan, Justin Winokur, Manoj Ghosh, Nick Craig-Wood, Ole Frost, Peter Brunner, piyushgarg, Ryan Caezar Itang, Simmon Li, ToBeFree)
  • Filter: Emit INFO message when can't work out directory filters (Nick Craig-Wood)
  • Added multiple ca certificate support. (alankrit)
  • Add --max-delete-size a delete size threshold (Leandro Sacchet)
  • Fspath: Allow the symbols @ and + in remote names (albertony)
  • Lib/terminal: Enable windows console virtual terminal sequences processing (ANSI/VT100 colors) (albertony)
  • Move: If --check-first and --order-by are set then delete with perfect ordering (Nick Craig-Wood)
  • Serve http: Support --auth-proxy (Matthias Baur)
  • Bug Fixes:
  • Accounting
  • Avoid negative ETA values for very slow speeds (albertony)
  • Limit length of ETA string (albertony)
  • Show human readable elapsed time when longer than a day (albertony)
  • All: Apply codeql fixes (Aaron Gokaslan)
  • Build
  • Fix condition for manual workflow run (albertony)
  • Fix building for ARMv5 and ARMv6 (albertony)
  • Selfupdate: Consider ARM version
  • Install.sh: fix ARMv6 download
  • Version: Report ARM version
  • Deletefile: Return error code 4 if file does not exist (Nick Craig-Wood)
  • Docker: Fix volume plugin does not remount volume on docker restart (logopk)
  • Fs: Fix race conditions in --max-delete and --max-delete-size (Nick Craig-Wood)
  • Lib/oauthutil: Handle fatal errors better (Alex Chen)
  • Mount2: Fix --allow-non-empty (Nick Craig-Wood)
  • Operations: Fix concurrency: use --checkers unless transferring files (Nick Craig-Wood)
  • Serve ftp: Fix timestamps older than 1 year in listings (Nick Craig-Wood)
  • Sync: Fix concurrency: use --checkers unless transferring files (Nick Craig-Wood)
  • Tree
  • Fix nil pointer exception on stat failure (Nick Craig-Wood)
  • Fix colored output on windows (albertony)
  • Fix display of files with illegal Windows file system names (Nick Craig-Wood)
  • Mount:
  • Fix creating and renaming files on case insensitive backends (Nick Craig-Wood)
  • Do not treat \? prefixed paths as network share paths on windows (albertony)
  • Fix check for empty mount point on Linux (Nick Craig-Wood)
  • Fix --allow-non-empty (Nick Craig-Wood)
  • Avoid incorrect or premature overlap check on windows (albertony)
  • Update to fuse3 after bazil.org/fuse update (Nick Craig-Wood)
  • VFS:
  • Make uploaded files retain modtime with non-modtime backends (Nick Craig-Wood)
  • Fix incorrect modtime on fs which don't support setting modtime (Nick Craig-Wood)
  • Fix rename of directory containing files to be uploaded (Nick Craig-Wood)
  • Local:
  • Fix %!w(<nil>) in "failed to read directory" error (Marks Polakovs)
  • Fix exclusion of dangling symlinks with -L/--copy-links (Nick Craig-Wood)
  • Crypt:
  • Obey --ignore-checksum (Nick Craig-Wood)
  • Fix for unencrypted directory names on case insensitive remotes (Ole Frost)
  • Azure Blob:
  • Remove workarounds for SDK bugs after v0.6.1 update (Nick Craig-Wood)
  • B2:
  • Fix uploading files bigger than 1TiB (Nick Craig-Wood)
  • Drive:
  • Note that --drive-acknowledge-abuse needs SA Manager permission (Nick Craig-Wood)
  • Make --drive-stop-on-upload-limit to respond to storageQuotaExceeded (Ninh Pham)
  • FTP:
  • Retry 426 errors (Nick Craig-Wood)
  • Retry errors when initiating downloads (Nick Craig-Wood)
  • Revert to upstream github.com/jlaffaye/ftp now fix is merged (Nick Craig-Wood)
  • Google Cloud Storage:
  • Add --gcs-env-auth to pick up IAM credentials from env/instance (Peter Brunner)
  • Mega:
  • Add --mega-use-https flag (NodudeWasTaken)
  • Onedrive:
  • Default onedrive personal to QuickXorHash as Microsoft is removing SHA1 (Nick Craig-Wood)
  • Add --onedrive-hash-type to change the hash in use (Nick Craig-Wood)
  • Improve speed of QuickXorHash (LXY)
  • Oracle Object Storage:
  • Speed up operations by using S3 pacer and setting minsleep to 10ms (Manoj Ghosh)
  • Expose the storage_tier option in config (Manoj Ghosh)
  • Bring your own encryption keys (Manoj Ghosh)
  • S3:
  • Check multipart upload ETag when --s3-no-head is in use (Nick Craig-Wood)
  • Add --s3-sts-endpoint to specify STS endpoint (Nick Craig-Wood)
  • Fix incorrect tier support for StorJ and IDrive when pointing at a file (Ole Frost)
  • Fix AWS STS failing if --s3-endpoint is set (Nick Craig-Wood)
  • Make purge remove directory markers too (Nick Craig-Wood)
  • Seafile:
  • Renew library password (Fred)
  • SFTP:
  • Fix uploads being 65% slower than they should be with crypt (Nick Craig-Wood)
  • Smb:
  • Allow SPN (service principal name) to be configured (Nick Craig-Wood)
  • Check smb connection is closed (happyxhw)
  • Storj:
  • Implement rclone link (Kaloyan Raev)
  • Implement rclone purge (Kaloyan Raev)
  • Update satellite urls and labels (Kaloyan Raev)
  • WebDAV:
  • Fix interop with davrods server (Nick Craig-Wood)

New in Rclone 1.61.1 (Dec 24, 2022)

  • Bug Fixes
  • Docs:
  • Show only significant parts of version number in version introduced label (albertony)
  • Fix unescaped HTML (Nick Craig-Wood)
  • Lib/http: Shutdown all servers on exit to remove unix socket (Nick Craig-Wood)
  • Rc: Fix --rc-addr flag (which is an alternate for --url) (Anagh Kumar Baranwal)
  • Serve restic
  • Don't serve via http if serving via --stdio (Nick Craig-Wood)
  • Fix immediate exit when not using stdio (Nick Craig-Wood)
  • Serve webdav
  • Fix --baseurl handling after lib/http refactor (Nick Craig-Wood)
  • Fix running duplicate Serve call (Nick Craig-Wood)
  • Azure Blob
  • Fix "409 Public access is not permitted on this storage account" (Nick Craig-Wood)
  • Storj: Update endpoints (Kaloyan Raev)

New in Rclone 1.61.0 (Dec 21, 2022)

  • New backends:
  • New S3 providers
  • Liara LOS (MohammadReza)
  • New Features:
  • Build: Add vulnerability testing using govulncheck (albertony)
  • Cmd: Enable SIGINFO (Ctrl-T) handler on FreeBSD, NetBSD, OpenBSD and Dragonfly BSD (x3-apptech)
  • Config: Add config/setpath for setting config path via rc/librclone (Nick Craig-Wood)
  • Dedupe
  • Count Checks in the stats while scanning for duplicates (Nick Craig-Wood)
  • Make dedupe obey the filters (Nick Craig-Wood)
  • Dlna: Properly attribute code used from https://github.com/anacrolix/dms (Nick Craig-Wood)
  • Docs
  • Add minimum versions and status badges to backend and command docs (Nick Craig-Wood, albertony)
  • Remote names may not start or end with space (albertony)
  • Filter: Add metadata filters --metadata-include/exclude/filter and friends (Nick Craig-Wood)
  • Make all duration flags take y, M, w, d etc suffixes (Nick Craig-Wood)
  • Add global flag --color to control terminal colors (Kevin Verstaen)
  • Fspath: Allow unicode numbers and letters in remote names (albertony)
  • Lib/file: Improve error message for creating dir on non-existent network host on windows (albertony)
  • Lib/http: Finish port of rclone servers to lib/http (Tom Mombourquette, Nick Craig-Wood)
  • Lib/oauthutil: Improved usability of config flows needing web browser (Ole Frost)
  • Ncdu
  • Add support for modification time (albertony)
  • Fallback to sort by name also for sort by average size (albertony)
  • Rework to use tcell directly instead of the termbox wrapper (eNV25)
  • Rc: Add commands to set GC Percent & Memory Limit (go 1.19+) (Anagh Kumar Baranwal)
  • Rcat: Preserve metadata when Copy falls back to Rcat (Nick Craig-Wood)
  • Rcd: Refactor rclone rc server to use lib/http (Nick Craig-Wood)
  • Rcserver: Avoid generating default credentials with htpasswd (Kamui)
  • Restic: Refactor to use lib/http (Nolan Woods)
  • Serve http: Support unix sockets and multiple listeners (Tom Mombourquette)
  • Serve webdav: Refactor to use lib/http (Nick Craig-Wood)
  • Test: Replace defer cleanup with t.Cleanup (Eng Zer Jun)
  • Test memory: Read metadata if -M flag is specified (Nick Craig-Wood)
  • Wasm: Comply with wasm_exec.js licence terms (Matthew Vernon)
  • Bug Fixes:
  • Build: Update golang.org/x/net/http2 to fix GO-2022-1144 (Nick Craig-Wood)
  • Restic: Fix typo in docs 'remove' should be 'remote' (asdffdsazqqq)
  • Serve dlna: Fix panic: Logger uninitialized. (Nick Craig-Wood)
  • Mount:
  • Update cgofuse for FUSE-T support for mounting volumes on Mac (Nick Craig-Wood)
  • VFS:
  • Windows: fix slow opening of exe files by not truncating files when not necessary (Nick Craig-Wood)
  • Fix IO Error opening a file with O_CREATE|O_RDONLY in --vfs-cache-mode not full (Nick Craig-Wood)
  • Crypt:
  • Fix compress wrapping crypt giving upload errors (Nick Craig-Wood)
  • Azure Blob:
  • Port to new SDK (Nick Craig-Wood)
  • Revamp authentication to include all methods and docs (Nick Craig-Wood)
  • Port old authentication methods to new SDK (Nick Craig-Wood, Brad Ackerman)
  • Thanks to Stonebranch for sponsoring this work.
  • Add --azureblob-no-check-container to assume container exists (Nick Craig-Wood)
  • Add --use-server-modtime support (Abdullah Saglam)
  • Add support for custom upload headers (rkettelerij)
  • Allow emulator account/key override (Roel Arents)
  • Support simple "environment credentials" (Nathaniel Wesley Filardo)
  • Ignore AuthorizationFailure when trying to create a create a container (Nick Craig-Wood)
  • Box:
  • Added note on Box API rate limits (Ole Frost)
  • Drive:
  • Handle shared drives with leading/trailing space in name (related to) (albertony)
  • FTP:
  • Update help text of implicit/explicit TLS options to refer to FTPS instead of FTP (ycdtosa)
  • Improve performance to speed up --files-from and NewObject (Anthony Pessy)
  • HTTP:
  • Parse GET responses when no_head is set (Arnie97)
  • Do not update object size based on Range requests (Arnie97)
  • Support Content-Range response header (Arnie97)
  • Onedrive:
  • Document workaround for shared with me files (vanplus)
  • S3:
  • Add Liara LOS to provider list (MohammadReza)
  • Add DigitalOcean Spaces regions sfo3, fra1, syd1 (Jack)
  • Avoid privileged GetBucketLocation to resolve s3 region (Anthony Pessy)
  • Stop setting object and bucket ACL to private if it is an empty string (Philip Harvey)
  • If bucket or object ACL is empty string then don't add X-Amz-Acl: header (Nick Craig-Wood)
  • Reduce memory consumption for s3 objects (Erik Agterdenbos)
  • Fix listing loop when using v2 listing on v1 server (Nick Craig-Wood)
  • Fix nil pointer exception when using Versions (Nick Craig-Wood)
  • Fix excess memory usage when using versions (Nick Craig-Wood)
  • Ignore versionIDs from uploads unless using --s3-versions or --s3-versions-at (Nick Craig-Wood)
  • SFTP:
  • Add configuration options to set ssh Ciphers / MACs / KeyExchange (dgouju)
  • Auto-detect shell type for fish (albertony)
  • Fix NewObject with leading / (Nick Craig-Wood)
  • Smb:
  • Fix issue where spurious dot directory is created (albertony)
  • Storj:
  • Implement server side Copy (Kaloyan Raev)

New in Rclone 1.60.1 (Nov 17, 2022)

  • Bug Fixes:
  • lib/cache: Fix alias backend shutting down too soon (Nick Craig-Wood)
  • wasm: Fix walltime link error by adding up-to-date wasm_exec.js (João Henrique Franco)
  • docs:
  • Update faq.md with bisync (Samuel Johnson)
  • Corrected download links in windows install docs (coultonluke)
  • Add direct download link for windows arm64 (albertony)
  • Remove link to rclone slack as it is no longer supported (Nick Craig-Wood)
  • Faq: how to use a proxy server that requires a username and password (asdffdsazqqq)
  • Oracle-object-storage: doc fix (Manoj Ghosh)
  • Fix typo remove in rclone_serve_restic command (Joda Stößer)
  • Fix character that was incorrectly interpreted as markdown (Clément Notin)
  • VFS:
  • Fix deadlock caused by cache cleaner and upload finishing (Nick Craig-Wood)
  • Local:
  • Clean absolute paths (albertony)
  • Fix -L/--copy-links with filters missing directories (Nick Craig-Wood)
  • Mailru:
  • Note that an app password is now needed (Nick Craig-Wood)
  • Allow timestamps to be before the epoch 1970-01-01 (Nick Craig-Wood)
  • S3:
  • Add provider quirk --s3-might-gzip to fix corrupted on transfer: sizes differ (Nick Craig-Wood)
  • Allow Storj to server side copy since it seems to work now (Nick Craig-Wood)
  • Fix for unchecked err value in s3 listv2 (Aaron Gokaslan)
  • Add additional Wasabi locations (techknowlogick)
  • Smb:
  • Fix Failed to sync: context canceled at the end of syncs (Nick Craig-Wood)
  • WebDAV:
  • Fix Move/Copy/DirMove when using -server-side-across-configs (Nick Craig-Wood)

New in Rclone 1.60.0 (Oct 21, 2022)

  • New Features:
  • Update to go1.19 and make go1.17 the minimum required version (Nick Craig-Wood)
  • Install.sh: fix arm-v7 download (Ole Frost)
  • fs: Warn the user when using an existing remote name without a colon (Nick Craig-Wood)
  • httplib: Add --xxx-min-tls-version option to select minimum TLS version for HTTP servers (Robert Newson)
  • librclone: Add PHP bindings and test program (Jordi Gonzalez Muñoz)
  • operations
  • Add --server-side-across-configs global flag for any backend (Nick Craig-Wood)
  • Optimise --copy-dest and --compare-dest (Nick Craig-Wood)
  • rc: add job/stopgroup to stop group (Evan Spensley)
  • serve dlna
  • Add --announce-interval to control SSDP Announce Interval (YanceyChiew)
  • Add --interface to Specify SSDP interface names line (Simon Bos)
  • Add support for more external subtitles (YanceyChiew)
  • Add verification of addresses (YanceyChiew)
  • sync: Optimise --copy-dest and --compare-dest (Nick Craig-Wood)
  • doc updates (albertony, Alexander Knorr, anonion, João Henrique Franco, Josh Soref, Lorenzo Milesi, Marco Molteni, Mark Trolley, Ole Frost, partev, Ryan Morey, Tom Mombourquette, YFdyh000)
  • Bug Fixes:
  • Fix incorrect filtering with UseFilter context flag and wrapping backends (Nick Craig-Wood)
  • Make sure we check --files-from when looking for a single file (Nick Craig-Wood)
  • Fix mount/listmounts not returning the full Fs entered in mount/mount (Tom Mombourquette)
  • Handle external unmount when mounting (Isaac Aymerich)
  • Validate Daemon option is not set when mounting a volume via RC (Isaac Aymerich)
  • sync: Update docs and error messages to reflect fixes to overlap checks (Nick Naumann)
  • VFS
  • Reduce memory use by embedding sync.Cond (Nick Craig-Wood)
  • Reduce memory usage by re-ordering commonly used structures (Nick Craig-Wood)
  • Fix excess CPU used by VFS cache cleaner looping (Nick Craig-Wood)
  • Local
  • Obey file filters in listing to fix errors on excluded files (Nick Craig-Wood)
  • Fix "Failed to read metadata: function not implemented" on old Linux kernels (Nick Craig-Wood)
  • Compress
  • Fix crash due to nil metadata (Nick Craig-Wood)
  • Fix error handling to not use or return nil objects (Nick Craig-Wood)
  • Drive
  • Make --drive-stop-on-upload-limit obey quota exceeded error (Steve Kowalik)
  • FTP
  • Add --ftp-force-list-hidden option to show hidden items (Øyvind Heddeland Instefjord)
  • Fix hang when using ExplicitTLS to certain servers. (Nick Craig-Wood)
  • Google Cloud Storage
  • Add --gcs-endpoint flag and config parameter (Nick Craig-Wood)
  • Hubic
  • Remove backend as service has now shut down (Nick Craig-Wood)
  • Onedrive
  • Rename Onedrive(cn) 21Vianet to Vnet Group (Yen Hu)
  • Disable change notify in China region since it is not supported (Nick Craig-Wood)
  • Implement --s3-versions flag to show old versions of objects if enabled (Nick Craig-Wood)
  • Implement --s3-version-at flag to show versions of objects at a particular time (Nick Craig-Wood)
  • Implement backend versioning command to get/set bucket versioning (Nick Craig-Wood)
  • Implement Purge to purge versions and backend cleanup-hidden (Nick Craig-Wood)
  • Add --s3-decompress flag to decompress gzip-encoded files (Nick Craig-Wood)
  • Add --s3-sse-customer-key-base64 to supply keys with binary data (Richard Bateman)
  • Try to keep the maximum precision in ModTime with --user-server-modtime (Nick Craig-Wood)
  • Drop binary metadata with an ERROR message as it can't be stored (Nick Craig-Wood)
  • Add --s3-no-system-metadata to suppress read and write of system metadata (Nick Craig-Wood)
  • SFTP
  • Fix directory creation races (Lesmiscore)
  • Swift
  • Add --swift-no-large-objects to reduce HEAD requests (Nick Craig-Wood)
  • Union
  • Propagate SlowHash feature to fix hasher interaction (Lesmiscore)

New in Rclone 1.59.2 (Sep 15, 2022)

  • Bug Fixes:
  • config: Move locking to fix fatal error: concurrent map read and map write (Nick Craig-Wood)
  • Local:
  • Disable xattr support if the filesystems indicates it is not supported (Nick Craig-Wood)
  • Azure Blob:
  • Fix chunksize calculations producing too many parts (Nick Craig-Wood)
  • B2:
  • Fix chunksize calculations producing too many parts (Nick Craig-Wood)
  • S3:
  • Fix chunksize calculations producing too many parts (Nick Craig-Wood)

New in Rclone 1.59.1 (Aug 8, 2022)

  • Bug Fixes:
  • Accounting: Fix panic in core/stats-reset with unknown group (Nick Craig-Wood)
  • Build: Fix android build after GitHub actions change (Nick Craig-Wood)
  • Dlna: Fix SOAP action header parsing (Joram Schrijver)
  • Docs: Fix links to mount command from install docs (albertony)
  • Dropox: Fix ChangeNotify was unable to decrypt errors (Nick Craig-Wood)
  • Fs: Fix parsing of times and durations of the form "YYYY-MM-DD HH:MM:SS" (Nick Craig-Wood)
  • Serve sftp: Fix checksum detection (Nick Craig-Wood)
  • Sync: Add accidentally missed filter-sensitivity to --backup-dir option (Nick Naumann)
  • Combine:
  • Fix docs showing remote= instead of upstreams= (Nick Craig-Wood)
  • Throw error if duplicate directory name is specified (Nick Craig-Wood)
  • Fix errors with backends shutting down while in use (Nick Craig-Wood)
  • Dropbox:
  • Fix hang on quit with --dropbox-batch-mode off (Nick Craig-Wood)
  • Fix infinite loop on uploading a corrupted file (Nick Craig-Wood)
  • Internetarchive:
  • Ignore checksums for files using the different method (Lesmiscore)
  • Handle hash symbol in the middle of filename (Lesmiscore)
  • Jottacloud:
  • Fix working with whitelabel Elgiganten Cloud
  • Do not store username in config when using standard auth (albertony)
  • Mega:
  • Fix nil pointer exception when bad node received (Nick Craig-Wood)
  • S3:
  • Fix --s3-no-head panic: reflect: Elem of invalid type s3.PutObjectInput (Nick Craig-Wood)
  • SFTP:
  • Fix issue with WS_FTP by working around failing RealPath (albertony)
  • Union:
  • Fix duplicated files when using directories with leading / (Nick Craig-Wood)
  • Fix multiple files being uploaded when roots don't exist (Nick Craig-Wood)
  • Fix panic due to misalignment of struct field in 32 bit architectures (r-ricci)

New in Rclone 1.59.0 (Jul 10, 2022)

  • New backends:
  • Combine multiple remotes in one directory tree (Nick Craig-Wood)
  • Hidrive (Ovidiu Victor Tatar)
  • Internet Archive (Lesmiscore (Naoya Ozaki))
  • New S3 providers:
  • ArvanCloud AOS (ehsantdy)
  • Cloudflare R2 (Nick Craig-Wood)
  • Huawei OBS (m00594701)
  • IDrive e2 (vyloy)
  • New commands:
  • test makefile: Create a single file for testing (Nick Craig-Wood)
  • New Features:
  • Metadata framework to read and write system and user metadata on backends (Nick Craig-Wood)
  • Implemented initially for local, s3 and internetarchive backends
  • metadata/-M flag to control whether metadata is copied
  • metadata-set flag to specify metadata for uploads
  • Thanks to Manz Solutions for sponsoring this work.
  • build:
  • Update to go1.18 and make go1.16 the minimum required version (Nick Craig-Wood)
  • Update android go build to 1.18.x and NDK to 23.1.7779620 (Nick Craig-Wood)
  • All windows binaries now no longer CGO (Nick Craig-Wood)
  • Add linux/arm/v6 to docker images (Nick Craig-Wood)
  • A huge number of fixes found with staticcheck (albertony)
  • Configurable version suffix independent of version number (albertony)
  • check: Implement --no-traverse and --no-unicode-normalization (Nick Craig-Wood)
  • config: Readability improvements (albertony)
  • copyurl: Add --header-filename to honor the HTTP header filename directive (J-P Treen)
  • filter: Allow multiple --exclude-if-present flags (albertony)
  • fshttp: Add --disable-http-keep-alives to disable HTTP Keep Alives (Nick Craig-Wood)
  • install.sh
  • Set the modes on the files and/or directories on macOS (Michael C Tiernan - MIT-Research Computing Project)
  • Pre verify sudo authorization -v before calling curl. (Michael C Tiernan - MIT-Research Computing Project)
  • lib/encoder: Add Semicolon encoding (Nick Craig-Wood)
  • lsf: Add metadata support with M flag (Nick Craig-Wood)
  • lsjson: Add --metadata/-M flag (Nick Craig-Wood)
  • ncdu:
  • Implement multi selection (CrossR)
  • Replace termbox with tcell's termbox wrapper (eNV25)
  • Display correct path in delete confirmation dialog (Roberto Ricci)
  • operations:
  • Speed up hash checking by aborting the other hash if first returns nothing (Nick Craig-Wood)
  • Use correct src/dst in some log messages (zzr93)
  • rcat: Check checksums by default like copy does (Nick Craig-Wood)
  • selfupdate: Replace deprecated x/crypto/openpgp package with ProtonMail/go-crypto (albertony)
  • serve ftp: Check --passive-port arguments are correct (Nick Craig-Wood)
  • size: Warn about inaccurate results when objects with unknown size (albertony)
  • sync: Overlap check is now filter-sensitive so --backup-dir can be in the root provided it is filtered (Nick)
  • test info: Check file name lengths using 1,2,3,4 byte unicode characters (Nick Craig-Wood)
  • test makefile(s): --sparse, --zero, --pattern, --ascii, --chargen flags to control file contents (Nick Craig-Wood)
  • Make sure we call the Shutdown method on backends (Martin Czygan)
  • Bug Fixes:
  • accounting: Fix unknown length file transfers counting 3 transfers each (buda)
  • ncdu: Fix issue where dir size is summed when file sizes are -1 (albertony)
  • sync/copy/move
  • Fix --fast-list --create-empty-src-dirs and --exclude (Nick Craig-Wood)
  • Fix --max-duration and --cutoff-mode soft (Nick Craig-Wood)
  • Fix fs cache unpin (Martin Czygan)
  • Set proper exit code for errors that are not low-level retried (e.g. size/timestamp changing) (albertony)
  • Mount:
  • Support windows/arm64 (may still be problems - see #5828) (Nick Craig-Wood)
  • Log IO errors at ERROR level (Nick Craig-Wood)
  • Ignore _netdev mount argument (Hugal31)
  • VFS:
  • Add --vfs-fast-fingerprint for less accurate but faster fingerprints (Nick Craig-Wood)
  • Add --vfs-disk-space-total-size option to manually set the total disk space (Claudio Maradonna)
  • vfscache: Fix fatal error: sync: unlock of unlocked mutex error (Nick Craig-Wood)
  • Local
  • Fix parsing of --local-nounc flag (Nick Craig-Wood)
  • Add Metadata support (Nick Craig-Wood)
  • Crypt:
  • Support metadata (Nick Craig-Wood)
  • Azure Blob:
  • Calculate Chunksize/blocksize to stay below maxUploadParts (Leroy van Logchem)
  • Use chunksize lib to determine chunksize dynamically (Derek Battams)
  • Case insensitive access tier (Rob Pickerill)
  • Allow remote emulator (azurite) (Lorenzo Maiorfi)
  • B2:
  • Add --b2-version-at flag to show file versions at time specified (SwazRGB)
  • Use chunksize lib to determine chunksize dynamically (Derek Battams)
  • Chunker:
  • Mark as not supporting metadata (Nick Craig-Wood)
  • Compress:
  • Support metadata (Nick Craig-Wood)
  • Drive:
  • Make backend config -o config add a combined AllDrives: remote (Nick Craig-Wood)
  • Make --drive-shared-with-me work with shared drives (Nick Craig-Wood)
  • Add --drive-resource-key for accessing link-shared files (Nick Craig-Wood)
  • Add backend commands exportformats and importformats for debugging (Nick Craig-Wood)
  • Fix 404 errors on copy/server side copy objects from public folder (Nick Craig-Wood)
  • Update Internal OAuth consent screen docs (Phil Shackleton)
  • Moved root_folder_id to advanced section (Abhiraj)
  • Dropbox:
  • Migrate from deprecated api (m8rge)
  • Add logs to show when poll interval limits are exceeded (Nick Craig-Wood)
  • Fix nil pointer exception on dropbox impersonate user not found (Nick Craig-Wood)
  • Fichier:
  • Parse api error codes and them accordingly (buengese)
  • FTP:
  • Add support for disable_utf8 option (Jason Zheng)
  • Revert to upstream github.com/jlaffaye/ftp from our fork (Nick Craig-Wood)
  • Google Cloud Storage:
  • Add --gcs-no-check-bucket to minimise transactions and perms (Nick Gooding)
  • Add --gcs-decompress flag to decompress gzip-encoded files (Nick Craig-Wood)
  • by default these will be downloaded compressed (which previously failed)
  • Hasher:
  • Support metadata (Nick Craig-Wood)
  • HTTP:
  • Fix missing response when using custom auth handler (albertony)
  • Jottacloud:
  • Add support for upload to custom device and mountpoint (albertony)
  • Always store username in config and use it to avoid initial API request (albertony)
  • Fix issue with server-side copy when destination is in trash (albertony)
  • Fix listing output of remote with special characters (albertony)
  • Mailru:
  • Fix timeout by using int instead of time.Duration for keeping number of seconds (albertony)
  • Mega:
  • Document using MEGAcmd to help with login failures (Art M. Gallagher)
  • Onedrive:
  • Implement --poll-interval for onedrive (Hugo Laloge)
  • Add access scopes option (Sven Gerber)
  • Opendrive
  • Resolve lag and truncate bugs (Scott Grimes)
  • Pcloud:
  • Fix about with no free space left (buengese)
  • Fix cleanup (buengese)
  • S3:
  • Use PUT Object instead of presigned URLs to upload single part objects (Nick Craig-Wood)
  • Backend restore command to skip non-GLACIER objects (Vincent Murphy)
  • Use chunksize lib to determine chunksize dynamically (Derek Battams)
  • Retry RequestTimeout errors (Nick Craig-Wood)
  • Implement reading and writing of metadata (Nick Craig-Wood)
  • SFTP:
  • Add support for about and hashsum on windows server (albertony)
  • Use vendor-specific VFS statistics extension for about if available (albertony)
  • Add --sftp-chunk-size to control packets sizes for high latency links (Nick Craig-Wood)
  • Add --sftp-concurrency to improve high latency transfers (Nick Craig-Wood)
  • Add --sftp-set-env option to set environment variables (Nick Craig-Wood)
  • Add Hetzner Storage Boxes to supported sftp backends (Anthrazz)
  • Storj:
  • Fix put which lead to the file being unreadable when using mount (Erik van Velzen)
  • Union:
  • Add min_free_space option for lfs/eplfs policies (Nick Craig-Wood)
  • Fix uploading files to union of all bucket based remotes (Nick Craig-Wood)
  • Fix get free space for remotes which don't support it (Nick Craig-Wood)
  • Fix eplus policy to select correct entry for existing files (Nick Craig-Wood)
  • Support metadata (Nick Craig-Wood)
  • Uptobox:
  • Fix root path handling (buengese)
  • WebDAV:
  • Add SharePoint in other specific regions support (Noah Hsu)
  • Yandex:
  • Handle api error on server-side move (albertony)
  • Zoho:
  • Add Japan and China regions (buengese)

New in Rclone 1.58.1 (Apr 29, 2022)

  • Bug Fixes:
  • build: Update github.com/billziss-gh to github.com/winfsp (Nick Craig-Wood)
  • filter: Fix timezone of --min-age/-max-age from UTC to local as documented (Nick Craig-Wood)
  • rc/js: Correct RC method names (Son Tr?n-Nguy?n)
  • docs
  • Fix some links to command pages (albertony)
  • Add --multi-thread-streams note to --transfers. (Zsolt Ero)
  • Mount:
  • Fix --devname and fusermount: unknown option 'fsname' when mounting via rc (Nick Craig-Wood)
  • VFS:
  • Remove wording which suggests VFS is only for mounting (Nick Craig-Wood)
  • Dropbox:
  • Fix retries of multipart uploads with incorrect_offset error (Nick Craig-Wood)
  • Google Cloud Storage:
  • Use the s3 pacer to speed up transactions (Nick Craig-Wood)
  • pacer: Default the Google pacer to a burst of 100 to fix gcs pacing (Nick Craig-Wood)
  • Jottacloud:
  • Fix scope in token request (albertony)
  • Netstorage:
  • Fix unescaped HTML in documentation (Nick Craig-Wood)
  • Make levels of headings consistent (Nick Craig-Wood)
  • Add support contacts to netstorage doc (Nil Alexandrov)
  • Onedrive:
  • Note that sharepoint also changes web files (.html, .aspx) (GH)
  • Putio:
  • Handle rate limit errors (Berkan Teber)
  • Fix multithread download and other ranged requests (rafma0)
  • S3:
  • Add ChinaMobile EOS to provider list (GuoXingbin)
  • Sync providers in config description with providers (Nick Craig-Wood)
  • SFTP:
  • Fix OpenSSH 8.8+ RSA keys incompatibility (KARBOWSKI Piotr)
  • Note that Scaleway C14 is deprecating SFTP in favor of S3 (Adrien Rey-Jarthon)
  • Storj:
  • Fix bucket creation on Move (Nick Craig-Wood)
  • WebDAV:
  • Don't override Referer if user sets it (Nick Craig-Wood)

New in Rclone 1.58.0 (Mar 18, 2022)

  • New backends:
  • Akamai Netstorage (Nil Alexandrov)
  • Seagate Lyve, SeaweedFS, Storj, RackCorp via s3 backend
  • Storj (renamed from Tardigrade - your old config files will continue working)
  • New commands:
  • bisync - experimental bidirectional cloud sync (Ivan Andreev, Chris Nelson)
  • New Features:
  • build
  • Add windows/arm64 build (rclone mount not supported yet) (Nick Craig-Wood)
  • Raise minimum go version to go1.15 (Nick Craig-Wood)
  • config: Allow dot in remote names and improve config editing (albertony)
  • dedupe: Add quit as a choice in interactive mode (albertony)
  • dlna: Change icons to the newest ones. (Alain Nussbaumer)
  • filter: Add {{ regexp }} syntax to pattern matches (Nick Craig-Wood)
  • fshttp: Add prometheus metrics for HTTP status code (Michał Matczuk)
  • hashsum: Support creating hash from data received on stdin (albertony)
  • librclone
  • Allow empty string or null input instead of empty json object (albertony)
  • Add support for mount commands (albertony)
  • operations: Add server-side moves to stats (Ole Frost)
  • rc: Allow user to disable authentication for web gui (negative0)
  • tree: Remove obsolete --human replaced by global --human-readable (albertony)
  • version: Report correct friendly-name for newer Windows 10/11 versions (albertony)
  • Bug Fixes:
  • build
  • Fix ARM architecture version in .deb packages after nfpm change (Nick Craig-Wood)
  • Hard fork github.com/jlaffaye/ftp to fix go get github.com/rclone/rclone (Nick Craig-Wood)
  • oauthutil: Fix crash when webrowser requests /robots.txt (Nick Craig-Wood)
  • operations: Fix goroutine leak in case of copy retry (Ankur Gupta)
  • rc:
  • Fix operations/publiclink default for expires parameter (Nick Craig-Wood)
  • Fix missing computation of transferQueueSize when summing up statistics group (Carlo Mion)
  • Fix missing StatsInfo fields in the computation of the group sum (Carlo Mion)
  • sync: Fix --max-duration so it doesn't retry when the duration is exceeded (Nick Craig-Wood)
  • touch: Fix issue where a directory is created instead of a file (albertony)
  • Mount:
  • Add --devname to set the device name sent to FUSE for mount display (Nick Craig-Wood)
  • VFS:
  • Add vfs/stats remote control to show statistics (Nick Craig-Wood)
  • Fix failed to _ensure cache internal error: downloaders is nil error (Nick Craig-Wood)
  • Fix handling of special characters in file names (Bumsu Hyeon)
  • Local:
  • Fix hash invalidation which caused errors with local crypt mount (Nick Craig-Wood)
  • Crypt:
  • Add base64 and base32768 filename encoding options (Max Sum, Sinan Tan)
  • Azure Blob:
  • Implement --azureblob-upload-concurrency parameter to speed uploads (Nick Craig-Wood)
  • Remove 100MB upper limit on chunk_size as it is no longer needed (Nick Craig-Wood)
  • Raise --azureblob-upload-concurrency to 16 by default (Nick Craig-Wood)
  • Fix crash with SAS URL and no container (Nick Craig-Wood)
  • Compress:
  • Fix crash if metadata upload failed (Nick Craig-Wood)
  • Fix memory leak (Nick Craig-Wood)
  • Drive:
  • Added --drive-copy-shortcut-content (Abhiraj)
  • Disable OAuth OOB flow (copy a token) due to Google deprecation (Nick Craig-Wood)
  • See the deprecation note.
  • Add --drive-skip-dangling-shortcuts flag (Nick Craig-Wood)
  • When using a link type --drive-export-formats shows all doc types (Nick Craig-Wood)
  • Dropbox:
  • Speed up directory listings by specifying 1000 items in a chunk (Nick Craig-Wood)
  • Save an API request when at the root (Nick Craig-Wood)
  • Fichier:
  • Implemented About functionality (Gourav T)
  • FTP:
  • Add --ftp-ask-password to prompt for password when needed (Borna Butkovic)
  • Google Cloud Storage:
  • Add missing regions (Nick Craig-Wood)
  • Disable OAuth OOB flow (copy a token) due to Google deprecation (Nick Craig-Wood)
  • See the deprecation note.
  • Googlephotos:
  • Disable OAuth OOB flow (copy a token) due to Google deprecation (Nick Craig-Wood)
  • See the deprecation note.
  • Hasher:
  • Fix crash on object not found (Nick Craig-Wood)
  • Hdfs:
  • Add file (Move) and directory move (DirMove) support (Andy Jackson)
  • HTTP:
  • Improved recognition of URL pointing to a single file (albertony)
  • Jottacloud:
  • Change API used by recursive list (ListR) (Kim)
  • Add support for Tele2 Cloud (Fredric Arklid)
  • Koofr:
  • Add Digistorage service as a Koofr provider. (jaKa)
  • Mailru
  • Fix int32 overflow on arm32 (Ivan Andreev)
  • Onedrive:
  • Add config option for oauth scope Sites.Read.All (Charlie Jiang)
  • Minor optimization of quickxorhash (Isaac Levy)
  • Add --onedrive-root-folder-id flag (Nick Craig-Wood)
  • Do not retry on 400 pathIsTooLong error (ctrl-q)
  • Pcloud:
  • Add support for recursive list (ListR) (Niels van de Weem)
  • Fix pre-1970 time stamps (Nick Craig-Wood)
  • S3:
  • Use ListObjectsV2 for faster listings (Felix Bünemann)
  • Fallback to ListObject v1 on unsupported providers (Nick Craig-Wood)
  • Use the ETag on multipart transfers to verify the transfer was OK (Nick Craig-Wood)
  • Add --s3-use-multipart-etag provider quirk to disable this on unsupported providers (Nick Craig-Wood)
  • New Providers:
  • RackCorp object storage (bbabich)
  • Seagate Lyve Cloud storage (Nick Craig-Wood)
  • SeaweedFS (Chris Lu)
  • Storj Shared gateways (Márton Elek, Nick Craig-Wood)
  • Add Wasabi AP Northeast 2 endpoint info (lindwurm)
  • Add GLACIER_IR storage class (Yunhai Luo)
  • Document Content-MD5 workaround for object-lock enabled buckets (Paulo Martins)
  • Fix multipart upload with --no-head flag (Nick Craig-Wood)
  • Simplify content length processing in s3 with download url (Logeshwaran Murugesan)
  • SFTP:
  • Add rclone to list of supported md5sum/sha1sum commands to look for (albertony)
  • Refactor so we only have one way of running remote commands (Nick Craig-Wood)
  • Fix timeout on hashing large files by sending keepalives (Nick Craig-Wood)
  • Fix unecessary seeking when uploading and downloading files (Nick Craig-Wood)
  • Update docs on how to create known_hosts file (Nick Craig-Wood)
  • Storj:
  • Rename tardigrade backend to storj backend (Nick Craig-Wood)
  • Implement server side Move for files (Nick Craig-Wood)
  • Update docs to explain differences between s3 and this backend (Elek, Márton)
  • Swift:
  • Fix About so it shows info about the current container only (Nick Craig-Wood)
  • Union:
  • Fix treatment of remotes with // in (Nick Craig-Wood)
  • Fix deadlock when one part of a multi-upload fails (Nick Craig-Wood)
  • Fix eplus policy returned nil (Vitor Arruda)
  • Yandex:
  • Add permanent deletion support (deinferno)

New in Rclone 1.57.0 (Nov 1, 2021)

  • New backends:
  • Sia: for Sia decentralized cloud (Ian Levesque, Matthew Sevey, Ivan Andreev)
  • Hasher: caches hashes and enable hashes for backends that don't support them (Ivan Andreev)
  • New commands:
  • lsjson --stat: to get info about a single file/dir and operations/stat api (Nick Craig-Wood)
  • config paths: show configured paths (albertony)
  • New Features:
  • about: Make human-readable output more consistent with other commands (albertony)
  • build
  • Use go1.17 for building and make go1.14 the minimum supported (Nick Craig-Wood)
  • Update Go to 1.16 and NDK to 22b for Android builds (x0b)
  • config
  • Support hyphen in remote name from environment variable (albertony)
  • Make temporary directory user-configurable (albertony)
  • Convert --cache-dir value to an absolute path (albertony)
  • Do not override MIME types from OS defaults (albertony)
  • docs
  • Toc styling and header levels cleanup (albertony)
  • Extend documentation on valid remote names (albertony)
  • Mention make for building and cmount tag for macos (Alex Chen)
  • ...and many more contributions to numerous to mention!
  • fs: Move with --ignore-existing will not delete skipped files (Nathan Collins)
  • hashsum
  • Treat hash values in sum file as case insensitive (Ivan Andreev)
  • Don't put ERROR or UNSUPPORTED in output (Ivan Andreev)
  • lib/encoder: Add encoding of square brackets (Ivan Andreev)
  • lib/file: Improve error message when attempting to create dir on nonexistent drive on windows (albertony)
  • lib/http: Factor password hash salt into options with default (Nolan Woods)
  • lib/kv: Add key-value database api (Ivan Andreev)
  • librclone
  • Add RcloneFreeString function (albertony)
  • Free strings in python example (albertony)
  • log: Optionally print pid in logs (Ivan Andreev)
  • ls: Introduce --human-readable global option to print human-readable sizes (albertony)
  • ncdu: Introduce key u to toggle human-readable (albertony)
  • operations: Add rmdirs -v output (Justin Winokur)
  • serve sftp
  • Generate an ECDSA server key as well as RSA (Nick Craig-Wood)
  • Generate an Ed25519 server key as well as ECDSA and RSA (albertony)
  • serve docker
  • Allow to customize proxy settings of docker plugin (Ivan Andreev)
  • Build docker plugin for multiple platforms (Thomas Stachl)
  • size: Include human-readable count (albertony)
  • touch: Add support for touching files in directory, with recursive option, filtering and --dry-run/-i (albertony)
  • tree: Option to print human-readable sizes removed in favor of global option (albertony)
  • Bug Fixes:
  • lib/http
  • Fix bad username check in single auth secret provider (Nolan Woods)
  • Fix handling of SSL credentials (Nolan Woods)
  • serve ftp: Ensure modtime is passed as UTC always to fix timezone oddities (Nick Craig-Wood)
  • serve sftp: Fix generation of server keys on windows (albertony)
  • serve docker: Fix octal umask (Ivan Andreev)
  • Mount
  • Enable rclone to be run as mount helper direct from the fstab (Ivan Andreev)
  • Use procfs to validate mount on linux (Ivan Andreev)
  • Correctly daemonize for compatibility with automount (Ivan Andreev)
  • VFS
  • Ensure names used in cache path are legal on current OS (albertony)
  • Ignore ECLOSED when truncating file handles to fix intermittent bad file descriptor error (Nick Craig-Wood)
  • Local
  • Refactor default OS encoding out from local backend into shared encoder lib (albertony)
  • Crypt
  • Return wrapped object even with --crypt-no-data-encryption (Ivan Andreev)
  • Fix uploads with --crypt-no-data-encryption (Nick Craig-Wood)
  • Azure Blob
  • Add --azureblob-no-head-object (Tatsuya Noyori)
  • Box
  • Make listings of heavily used directories more reliable (Nick Craig-Wood)
  • When doing cleanup delete as much as possible (Nick Craig-Wood)
  • Add --box-list-chunk to control listing chunk size (Nick Craig-Wood)
  • Delete items in parallel in cleanup using --checkers threads (Nick Craig-Wood)
  • Add --box-owned-by to only show items owned by the login passed (Nick Craig-Wood)
  • Retry operation_blocked_temporary errors (Nick Craig-Wood)
  • Chunker
  • Md5all must create metadata if base hash is slow (Ivan Andreev)
  • Drive
  • Speed up directory listings by constraining the API listing using the current filters (fotile96, Ivan Andreev)
  • Fix buffering for single request upload for files smaller than --drive-upload-cutoff (YenForYang)
  • Add -o config option to backend drives to make config for all shared drives (Nick Craig-Wood)
  • Dropbox
  • Add --dropbox-batch-commit-timeout to control batch timeout (Nick Craig-Wood)
  • Filefabric
  • Make backoff exponential for error_background to fix errors (Nick Craig-Wood)
  • Fix directory move after API change (Nick Craig-Wood)
  • FTP
  • Enable tls session cache by default (Ivan Andreev)
  • Add option to disable tls13 (Ivan Andreev)
  • Fix timeout after long uploads (Ivan Andreev)
  • Add support for precise time (Ivan Andreev)
  • Enable CI for ProFtpd, PureFtpd, VsFtpd (Ivan Andreev)
  • Googlephotos
  • Use encoder for album names to fix albums with control characters (Parth Shukla)
  • Jottacloud
  • Implement SetModTime to support modtime-only changes (albertony)
  • Improved error handling with SetModTime and corrupt files in general (albertony)
  • Add support for UserInfo (rclone config userinfo) feature (albertony)
  • Return direct download link from rclone link command (albertony)
  • Koofr
  • Create direct share link (Dmitry Bogatov)
  • Pcloud
  • Add sha256 support (Ken Enrique Morel)
  • Premiumizeme
  • Fix directory listing after API changes (Nick Craig-Wood)
  • Fix server side move after API change (Nick Craig-Wood)
  • Fix server side directory move after API changes (Nick Craig-Wood)
  • Add support to use CDN URL to download the file (Logeshwaran)
  • Add AWS Snowball Edge to providers examples (r0kk3rz)
  • Use a combination of SDK retries and rclone retries (Nick Craig-Wood)
  • Fix IAM Role for Service Account not working and other auth problems (Nick Craig-Wood)
  • Fix shared_credentials_file auth after reverting incorrect fix (Nick Craig-Wood)
  • Fix corrupted on transfer: sizes differ 0 vs xxxx with Ceph (Nick Craig-Wood)
  • Seafile
  • Fix error when not configured for 2fa (Fred)
  • SFTP
  • Fix timeout when doing MD5SUM of large file (Nick Craig-Wood)
  • Swift
  • Update OCI URL (David Liu)
  • Document OVH Cloud Archive (HNGamingUK)
  • Union
  • Fix rename not working with union of local disk and bucket based remote (Nick Craig-Wood)

New in Rclone 1.56.2 (Oct 2, 2021)

  • Bug Fixes:
  • serve http: Re-add missing auth to http service (Nolan Woods)
  • build: Update golang.org/x/sys to fix crash on macOS when compiled with go1.17 (Herby Gillot)
  • FTP:
  • Fix deadlock after failed update when concurrency=1 (Ivan Andreev)

New in Rclone 1.56.1 (Sep 19, 2021)

  • Bug Fixes:
  • Accounting: Fix maximum bwlimit by scaling scale max token bucket size (Nick Craig-Wood)
  • Rc: Fix speed does not update in core/stats (negative0)
  • Selfupdate: Fix --quiet option, not quite quiet (yedamo)
  • Serve http: Fix serve http exiting directly after starting (Cnly)
  • Build:
  • Apply gofmt from golang 1.17 (Ivan Andreev)
  • Update Go to 1.16 and NDK to 22b for android/any (x0b)
  • Mount:
  • Fix --daemon mode (Ivan Andreev)
  • VFS:
  • Fix duplicates on rename (Nick Craig-Wood)
  • Fix crash when truncating a just uploaded object (Nick Craig-Wood)
  • Fix issue where empty dirs would build up in cache meta dir (albertony)
  • Drive:
  • Fix instructions for auto config (Greg Sadetsky)
  • Fix lsf example without drive-impersonate (Greg Sadetsky)
  • Onedrive:
  • Handle HTTP 400 better in PublicLink (Alex Chen)
  • Clarification of the process for creating custom client_id (Mariano Absatz)
  • Pcloud:
  • Return an early error when Put is called with an unknown size (Nick Craig-Wood)
  • Try harder to delete a failed upload (Nick Craig-Wood)
  • S3:
  • Add Wasabi's AP-Northeast endpoint info (hota)
  • Fix typo in s3 documentation (Greg Sadetsky)
  • Seafile:
  • Fix 2fa config state machine (Fred)
  • SFTP:
  • Remove spurious error message on --sftp-disable-concurrent-reads (Nick Craig-Wood)
  • Sugarsync:
  • Fix initial connection after config re-arrangement (Nick Craig-Wood)

New in Rclone 1.56.0 (Jul 21, 2021)

  • New backends:
  • Uptobox (buengese)
  • New commands:
  • serve docker (Antoine GIRARD) (Ivan Andreev)
  • and accompanying docker volume plugin
  • checksum to check files against a file of checksums (Ivan Andreev)
  • this is also available as rclone md5sum -C etc
  • config touch: ensure config exists at configured location (albertony)
  • test changenotify: command to help debugging changenotify (Nick Craig-Wood)
  • Deprecations:
  • dbhashsum: Remove command deprecated a year ago (Ivan Andreev)
  • cache: Deprecate cache backend (Ivan Andreev)
  • New Features:
  • rework config system so it can be used non-interactively via cli and rc API.
  • See docs in config create
  • This is a very big change to all the backends so may cause breakages - please file bugs!
  • librclone - export the rclone RC as a C library (lewisxy) (Nick Craig-Wood)
  • Link a C-API rclone shared object into your project
  • Use the RC as an in memory interface
  • Python example supplied
  • Also supports Android and gomobile
  • fs:
  • Add --disable-http2 for global http2 disable (Nick Craig-Wood)
  • Make --dump imply -vv (Alex Chen)
  • Use binary prefixes for size and rate units (albertony)
  • Use decimal prefixes for counts (albertony)
  • Add google search widget to rclone.org (Ivan Andreev)
  • accounting: Calculate rolling average speed (Haochen Tong)
  • atexit: Terminate with non-zero status after receiving signal (Michael Hanselmann)
  • build:
  • Only run event-based workflow scripts under rclone repo with manual override (Mathieu Carbou)
  • Add Android build with gomobile (x0b)
  • check: Log the hash in use like cryptcheck does (Nick Craig-Wood)
  • version: Print os/version, kernel and bitness (Ivan Andreev)
  • config:
  • Prevent use of Windows reserved names in config file name (albertony)
  • Create config file in windows appdata directory by default (albertony)
  • Treat any config file paths with filename notfound as memory-only config (albertony)
  • Delay load config file (albertony)
  • Replace defaultConfig with a thread-safe in-memory implementation (Chris Macklin)
  • Allow config create and friends to take key=value parameters (Nick Craig-Wood)
  • Fixed issues with flags/options set by environment vars. (Ole Frost)
  • fshttp: Implement graceful DSCP error handling (Tyson Moore)
  • lib/http - provides an abstraction for a central http server that services can bind routes to (Nolan Woods)
  • Add --template config and flags to serve/data (Nolan Woods)
  • Add default 404 handler (Nolan Woods)
  • link: Use "off" value for unset expiry (Nick Craig-Wood)
  • oauthutil: Raise fatal error if token expired without refresh token (Alex Chen)
  • rcat: Add --size flag for more efficient uploads of known size (Nazar Mishturak)
  • serve sftp: Add --stdio flag to serve via stdio (Tom)
  • sync: Don't warn about --no-traverse when --files-from is set (Nick Gaya)
  • test makefiles:
  • Add --seed flag and make data generated repeatable (Nick Craig-Wood)
  • Add log levels and speed summary (Nick Craig-Wood)
  • Bug Fixes:
  • accounting: Fix startTime of statsGroups.sum (Haochen Tong)
  • cmd/ncdu: Fix out of range panic in delete (buengese)
  • config
  • Fix issues with memory-only config file paths (albertony)
  • Fix in memory config not saving on the fly backend config (Nick Craig-Wood)
  • fshttp: Fix address parsing for DSCP (Tyson Moore)
  • ncdu: Update termbox-go library to fix crash (Nick Craig-Wood)
  • oauthutil: Fix old authorize result not recognised (Cnly)
  • operations: Don't update timestamps of files in --compare-dest (Nick Gaya)
  • selfupdate: fix archive name on macos (Ivan Andreev)
  • Mount
  • Refactor before adding serve docker (Antoine GIRARD)
  • VFS:
  • Add cache reset for --vfs-cache-max-size handling at cache poll interval (Leo Luan)
  • Fix modtime changing when reading file into cache (Nick Craig-Wood)
  • Avoid unnecessary subdir in cache path (albertony)
  • Fix that umask option cannot be set as environment variable (albertony)
  • Do not print notice about missing poll-interval support when set to 0 (albertony)
  • Local:
  • Always use readlink to read symlink size for better compatibility (Nick Craig-Wood)
  • Add --local-unicode-normalization (and remove --local-no-unicode-normalization) (Nick Craig-Wood)
  • Skip entries removed concurrently with List() (Ivan Andreev)
  • Crypt:
  • Support timestamped filenames from --b2-versions (Dominik Mydlil)
  • B2:
  • Don't include the bucket name in public link file prefixes (Jeffrey Tolar)
  • Fix versions and .files with no extension (Nick Craig-Wood)
  • Factor version handling into lib/version (Dominik Mydlil)
  • Box:
  • Use upload preflight check to avoid listings in file uploads (Nick Craig-Wood)
  • Return errors instead of calling log.Fatal with them (Nick Craig-Wood)
  • Drive:
  • Switch to the Drives API for looking up shared drives (Nick Craig-Wood)
  • Fix some google docs being treated as files (Nick Craig-Wood)
  • Dropbox:
  • Add --dropbox-batch-mode flag to speed up uploading (Nick Craig-Wood)
  • Read the batch mode docs for more info
  • Set visibility in link sharing when --expire is set (Nick Craig-Wood)
  • Simplify chunked uploads (Alexey Ivanov)
  • Improve "own App IP" instructions (Ivan Andreev)
  • Fichier:
  • Check if more than one upload link is returned (Nick Craig-Wood)
  • Support downloading password protected files and folders (Florian Penzkofer)
  • Make error messages report text from the API (Nick Craig-Wood)
  • Fix move of files in the same directory (Nick Craig-Wood)
  • Check that we actually got a download token and retry if we didn't (buengese)
  • Filefabric:
  • Fix listing after change of from field from "int" to int. (Nick Craig-Wood)
  • FTP
  • Make upload error 250 indicate success (Nick Craig-Wood)
  • GCS:
  • Make compatible with gsutil's mtime metadata (database64128)
  • Clean up time format constants (database64128)
  • Google Photos:
  • Fix read only scope not being used properly (Nick Craig-Wood)
  • HTTP:
  • Replace httplib with lib/http (Nolan Woods)
  • Clean up Bind to better use middleware (Nolan Woods)
  • Jottacloud:
  • Fix legacy auth with state based config system (buengese)
  • Fix invalid url in output from link command (albertony)
  • Add no versions option (buengese)
  • Onedrive:
  • Add list_chunk option (Nick Gaya)
  • Also report root error if unable to cancel multipart upload (Cnly)
  • Fix failed to configure: empty token found error (Nick Craig-Wood)
  • Make link return direct download link (Xuanchen Wu)
  • S3:
  • Add --s3-no-head-object (Tatsuya Noyori)
  • Remove WebIdentityRoleProvider to fix crash on auth (Nick Craig-Wood)
  • Don't check to see if remote is object if it ends with / (Nick Craig-Wood)
  • Add SeaweedFS (Chris Lu)
  • Update Alibaba OSS endpoints (Chuan Zh)
  • SFTP:
  • Fix performance regression by re-enabling concurrent writes (Nick Craig-Wood)
  • Expand tilde and environment variables in configured known_hosts_file (albertony)
  • Tardigrade:
  • Upgrade to uplink v1.4.6 (Caleb Case)
  • Use negative offset (Caleb Case)
  • Add warning about too many open files (acsfer)
  • WebDAV:
  • Fix sharepoint auth over http (Nick Craig-Wood)
  • Add headers option (Antoon Prins)

New in Rclone 1.55.1 (Apr 26, 2021)

  • Bug Fixes:
  • Self-update:
  • Dont detect FUSE if build is static (Ivan Andreev)
  • Add build tag noselfupdate (Ivan Andreev)
  • Sync: Fix incorrect error reported by graceful cutoff (Nick Craig-Wood)
  • Build: Fix version numbers in android branch builds (Nick Craig-Wood)
  • Docs:
  • Contributing.md: update setup instructions for go1.16 (Nick Gaya)
  • WinFsp 2021 is out of beta (albertony)
  • Minor cleanup of space around code section (albertony)
  • Fixed some typos (albertony)
  • VFS:
  • Fix a code path which allows dirty data to be removed causing data loss (Nick Craig-Wood)
  • Compress:
  • Fix compressed name regexp (buengese)
  • Drive:
  • Fix backend copyid of google doc to directory (Nick Craig-Wood)
  • Don't open browser when service account... (Ansh Mittal)
  • Dropbox:
  • Add missing team_data.member scope for use with --impersonate (Nick Craig-Wood)
  • Fix About after scopes changes - rclone config reconnect needed (Nick Craig-Wood)
  • Fix Unable to decrypt returned paths from changeNotify (Nick Craig-Wood)
  • FTP:
  • Fix implicit TLS (Ivan Andreev)
  • Onedrive:
  • Work around for random "Unable to initialize RPS" errors (OleFrost)
  • SFTP:
  • Revert sftp library to v1.12.0 from v1.13.0 to fix performance regression (Nick Craig-Wood)
  • Fix Update ReadFrom failed: failed to send packet: EOF errors (Nick Craig-Wood)
  • Zoho:
  • Fix error when region isn't set (buengese)
  • Do not ask for mountpoint twice when using headless setup (buengese)

New in Rclone 1.55.0 (Mar 31, 2021)

  • New commands:
  • Selfupdate (Ivan Andreev)
  • Allows rclone to update itself in-place or via a package (using --package flag)
  • Reads cryptographically signed signatures for non beta releases
  • Works on all OSes.
  • Test - these are test commands - use with care!
  • Histogram - Makes a histogram of file name characters.
  • Info - Discovers file name or other limitations for paths.
  • Makefiles - Make a random file hierarchy for testing.
  • Memory - Load all the objects at remote:path into memory and report memory stats.
  • New Features
  • Connection strings
  • Config parameters can now be passed as part of the remote name as a connection string.
  • For example to do the equivalent of --drive-shared-with-me use drive,shared_with_me:
  • Make sure we don't save on the fly remote config to the config file (Nick Craig-Wood)
  • Make sure backends with additional config have a different name for caching (Nick Craig-Wood)
  • This work was sponsored by CERN, through the CS3MESH4EOSC Project.
  • CS3MESH4EOSC has received funding from the European Union’s Horizon 2020
  • Research and innovation programme under Grant Agreement no. 863353.
  • Build
  • Update go build version to go1.16 and raise minimum go version to go1.13 (Nick Craig-Wood)
  • Make a macOS ARM64 build to support Apple Silicon (Nick Craig-Wood)
  • Install macfuse 4.x instead of osxfuse 3.x (Nick Craig-Wood)
  • Use GO386=softfloat instead of deprecated GO386=387 for 386 builds (Nick Craig-Wood)
  • Disable IOS builds for the time being (Nick Craig-Wood)
  • Androids builds made with up to date NDK (x0b)
  • Add an rclone user to the Docker image but don't use it by default (cynthia kwok)
  • dedupe: Make largest directory primary to minimize data moved (Saksham Khanna)
  • config
  • Wrap config library in an interface (Fionera)
  • Make config file system pluggable (Nick Craig-Wood)
  • --config "" or "/notfound" for in memory config only (Nick Craig-Wood)
  • Clear fs cache of stale entries when altering config (Nick Craig-Wood)
  • Copyurl: Add option to print resulting auto-filename (albertony)
  • Delete: Make --rmdirs obey the filters (Nick Craig-Wood)
  • Docs - many fixes and reworks from edwardxml, albertony, pvalls, Ivan Andreev, Evan Harris, buengese, Alexey Tabakman
  • Encoder/filename - add SCSU as tables (Klaus Post)
  • Add multiple paths support to --compare-dest and --copy-dest flag (K265)
  • Filter: Make --exclude "dir/" equivalent to --exclude "dir/**" (Nick Craig-Wood)
  • Fshttp: Add DSCP support with --dscp for QoS with differentiated services (Max Sum)
  • Lib/cache: Add Delete and DeletePrefix methods (Nick Craig-Wood)
  • Lib/file
  • Make pre-allocate detect disk full errors and return them (Nick Craig-Wood)
  • Don't run preallocate concurrently (Nick Craig-Wood)
  • Retry preallocate on EINTR (Nick Craig-Wood)
  • Operations: Made copy and sync operations obey a RetryAfterError (Ankur Gupta)rc
  • Add string alternatives for setting options over the rc (Nick Craig-Wood)
  • Add options/local to see the options configured in the context (Nick Craig-Wood)
  • Add _config parameter to set global config for just this rc call (Nick Craig-Wood)
  • Implement passing filter config with _filter parameter (Nick Craig-Wood)
  • Add fscache/clear and fscache/entries to control the fs cache (Nick Craig-Wood)
  • Avoid +Inf value for speed in core/stats (albertony)
  • Add a full set of stats to core/stats (Nick Craig-Wood)
  • Allow fs= params to be a JSON blob (Nick Craig-Wood)
  • Rcd: Added systemd notification during the rclone rcd command. (Naveen Honest Raj)
  • Rmdirs: Make --rmdirs obey the filters (Nick Craig-Wood)
  • Version: Show build tags and type of executable (Ivan Andreev)
  • Bug Fixes
  • Install.sh: make it fail on download errors (Ivan Andreev)
  • Fix excessive retries missing --max-duration timeout (Nick Craig-Wood)
  • Fix crash when --low-level-retries=0 (Nick Craig-Wood)
  • Fix failed token refresh on mounts created via the rc (Nick Craig-Wood)
  • Fshttp: Fix bandwidth limiting after bad merge (Nick Craig-Wood)
  • Lib/atexit
  • Unregister interrupt handler once it has fired so users can interrupt again (Nick Craig-Wood)
  • Fix occasional failure to unmount with CTRL-C (Nick Craig-Wood)
  • Fix deadlock calling Finalise while Run is running (Nick Craig-Wood)
  • Lib/rest: Fix multipart uploads not stopping on context cancel (Nick Craig-Wood)

New in Rclone 1.54.1 (Mar 8, 2021)

  • Bug Fixes:
  • accounting: Fix --bwlimit when up or down is off (Nick Craig-Wood)
  • docs
  • Fix nesting of brackets and backticks in ftp docs (edwardxml)
  • Fix broken link in sftp page (edwardxml)
  • Fix typo in crypt.md (Romeo Kienzler)
  • Changelog: Correct link to digitalis.io (Alex JOST)
  • Replace #file-caching with #vfs-file-caching (Miron Veryanskiy)
  • Convert bogus example link to code (edwardxml)
  • Remove dead link from rc.md (edwardxml)
  • rc: Sync,copy,move: document createEmptySrcDirs parameter (Nick Craig-Wood)
  • lsjson: Fix unterminated JSON in the presence of errors (Nick Craig-Wood)
  • Mount:
  • Fix mount dropping on macOS by setting --daemon-timeout 10m (Nick Craig-Wood)
  • VFS:
  • Document simultaneous usage with the same cache shouldn't be used (Nick Craig-Wood)
  • B2:
  • Automatically raise upload cutoff to avoid spurious error (Nick Craig-Wood)
  • Fix failed to create file system with application key limited to a prefix (Nick Craig-Wood)
  • Drive:
  • Refer to Shared Drives instead of Team Drives (Nick Craig-Wood)
  • Dropbox:
  • Add scopes to oauth request and optionally "members.read" (Nick Craig-Wood)
  • S3:
  • Fix failed to create file system with folder level permissions policy (Nick Craig-Wood)
  • Fix Wasabi HEAD requests returning stale data by using only 1 transport (Nick Craig-Wood)
  • Fix shared_credentials_file auth (Dmitry Chepurovskiy)
  • Add --s3-no-head to reducing costs docs (Nick Craig-Wood)
  • Union:
  • Fix mkdir at root with remote:/ (Nick Craig-Wood)
  • Zoho:
  • Fix custom client id's (buengese)

New in Rclone 1.54.0 (Feb 2, 2021)

  • New backends
  • Compression remote (experimental) (buengese)
  • Enterprise File Fabric (Nick Craig-Wood)
  • This work was sponsored by Storage Made Easy
  • HDFS (Hadoop Distributed File System) (Yury Stankevich)
  • Zoho workdrive (buengese)
  • New Features
  • Deglobalise the config (Nick Craig-Wood)
  • Global config now read from the context
  • This will enable passing of global config via the rc
  • This work was sponsored by Digitalis
  • Add --bwlimit for upload and download (Nick Craig-Wood)
  • Obey bwlimit in http Transport for better limiting
  • Enhance systemd integration (Hekmon)
  • Log level identification, manual activation with flag, automatic systemd launch detection
  • Don't compile systemd log integration for non unix systems (Benjamin Gustin)
  • Add a --download flag to md5sum/sha1sum/hashsum to force rclone to download and hash files locally (lostheli)
  • Add --progress-terminal-title to print ETA to terminal title (LaSombra)
  • Make backend env vars show in help as the defaults for backend flags (Nick Craig-Wood)
  • Build:
  • Raise minimum go version to go1.12 (Nick Craig-Wood)
  • Dedupe:
  • Add --by-hash to dedupe on content hash not file name (Nick Craig-Wood)
  • Add --dedupe-mode list to just list dupes, changing nothing (Nick Craig-Wood)
  • Add warning if used on a remote which can't have duplicate names (Nick Craig-Wood)
  • Fs:
  • Add Shutdown optional method for backends (Nick Craig-Wood)
  • When using --files-from check files concurrently (zhucan)
  • Accumulate stats when using --dry-run (Ingo Weiss)
  • Always show stats when using --dry-run or --interactive (Nick Craig-Wood)
  • Add support for flag --no-console on windows to hide the console window (albertony)
  • Genautocomplete: Add support to output to stdout (Ingo)
  • Ncdu
  • Highlight read errors instead of aborting (Claudio Bantaloukas)
  • Add sort by average size in directory (Adam Plánský)
  • Add toggle option for average s3ize in directory - key 'a' (Adam Plánský)
  • Add empty folder flag into ncdu browser (Adam Plánský)
  • Add ! (errror) and . (unreadable) file flags to go with e (empty) (Nick Craig-Wood)
  • Obscure: Make rclone osbcure - ignore newline at end of line (Nick Craig-Wood)
  • Operations:
  • Add logs when need to upload files to set mod times (Nick Craig-Wood)
  • Move and copy log name of the destination object in verbose (Adam Plánský)
  • Add size if known to skipped items and JSON log (Nick Craig-Wood)
  • Rc:
  • Prefer actual listener address if using ":port" or "addr:0" only (Nick Craig-Wood)
  • Add listener for finished jobs (Aleksandar Jankovic)
  • Serve ftp: Add options to enable TLS (Deepak Sah)
  • Serve http/webdav: Redirect requests to the base url without the / (Nick Craig-Wood)
  • Serve restic: Implement object cache (Nick Craig-Wood)
  • Stats: Add counter for deleted directories (Nick Craig-Wood)
  • Sync: Only print "There was nothing to transfer" if no errors (Nick Craig-Wood)
  • Webui:
  • Prompt user for updating webui if an update is available (Chaitanya Bankanhal)
  • Fix plugins initialization (negative0)
  • Bug Fixes:
  • Fix nil pointer on copy & move operations directly to remote (Anagh Kumar Baranwal)
  • Fix parsing of .. when joining remotes (Nick Craig-Wood)
  • Log: Fix enabling systemd logging when using --log-file (Nick Craig-Wood)
  • Check:
  • Make the error count match up in the log message (Nick Craig-Wood)
  • Move: Fix data loss when source and destination are the same object (Nick Craig-Wood)
  • Operations:
  • Fix --cutof-mode hard not cutting off immediately (Nick Craig-Wood)
  • Fix --immutable error message (Nick Craig-Wood)
  • Sync
  • Fix --cutoff-mode soft & cautious so it doesn't end the transfer early (Nick Craig-Wood)
  • Fix --immutable errors retrying many times (Nick Craig-Wood)
  • Docs:
  • Many fixes and a rewrite of the filtering docs (edwardxml)
  • Many spelling and grammar fixes (Josh Soref)
  • Doc fixes for commands delete, purge, rmdir, rmdirs and mount (albertony)
  • Mount:
  • Update systemd status with cache stats (Hekmon)
  • Disable bazil/fuse based mount on macOS (Nick Craig-Wood)
  • Make rclone mount actually run rclone cmount under macOS (Nick Craig-Wood)
  • Implement mknod to make NFS file creation work (Nick Craig-Wood)
  • Make sure we don't call umount more than once (Nick Craig-Wood)
  • More user friendly mounting as network drive on windows (albertony)
  • Detect if uid or gid are set in same option string: -o uid=123,gid=456 (albertony)
  • Don't attempt to unmount if fs has been destroyed already (Nick Craig-Wood)
  • VFS:
  • Fix virtual entries causing deleted files to still appear (Nick Craig-Wood)
  • Fix "file already exists" error for stale cache files (Nick Craig-Wood)
  • Fix file leaks with --vfs-cache-mode full and --buffer-size 0 (Nick Craig-Wood)
  • Fix invalid cache path on windows when using :backend: as remote (albertony)
  • Local:
  • Continue listing files/folders when a circular symlink is detected (Manish Gupta)
  • New flag --local-zero-size-links to fix sync on some virtual filesystems (Riccardo Iaconelli)
  • Azure Blob:
  • Add support for service principals (James Lim)
  • Add support for managed identities (Brad Ackerman)
  • Add examples for access tier (Bob Pusateri)
  • Utilize the streaming capabilities from the SDK for multipart uploads (Denis Neuling)
  • Fix setting of mime types (Nick Craig-Wood)
  • Fix crash when listing outside a SAS URL's root (Nick Craig-Wood)
  • Delete archive tier blobs before update if --azureblob-archive-tier-delete (Nick Craig-Wood)
  • Fix crash on startup (Nick Craig-Wood)
  • Fix memory usage by upgrading the SDK to v0.13.0 and implementing a TransferManager (Nick Craig-Wood)
  • Require go1.14+ to compile due to SDK changes (Nick Craig-Wood)
  • B2:
  • Make NewObject use less expensive API calls (Nick Craig-Wood)
  • This will improve --files-from and restic serve in particular
  • Fixed crash on an empty file name (lluuaapp)
  • Box
  • Fix NewObject for files that differ in case (Nick Craig-Wood)
  • Fix finding directories in a case insentive way (Nick Craig-Wood)
  • Chunker:
  • Skip long local hashing, hash in-transit (fixes) (Ivan Andreev)
  • Set Features ReadMimeType to false as Object.MimeType not supported (Nick Craig-Wood)
  • Fix case-insensitive NewObject, test metadata detection (Ivan Andreev)
  • Drive:
  • Implement rclone backend copyid command for copying files by ID (Nick Craig-Wood)
  • Added flag --drive-stop-on-download-limit to stop transfers when the download limit is exceeded (Anagh Kumar Baranwal)
  • Implement CleanUp workaround for team drives (buengese)
  • Allow shortcut resolution and creation to be retried (Nick Craig-Wood)
  • Log that emptying the trash can take some time (Nick Craig-Wood)
  • Add xdg office icons to xdg desktop files (Pau Rodriguez-Estivill)
  • Dropbox:
  • Add support for viewing shared files and folders (buengese)
  • Enable short lived access tokens (Nick Craig-Wood)
  • Implement IDer on Objects so rclone lsf etc can read the IDs (buengese)
  • Set Features ReadMimeType to false as Object.MimeType not supported (Nick Craig-Wood)
  • Make malformed_path errors from too long files not retriable (Nick Craig-Wood)
  • Test file name length before upload to fix upload loop (Nick Craig-Wood)
  • Fichier:
  • Set Features ReadMimeType to true as Object.MimeType is supported (Nick Craig-Wood)
  • FTP:
  • Add --ftp-disable-msld option to ignore MLSD for really old servers (Nick Craig-Wood)
  • Make --tpslimit apply (Nick Craig-Wood)
  • Google Cloud Storage:
  • Storage class object header support (Laurens Janssen)
  • Fix anonymous client to use rclone's HTTP client (Nick Craig-Wood)
  • Fix Entry doesn't belong in directory "" (same as directory) - ignoring (Nick Craig-Wood)
  • Googlephotos:
  • New flag --gphotos-include-archived to show archived photos as well (Nicolas Rueff)
  • Jottacloud:
  • Don't erroneously report support for writing mime types (buengese)
  • Add support for Telia Cloud (Patrik Nordlén)
  • Mailru:
  • Accept special folders eg camera-upload (Ivan Andreev)
  • Avoid prehashing of large local files (Ivan Andreev)
  • Fix uploads after recent changes on server (Ivan Andreev)
  • Fix range requests after June 2020 changes on server (Ivan Andreev)
  • Fix invalid timestamp on corrupted files (fixes) (Ivan Andreev)
  • Remove deprecated protocol quirks (Ivan Andreev)
  • Memory:
  • Fix setting of mime types (Nick Craig-Wood)
  • Onedrive:
  • Add support for China region operated by 21vianet and other regional suppliers (NyaMisty)
  • Warn on gateway timeout errors (Nick Craig-Wood)
  • Fall back to normal copy if server-side copy unavailable (Alex Chen)
  • Fix server-side copy completely disabled on OneDrive for Business (Cnly)
  • (business only) workaround to replace existing file on server-side copy (Alex Chen)
  • Enhance link creation with expiry, scope, type and password (Nick Craig-Wood)
  • Remove % and # from the set of encoded characters (Alex Chen)
  • Support addressing site by server-relative URL (kice)
  • Opendrive;
  • Fix finding directories in a case insensitive way (Nick Craig-Wood)
  • Pcloud:
  • Fix setting of mime types (Nick Craig-Wood)
  • Premiumizeme:
  • Fix finding directories in a case insensitive way (Nick Craig-Wood)
  • Qingstor:
  • Fix error propagation in CleanUp (Nick Craig-Wood)
  • Fix rclone cleanup (Nick Craig-Wood)
  • S3:
  • Added --s3-disable-http2 to disable http/2 (Anagh Kumar Baranwal)
  • Complete SSE-C implementation (Nick Craig-Wood)
  • Fix hashes on small files with AWS:KMS and SSE-C (Nick Craig-Wood)
  • Add MD5 metadata to objects uploaded with SSE-AWS/SSE-C (Nick Craig-Wood)
  • Add --s3-no-head parameter to minimise transactions on upload (Nick Craig-Wood)
  • Update docs with a Reducing Costs section (Nick Craig-Wood)
  • Added error handling for error code 429 indicating too many requests (Anagh Kumar Baranwal)
  • Add requester pays option (kelv)
  • Fix copy multipart with v2 auth failing with 'SignatureDoesNotMatch' (Louis Koo)
  • SFTP:
  • Allow cert based auth via optional pubkey (Stephen Harris)
  • Allow user to optionally check server hosts key to add security (Stephen Harris)
  • Defer asking for user passwords until the SSH connection succeeds (Stephen Harris)
  • Remember entered password in AskPass mode (Stephen Harris)
  • Implement Shutdown method (Nick Craig-Wood)
  • Implement keyboard interactive authentication (Nick Craig-Wood)
  • Make --tpslimit apply (Nick Craig-Wood)
  • Implement --sftp-use-fstat for unusual SFTP servers (Nick Craig-Wood)
  • Sugarsync:
  • Fix NewObject for files that differ in case (Nick Craig-Wood)
  • Fix finding directories in a case insentive way (Nick Craig-Wood)
  • Swift:
  • Fix deletion of parts of Static Large Object (SLO) (Nguyễn Hữu Luân)
  • Ensure partially uploaded large files are uploaded unless --swift-leave-parts-on-error (Nguyễn Hữu Luân)
  • Tardigrade:
  • Upgrade to uplink v1.4.1 (Caleb Case)
  • WebDAV:
  • Updated docs to show streaming to nextcloud is working (Durval Menezes)
  • Yandex:
  • Set Features WriteMimeType to false as Yandex ignores mime types (Nick Craig-Wood)

New in Rclone 1.53.4 (Jan 21, 2021)

  • Bug Fixes:
  • accounting: Fix data race in Transferred() (Maciej Zimnoch)
  • build:
  • Stop tagged releases making a current beta (Nick Craig-Wood)
  • Upgrade docker buildx action (Matteo Pietro Dazzi)
  • Add -buildmode to cross-compile.go (Nick Craig-Wood)
  • Fix docker build by upgrading ilteoood/docker_buildx (Nick Craig-Wood)
  • Revert GitHub actions brew fix since this is now fixed (Nick Craig-Wood)
  • Fix brew install --cask syntax for macOS build (Nick Craig-Wood)
  • Update nfpm syntax to fix build of .deb/.rpm packages (Nick Craig-Wood)
  • Fix for Windows build errors (Ivan Andreev)
  • fs: Parseduration: fixed tests to use UTC time (Ankur Gupta)
  • fshttp: Prevent overlap of HTTP headers in logs (Nathan Collins)
  • rc:
  • Fix core/command giving 500 internal error (Nick Craig-Wood)
  • Add Copy method to rc.Params (Nick Craig-Wood)
  • Fix 500 error when marshalling errors from core/command (Nick Craig-Wood)
  • plugins: Create plugins files only if webui is enabled. (negative0)
  • serve http: Fix serving files of unknown length (Nick Craig-Wood)
  • serve sftp: Fix authentication on one connection blocking others (Nick Craig-Wood)
  • Mount:
  • Add optional brew tag to throw an error when using mount in the binaries installed via Homebrew (Anagh Kumar Baranwal)
  • Add "." and ".." to directories to match cmount and expectations (Nick Craig-Wood)
  • VFS:
  • Make cache dir absolute before using it to fix path too long errors (Nick Craig-Wood)
  • Chunker:
  • Improve detection of incompatible metadata (Ivan Andreev)
  • Google Cloud Storage:
  • Fix server side copy of large objects (Nick Craig-Wood)
  • Jottacloud:
  • Fix token renewer to fix long uploads (Nick Craig-Wood)
  • Fix token refresh failed: is not a regular file error (Nick Craig-Wood)
  • Pcloud:
  • Only use SHA1 hashes in EU region (Nick Craig-Wood)
  • Sharefile:
  • Undo Fix backend due to API swapping integers for strings (Nick Craig-Wood)
  • WebDAV:
  • Fix Open Range requests to fix 4shared mount (Nick Craig-Wood)
  • Add "Depth: 0" to GET requests to fix bitrix (Nick Craig-Wood)

New in Rclone 1.53.3 (Nov 19, 2020)

  • Bug Fixes:
  • random: Fix incorrect use of math/rand instead of crypto/rand CVE-2020-28924 (Nick Craig-Wood)
  • Passwords you have generated with rclone config may be insecure
  • See issue #4783 for more details and a checking tool
  • random: Seed math/rand in one place with crypto strong seed (Nick Craig-Wood)
  • VFS:
  • Fix vfs/refresh calls with fs= parameter (Nick Craig-Wood)
  • Sharefile:
  • Fix backend due to API swapping integers for strings (Nick Craig-Wood)

New in Rclone 1.53.2 (Oct 26, 2020)

  • Bug Fixes:
  • acounting:
  • Fix incorrect speed and transferTime in core/stats (Nick Craig-Wood)
  • Stabilize display order of transfers on Windows (Nick Craig-Wood)
  • operations:
  • Fix use of --suffix without --backup-dir (Nick Craig-Wood)
  • Fix spurious "--checksum is in use but the source and destination have no hashes in common" (Nick Craig-Wood)
  • build:
  • Work around GitHub actions brew problem (Nick Craig-Wood)
  • Stop using set-env and set-path in the GitHub actions (Nick Craig-Wood)
  • Mount:
  • mount2: Fix the swapped UID / GID values (Russell Cattelan)
  • VFS:
  • Detect and recover from a file being removed externally from the cache (Nick Craig-Wood)
  • Fix a deadlock vulnerability in downloaders.Close (Leo Luan)
  • Fix a race condition in retryFailedResets (Leo Luan)
  • Fix missed concurrency control between some item operations and reset (Leo Luan)
  • Add exponential backoff during ENOSPC retries (Leo Luan)
  • Add a missed update of used cache space (Leo Luan)
  • Fix --no-modtime to not attempt to set modtimes (as documented) (Nick Craig-Wood)
  • Local:
  • Fix sizes and syncing with --links option on Windows (Nick Craig-Wood)
  • Chunker:
  • Disable ListR to fix missing files on GDrive (workaround) (Ivan Andreev)
  • Fix upload over crypt (Ivan Andreev)
  • Fichier:
  • Increase maximum file size from 100GB to 300GB (gyutw)
  • Jottacloud:
  • Remove clientSecret from config when upgrading to token based authentication (buengese)
  • Avoid double url escaping of device/mountpoint (albertony)
  • Remove DirMove workaround as it's not required anymore - also (buengese)
  • Mailru:
  • Fix uploads after recent changes on server (Ivan Andreev)
  • Fix range requests after june changes on server (Ivan Andreev)
  • Fix invalid timestamp on corrupted files (fixes) (Ivan Andreev)
  • Onedrive:
  • Fix disk usage for sharepoint (Nick Craig-Wood)
  • S3:
  • Add missing regions for AWS (Anagh Kumar Baranwal)
  • Seafile:
  • Fix accessing libraries > 2GB on 32 bit systems (Muffin King)
  • SFTP:
  • Always convert the checksum to lower case (buengese)
  • Union:
  • Create root directories if none exist (Nick Craig-Wood)

New in Rclone 1.53.1 (Oct 26, 2020)

  • Bug Fixes:
  • acounting:
  • Fix incorrect speed and transferTime in core/stats (Nick Craig-Wood)
  • Stabilize display order of transfers on Windows (Nick Craig-Wood)
  • operations:
  • Fix use of --suffix without --backup-dir (Nick Craig-Wood)
  • Fix spurious "--checksum is in use but the source and destination have no hashes in common" (Nick Craig-Wood)
  • build:
  • Work around GitHub actions brew problem (Nick Craig-Wood)
  • Stop using set-env and set-path in the GitHub actions (Nick Craig-Wood)
  • Mount:
  • mount2: Fix the swapped UID / GID values (Russell Cattelan)
  • VFS:
  • Detect and recover from a file being removed externally from the cache (Nick Craig-Wood)
  • Fix a deadlock vulnerability in downloaders.Close (Leo Luan)
  • Fix a race condition in retryFailedResets (Leo Luan)
  • Fix missed concurrency control between some item operations and reset (Leo Luan)
  • Add exponential backoff during ENOSPC retries (Leo Luan)
  • Add a missed update of used cache space (Leo Luan)
  • Fix --no-modtime to not attempt to set modtimes (as documented) (Nick Craig-Wood)
  • Local:
  • Fix sizes and syncing with --links option on Windows (Nick Craig-Wood)
  • Chunker:
  • Disable ListR to fix missing files on GDrive (workaround) (Ivan Andreev)
  • Fix upload over crypt (Ivan Andreev)
  • Fichier:
  • Increase maximum file size from 100GB to 300GB (gyutw)
  • Jottacloud:
  • Remove clientSecret from config when upgrading to token based authentication (buengese)
  • Avoid double url escaping of device/mountpoint (albertony)
  • Remove DirMove workaround as it's not required anymore - also (buengese)
  • Mailru:
  • Fix uploads after recent changes on server (Ivan Andreev)
  • Fix range requests after june changes on server (Ivan Andreev)
  • Fix invalid timestamp on corrupted files (fixes) (Ivan Andreev)
  • Onedrive:
  • Fix disk usage for sharepoint (Nick Craig-Wood)
  • S3:
  • Add missing regions for AWS (Anagh Kumar Baranwal)
  • Seafile:
  • Fix accessing libraries > 2GB on 32 bit systems (Muffin King)
  • SFTP:
  • Always convert the checksum to lower case (buengese)
  • Union:
  • Create root directories if none exist (Nick Craig-Wood)

New in Rclone 1.53.1 (Sep 13, 2020)

  • Bug Fixes:
  • accounting: Remove new line from end of --stats-one-line display (Nick Craig-Wood)
  • check:
  • Add back missing --download flag (Nick Craig-Wood)
  • Fix docs (Nick Craig-Wood)
  • docs:
  • Note --log-file does append (Nick Craig-Wood)
  • Add full stops for consistency in rclone --help (edwardxml)
  • Add Tencent COS to s3 provider list (wjielai)
  • Updated mount command to reflect that it requires Go 1.13 or newer (Evan Harris)
  • jottacloud: Mention that uploads from local disk will not need to cache files to disk for md5 calculation (albertony)
  • Fix formatting of rc docs page (Nick Craig-Wood)
  • build:
  • Include vendor tar ball in release and fix startdev (Nick Craig-Wood)
  • Fix "Illegal instruction" error for ARMv6 builds (Nick Craig-Wood)
  • Fix architecture name in ARMv7 build (Nick Craig-Wood)
  • VFS:
  • Fix spurious error "vfs cache: failed to _ensure cache EOF" (Nick Craig-Wood)
  • Log an ERROR if we fail to set the file to be sparse (Nick Craig-Wood)
  • Local:
  • Log an ERROR if we fail to set the file to be sparse (Nick Craig-Wood)
  • Drive:
  • Re-adds special oauth help text (Tim Gallant)
  • Opendrive:
  • Do not retry 400 errors (Evan Harris)

New in Rclone 1.53.0 (Sep 3, 2020)

  • New Features:
  • The VFS layer was heavily reworked for this release - see below for more details
  • Interactive mode -i/--interactive for destructive operations (fishbullet)
  • Add --bwlimit-file flag to limit speeds of individual file transfers (Nick Craig-Wood)
  • Transfers are sorted by start time in the stats and progress output (Max Sum)
  • Make sure backends expand ~ and environment vars in file names they use (Nick Craig-Wood)
  • Add --refresh-times flag to set modtimes on hashless backends (Nick Craig-Wood)
  • build:
  • Remove vendor directory in favour of Go modules (Nick Craig-Wood)
  • Build with go1.15.x by default (Nick Craig-Wood)
  • Drop macOS 386 build as it is no longer supported by go1.15 (Nick Craig-Wood)
  • Add ARMv7 to the supported builds (Nick Craig-Wood)
  • Enable rclone cmount on macOS (Nick Craig-Wood)
  • Make rclone build with gccgo (Nick Craig-Wood)
  • Make rclone build with wasm (Nick Craig-Wood)
  • Change beta numbering to be semver compatible (Nick Craig-Wood)
  • Add file properties and icon to Windows executable (albertony)
  • Add experimental interface for integrating rclone into browsers (Nick Craig-Wood)
  • lib: Add file name compression (Klaus Post)
  • rc:
  • Allow installation and use of plugins and test plugins with rclone-webui (Chaitanya Bankanhal)
  • Add reverse proxy pluginsHandler for serving plugins (Chaitanya Bankanhal)
  • Add mount/listmounts option for listing current mounts (Chaitanya Bankanhal)
  • Add operations/uploadfile to upload a file through rc using encoding multipart/form-data (Chaitanya Bankanhal)
  • Add core/copmmand to execute rclone terminal commands. (Chaitanya Bankanhal)
  • rclone check:
  • Add reporting of filenames for same/missing/changed (Nick Craig-Wood)
  • Make check command obey --dry-run/-i/--interactive (Nick Craig-Wood)
  • Make check do --checkers files concurrently (Nick Craig-Wood)
  • Retry downloads if they fail when using the --download flag (Nick Craig-Wood)
  • Make it show stats by default (Nick Craig-Wood)
  • rclone obscure: Allow obscure command to accept password on STDIN (David Ibarra)
  • rclone config:
  • Set RCLONE_CONFIG_DIR for use in config files and subprocesses (Nick Craig-Wood)
  • Reject remote names starting with a dash. (jtagcat)
  • rclone cryptcheck: Add reporting of filenames for same/missing/changed (Nick Craig-Wood)
  • rclone dedupe: Make it obey the --size-only flag for duplicate detection (Nick Craig-Wood)
  • rclone link: Add --expire and --unlink flags (Roman Kredentser)
  • rclone mkdir: Warn when using mkdir on remotes which can't have empty directories (Nick Craig-Wood)
  • rclone rc: Allow JSON parameters to simplify command line usage (Nick Craig-Wood)
  • rclone serve ftp:
  • Don't compile on < go1.13 after dependency update (Nick Craig-Wood)
  • Add error message if auth proxy fails (Nick Craig-Wood)
  • Use refactored goftp.io/server library for binary shrink (Nick Craig-Wood)
  • rclone serve restic: Expose interfaces so that rclone can be used as a library from within restic (Jack)
  • rclone sync: Add --track-renames-strategy leaf (Nick Craig-Wood)
  • rclone touch: Add ability to set nanosecond resolution times (Nick Craig-Wood)
  • rclone tree: Remove -i shorthand for --noindent as it conflicts with -i/--interactive (Nick Craig-Wood)
  • Bug Fixes:
  • accounting:
  • Fix documentation for speed/speedAvg (Nick Craig-Wood)
  • Fix elapsed time not show actual time since beginning (Chaitanya Bankanhal)
  • Fix deadlock in stats printing (Nick Craig-Wood)
  • build:
  • Fix file handle leak in GitHub release tool (Garrett Squire)
  • rclone check: Fix successful retries with --download counting errors (Nick Craig-Wood)
  • rclone dedupe: Fix logging to be easier to understand (Nick Craig-Wood)
  • Mount:
  • Warn macOS users that mount implementation is changing (Nick Craig-Wood)
  • to test the new implementation use rclone cmount instead of rclone mount
  • this is because the library rclone uses has dropped macOS support
  • rc interface
  • Add call for unmount all (Chaitanya Bankanhal)
  • Make mount/mount remote control take vfsOpt option (Nick Craig-Wood)
  • Add mountOpt to mount/mount (Nick Craig-Wood)
  • Add VFS and Mount options to mount/listmounts (Nick Craig-Wood)
  • Catch panics in cgofuse initialization and turn into error messages (Nick Craig-Wood)
  • Always supply stat information in Readdir (Nick Craig-Wood)
  • Add support for reading unknown length files using direct IO (Windows) (Nick Craig-Wood)
  • Fix On Windows don't add -o uid/gid=-1 if user supplies -o uid/gid. (Nick Craig-Wood)
  • Fix macOS losing directory contents in cmount (Nick Craig-Wood)
  • Fix volume name broken in recent refactor (Nick Craig-Wood)
  • VFS:
  • Implement partial reads for --vfs-cache-mode full (Nick Craig-Wood)
  • Add --vfs-writeback option to delay writes back to cloud storage (Nick Craig-Wood)
  • Add --vfs-read-ahead parameter for use with --vfs-cache-mode full (Nick Craig-Wood)
  • Restart pending uploads on restart of the cache (Nick Craig-Wood)
  • Support synchronous cache space recovery upon ENOSPC (Leo Luan)
  • Allow ReadAt and WriteAt to run concurrently with themselves (Nick Craig-Wood)
  • Change modtime of file before upload to current (Rob Calistri)
  • Recommend --vfs-cache-modes writes on backends which can't stream (Nick Craig-Wood)
  • Add an optional fs parameter to vfs rc methods (Nick Craig-Wood)
  • Fix errors when using > 260 char files in the cache in Windows (Nick Craig-Wood)
  • Fix renaming of items while they are being uploaded (Nick Craig-Wood)
  • Fix very high load caused by slow directory listings (Nick Craig-Wood)
  • Fix renamed files not being uploaded with --vfs-cache-mode minimal (Nick Craig-Wood)
  • Fix directory locking caused by slow directory listings (Nick Craig-Wood)
  • Fix saving from chrome without --vfs-cache-mode writes (Nick Craig-Wood)
  • Local:
  • Add --local-no-updated to provide a consistent view of changing objects (Nick Craig-Wood)
  • Add --local-no-set-modtime option to prevent modtime changes (tyhuber1)
  • Fix race conditions updating and reading Object metadata (Nick Craig-Wood)
  • Cache:
  • Make any created backends be cached to fix rc problems (Nick Craig-Wood)
  • Fix dedupe on caches wrapping drives (Nick Craig-Wood)
  • Crypt:
  • Add --crypt-server-side-across-configs flag (Nick Craig-Wood)
  • Make any created backends be cached to fix rc problems (Nick Craig-Wood)
  • Alias:
  • Make any created backends be cached to fix rc problems (Nick Craig-Wood)
  • Azure Blob:
  • Don't compile on < go1.13 after dependency update (Nick Craig-Wood)
  • B2:
  • Implement server side copy for files > 5GB (Nick Craig-Wood)
  • Cancel in progress multipart uploads and copies on rclone exit (Nick Craig-Wood)
  • Note that b2's encoding now allows but rclone's hasn't changed (Nick Craig-Wood)
  • Fix transfers when using download_url (Nick Craig-Wood)
  • Box:
  • Implement rclone cleanup (buengese)
  • Cancel in progress multipart uploads and copies on rclone exit (Nick Craig-Wood)
  • Allow authentication with access token (David)
  • Chunker:
  • Make any created backends be cached to fix rc problems (Nick Craig-Wood)
  • Drive:
  • Add rclone backend drives to list shared drives (teamdrives) (Nick Craig-Wood)
  • Implement rclone backend untrash (Nick Craig-Wood)
  • Work around drive bug which didn't set modtime of copied docs (Nick Craig-Wood)
  • Added --drive-starred-only to only show starred files (Jay McEntire)
  • Deprecate --drive-alternate-export as it is no longer needed (themylogin)
  • Fix duplication of Google docs on server side copy (Nick Craig-Wood)
  • Fix "panic: send on closed channel" when recycling dir entries (Nick Craig-Wood)
  • Dropbox:
  • Add copyright detector info in limitations section in the docs (Alex Guerrero)
  • Fix rclone link by removing expires parameter (Nick Craig-Wood)
  • Fichier:
  • Detect Flood detected: IP Locked error and sleep for 30s (Nick Craig-Wood)
  • FTP:
  • Add explicit TLS support (Heiko Bornholdt)
  • Add support for --dump bodies and --dump auth for debugging (Nick Craig-Wood)
  • Fix interoperation with pure-ftpd (Nick Craig-Wood)
  • Google Cloud Storage:
  • Add support for anonymous access (Kai Lüke)
  • Jottacloud:
  • Bring back legacy authentification for use with whitelabel versions (buengese)
  • Switch to new api root - also implement a very ugly workaround for the DirMove failures (buengese)
  • Onedrive:
  • Rework cancel of multipart uploads on rclone exit (Nick Craig-Wood)
  • Implement rclone cleanup (Nick Craig-Wood)
  • Add --onedrive-no-versions flag to remove old versions (Nick Craig-Wood)
  • Pcloud:
  • Implement rclone link for public link creation (buengese)
  • Qingstor:
  • Cancel in progress multipart uploads on rclone exit (Nick Craig-Wood)
  • S3:
  • Preserve metadata when doing multipart copy (Nick Craig-Wood)
  • Cancel in progress multipart uploads and copies on rclone exit (Nick Craig-Wood)
  • Add rclone link for public link sharing (Roman Kredentser)
  • Add rclone backend restore command to restore objects from GLACIER (Nick Craig-Wood)
  • Add rclone cleanup and rclone backend cleanup to clean unfinished multipart uploads (Nick Craig-Wood)
  • Add rclone backend list-multipart-uploads to list unfinished multipart uploads (Nick Craig-Wood)
  • Add --s3-max-upload-parts support (Kamil Trzcinski)
  • Add --s3-no-check-bucket for minimising rclone transactions and perms (Nick Craig-Wood)
  • Add --s3-profile and --s3-shared-credentials-file options (Nick Craig-Wood)
  • Use regional s3 us-east-1 endpoint (David)
  • Add Scaleway provider (Vincent Feltz)
  • Update IBM COS endpoints (Egor Margineanu)
  • Reduce the default --s3-copy-cutoff to < 5GB for Backblaze S3 compatibility (Nick Craig-Wood)
  • Fix detection of bucket existing (Nick Craig-Wood)
  • SFTP:
  • Use the absolute path instead of the relative path for listing for improved compatibility (Nick Craig-Wood)
  • Add --sftp-subsystem and --sftp-server-command options (aus)
  • Swift:
  • Fix dangling large objects breaking the listing (Nick Craig-Wood)
  • Fix purge not deleting directory markers (Nick Craig-Wood)
  • Fix update multipart object removing all of its own parts (Nick Craig-Wood)
  • Fix missing hash from object returned from upload (Nick Craig-Wood)
  • Tardigrade:
  • Upgrade to uplink v1.2.0 (Kaloyan Raev)
  • Union:
  • Fix writing with the all policy (Nick Craig-Wood)
  • WebDAV:
  • Fix directory creation with 4shared (Nick Craig-Wood)

New in Rclone 1.52.3 (Aug 8, 2020)

  • Bug Fixes:
  • docs:
  • Disable smart typography (eg en-dash) in MANUAL.* and man page (Nick Craig-Wood)
  • Update install.md to reflect minimum Go version (Evan Harris)
  • Update install from source instructions (Nick Craig-Wood)
  • make_manual: Support SOURCE_DATE_EPOCH (Morten Linderud)
  • log:
  • Fix --use-json-log going to stderr not --log-file on Windows (Nick Craig-Wood)
  • serve dlna:
  • Fix file list on Samsung Series 6+ TVs (Matteo Pietro Dazzi)
  • sync: Fix deadlock with --track-renames-strategy modtime (Nick Craig-Wood)
  • Cache:
  • Fix moveto/copyto remote:file remote:file2 (Nick Craig-Wood)
  • Drive:
  • Stop using root_folder_id as a cache (Nick Craig-Wood)
  • Make dangling shortcuts appear in listings (Nick Craig-Wood)
  • Drop "Disabling ListR" messages down to debug (Nick Craig-Wood)
  • Workaround and policy for Google Drive API (Dmitry Ustalov)
  • FTP:
  • Add note to docs about home vs root directory selection (Nick Craig-Wood)
  • Onedrive:
  • Fix reverting to Copy when Move would have worked (Nick Craig-Wood)
  • Avoid comma rendered in URL in onedrive.md (Kevin)
  • Pcloud:
  • Fix oauth on European region "eapi.pcloud.com" (Nick Craig-Wood)
  • S3:
  • Fix bucket Region auto detection when Region unset in config (Nick Craig-Wood)

New in Rclone 1.52.2 (Jun 24, 2020)

  • Bug Fixes:
  • Build:
  • Fix docker release build action (Nick Craig-Wood)
  • Fix custom timezone in Docker image (NoLooseEnds)
  • check: Fix misleading message which printed errors instead of differences (Nick Craig-Wood)
  • errors: Add WSAECONNREFUSED and more to the list of retriable Windows errors (Nick Craig-Wood)
  • rcd: Fix incorrect prometheus metrics (Gary Kim)
  • serve restic: Fix flags so they use environment variables (Nick Craig-Wood)
  • serve webdav: Fix flags so they use environment variables (Nick Craig-Wood)
  • sync: Fix --track-renames-strategy modtime (Nick Craig-Wood)
  • Drive:
  • Fix not being able to delete a directory with a trashed shortcut (Nick Craig-Wood)
  • Fix creating a directory inside a shortcut (Nick Craig-Wood)
  • Fix --drive-impersonate with cached root_folder_id (Nick Craig-Wood)
  • SFTP:
  • Fix SSH key PEM loading (Zac Rubin)
  • Swift:
  • Speed up deletes by not retrying segment container deletes (Nick Craig-Wood)
  • Tardigrade:
  • Upgrade to uplink v1.1.1 (Caleb Case)
  • WebDAV:
  • Fix free/used display for rclone about/df for certain backends (Nick Craig-Wood)

New in Rclone 1.52.1 (Jun 10, 2020)

  • Bug Fixes:
  • lib/file: Fix SetSparse on Windows 7 which fixes downloads of files > 250MB (Nick Craig-Wood)
  • build
  • Update go.mod to go1.14 to enable -mod=vendor build (Nick Craig-Wood)
  • Remove quicktest from Dockerfile (Nick Craig-Wood)
  • Build Docker images with GitHub actions (Matteo Pietro Dazzi)
  • Update Docker build workflows (Nick Craig-Wood)
  • Set user_allow_other in /etc/fuse.conf in the Docker image (Nick Craig-Wood)
  • Fix xgo build after go1.14 go.mod update (Nick Craig-Wood)
  • docs
  • Add link to source and modified time to footer of every page (Nick Craig-Wood)
  • Remove manually set dates and use git dates instead (Nick Craig-Wood)
  • Minor tense, punctuation, brevity and positivity changes for the home page (edwardxml)
  • Remove leading slash in page reference in footer when present (Nick Craig-Wood)
  • Note commands which need obscured input in the docs (Nick Craig-Wood)
  • obscure: Write more help as we are referencing it elsewhere (Nick Craig-Wood)
  • VFS:
  • Fix OS vs Unix path confusion - fixes ChangeNotify on Windows (Nick Craig-Wood)
  • Drive:
  • Fix missing items when listing using --fast-list / ListR (Nick Craig-Wood)
  • Putio:
  • Fix panic on Object.Open (Cenk Alti)
  • S3:
  • Fix upload of single files into buckets without create permission (Nick Craig-Wood)
  • Fix --header-upload (Nick Craig-Wood)
  • Tardigrade:
  • Fix listing bug by upgrading to v1.0.7
  • Set UserAgent to rclone (Caleb Case)

New in Rclone 1.52.0 (May 27, 2020)

  • Bug Fixes:
  • Accounting:
  • Restore "Max number of stats groups reached" log line (Michał Matczuk)
  • Correct exitcode on Transfer Limit Exceeded flag. (Anuar Serdaliyev)
  • Reset bytes read during copy retry (Ankur Gupta)
  • Fix race clearing stats (Nick Craig-Wood)
  • Copy: Only create empty directories when they don't exist on the remote (Ishuah Kariuki)
  • Dedupe: Stop dedupe deleting files with identical IDs (Nick Craig-Wood)
  • Oauth:
  • Use custom http client so that --no-check-certificate is honored by oauth token fetch (Mark Spieth)
  • Replace deprecated oauth2.NoContext (Lars Lehtonen)
  • Operations
  • Fix setting the timestamp on Windows for multithread copy (Nick Craig-Wood)
  • Make rcat obey --ignore-checksum (Nick Craig-Wood)
  • Make --max-transfer more accurate (Nick Craig-Wood)
  • Rc:
  • Fix dropped error (Lars Lehtonen)
  • Fix misplaced http server config (Xiaoxing Ye)
  • Disable duplicate log (ElonH)
  • Serve dlna:
  • Cds: don't specify childCount at all when unknown (Dan Walters)
  • Cds: use modification time as date in dlna metadata (Dan Walters)
  • Serve restic: Fix tests after restic project removed vendoring (Nick Craig-Wood)
  • Sync:
  • Fix incorrect "nothing to transfer" message using --delete-before (Nick Craig-Wood)
  • Only create empty directories when they don't exist on the remote (Ishuah Kariuki)

New in Rclone 1.51.0 (Feb 1, 2020)

  • New backends:
  • Memory (Nick Craig-Wood)
  • Sugarsync (Nick Craig-Wood)
  • New Features:
  • Adjust all backends to have --backend-encoding parameter (Nick Craig-Wood)
  • this enables the encoding for special characters to be adjusted or disabled
  • Add --max-duration flag to control the maximum duration of a transfer session (boosh)
  • Add --expect-continue-timeout flag, default 1s (Nick Craig-Wood)
  • Add --no-check-dest flag for copying without testing the destination (Nick Craig-Wood)
  • Implement --order-by flag to order transfers (Nick Craig-Wood)
  • accounting
  • Don’t show entries in both transferring and checking (Nick Craig-Wood)
  • Add option to delete stats (Aleksandar Jankovic)
  • build
  • Compress the test builds with gzip (Nick Craig-Wood)
  • Implement a framework for starting test servers during tests (Nick Craig-Wood)
  • cmd: Always print elapsed time to tenth place seconds in progress (Gary Kim)
  • config
  • Add --password-command to allow dynamic config password (Damon Permezel)
  • Give config questions default values (Nick Craig-Wood)
  • Check a remote exists when creating a new one (Nick Craig-Wood)
  • copyurl: Add --stdout flag to write to stdout (Nick Craig-Wood)
  • dedupe: Implement keep smallest too (Nick Craig-Wood)
  • hashsum: Add flag --base64 flag (landall)
  • lsf: Speed up on s3/swift/etc by not reading mimetype by default (Nick Craig-Wood)
  • lsjson: Add --no-mimetype flag (Nick Craig-Wood)
  • rc: Add methods to turn on blocking and mutex profiling (Nick Craig-Wood)
  • rcd
  • Adding group parameter to stats (Chaitanya)
  • Move webgui apart; option to disable browser (Xiaoxing Ye)
  • serve sftp: Add support for public key with auth proxy (Paul Tinsley)
  • stats: Show deletes in stats and hide zero stats (anuar45)
  • Bug Fixes:
  • accounting
  • Fix error counter counting multiple times (Ankur Gupta)
  • Fix error count shown as checks (Cnly)
  • Clear finished transfer in stats-reset (Maciej Zimnoch)
  • Added StatsInfo locking in statsGroups sum function (Michal Matczuk)
  • asyncreader: Fix EOF error (buengese)
  • check: Fix --one-way recursing more directories than it needs to (Nick Craig-Wood)
  • chunkedreader: Disable hash calculation for first segment (Nick Craig-Wood)
  • config
  • Do not open browser on headless on drive/gcs/google photos (Xiaoxing Ye)
  • SetValueAndSave ignore error if config section does not exist yet (buengese)
  • cmd: Fix completion with an encrypted config (Danil Semelenov)
  • dbhashsum: Stop it returning UNSUPPORTED on dropbox (Nick Craig-Wood)
  • dedupe: Add missing modes to help string (Nick Craig-Wood)
  • operations
  • Fix dedupe continuing on errors like insufficientFilePermisson (SezalAgrawal)
  • Clear accounting before low level retry (Maciej Zimnoch)
  • Write debug message when hashes could not be checked (Ole Schütt)
  • Move interface assertion to tests to remove pflag dependency (Nick Craig-Wood)
  • Make NewOverrideObjectInfo public and factor uses (Nick Craig-Wood)
  • proxy: Replace use of bcrypt with sha256 (Nick Craig-Wood)
  • vendor
  • Update bazil.org/fuse to fix FreeBSD 12.1 (Nick Craig-Wood)
  • Update github.com/t3rm1n4l/go-mega to fix mega “illegal base64 data at input byte 22” (Nick Craig-Wood)
  • Update termbox-go to fix ncdu command on FreeBSD (Kuang-che Wu)
  • Update t3rm1n4l/go-mega - fixes mega: couldn’t login: crypto/aes: invalid key size 0 (Nick Craig-Wood)
  • Mount:
  • Enable async reads for a 20% speedup (Nick Craig-Wood)
  • Replace use of WriteAt with Write for cache mode >= writes and O_APPEND (Brett Dutro)
  • Make sure we call unmount when exiting (Nick Craig-Wood)
  • Don’t build on go1.10 as bazil/fuse no longer supports it (Nick Craig-Wood)
  • When setting dates discard out of range dates (Nick Craig-Wood)
  • VFS:
  • Add a newly created file straight into the directory (Nick Craig-Wood)
  • Only calculate one hash for reads for a speedup (Nick Craig-Wood)
  • Make ReadAt for non cached files work better with non-sequential reads (Nick Craig-Wood)
  • Fix edge cases when reading ModTime from file (Nick Craig-Wood)
  • Make sure existing files opened for write show correct size (Nick Craig-Wood)
  • Don’t cache the path in RW file objects to fix renaming (Nick Craig-Wood)
  • Fix rename of open files when using the VFS cache (Nick Craig-Wood)
  • When renaming files in the cache, rename the cache item in memory too (Nick Craig-Wood)
  • Fix open file renaming on drive when using --vfs-cache-mode writes (Nick Craig-Wood)
  • Fix incorrect modtime for mv into mount with --vfs-cache-modes writes (Nick Craig-Wood)
  • On rename, rename in cache too if the file exists (Anagh Kumar Baranwal)
  • Local:
  • Make source file being updated errors be NoLowLevelRetry errors (Nick Craig-Wood)
  • Fix update of hidden files on Windows (Nick Craig-Wood)
  • Cache:
  • Follow move of upstream library github.com/coreos/bbolt github.com/etcd-io/bbolt (Nick Craig-Wood)
  • Fix fatal error: concurrent map writes (Nick Craig-Wood)
  • Crypt:
  • Reorder the filename encryption options (Thomas Eales)
  • Correctly handle trailing dot (buengese)
  • Chunker:
  • Reduce length of temporary suffix (Ivan Andreev)
  • Drive:
  • Add --drive-stop-on-upload-limit flag to stop syncs when upload limit reached (Nick Craig-Wood)
  • Add --drive-use-shared-date to use date file was shared instead of modified date (Garry McNulty)
  • Make sure invalid auth for teamdrives always reports an error (Nick Craig-Wood)
  • Fix --fast-list when using appDataFolder (Nick Craig-Wood)
  • Use multipart resumable uploads for streaming and uploads in mount (Nick Craig-Wood)
  • Log an ERROR if an incomplete search is returned (Nick Craig-Wood)
  • Hide dangerous config from the configurator (Nick Craig-Wood)
  • Dropbox:
  • Treat insufficient_space errors as non retriable errors (Nick Craig-Wood)
  • Jottacloud:
  • Use new auth method used by official client (buengese)
  • Add URL to generate Login Token to config wizard (Nick Craig-Wood)
  • Add support whitelabel versions (buengese)
  • Koofr:
  • Use rclone HTTP client(jaKa)
  • Onedrive:
  • Add Sites.Read.All permission (Benjamin Richter)
  • Add support “Retry-After” header (Motonori IWAMURO)
  • Opendrive:
  • Implement --opendrive-chunk-size (Nick Craig-Wood)
  • S3:
  • Re-implement multipart upload to fix memory issues (Nick Craig-Wood)
  • Add --s3-copy-cutoff for size to switch to multipart copy (Nick Craig-Wood)
  • Add new region Asia Patific (Hong Kong) (Outvi V)
  • Reduce memory usage streaming files by reducing max stream upload size (Nick Craig-Wood)
  • Add --s3-list-chunk option for bucket listing (Thomas Kriechbaumer)
  • Force path style bucket access to off for AWS deprecation (Nick Craig-Wood)
  • Use AWS web identity role provider if available (Tennix)
  • Add StackPath Object Storage Support (Dave Koston)
  • Fix ExpiryWindow value (Aleksandar Jankovic)
  • Fix DisableChecksum condition (Aleksandar Jankovic)
  • Fix URL decoding of NextMarker (Nick Craig-Wood)
  • SFTP:
  • Add --sftp-skip-links to skip symlinks and non regular files (Nick Craig-Wood)
  • Retry Creation of Connection (Sebastian Brandt)
  • Fix “failed to parse private key file: ssh: not an encrypted key” error (Nick Craig-Wood)
  • Open files for update write only to fix AWS SFTP interop (Nick Craig-Wood)
  • Swift:
  • Reserve segments of dynamic large object when delete objects in container what was enabled versioning(Nguy?n H?u Luân)
  • Fix parsing of X-Object-Manifest (Nick Craig-Wood)
  • Update OVH API endpoint (unbelauscht)
  • WebDAV
  • Make nextcloud only upload SHA1 checksums (Nick Craig-Wood)
  • Fix case of “Bearer” in Authorization: header to agree with RFC (Nick Craig-Wood)
  • Add Referer header to fix problems with WAFs (Nick Craig-Wood)

New in Rclone 1.50.2 (Nov 19, 2019)

  • Bug Fixes:
  • accounting: Fix memory leak on retries operations (Nick Craig-Wood)
  • Drive:
  • Fix listing of the root directory with drive.files scope (Nick Craig-Wood)
  • Fix --drive-root-folder-id with team/shared drives (Nick Craig-Wood)

New in Rclone 1.50.1 (Nov 19, 2019)

  • Bug Fixes
  • hash: Fix accidentally changed hash names for DropboxHash and CRC-32 (Nick Craig-Wood)
  • fshttp: Fix error reporting on tpslimit token bucket errors (Nick Craig-Wood)
  • fshttp: Don’t print token bucket errors on context cancelled (Nick Craig-Wood)
  • Local
  • Fix listings of . on Windows (Nick Craig-Wood)
  • Onedrive
  • Fix DirMove/Move after Onedrive change (Xiaoxing Ye)

New in Rclone 1.50.0 (Nov 19, 2019)

  • New backends
  • Citrix Sharefile (Nick Craig-Wood)
  • Chunker - an overlay backend to split files into smaller parts (Ivan Andreev)
  • Mail.ru Cloud (Ivan Andreev)
  • New Features
  • encodings (Fabian Möller & Nick Craig-Wood)
  • All backends now use file name encoding to ensure any file name can be written to any backend.
  • See the restricted file name docs for more info and the local backend docs.
  • Some file names may look different in rclone if you are using any control characters in names or unicode FULLWIDTH symbols.
  • build
  • Update to use go1.13 for the build (Nick Craig-Wood)
  • Drop support for go1.9 (Nick Craig-Wood)
  • Build rclone with GitHub actions (Nick Craig-Wood)
  • Convert python scripts to python3 (Nick Craig-Wood)
  • Swap Azure/go-ansiterm for mattn/go-colorable (Nick Craig-Wood)
  • Dockerfile fixes (Matei David)
  • Add plugin support for backends and commands (Richard Patel)
  • config
  • Use alternating Red/Green in config to make more obvious (Nick Craig-Wood)
  • contrib
  • Add sample DLNA server Docker Compose manifest. (pataquets)
  • Add sample WebDAV server Docker Compose manifest. (pataquets)
  • copyurl
  • Add --auto-filename flag for using file name from URL in destination path (Denis)
  • serve dlna:
  • Many compatability improvements (Dan Walters)
  • Support for external srt subtitles (Dan Walters)
  • Added command core/quit (Saksham Khanna)
  • Bug Fixes
  • sync
  • Make --update/-u not transfer files that haven’t changed (Nick Craig-Wood)
  • Free objects after they come out of the transfer pipe to save memory (Nick Craig-Wood)
  • Fix --files-from without --no-traverse doing a recursive scan (Nick Craig-Wood)
  • operations
  • Fix accounting for server side copies (Nick Craig-Wood)
  • Display ‘All duplicates removed’ only if dedupe successful (Sezal Agrawal)
  • Display ‘Deleted X extra copies’ only if dedupe successful (Sezal Agrawal)
  • accounting
  • Only allow up to 100 completed transfers in the accounting list to save memory (Nick Craig-Wood)
  • Cull the old time ranges when possible to save memory (Nick Craig-Wood)
  • Fix panic due to server-side copy fallback (Ivan Andreev)
  • Fix memory leak noticeable for transfers of large numbers of objects (Nick Craig-Wood)
  • Fix total duration calculation (Nick Craig-Wood)
  • cmd
  • Fix environment variables not setting command line flags (Nick Craig-Wood)
  • Make autocomplete compatible with bash’s posix mode for macOS (Danil Semelenov)
  • Make --progress work in git bash on Windows (Nick Craig-Wood)
  • Fix ‘compopt: command not found’ on autocomplete on macOS (Danil Semelenov)
  • config
  • Fix setting of non top level flags from environment variables (Nick Craig-Wood)
  • Check config names more carefully and report errors (Nick Craig-Wood)
  • Remove error: can’t use --size-only and --ignore-size together. (Nick Craig-Wood)
  • filter: Prevent mixing options when --files-from is in use (Michele Caci)
  • serve sftp: Fix crash on unsupported operations (eg Readlink) (Nick Craig-Wood)
  • Mount
  • Allow files of unkown size to be read properly (Nick Craig-Wood)
  • Skip tests on <= 2 CPUs to avoid lockup (Nick Craig-Wood)
  • Fix panic on File.Open (Nick Craig-Wood)
  • Fix “mount_fusefs: -o timeout=: option not supported” on FreeBSD (Nick Craig-Wood)
  • Don’t pass huge filenames (>4k) to FUSE as it can’t cope (Nick Craig-Wood)
  • VFS
  • Add flag --vfs-case-insensitive for windows/macOS mounts (Ivan Andreev)
  • Make objects of unknown size readable through the VFS (Nick Craig-Wood)
  • Move writeback of dirty data out of close() method into its own method (FlushWrites) and remove close() call from Flush() (Brett Dutro)
  • Stop empty dirs disappearing when renamed on bucket based remotes (Nick Craig-Wood)
  • Stop change notify polling clearing so much of the directory cache (Nick Craig-Wood)
  • Azure Blob
  • Disable logging to the Windows event log (Nick Craig-Wood)
  • Remove unverified: prefix on sha1 to improve interop (eg with CyberDuck) (Nick Craig-Wood)
  • Box
  • Add options to get access token via JWT auth (David)
  • Drive
  • Disable HTTP/2 by default to work around INTERNAL_ERROR problems (Nick Craig-Wood)
  • Make sure that drive root ID is always canonical (Nick Craig-Wood)
  • Fix --drive-shared-with-me from the root with lsand --fast-list (Nick Craig-Wood)
  • Fix ChangeNotify polling for shared drives (Nick Craig-Wood)
  • Fix change notify polling when using appDataFolder (Nick Craig-Wood)
  • Dropbox
  • Make disallowed filenames errors not retry (Nick Craig-Wood)
  • Fix nil pointer exception on restricted files (Nick Craig-Wood)
  • Fichier
  • Fix accessing files > 2GB on 32 bit systems (Nick Craig-Wood)
  • FTP
  • Allow disabling EPSV mode (Jon Fautley)
  • HTTP
  • HEAD directory entries in parallel to speedup (Nick Craig-Wood)
  • Add --http-no-head to stop rclone doing HEAD in listings (Nick Craig-Wood)
  • Putio
  • Add ability to resume uploads (Cenk Alti)
  • Fix signature v2_auth headers (Anthony Rusdi)
  • Fix encoding for control characters (Nick Craig-Wood)
  • Only ask for URL encoded directory listings if we need them on Ceph (Nick Craig-Wood)
  • Add option for multipart failiure behaviour (Aleksandar Jankovic)
  • Support for multipart copy (???)
  • Fix nil pointer reference if no metadata returned for object (Nick Craig-Wood)
  • SFTP
  • Fix --sftp-ask-password trying to contact the ssh agent (Nick Craig-Wood)
  • Fix hashes of files with backslashes (Nick Craig-Wood)
  • Include more ciphers with --sftp-use-insecure-cipher (Carlos Ferreyra)
  • WebDAV
  • Parse and return Sharepoint error response (Henning Surmeier)

New in Rclone 1.49.5 (Oct 7, 2019)

  • Bug Fixes:
  • Revert back to go1.12.x for the v1.49.x builds as go1.13.x was causing issues (Nick Craig-Wood)
  • Fix rpm packages by using master builds of nfpm (Nick Craig-Wood)
  • Fix macOS build after brew changes (Nick Craig-Wood)

New in Rclone 1.49.4 (Sep 30, 2019)

  • Bug Fixes:
  • cmd/rcd: Address ZipSlip vulnerability (Richard Patel)
  • accounting: Fix file handle leak on errors (Nick Craig-Wood)
  • oauthutil: Fix security problem when running with two users on the same machine (Nick Craig-Wood)
  • FTP:
  • Fix listing of an empty root returning: error dir not found (Nick Craig-Wood)
  • S3:
  • Fix SetModTime on GLACIER/ARCHIVE objects and implement set/get tier (Nick Craig-Wood)

New in Rclone 1.49.3 (Sep 16, 2019)

  • Bug Fixes:
  • accounting
  • Fix total duration calculation (Aleksandar Jankovic)
  • Fix “file already closed” on transfer retries (Nick Craig-Wood)

New in Rclone 1.49.2 (Sep 8, 2019)

  • Rclone - rsync for cloud storage. Sync files to and from many cloud storage providers.

New in Rclone 1.49.1 (Aug 29, 2019)

  • Bug Fixes:
  • Config: Fix generated passwords being stored as empty password (Nick Craig-Wood)
  • Rcd: Added missing parameter for web-gui info logs. (Chaitanya)
  • Googlephotos
  • Fix crash on error response (Nick Craig-Wood)
  • Onedrive:
  • Fix crash on error response (Nick Craig-Wood)

New in Rclone 1.49.1 (Aug 29, 2019)

  • Bug Fixes:
  • Config: Fix generated passwords being stored as empty password (Nick Craig-Wood)
  • Rcd: Added missing parameter for web-gui info logs. (Chaitanya)
  • Googlephotos
  • Fix crash on error response (Nick Craig-Wood)
  • Onedrive:
  • Fix crash on error response (Nick Craig-Wood)

New in Rclone 1.49 (Aug 27, 2019)

  • New backends:
  • 1fichier (Laura Hausmann)
  • Google Photos (Nick Craig-Wood)
  • Putio (Cenk Alti)
  • premiumize.me (Nick Craig-Wood)
  • New Features:
  • Experimental web GUI (Chaitanya Bankanhal)
  • Implement --compare-dest & --copy-dest (yparitcher)
  • Implement --suffix without --backup-dir for backup to current dir (yparitcher)
  • config reconnect to re-login (re-run the oauth login) for the backend. (Nick Craig-Wood)
  • config userinfo to discover which user you are logged in as. (Nick Craig-Wood)
  • config disconnect to disconnect you (log out) from the backend. (Nick Craig-Wood)
  • Add --use-json-log for JSON logging (justinalin)
  • Add context propagation to rclone (Aleksandar Jankovic)
  • Reworking internal statistics interfaces so they work with rc jobs (Aleksandar Jankovic)
  • Add Higher units for ETA (AbelThar)
  • Update rclone logos to new design (Andreas Chlupka)
  • hash: Add CRC-32 support (Cenk Alti)
  • help showbackend: Fixed advanced option category when there are no standard options (buengese)
  • ncdu: Display/Copy to Clipboard Current Path (Gary Kim)
  • operations:
  • Run hashing operations in parallel (Nick Craig-Wood)
  • Don’t calculate checksums when using --ignore-checksum (Nick Craig-Wood)
  • Check transfer hashes when using --size-only mode (Nick Craig-Wood)
  • Disable multi thread copy for local to local copies (Nick Craig-Wood)
  • Debug successful hashes as well as failures (Nick Craig-Wood)
  • Add ability to stop async jobs (Aleksandar Jankovic)
  • Return current settings if core/bwlimit called without parameters (Nick Craig-Wood)
  • Rclone-WebUI integration with rclone (Chaitanya Bankanhal)
  • Added command line parameter to control the cross origin resource sharing (CORS) in the rcd. (Security Improvement) (Chaitanya Bankanhal)
  • Add anchor tags to the docs so links are consistent (Nick Craig-Wood)
  • Remove _async key from input parameters after parsing so later operations won’t get confused (buengese)
  • Add call to clear stats (Aleksandar Jankovic)
  • rcd
  • Auto-login for web-gui (Chaitanya Bankanhal)
  • Implement --baseurl for rcd and web-gui (Chaitanya Bankanhal)
  • serve dlna
  • Only select interfaces which can multicast for SSDP (Nick Craig-Wood)
  • Add more builtin mime types to cover standard audio/video (Nick Craig-Wood)
  • Fix missing mime types on Android causing missing videos (Nick Craig-Wood)
  • serve ftp
  • Refactor to bring into line with other serve commands (Nick Craig-Wood)
  • Implement --auth-proxy (Nick Craig-Wood)
  • serve http: Implement --baseurl (Nick Craig-Wood)
  • serve restic: Implement --baseurl (Nick Craig-Wood)
  • serve sftp
  • Implement auth proxy (Nick Craig-Wood)
  • Fix detection of whether server is authorized (Nick Craig-Wood)
  • serve webdav
  • Implement --baseurl (Nick Craig-Wood)
  • Support --auth-proxy (Nick Craig-Wood)
  • Bug Fixes:
  • Make “bad record MAC” a retriable error (Nick Craig-Wood)
  • copyurl: Fix copying files that return HTTP errors (Nick Craig-Wood)
  • march: Fix checking sub-directories when using --no-traverse (buengese)
  • Fix unmarshalable http.AuthFn in options and put in test for marshalability (Nick Craig-Wood)
  • Move job expire flags to rc to fix initalization problem (Nick Craig-Wood)
  • Fix --loopback with rc/list and others (Nick Craig-Wood)
  • rcat: Fix slowdown on systems with multiple hashes (Nick Craig-Wood)
  • rcd: Fix permissions problems on cache directory with web gui download (Nick Craig-Wood)
  • Mount:
  • Default --deamon-timout to 15 minutes on macOS and FreeBSD (Nick Craig-Wood)
  • Update docs to show mounting from root OK for bucket based (Nick Craig-Wood)
  • Remove nonseekable flag from write files (Nick Craig-Wood)
  • VFS:
  • Make write without cache more efficient (Nick Craig-Wood)
  • Fix --vfs-cache-mode minimal and writes ignoring cached files (Nick Craig-Wood)
  • Local:
  • Add --local-case-sensitive and --local-case-insensitive (Nick Craig-Wood)
  • Avoid polluting page cache when uploading local files to remote backends (Michal Matczuk)
  • Don’t calculate any hashes by default (Nick Craig-Wood)
  • Fadvise run syscall on a dedicated go routine (Michal Matczuk)
  • Azure Blob:
  • Azure Storage Emulator support (Sandeep)
  • Updated config help details to remove connection string references (Sandeep)
  • Make all operations work from the root (Nick Craig-Wood)
  • B2:
  • Implement link sharing (yparitcher)
  • Enable server side copy to copy between buckets (Nick Craig-Wood)
  • Make all operations work from the root (Nick Craig-Wood)
  • Drive:
  • Fix server side copy of big files (Nick Craig-Wood)
  • Update API for teamdrive use (Nick Craig-Wood)
  • Add error for purge with --drive-trashed-only (ginvine)
  • Fichier:
  • Make FolderID int and adjust related code (buengese)
  • Google Cloud Storage:
  • Reduce oauth scope requested as suggested by Google (Nick Craig-Wood)
  • Make all operations work from the root (Nick Craig-Wood)
  • HTTP:
  • Add --http-headers flag for setting arbitrary headers (Nick Craig-Wood)
  • Jottacloud:
  • Use new api for retrieving internal username (buengese)
  • Refactor configuration and minor cleanup (buengese)
  • Koofr:
  • Support setting modification times on Koofr backend. (jaKa)
  • Opendrive:
  • Refactor to use existing lib/rest facilities for uploads (Nick Craig-Wood)
  • Qingstor:
  • Upgrade to v3 SDK and fix listing loop (Nick Craig-Wood)
  • Make all operations work from the root (Nick Craig-Wood)
  • S3:
  • Add INTELLIGENT_TIERING storage class (Matti Niemenmaa)
  • Make all operations work from the root (Nick Craig-Wood)
  • SFTP:
  • Add missing interface check and fix About (Nick Craig-Wood)
  • Completely ignore all modtime checks if SetModTime=false (Jon Fautley)
  • Support md5/sha1 with rsync.net (Nick Craig-Wood)
  • Save the md5/sha1 command in use to the config file for efficiency (Nick Craig-Wood)
  • Opt-in support for diffie-hellman-group-exchange-sha256 diffie-hellman-group-exchange-sha1 (Yi FU)
  • Swift:
  • Use FixRangeOption to fix 0 length files via the VFS (Nick Craig-Wood)
  • Fix upload when using no_chunk to return the correct size (Nick Craig-Wood)
  • Make all operations work from the root (Nick Craig-Wood)
  • Fix segments leak during failed large file uploads. (nguyenhuuluan434)
  • WebDAV:
  • Add --webdav-bearer-token-command (Nick Craig-Wood)
  • Refresh token when it expires with --webdav-bearer-token-command (Nick Craig-Wood)
  • Add docs for using bearer_token_command with oidc-agent (Paul Millar)

New in Rclone 1.48 (Jun 17, 2019)

  • New commands:
  • serve sftp: Serve an rclone remote over SFTP (Nick Craig-Wood)
  • New Features:
  • Multi threaded downloads to local storage (Nick Craig-Wood) ?controlled with --multi-thread-cutoff and --multi-thread-streams
  • Use rclone.conf from rclone executable directory to enable portable use (albertony)
  • Allow sync of a file and a directory with the same name (forgems) ?this is common on bucket based remotes, eg s3, gcs
  • Add --ignore-case-sync for forced case insensitivity (garry415)
  • Implement --stats-one-line-date and --stats-one-line-date-format (Peter Berbec)
  • Log an ERROR for all commands which exit with non-zero status (Nick Craig-Wood)
  • Use go-homedir to read the home directory more reliably (Nick Craig-Wood)
  • Enable creating encrypted config through external script invocation (Wojciech Smigielski)
  • build: Drop support for go1.8 (Nick Craig-Wood)
  • config: Make config create/update encrypt passwords where necessary (Nick Craig-Wood)
  • copyurl: Honor --no-check-certificate (Stefan Breunig)
  • install: Linux skip man pages if no mandb (didil)
  • lsf: Support showing the Tier of the object (Nick Craig-Wood)
  • lsjson ?Added EncryptedPath to output (calisro)
  • Support showing the Tier of the object (Nick Craig-Wood)
  • Add IsBucket field for bucket based remote listing of the root (Nick Craig-Wood)
  • rc:
  • Add --loopback flag to run commands directly without a server (Nick Craig-Wood)
  • Add operations/fsinfo: Return information about the remote (Nick Craig-Wood)
  • Skip auth for OPTIONS request (Nick Craig-Wood)
  • cmd/providers: Add DefaultStr, ValueStr and Type fields (Nick Craig-Wood)
  • jobs: Make job expiry timeouts configurable (Aleksandar Jankovic)
  • serve dlna reworked and improved (Dan Walters)
  • serve ftp: add --ftp-public-ip flag to specify public IP (calistri)
  • serve restic: Add support for --private-repos in serve restic (Florian Apolloner)
  • serve webdav: Combine serve webdav and serve http (Gary Kim)
  • size: Ignore negative sizes when calculating total (Garry McNulty)
  • Bug Fixes:
  • Make move and copy individual files obey --backup-dir (Nick Craig-Wood)
  • If --ignore-checksum is in effect, don’t calculate checksum (Nick Craig-Wood)
  • moveto: Fix case-insensitive same remote move (Gary Kim)
  • rc: Fix serving bucket based objects with --rc-serve (Nick Craig-Wood)
  • serve webdav: Fix serveDir not being updated with changes from webdav (Gary Kim)
  • Mount:
  • Fix poll interval documentation (Animosity022)
  • VFS:
  • Make WriteAt for non cached files work with non-sequential writes (Nick Craig-Wood)
  • Local:
  • Only calculate the required hashes for big speedup (Nick Craig-Wood)
  • Log errors when listing instead of returning an error (Nick Craig-Wood)
  • Fix preallocate warning on Linux with ZFS (Nick Craig-Wood)
  • Crypt:
  • Make rclone dedupe work through crypt (Nick Craig-Wood)
  • Fix wrapping of ChangeNotify to decrypt directories properly (Nick Craig-Wood)
  • Support PublicLink (rclone link) of underlying backend (Nick Craig-Wood)
  • Implement Optional methods SetTier, GetTier (Nick Craig-Wood)
  • B2:
  • Implement server side copy (Nick Craig-Wood)
  • Implement SetModTime (Nick Craig-Wood)
  • Drive:
  • Fix move and copy from TeamDrive to GDrive (Fionera)
  • Add notes that cleanup works in the background on drive (Nick Craig-Wood)
  • Add --drive-server-side-across-configs to default back to old server side copy semantics by default (Nick Craig-Wood)
  • Add --drive-size-as-quota to show storage quota usage for file size (Garry McNulty)
  • FTP:
  • Add FTP List timeout (Jeff Quinn)
  • Add FTP over TLS support (Gary Kim)
  • Add --ftp-no-check-certificate option for FTPS (Gary Kim)
  • Google Cloud Storage:
  • Fix upload errors when uploading pre 1970 files (Nick Craig-Wood)
  • Jottacloud:
  • Add support for selecting device and mountpoint. (buengese)
  • Mega:
  • Add cleanup support (Gary Kim)
  • Onedrive:
  • More accurately check if root is found (Cnly)
  • S3:
  • Suppport S3 Accelerated endpoints with --s3-use-accelerate-endpoint (Nick Craig-Wood)
  • Add config info for Wasabi’s EU Central endpoint (Robert Marko)
  • Make SetModTime work for GLACIER while syncing (Philip Harvey)
  • SFTP:
  • Add About support (Gary Kim)
  • Fix about parsing of df results so it can cope with -ve results (Nick Craig-Wood)
  • Send custom client version and debug server version (Nick Craig-Wood)
  • WebDAV:
  • Retry on 423 Locked errors (Nick Craig-Wood)

New in Rclone 1.47 (Apr 15, 2019)

  • New backends:
  • Backend for Koofr cloud storage service. (jaKa)
  • New Features:
  • Resume downloads if the reader fails in copy (Nick Craig-Wood) ?this means rclone will restart transfers if the source has an error
  • this is most useful for downloads or cloud to cloud copies
  • Use --fast-list for listing operations where it won’t use more memory (Nick Craig-Wood) ?this should speed up the following operations on remotes which support ListR
  • dedupe, serve restic lsf, ls, lsl, lsjson, lsd, md5sum, sha1sum, hashsum, size, delete, cat, settier
  • use --disable ListR to get old behaviour if required
  • Make --files-from traverse the destination unless --no-traverse is set (Nick Craig-Wood) ?this fixes --files-from with Google drive and excessive API use in general.
  • Make server side copy account bytes and obey --max-transfer (Nick Craig-Wood)
  • Add --create-empty-src-dirs flag and default to not creating empty dirs (ishuah)
  • Add client side TLS/SSL flags --ca-cert/--client-cert/--client-key (Nick Craig-Wood)
  • Implement --suffix-keep-extension for use with --suffix (Nick Craig-Wood)
  • build: ?Switch to semvar compliant version tags to be go modules compliant (Nick Craig-Wood)
  • Update to use go1.12.x for the build (Nick Craig-Wood)
  • serve dlna: Add connection manager service description to improve compatibility (Dan Walters)
  • lsf: Add ‘e’ format to show encrypted names and ‘o’ for original IDs (Nick Craig-Wood)
  • lsjson: Added --files-only and --dirs-only flags (calistri)
  • rc: Implement operations/publiclink the equivalent of rclone link (Nick Craig-Wood)
  • Bug Fixes:
  • accounting: Fix total ETA when --stats-unit bits is in effect (Nick Craig-Wood)
  • Bash TAB completion ?Use private custom func to fix clash between rclone and kubectl (Nick Craig-Wood)
  • Fix for remotes with underscores in their names (Six)
  • Fix completion of remotes (Florian Gamböck)
  • Fix autocompletion of remote paths with spaces (Danil Semelenov)
  • serve dlna: Fix root XML service descriptor (Dan Walters)
  • ncdu: Fix display corruption with Chinese characters (Nick Craig-Wood)
  • Add SIGTERM to signals which run the exit handlers on unix (Nick Craig-Wood)
  • rc: Reload filter when the options are set via the rc (Nick Craig-Wood)
  • VFS / Mount:
  • Fix FreeBSD: Ignore Truncate if called with no readers and already the correct size (Nick Craig-Wood)
  • Read directory and check for a file before mkdir (Nick Craig-Wood)
  • Shorten the locking window for vfs/refresh (Nick Craig-Wood)
  • Azure Blob:
  • Enable MD5 checksums when uploading files bigger than the “Cutoff” (Dr.Rx)
  • Fix SAS URL support (Nick Craig-Wood)
  • B2:
  • Allow manual configuration of backblaze downloadUrl (Vince)
  • Ignore already_hidden error on remove (Nick Craig-Wood)
  • Ignore malformed src_last_modified_millis (Nick Craig-Wood)
  • Drive:
  • Add --skip-checksum-gphotos to ignore incorrect checksums on Google Photos (Nick Craig-Wood)
  • Allow server side move/copy between different remotes. (Fionera)
  • Add docs on team drives and --fast-list eventual consistency (Nestar47)
  • Fix imports of text files (Nick Craig-Wood)
  • Fix range requests on 0 length files (Nick Craig-Wood)
  • Fix creation of duplicates with server side copy (Nick Craig-Wood)
  • Dropbox:
  • Retry blank errors to fix long listings (Nick Craig-Wood)
  • FTP:
  • Add --ftp-concurrency to limit maximum number of connections (Nick Craig-Wood)
  • Google Cloud Storage ?Fall back to default application credentials (marcintustin)
  • Allow bucket policy only buckets (Nick Craig-Wood)
  • HTTP:
  • Add --http-no-slash for websites with directories with no slashes (Nick Craig-Wood)
  • Remove duplicates from listings (Nick Craig-Wood)
  • Fix socket leak on 404 errors (Nick Craig-Wood)
  • Jottacloud:
  • Fix token refresh (Sebastian Bünger)
  • Add device registration (Oliver Heyme)
  • Onedrive:
  • Implement graceful cancel of multipart uploads if rclone is interrupted (Cnly)
  • Always add trailing colon to path when addressing items, (Cnly)
  • Return errors instead of panic for invalid uploads (Fabian Möller)
  • S3:
  • Add support for “Glacier Deep Archive” storage class (Manu)
  • Update Dreamhost endpoint (Nick Craig-Wood)
  • Note incompatibility with CEPH Jewel (Nick Craig-Wood)
  • SFTP:
  • Allow custom ssh client config (Alexandru Bumbacea)
  • Swift:
  • Obey Retry-After to enable OVH restore from cold storage (Nick Craig-Wood)
  • Work around token expiry on CEPH (Nick Craig-Wood)
  • WebDAV:
  • Allow IsCollection property to be integer or boolean (Nick Craig-Wood)
  • Fix race when creating directories (Nick Craig-Wood)
  • Fix About/df when reading the available/total returns 0 (Nick Craig-Wood)

New in Rclone 1.46 (Feb 11, 2019)

  • New backends:
  • Support Alibaba Cloud (Aliyun) OSS via the s3 backend (Nick Craig-Wood)
  • New commands:
  • serve dlna: serves a remove via DLNA for the local network (nicolov)
  • New Features:
  • copy, move: Restore deprecated --no-traverse flag (Nick Craig-Wood).This is useful for when transferring a small number of files into a large destination
  • genautocomplete: Add remote path completion for bash completion (Christopher Peterson & Danil Semelenov)
  • Buffer memory handling reworked to return memory to the OS better (Nick Craig-Wood) ?Buffer recycling library to replace sync.Pool
  • Optionally use memory mapped memory for better memory shrinking
  • Enable with --use-mmap if having memory problems - not default yet
  • Parallelise reading of files specified by --files-from (Nick Craig-Wood)
  • check: Add stats showing total files matched. (Dario Guzik)
  • Allow rename/delete open files under Windows (Nick Craig-Wood)
  • lsjson: Use exactly the correct number of decimal places in the seconds (Nick Craig-Wood)
  • Add cookie support with cmdline switch --use-cookies for all HTTP based remotes (qip)
  • Warn if --checksum is set but there are no hashes available (Nick Craig-Wood)
  • Rework rate limiting (pacer) to be more accurate and allow bursting (Nick Craig-Wood)
  • Improve error reporting for too many/few arguments in commands (Nick Craig-Wood)
  • listremotes: Remove -l short flag as it conflicts with the new global flag (weetmuts)
  • Make http serving with auth generate INFO messages on auth fail (Nick Craig-Wood)
  • Bug Fixes:
  • Fix layout of stats (Nick Craig-Wood)
  • Fix --progress crash under Windows Jenkins (Nick Craig-Wood)
  • Fix transfer of google/onedrive docs by calling Rcat in Copy when size is -1 (Cnly)
  • copyurl: Fix checking of --dry-run (Denis Skovpen)
  • Mount:
  • Check that mountpoint and local directory to mount don’t overlap (Nick Craig-Wood)
  • Fix mount size under 32 bit Windows (Nick Craig-Wood)
  • VFS:
  • Implement renaming of directories for backends without DirMove (Nick Craig-Wood) ?now all backends except b2 support renaming directories
  • Implement --vfs-cache-max-size to limit the total size of the cache (Nick Craig-Wood)
  • Add --dir-perms and --file-perms flags to set default permissions (Nick Craig-Wood)
  • Fix deadlock on concurrent operations on a directory (Nick Craig-Wood)
  • Fix deadlock between RWFileHandle.close and File.Remove (Nick Craig-Wood)
  • Fix renaming/deleting open files with cache mode “writes” under Windows (Nick Craig-Wood)
  • Fix panic on rename with --dry-run set (Nick Craig-Wood)
  • Fix vfs/refresh with recurse=true needing the --fast-list flag
  • Local:
  • Add support for -l/--links (symbolic link translation) (yair@unicorn) ?this works by showing links as link.rclonelink - see local backend docs for more info
  • this errors if used with -L/--copy-links
  • Fix renaming/deleting open files on Windows (Nick Craig-Wood)
  • Crypt:
  • Check for maximum length before decrypting filename to fix panic (Garry McNulty)
  • Azure Blob:
  • Allow building azureblob backend on *BSD (themylogin)
  • Use the rclone HTTP client to support --dump headers, --tpslimit etc (Nick Craig-Wood)
  • Use the s3 pacer for 0 delay in non error conditions (Nick Craig-Wood)
  • Ignore directory markers (Nick Craig-Wood)
  • Stop Mkdir attempting to create existing containers (Nick Craig-Wood)
  • B2:
  • cleanup: will remove unfinished large files >24hrs old (Garry McNulty)
  • For a bucket limited application key check the bucket name (Nick Craig-Wood) ?before this, rclone would use the authorised bucket regardless of what you put on the command line
  • Added --b2-disable-checksum flag (Wojciech Smigielski) ?this enables large files to be uploaded without a SHA-1 hash for speed reasons
  • Drive:
  • Set default pacer to 100ms for 10 tps (Nick Craig-Wood) ?This fits the Google defaults much better and reduces the 403 errors massively
  • Add --drive-pacer-min-sleep and --drive-pacer-burst to control the pacer
  • Improve ChangeNotify support for items with multiple parents (Fabian Möller)
  • Fix ListR for items with multiple parents - this fixes oddities with vfs/refresh (Fabian Möller)
  • Fix using --drive-impersonate and appfolders (Nick Craig-Wood)
  • Fix google docs in rclone mount for some (not all) applications (Nick Craig-Wood)
  • Dropbox:
  • Retry-After support for Dropbox backend (Mathieu Carbou)
  • FTP:
  • Wait for 60 seconds for a connection to Close then declare it dead (Nick Craig-Wood) ?helps with indefinite hangs on some FTP servers
  • Google Cloud Storage:
  • Update google cloud storage endpoints (weetmuts)
  • HTTP:
  • Add an example with username and password which is supported but wasn’t documented (Nick Craig-Wood)
  • Fix backend with --files-from and non-existent files (Nick Craig-Wood)
  • Hubic:
  • Make error message more informative if authentication fails (Nick Craig-Wood)
  • Jottacloud ?Resume and deduplication support (Oliver Heyme)
  • Use token auth for all API requests Don’t store password anymore (Sebastian Bünger)
  • Add support for 2-factor authentification (Sebastian Bünger)
  • Mega:
  • Implement v2 account login which fixes logins for newer Mega accounts (Nick Craig-Wood)
  • Return error if an unknown length file is attempted to be uploaded (Nick Craig-Wood)
  • Add new error codes for better error reporting (Nick Craig-Wood)
  • Onedrive:
  • Fix broken support for “shared with me” folders (Alex Chen)
  • Fix root ID not normalised (Cnly)
  • Return err instead of panic on unknown-sized uploads (Cnly)
  • Qingstor:
  • Fix go routine leak on multipart upload errors (Nick Craig-Wood)
  • Add upload chunk size/concurrency/cutoff control (Nick Craig-Wood)
  • Default --qingstor-upload-concurrency to 1 to work around bug (Nick Craig-Wood)
  • S3:
  • Implement --s3-upload-cutoff for single part uploads below this (Nick Craig-Wood)
  • Change --s3-upload-concurrency default to 4 to increase perfomance (Nick Craig-Wood)
  • Add --s3-bucket-acl to control bucket ACL (Nick Craig-Wood)
  • Auto detect region for buckets on operation failure (Nick Craig-Wood)
  • Add GLACIER storage class (William Cocker)
  • Add Scaleway to s3 documentation (Rémy Léone)
  • Add AWS endpoint eu-north-1 (weetmuts)
  • SFTP:
  • Add support for PEM encrypted private keys (Fabian Möller)
  • Add option to force the usage of an ssh-agent (Fabian Möller)
  • Perform environment variable expansion on key-file (Fabian Möller)
  • Fix rmdir on Windows based servers (eg CrushFTP) (Nick Craig-Wood)
  • Fix rmdir deleting directory contents on some SFTP servers (Nick Craig-Wood)
  • Fix error on dangling symlinks (Nick Craig-Wood)
  • Swift:
  • Add --swift-no-chunk to disable segmented uploads in rcat/mount (Nick Craig-Wood)
  • Introduce application credential auth support (kayrus)
  • Fix memory usage by slimming Object (Nick Craig-Wood)
  • Fix extra requests on upload (Nick Craig-Wood)
  • Fix reauth on big files (Nick Craig-Wood)
  • Union:
  • Fix poll-interval not working (Nick Craig-Wood)
  • WebDAV:
  • Support About which means rclone mount will show the correct disk size (Nick Craig-Wood)
  • Support MD5 and SHA1 hashes with Owncloud and Nextcloud (Nick Craig-Wood)
  • Fail soft on time parsing errors (Nick Craig-Wood)
  • Fix infinite loop on failed directory creation (Nick Craig-Wood)
  • Fix identification of directories for Bitrix Site Manager (Nick Craig-Wood)
  • Fix upload of 0 length files on some servers (Nick Craig-Wood)
  • Fix if MKCOL fails with 423 Locked assume the directory exists (Nick Craig-Wood)

New in Rclone 1.45 (Dec 6, 2018)

  • New backends:
  • The Yandex backend was re-written - see below for details (Sebastian Bünger)
  • New commands:
  • rcd: New command just to serve the remote control API (Nick Craig-Wood)
  • New Features:
  • The remote control API (rc) was greatly expanded to allow full control over rclone (Nick Craig-Wood) ?sensitive operations require authorization or the --rc-no-auth flag
  • config/* operations to configure rclone
  • options/* for reading/setting command line flags
  • operations/* for all low level operations, eg copy file, list directory
  • sync/* for sync, copy and move
  • rc-files flag to serve files on the rc http server ?this is for building web native GUIs for rclone
  • Optionally serving objects on the rc http server
  • Ensure rclone fails to start up if the --rc port is in use already
  • See the rc docs for more info
  • sync/copy/move ?Make --files-from only read the objects specified and don’t scan directories (Nick Craig-Wood) ?This is a huge speed improvement for destinations with lots of files
  • filter: Add --ignore-case flag (Nick Craig-Wood)
  • ncdu: Add remove function (’d’ key) (Henning Surmeier)
  • rc command ?Add --json flag for structured JSON input (Nick Craig-Wood)
  • Add --user and --pass flags and interpret --rc-user, --rc-pass, --rc-addr (Nick Craig-Wood)
  • build Require go1.8 or later for compilation (Nick Craig-Wood)
  • Enable softfloat on MIPS arch (Scott Edlund)
  • Integration test framework revamped with a better report and better retries (Nick Craig-Wood)
  • Bug Fixes:
  • cmd: Make --progress update the stats correctly at the end (Nick Craig-Wood)
  • config: Create config directory on save if it is missing (Nick Craig-Wood)
  • dedupe: Check for existing filename before renaming a dupe file (ssaqua)
  • move: Don’t create directories with --dry-run (Nick Craig-Wood)
  • operations: Fix Purge and Rmdirs when dir is not the root (Nick Craig-Wood)
  • serve http/webdav/restic: Ensure rclone exits if the port is in use (Nick Craig-Wood)
  • Mount:
  • Make --volname work for Windows and macOS (Nick Craig-Wood)
  • Azure Blob:
  • Avoid context deadline exceeded error by setting a large TryTimeout value (brused27)
  • Fix erroneous Rmdir error “directory not empty” (Nick Craig-Wood)
  • Wait for up to 60s to create a just deleted container (Nick Craig-Wood)
  • Dropbox:
  • Add dropbox impersonate support (Jake Coggiano)
  • Jottacloud:
  • Fix bug in --fast-list handing of empty folders (albertony)
  • Opendrive:
  • Fix transfer of files with + and & in (Nick Craig-Wood)
  • Fix retries of upload chunks (Nick Craig-Wood)
  • S3:
  • Set ACL for server side copies to that provided by the user (Nick Craig-Wood)
  • Fix role_arn, credential_source, … (Erik Swanson)
  • Add config info for Wasabi’s US-West endpoint (Henry Ptasinski)
  • SFTP:
  • Ensure file hash checking is really disabled (Jon Fautley)
  • Swift:
  • Add pacer for retries to make swift more reliable (Nick Craig-Wood)
  • WebDAV:
  • Add Content-Type to PUT requests (Nick Craig-Wood)
  • Fix config parsing so --webdav-user and --webdav-pass flags work (Nick Craig-Wood)
  • Add RFC3339 date format (Ralf Hemberger)
  • Yandex:
  • The yandex backend was re-written (Sebastian Bünger) ?This implements low level retries (Sebastian Bünger)
  • Copy, Move, DirMove, PublicLink and About optional interfaces (Sebastian Bünger)
  • Improved general error handling (Sebastian Bünger)
  • Removed ListR for now due to inconsistent behaviour (Sebastian Bünger)

New in Rclone 1.44 (Oct 15, 2018)

  • New commands:
  • Serve ftp: Add ftp server (Antoine GIRARD)
  • Settier: perform storage tier changes on supported remotes (sandeepkru)
  • New Features:
  • Reworked command line help ?Make default help less verbose (Nick Craig-Wood)
  • Split flags up into global and backend flags (Nick Craig-Wood)
  • Implement specialised help for flags and backends (Nick Craig-Wood)
  • Show URL of backend help page when starting config (Nick Craig-Wood)
  • Stats: Long names now split in center (Joanna Marek)
  • Add --log-format flag for more control over log output (dcpu)
  • Rc: Add support for OPTIONS and basic CORS (frenos)
  • Stats: show FatalErrors and NoRetryErrors in stats (Cédric Connes)
  • Bug Fixes:
  • Fix -P not ending with a new line (Nick Craig-Wood)
  • Config: don’t create default config dir when user supplies --config (albertony)
  • Don’t print non-ASCII characters with --progress on windows (Nick Craig-Wood)
  • Correct logs for excluded items (ssaqua)
  • Mount:
  • Remove EXPERIMENTAL tags (Nick Craig-Wood)
  • VFS:
  • Fix race condition detected by serve ftp tests (Nick Craig-Wood)
  • Add vfs/poll-interval rc command (Fabian Möller)
  • Enable rename for nearly all remotes using server side Move or Copy (Nick Craig-Wood)
  • Reduce directory cache cleared by poll-interval (Fabian Möller)
  • Remove EXPERIMENTAL tags (Nick Craig-Wood)
  • Local:
  • Skip bad symlinks in dir listing with -L enabled (Cédric Connes)
  • Preallocate files on Windows to reduce fragmentation (Nick Craig-Wood)
  • Preallocate files on linux with fallocate(2) (Nick Craig-Wood)
  • Cache:
  • Add cache/fetch rc function (Fabian Möller)
  • Fix worker scale down (Fabian Möller)
  • Improve performance by not sending info requests for cached chunks (dcpu)
  • Fix error return value of cache/fetch rc method (Fabian Möller)
  • Documentation fix for cache-chunk-total-size (Anagh Kumar Baranwal)
  • Preserve leading / in wrapped remote path (Fabian Möller)
  • Add plex_insecure option to skip certificate validation (Fabian Möller)
  • Remove entries that no longer exist in the source (dcpu)
  • Crypt:
  • Preserve leading / in wrapped remote path (Fabian Möller)
  • Alias:
  • Fix handling of Windows network paths (Nick Craig-Wood)
  • Azure Blob ?Add --azureblob-list-chunk parameter (Santiago Rodríguez)
  • Implemented settier command support on azureblob remote. (sandeepkru)
  • Work around SDK bug which causes errors for chunk-sized files (Nick Craig-Wood)
  • Box:
  • Implement link sharing. (Sebastian Bünger)
  • Drive:
  • Add --drive-import-formats - google docs can now be imported (Fabian Möller) ?Rewrite mime type and extension handling (Fabian Möller)
  • Add document links (Fabian Möller)
  • Add support for multipart document extensions (Fabian Möller)
  • Add support for apps-script to json export (Fabian Möller)
  • Fix escaped chars in documents during list (Fabian Möller)
  • Add --drive-v2-download-min-size a workaround for slow downloads (Fabian Möller)
  • Improve directory notifications in ChangeNotify (Fabian Möller)
  • When listing team drives in config, continue on failure (Nick Craig-Wood)
  • FTP:
  • Add a small pause after failed upload before deleting file (Nick Craig-Wood)
  • Google Cloud Storage ?Fix service_account_file being ignored (Fabian Möller)
  • Jottacloud:
  • Minor improvement in quota info (omit if unlimited) (albertony)
  • Add --fast-list support (albertony)
  • Add permanent delete support: --jottacloud-hard-delete (albertony)
  • Add link sharing support (albertony)
  • Fix handling of reserved characters. (Sebastian Bünger)
  • Fix socket leak on Object.Remove (Nick Craig-Wood)
  • Onedrive:
  • Rework to support Microsoft Graph (Cnly)
  • NB this will require re-authenticating the remote
  • Removed upload cutoff and always do session uploads (Oliver Heyme)
  • Use single-part upload for empty files (Cnly)
  • Fix new fields not saved when editing old config (Alex Chen)
  • Fix sometimes special chars in filenames not replaced (Alex Chen)
  • Ignore OneNote files by default (Alex Chen)
  • Add link sharing support (jackyzy823)
  • S3:
  • Use custom pacer, to retry operations when reasonable (Craig Miskell)
  • Use configured server-side-encryption and storace class options when calling CopyObject() (Paul Kohout)
  • Make --s3-v2-auth flag (Nick Craig-Wood)
  • Fix v2 auth on files with spaces (Nick Craig-Wood)
  • Union:
  • Implement union backend which reads from multiple backends (Felix Brucker)
  • Implement optional interfaces (Move, DirMove, Copy etc) (Nick Craig-Wood)
  • Fix ChangeNotify to support multiple remotes (Fabian Möller)
  • Fix --backup-dir on union backend (Nick Craig-Wood)
  • WebDAV:
  • Add another time format (Nick Craig-Wood)
  • Add a small pause after failed upload before deleting file (Nick Craig-Wood)
  • Add workaround for missing mtime (buergi)
  • Sharepoint: Renew cookies after 12hrs (Henning Surmeier)
  • Yandex:
  • Remove redundant nil checks (teresy)

New in Rclone 1.43.1 (Sep 10, 2018)

  • Bug Fixes:
  • ncdu: Return error instead of log.Fatal in Show (Fabian Möller)
  • cmd: Fix crash with --progress and --stats 0 (Nick Craig-Wood)
  • docs: Tidy website display (Anagh Kumar Baranwal)
  • Azure Blob:
  • Fix multi-part uploads. (sandeepkru)
  • Hubic:
  • Fix uploads (Nick Craig-Wood)
  • Retry auth fetching if it fails to make hubic more reliable (Nick Craig-Wood)

New in Rclone 1.43 (Sep 3, 2018)

  • New backends:
  • Jottacloud (Sebastian Bünger)
  • New commands:
  • copyurl: copies a URL to a remote (Denis)
  • New Features:
  • Reworked config for backends (Nick Craig-Wood)
  • All backend config can now be supplied by command line, env var or config file
  • Advanced section in the config wizard for the optional items
  • A large step towards rclone backends being usable in other go software
  • Allow on the fly remotes with :backend: syntax
  • Stats revamp
  • Add --progress/-P flag to show interactive progress (Nick Craig-Wood)
  • Show the total progress of the sync in the stats (Nick Craig-Wood)
  • Add --stats-one-line flag for single line stats (Nick Craig-Wood)
  • Added weekday schedule into --bwlimit (Mateusz)
  • lsjson: Add option to show the original object IDs (Fabian Möller)
  • serve webdav: Make Content-Type without reading the file and add --etag-hash (Nick Craig-Wood)
  • build
  • Build macOS with native compiler (Nick Craig-Wood)
  • Update to use go1.11 for the build (Nick Craig-Wood)
  • Added core/stats to return the stats (reddi1)
  • version --check: Prints the current release and beta versions (Nick Craig-Wood)
  • Bug Fixes:
  • accounting:
  • Fix time to completion estimates (Nick Craig-Wood)
  • Fix moving average speed for file stats (Nick Craig-Wood)
  • config: Fix error reading password from piped input (Nick Craig-Wood)
  • move: Fix --delete-empty-src-dirs flag to delete all empty dirs on move (ishuah)
  • Mount:
  • Implement --daemon-timeout flag for OSXFUSE (Nick Craig-Wood)
  • Fix mount --daemon not working with encrypted config (Alex Chen)
  • Clip the number of blocks to 2^32-1 on macOS - fixes borg backup (Nick Craig-Wood)
  • VFS:
  • Enable vfs-read-chunk-size by default (Fabian Möller)
  • Add the vfs/refresh rc command (Fabian Möller)
  • Add non recursive mode to vfs/refresh rc command (Fabian Möller)
  • Try to seek buffer on read only files (Fabian Möller)
  • Local:
  • Fix crash when deprecated --local-no-unicode-normalization is supplied (Nick Craig-Wood)
  • Fix mkdir error when trying to copy files to the root of a drive on windows (Nick Craig-Wood)
  • Cache:
  • Fix nil pointer deref when using lsjson on cached directory (Nick Craig-Wood)
  • Fix nil pointer deref for occasional crash on playback (Nick Craig-Wood)
  • Crypt:
  • Fix accounting when checking hashes on upload (Nick Craig-Wood)
  • Amazon Cloud Drive
  • Make very clear in the docs that rclone has no ACD keys (Nick Craig-Wood)
  • Azure Blob:
  • Add connection string and SAS URL auth (Nick Craig-Wood)
  • List the container to see if it exists (Nick Craig-Wood)
  • Port new Azure Blob Storage SDK (sandeepkru)
  • Added blob tier, tier between Hot, Cool and Archive. (sandeepkru)
  • Remove leading / from paths (Nick Craig-Wood)
  • B2:
  • Support Application Keys (Nick Craig-Wood)
  • Remove leading / from paths (Nick Craig-Wood)
  • Box:
  • Fix upload of > 2GB files on 32 bit platforms (Nick Craig-Wood)
  • Make --box-commit-retries flag defaulting to 100 to fix large uploads (Nick Craig-Wood)
  • Drive:
  • Add --drive-keep-revision-forever flag (lewapm)
  • Handle gdocs when filtering file names in list (Fabian Möller)
  • Support using --fast-list for large speedups (Fabian Möller)
  • FTP:
  • Fix Put mkParentDir failed: 521 for BunnyCDN (Nick Craig-Wood)
  • Google Cloud Storage
  • Fix index out of range error with --fast-list (Nick Craig-Wood)
  • Jottacloud:
  • Fix MD5 error check (Oliver Heyme)
  • Handle empty time values (Martin Polden)
  • Calculate missing MD5s (Oliver Heyme)
  • Docs, fixes and tests for MD5 calculation (Nick Craig-Wood)
  • Add optional MimeTyper interface. (Sebastian Bünger)
  • Implement optional About interface (for df support). (Sebastian Bünger)
  • Mega:
  • Wait for events instead of arbitrary sleeping (Nick Craig-Wood)
  • Add --mega-hard-delete flag (Nick Craig-Wood)
  • Fix failed logins with upper case chars in email (Nick Craig-Wood)
  • Onedrive:
  • Shared folder support (Yoni Jah)
  • Implement DirMove (Cnly)
  • Fix rmdir sometimes deleting directories with contents (Nick Craig-Wood)
  • Pcloud:
  • Delete half uploaded files on upload error (Nick Craig-Wood)
  • Qingstor:
  • Remove leading / from paths (Nick Craig-Wood)
  • S3:
  • Fix index out of range error with --fast-list (Nick Craig-Wood)
  • Add --s3-force-path-style (Nick Craig-Wood)
  • Add support for KMS Key ID (bsteiss)
  • Remove leading / from paths (Nick Craig-Wood)
  • Swift:
  • Add storage_policy (Ruben Vandamme)
  • Make it so just storage_url or auth_token can be overidden (Nick Craig-Wood)
  • Fix server side copy bug for unusal file names (Nick Craig-Wood)
  • Remove leading / from paths (Nick Craig-Wood)
  • WebDAV:
  • Ensure we call MKCOL with a URL with a trailing / for QNAP interop (Nick Craig-Wood)
  • If root ends with / then don’t check if it is a file (Nick Craig-Wood)
  • Don’t accept redirects when reading metadata (Nick Craig-Wood)
  • Add bearer token (Macaroon) support for dCache (Nick Craig-Wood)
  • Document dCache and Macaroons (Onno Zweers)
  • Sharepoint recursion with different depth (Henning)
  • Attempt to remove failed uploads (Nick Craig-Wood)
  • Yandex:
  • Fix listing/deleting files in the root (Nick Craig-Wood)

New in Rclone 1.42 (Aug 9, 2018)

  • New backends:
  • OpenDrive (Oliver Heyme, Jakub Karlicek, ncw)
  • New commands:
  • deletefile command (Filip Bartodziej)
  • New Features:
  • copy, move: Copy single files directly, don’t use --files-from work-around
  • this makes them much more efficient
  • Implement --max-transfer flag to quit transferring at a limit
  • make exit code 8 for --max-transfer exceeded
  • copy: copy empty source directories to destination (Ishuah Kariuki)
  • check: Add --one-way flag (Kasper Byrdal Nielsen)
  • Add siginfo handler for macOS for ctrl-T stats (kubatasiemski)
  • add core/gc to run a garbage collection on demand
  • enable go profiling by default on the --rc port
  • return error from remote on failure
  • lsf
  • Add --absolute flag to add a leading / onto path names
  • Add --csv flag for compliant CSV output
  • Add ’m’ format specifier to show the MimeType
  • Implement ‘i’ format for showing object ID
  • lsjson
  • Add MimeType to the output
  • Add ID field to output to show Object ID
  • Add --retries-sleep flag (Benjamin Joseph Dag)
  • Oauth tidy up web page and error handling (Henning Surmeier)
  • Bug Fixes:
  • Password prompt output with --log-file fixed for unix (Filip Bartodziej)
  • Calculate ModifyWindow each time on the fly to fix various problems (Stefan Breunig)
  • Mount:
  • Only print “File.rename error” if there actually is an error (Stefan Breunig)
  • Delay rename if file has open writers instead of failing outright (Stefan Breunig)
  • Ensure atexit gets run on interrupt
  • macOS enhancements
  • Make --noappledouble --noapplexattr
  • Add --volname flag and remove special chars from it
  • Make Get/List/Set/Remove xattr return ENOSYS for efficiency
  • Make --daemon work for macOS without CGO
  • VFS:
  • Add --vfs-read-chunk-size and --vfs-read-chunk-size-limit (Fabian Möller)
  • Fix ChangeNotify for new or changed folders (Fabian Möller)
  • Local:
  • Fix symlink/junction point directory handling under Windows
  • NB you will need to add -L to your command line to copy files with reparse points
  • Cache:
  • Add non cached dirs on notifications (Remus Bunduc)
  • Allow root to be expired from rc (Remus Bunduc)
  • Clean remaining empty folders from temp upload path (Remus Bunduc)
  • Cache lists using batch writes (Remus Bunduc)
  • Use secure websockets for HTTPS Plex addresses (John Clayton)
  • Reconnect plex websocket on failures (Remus Bunduc)
  • Fix panic when running without plex configs (Remus Bunduc)
  • Fix root folder caching (Remus Bunduc)
  • Crypt:
  • Check the crypted hash of files when uploading for extra data security
  • Dropbox:
  • Make Dropbox for business folders accessible using an initial / in the path
  • Google Cloud Storage:
  • Low level retry all operations if necessary
  • Google Drive:
  • Add --drive-acknowledge-abuse to download flagged files
  • Add --drive-alternate-export to fix large doc export
  • Don’t attempt to choose Team Drives when using rclone config create
  • Fix change list polling with team drives
  • Fix ChangeNotify for folders (Fabian Möller)
  • Fix about (and df on a mount) for team drives
  • Onedrive:
  • Errorhandler for onedrive for business requests (Henning Surmeier)
  • S3:
  • Adjust upload concurrency with --s3-upload-concurrency (themylogin)
  • Fix --s3-chunk-size which was always using the minimum
  • SFTP:
  • Add --ssh-path-override flag (Piotr Oleszczyk)
  • Fix slow downloads for long latency connections
  • Webdav:
  • Add workarounds for biz.mail.ru
  • Ignore Reason-Phrase in status line to fix 4shared (Rodrigo)
  • Better error message generation