community
/
rclone
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
rclone/backend
History
Saksham Khanna 4d8ef7bca7
cmd/dedupe: make largest directory primary to minimize data moved (#3648) 
This change makes dedupe recursively count elements in same-named directories
and make the largest one primary. This allows to minimize the amount of data
moved (or at least the amount of API calls) when dedupe merges them.
It also adds a new fs.Object interface `ParentIDer` with function `ParentID` and
implements it for the drive and opendrive backends. This function returns
parent directory ID for objects on filesystems that allow same-named dirs.
We use it to correctly count sizes of same-named directories.

Fixes #2568

Co-authored-by: Ivan Andreev <ivandeex@gmail.com>
 		2021-03-11 20:40:29 +03:00
..
alias config: make config file system pluggable 2021-03-11 17:29:26 +00:00
all HDFS (Hadoop Distributed File System) implementation - #42 2021-01-07 09:48:51 +00:00
amazonclouddrive fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
azureblob azureblob: require go1.14+ to compile due to SDK changes 2021-01-30 18:01:12 +00:00
b2 b2: fix failed to create file system with application key limited to a prefix 2021-02-11 15:13:19 +00:00
box box: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
cache config: make config file system pluggable 2021-03-11 17:29:26 +00:00
chunker address stringent ineffectual assignment check in golangci-lint (#5093) 2021-03-04 14:26:48 +03:00
compress compress: check type assertion in SetTier - fixes #4941 2021-01-20 22:59:14 +00:00
crypt crypt: add option to not encrypt data #1077 (#2981) 2021-02-17 03:40:37 +03:00
drive cmd/dedupe: make largest directory primary to minimize data moved (#3648) 2021-03-11 20:40:29 +03:00
dropbox dropbox: fix polling support for scoped apps - fixes #5089 (#5092) 2021-03-05 17:44:47 +00:00
fichier fichier: implement public link 2021-03-11 00:44:26 +01:00
filefabric filefabric: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
ftp dropbox,ftp,onedrive,yandex: make --timeout 0 work properly 2021-03-01 12:08:58 +00:00
googlecloudstorage Use http.NewRequestWithContext where possible after go1.13 minimum version 2021-02-03 17:41:27 +00:00
googlephotos gphotos: new flag --gphotos-include-archived - fixes #4728 2021-01-28 16:51:31 +00:00
hdfs hdfs: support kerberos authentication #42 2021-01-27 18:16:58 +00:00
http config: make config file system pluggable 2021-03-11 17:29:26 +00:00
hubic swift: update github.com/ncw/swift to v2.0.0 2021-02-03 20:23:37 +00:00
jottacloud jottacloud: Add support for Telia Cloud (#4930) 2021-01-17 02:38:57 +01:00
koofr fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
local local: Add flag --no-preallocate - #3207 2021-02-11 17:25:28 +00:00
mailru fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
mega fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
memory azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
onedrive dropbox,ftp,onedrive,yandex: make --timeout 0 work properly 2021-03-01 12:08:58 +00:00
opendrive cmd/dedupe: make largest directory primary to minimize data moved (#3648) 2021-03-11 20:40:29 +03:00
pcloud azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
premiumizeme premiumizeme: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
putio Use http.NewRequestWithContext where possible after go1.13 minimum version 2021-02-03 17:41:27 +00:00
qingstor qingstor: fix rclone cleanup 2021-01-21 17:35:31 +00:00
s3 s3: fix Wasabi HEAD requests returning stale data by using only 1 transport 2021-03-05 15:34:56 +00:00
seafile fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
sftp sftp: close idle connections after --sftp-idle-timeout (1m by default) 2021-02-16 12:39:05 +00:00
sharefile fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
sugarsync sugarsync: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
swift swift: update github.com/ncw/swift to v2.0.0 2021-02-03 20:23:37 +00:00
tardigrade build: remove go1.13 build constraints 2021-02-03 17:46:08 +00:00
union union: fix mkdir at root with remote:/ 2021-02-17 12:11:34 +00:00
webdav webdav: check that purged directory really exists (#2921) 2021-02-23 23:27:30 +00:00
yandex dropbox,ftp,onedrive,yandex: make --timeout 0 work properly 2021-03-01 12:08:58 +00:00
zoho zoho: fix custom client id's 2021-02-23 11:27:05 +00:00