21aca68680
tree: fix when running under Windows
2017-08-01 14:46:21 +01:00
ef328c5497
Fixes typo in command dedupe definition
2017-07-27 21:17:57 +01:00
f3060caf04
Implement tree command - fixes #1528
2017-07-26 23:06:48 +01:00
ebc8361933
mount: Add notes on Windows limitations from Bill Zissimopoulos
2017-07-26 21:08:24 +01:00
cd4895690a
fstest: Factor test initialisation into Initialise()
2017-07-26 16:38:33 +01:00
de54fd4c64
mount: add docs for windows install
2017-07-23 13:05:02 +01:00
7b81f12dad
box: add docs
...
* reorder remotes so they are in alphabetical order by full name everywhere
* update CONTRIBUTING doc
2017-07-23 11:32:34 +01:00
c223464cd0
mount: fix panic on renames - fixes #1533
...
Make sure d.items is not nil and improve locking
2017-07-22 11:00:51 +01:00
3ddcbce989
DOC: any empty directoryies -> empty directories ( fixes #1546 )
2017-07-22 10:24:41 +02:00
e86f62c3e8
Add rclone info internal command for testing out limits of remotes
2017-07-03 15:05:27 +01:00
e7d04fc103
Create fs.Directory interface and use it everywhere
2017-06-30 14:26:59 +01:00
e2d7d413ef
fs: rename BasicInfo to DirEntry
2017-06-30 14:26:58 +01:00
aa20486485
Add --stats-log-level so can see --stats without -v - fixes #1180
...
The most common use for this flag is likely to be showing the stats
without using -v by using `--stats-log-level NOTICE`.
2017-06-26 22:50:37 +01:00
1817d8f631
crypt: Fix typo in cryptcheck's short description
2017-06-26 12:35:20 +01:00
b360527931
mount: fix hang on errored upload
...
In certain circumstances if an upload failed then the mount could hang
indefinitely. This was fixed by closing the read pipe after the Put
completed. This will cause the write side to return a pipe closed
error fixing the hang.
Fixes #1498
2017-06-26 12:08:51 +01:00
b22c4c4307
http: fix, tidy and rework ready for release
...
* Fix remaining problems
* Refactor to make testing easier and add a test suite
* Make path parsing more robust.
* Add single file operations
* Add MimeType reading for objects
* Add documentation
* Note go1.7+ is required to build
2017-06-20 21:27:14 +01:00
dcce65b2b3
mount/cmount: factor duplicated code into mountlib
2017-06-19 14:36:51 +01:00
97364fd0b6
ncdu: disable on plan9 and solaris as termbox isn't supported there
2017-06-15 20:10:54 +01:00
c34f11a92f
rclone ncdu for exploring a remote with a text based user interface.
2017-06-15 17:44:17 +01:00
7be49249d3
Add lsjson command - fixes #1063
2017-06-14 16:49:40 +01:00
7e20e16cff
core: Implement Walk directory listing and use in place of Lister
...
This is in preparation for removing the Lister code and replacing the
fundamental operation in the Fs with listing a single directory.
2017-06-14 16:49:40 +01:00
68333d34a1
dropbox: make setting mod time on existing files work properly
...
This is a fix left over from the v2 conversion. Dropbox ignores the
client modification on an incoming file if it was identical to the
existing file. This change deletes the existing file first before
re-uploading the new one.
2017-06-13 13:58:39 +01:00
740b3f6ae2
Fix problems found with ineffassign
2017-06-13 11:52:36 +01:00
28fcc53e45
mount test: retry umount as it fails occasionally
...
This is because of the background releasing of files which happens
after all the files are closed.
2017-06-13 10:52:10 +01:00
d30cc1e119
Factor RemoteSplit into fs
2017-06-07 12:27:33 +01:00
9782c264e9
hand dirCacheTime through again
2017-06-01 09:02:22 +01:00
52e96bc0e2
dropbox: add missing dbhashsum command
...
This was missed from 6381959850
2017-05-30 19:26:06 +01:00
6381959850
dropbox: support Dropbox content hashing scheme - fixes #1302
...
* add support to hashing module
* add dbhashsum to list the hashes
* add support to dropbox module
This means objects up and downloaded to/from Dropbox will have their
hashes checked.
Note after this change local objects are calculating MD5, SHA1 and
DBHASH which is excessive and needs to be fixed.
2017-05-29 12:04:44 +01:00
a2e3af0523
poll for Google Drive changes when mounted
2017-05-28 17:54:52 +01:00
ade61fa756
Updated FTP to follow SFTP standards, updated documentation
2017-05-25 09:30:15 +01:00
8f54dc06a2
Use build tags to control when and where cmount is built
2017-05-19 17:08:04 +01:00
2cae017738
mountlib: fix race condition in cache clear
2017-05-19 15:47:52 +01:00
ecedcd0e7f
cmount: stop failing tests on Windows
2017-05-15 17:40:44 +01:00
3dff91d691
mount: add missing build constraint to fix Windows build
2017-05-15 17:40:15 +01:00
b259f8b752
cmount, mount, mountlib: make --read-only reject modify operations
...
Normally mount/cmount use `-o ro` to get the kernel to mark the fs as
read only. However this is ignored by WinFsp, so in addition if
`--read-only` is in effect then return EROFS ("Read only File System")
from all methods which attempt to modify something.
2017-05-15 16:56:47 +01:00
8be8a8e41b
mountlib: on read only open of file, make open pending until first read
...
This fixes a problem with Windows which seems fond of opening files
just to read their attributes and closing them again.
2017-05-15 16:56:47 +01:00
f9500729b7
mountlib: fix cross platform tests
2017-05-15 16:56:46 +01:00
204a19e67f
cmount: Wait for mountpoint to appear on Windows before declaring mounted
2017-05-15 16:56:46 +01:00
e6ffe3464c
cmount: check for filesystem blowing up before Init is called
2017-05-15 16:56:46 +01:00
0384364c3e
cmount: pass --FileSystemName under windows
2017-05-15 16:56:46 +01:00
763facfd78
cmount: implement --fuse-flag to pass commands to fuse library directly
...
Useful for `--fuse-flag -h` to see exactly which options the library supports.
2017-05-15 16:56:46 +01:00
bc88f1dafa
cmount: fix openFile leak
2017-05-15 16:56:46 +01:00
0c055a1215
cmount: Statfs: reduce max size of volume for Windows
2017-05-15 16:56:46 +01:00
938d7951ab
cmount: allow extra options to pass to fuse with -o
2017-05-15 16:56:45 +01:00
b4466bd9b1
Add -o uid=-1 -o gid=-1 for Windows/WinFsp
2017-05-15 16:56:45 +01:00
31f76aa464
cmount: implement no-ops for Fsync, Chmod, Chown, Access, Fsyncdir and stop using fuse.FileSystemBase
2017-05-15 16:56:45 +01:00
c887c164dc
cmount: add function tracing
2017-05-15 16:56:45 +01:00
115ac00222
mount, mountlib: move function tracing into mount
2017-05-15 16:56:45 +01:00
abda616f84
mountlib: make Nodes also be fmt.Stringer so they debug nicely
2017-05-15 16:56:45 +01:00
9c3048580a
cmount: fix code quality warnings
2017-05-15 16:56:45 +01:00
c1d5faa32a
mountlib: fix code quality warnings
2017-05-15 16:56:45 +01:00
d127d8686a
mountlib: pass options in fsys not as args
2017-05-15 16:56:44 +01:00
bc9856b570
Forward port 930ff266f2 to cmount branch
...
compare checksums on upload/download via FUSE
2017-05-15 16:56:44 +01:00
855071cc19
cmount: name the command mount under windows and cmount under linux
2017-05-15 16:56:44 +01:00
b179540e80
cmount: fix Getattr to work on directories
2017-05-15 16:56:44 +01:00
6a8e4690d3
mountlib: windows fixes for drive letter and timing
2017-05-15 16:56:44 +01:00
917ea6ac57
mountlib: make tests work under all platforms
2017-05-15 16:56:44 +01:00
7b47a1e842
cmount: set the correct values for uid, gid under Windows
2017-05-15 16:56:44 +01:00
bcd87009e2
Fix docs typo
2017-05-15 16:56:44 +01:00
caf85737c3
cmount: fix Windows compile (thanks Bill Zissimopoulos)
2017-05-15 16:56:44 +01:00
e1516e0159
Forward port 58a82cd578 into cmount branch
...
allow the fuse directory cached to be cleaned manually
2017-05-15 16:56:43 +01:00
ee1111e4c9
cmount: a new mount option based on cgofuse.
...
This with the aid of WinFSP should work on Windows.
Unfinished bits
* 1 test doesn't pass
* docs
* build
2017-05-15 16:56:43 +01:00
268fe0004c
mount: factor filesystem code into mountlib and mounttest
2017-05-12 21:24:24 +01:00
58a82cd578
allow the fuse directory cached to be cleaned manually ( fixes #803 )
2017-05-07 12:08:59 +01:00
930ff266f2
compare checksums on upload/download via FUSE
2017-05-02 22:27:38 +01:00
2fd86c93fc
allow modTime to be changed even before all writers are closed ( fixes #1197 -- again)
2017-03-31 01:28:08 +02:00
a54692d165
OneDrive vs One Drive
...
It's better to call this service as it's officially named.
2017-03-29 18:11:33 +01:00
4810aa65a4
Update references from HTTP to HTTPS where possible
2017-03-29 05:38:34 -07:00
4dc030d081
implement ModTime via FUSE for remotes that support it ( fixes #1197 )
2017-03-24 09:23:04 +01:00
788b6ce821
mount: umount dir when program ends with SIGINT (Ctrl+C) or SIGTERM
2017-03-18 21:24:05 +00:00
1cc58e4e09
mount: fix logging for unimplemented file open modes #1195
2017-03-02 22:07:01 +00:00
30e97ad9ec
Fix parsing of remotes in moveto and copyto - fixes #1079
2017-02-22 22:09:33 +00:00
07dc76eff0
Remove unused test file
2017-02-22 20:58:24 +00:00
31745320c8
Log the rclone version at the end of the run - fixes #847
2017-02-20 16:36:25 +00:00
2da6cd7f84
Introduce AtExit to fix --cpuprofile and --memprofile to write profiles at end of run
2017-02-20 16:33:45 +00:00
3ef9f6f016
mount: add test scripts
2017-02-17 11:37:19 +00:00
033d1eb7af
Refactor Account interface
2017-02-17 09:15:24 +00:00
928be0f1fd
mount: fix seek with buffering to use correct interface
...
Stop pre-cache before seeking which stops lots of excess data transfer
2017-02-17 08:55:24 +00:00
ef604f6100
mount: implement renaming directories - fixes #954
...
This also fixes various caching issues renaming files.
2017-02-16 17:42:38 +00:00
dac4bb22d3
mount: Make include and exclude filters apply to mount - fixes #1060
2017-02-15 23:28:53 +00:00
9a9d09845c
mount: put read and write async buffers back - control with --buffer-size #1043
2017-02-14 22:59:52 +00:00
541929258b
check: Add --download flag to check all the data, not just hashes
2017-02-13 10:48:26 +00:00
01c747e7db
Add cryptcheck command to check integrity of crypt remotes #1102
2017-02-12 16:30:18 +00:00
ca0e25b1a1
Remove spurious comment
2017-02-12 10:56:52 +00:00
666dae4229
Add --syslog flag to optionally log to syslog on capable platforms
2017-02-11 20:27:46 +00:00
ac1c041377
Redo log level flags
...
* -vv or --log-level DEBUG
* -v or --log-level INFO
* --log-level NOTICE (default)
* -q --log-level ERROR
Replace Config.Verbose and Config.Quiet with Config.LogLevel
Fixes #739 Fixes #1108 Fixes #1000
2017-02-11 20:22:42 +00:00
0366ea39c5
Reassign some logging levels
2017-02-11 17:56:05 +00:00
80f53176d9
Rename log functions and factor into own file
2017-02-11 17:54:50 +00:00
d091d4a8bb
rclone cat: add --head, --tail, --offset, --count and --discard
...
Fixes #819
2017-02-08 08:09:41 +00:00
288302c2cf
Make fallback purge delete empty directories too.
...
This was implemented to make the SFTP unit tests pass.
2017-02-04 10:29:46 +00:00
8a11da4e14
mount: Make fsync be a no-op for direectories too #1045
2017-02-02 21:31:41 +00:00
37fe6d56e5
mount: fix docs for umount flags - fixes #1036
2017-01-30 18:17:16 +00:00
29c6e22024
mount: Make fsync be a no-op rather than returning an error - fixes #1045
2017-01-29 11:29:42 +00:00
a6b4065e13
mount: fix retry on network failure when reading off crypt - fixes #1042
2017-01-17 16:32:04 +00:00
d4c923a5cc
Add obscure command for generating encrypted passwords for rclone's config
2017-01-10 13:18:09 +00:00
35a6436983
mount: implement proper directory handling (mkdir, rmdir)
...
Before this change mount only simulated rmdir & mkdir, now it actually
runs mkdir & rmdir on the underlying remote, using the new parmaeters
to fs.Mkdir and fs.Rmdir.
Fixes #956
2017-01-06 11:24:22 +00:00
f73ee5eade
Make all config file variables be settable in the environment
...
These are set in the form RCLONE_CONFIG_remote_option where remote is
the uppercased remote name and option is the uppercased config file
option name. Note that RCLONE_CONFIG_remote_TYPE must be set if
defining a new remote.
Fixes #616
2017-01-03 22:42:47 +00:00
0d75d2585f
Allow all options to be set from environment variables
...
The option names are munged changing - to _ making upper case and
prepending RCLONE_. The values are as parsed by pflag.
2017-01-03 22:42:47 +00:00
5894c02a34
Typo: the the -> the in docs and comments
2017-01-03 20:48:26 +00:00
43c530922a
Restore ability for any command to show stats by adding --stats flag
...
Make default for `mount` command not to show stats - this can be
re-enabled by adding a `--stats` parameter.
2016-12-15 17:40:17 +00:00
dd60f088ed
mount: retry reads on error #873
2016-12-15 17:16:55 +00:00
0117aeafbf
mount: this removes the async buffering as it was killing seek performance
2016-12-15 17:08:52 +00:00
13b705e227
mount: report the modification times for directories from the remote #940 #950
...
This stops the modification times for directories just being the
current time and reads them from the remote instead. This doesn't
take any extra transactions.
2016-12-14 15:26:04 +00:00
c24da0b886
fuse: add stats printing and note which files are transferring
2016-12-04 16:59:46 +00:00
be4fd51289
fuse: Add bandwidth accounting and buffering
...
This fixes rclone mount ignoring bwlimit and increases buffering which
should speed up transfers greatly.
Fixes #796
Fixes #690
2016-12-04 16:57:47 +00:00
2cbdb95ce5
Only show transfer stats on commands which transfer stuff - fixes #849
2016-12-04 16:52:24 +00:00
c265f451f2
Implement moveto and copyto commands for choosing a destination name on copy/move
...
Fixes #227
Fixes #476
2016-12-03 23:43:52 +00:00
2058652fa4
Allow overlapping remotes in move when DirMove is supported
2016-12-03 09:08:40 +00:00
5e35aeca9e
Regularize the command definition names
2016-12-03 09:08:40 +00:00
7929b6e756
fuse: support R/W files only if truncate is set.
...
Any reads on the file handle will return an error. This is to support
windows/samba writes.
2016-11-28 17:56:54 +00:00
f9df545e3c
add --stats-unit option and improve alignment for --stats output
2016-11-28 12:18:30 +00:00
5e62ede8d0
make the parameter format for --stats flag more obvious
2016-11-27 18:57:23 +00:00
8aae166a5b
Add missing rmdirs command
2016-11-27 18:36:13 +00:00
f3365dd251
Make rclone rmdirs command to delete empty directories - fixes #831
2016-11-27 11:49:31 +00:00
aaa1370a36
Add directory parameter to Rmdir and Mkdir #100 #831
...
This will enable rclone to manage directories properly in the future.
2016-11-26 12:02:53 +00:00
c41b67ea08
mount: Implement statfs interface so df works - fixes #894
...
The data returned is not related to the files on the remote, but
apparently samba needs it.
2016-11-20 22:54:03 +00:00
0b562bcabc
mount: Note that write is now supported on ACD
2016-11-19 10:54:37 +00:00
bf243f30d3
report number of blocks in fuse
2016-11-12 14:10:36 +01:00
64b5a76bec
mount: detect and deal with seeking beyond end of file - fixes #828
2016-11-05 09:59:36 +00:00
7cfb1bdc70
fuse: tests: create the directory before starting tests
2016-11-05 09:57:45 +00:00
062616e4dd
mount: update code comments
2016-10-30 17:46:00 +00:00
87107413f5
fuse: add missing locking on filehandle read #823 #802
2016-10-27 09:57:52 +01:00
77b975d16f
Note Amazon Drive doesn't support uploads via FUSE yet
2016-10-23 21:46:48 +01:00
c464cc6376
mount: fix alignment of 64 bit counter on ARM #813
2016-10-23 17:36:35 +01:00
93e84403bb
Remove io.SeekStart and replace with 0 as it is go 1.7 only
2016-10-22 12:07:51 +01:00
eba0a3633b
crypt: speed up repeated seeking - fixes #804
2016-10-21 10:03:16 +01:00
de73063977
Fix output of crypt objects in logs
2016-10-20 17:46:51 +01:00
a02edb9e69
Add rclone mount --dir-cache-time to control caching of directory entries - fixes #680
2016-10-18 17:23:57 +01:00
d8d11023d3
mount: update internal position on seek - fixes #774
2016-10-17 20:20:07 +01:00
ace1e21894
Add listremotes command - fixes #558
2016-10-08 14:24:37 +01:00
f45b3c87bf
mount: add --no-seek flag to disable seeking
2016-10-06 13:37:45 +01:00
de80a540a7
mount: attempt to speed up
2016-10-05 21:04:57 +01:00
392a86f585
mount: Fix read flushing - fixes #638
2016-10-05 21:03:56 +01:00
265f5b77a7
mount: make files opened for read seekable - fixes #707
2016-10-05 21:03:56 +01:00
bfe6f299d0
Revise list of OSes which can redirect stderr - fixes #698
2016-09-19 17:13:41 +01:00
4001e21624
Make sure high level retries show with -q - fixes #648
...
Also update the exit code documentation describing that.
2016-09-12 17:50:19 +01:00
bbf819e2d1
Move versioncheck so it happens earlier in the compile process.
2016-09-12 17:50:19 +01:00
5c91623148
mount: Implement FUSE mount options - fixes #653
2016-09-10 09:50:46 +01:00
87db3cfad3
Use Dup2 library function instead of raw syscall
...
The Dup2 syscall does not exist on 64-bit arm Linux while its
replacement Dup3 does not exist on non-Linux systems.
Using the unix.Dup2 library function instead of raw syscalls
improves the portability across more platforms.
2016-09-08 08:17:31 +01:00
ca841c56a8
Disable smart dashes so `--flag` shows properly in the docs - fixes #632
2016-08-22 16:46:08 +01:00
9e7ddd5efc
Fix tests when FUSE isn't present
2016-08-20 14:11:21 +01:00
84eb7031bb
Implement the rclone cat command
2016-08-18 22:45:32 +01:00
f22029bf3d
Add mount command to implement FUSE mounting of remotes #494
...
This enables any rclone remote to be mounted and used as a filesystem
with some limitations.
Only supported for Linux, FreeBSD and OS X
2016-08-18 21:54:54 +01:00
ae6018355c
Correct parameter order for copy/sync etc
2016-08-06 00:07:36 +01:00
e27b91ffb8
Factor each commmand into its own package
2016-08-05 17:13:54 +01:00
0a7b34eefc
Move internals of rclone command into cmd so it can be imported externally
2016-08-04 22:33:46 +01:00
Nick Craig-Wood
Andy Pilate
Yaroslav Halchenko
sainaen
Stefan Breunig
Sjur Fredriksen
Ihor Dvoretskyi
marvwatson
Jérôme Vizcaino
T.C. Ferguson
Lukas Loesche
Scott McGillivray
Fredrik Fornwall