Sabre_DAV_Exception_BadRequest: expected filesize mismatch

[paulepanter]

With ownCloud 7.0.0 (already present before in at least 6.0.4) I see a lot of Sabre_DEV_Exception_BadRequest errors in /var/www/owncloud/data/owncloud.log.

{"app":"webdav","message":"Sabre_DAV_Exception_BadRequest: expected filesize 4734206 got 458752","level":4,"time":"2014-07-10T13:58:54+00:00"}

There is one user having problems synchronizing it’s files with the server. The user has the latest ownCloud client 1.6.1 installed and experiences the problems with the client on Microsoft Windows and Mac OS. Other users with Mac OS and the client do not experience any problems.

[DeepDiver1975]

Starting with OC7 we log every webdav exception in order to enable easier debugging in case of sync issues. Not really relevant

"expected filesize 4734206 got 458752" basically is telling us that a file upload was terminated before all data got passed to the server.

[DeepDiver1975]

In addition 'Sabre_DAV_Exception_BadRequest' is used in OC6 - but no longer in OC7.
This error message is from OC6 times - log date confirms this (2014-07-10T13:58:54+00:00)

[paulepanter]

@DeepDiver1975, sorry for overlooking that information. For the said user, the ownCloud client currently shows that everything is synchronized and it shows 1.6 GB of data is stored on the server. But it should actually be over 20 GB.

[bastla]

I'm encountering the same problems with the update to OC 7.0.0 last night. Using davfs to mount my OC WebDav i can't create new files:

{"app":"webdav","message":"Sabre\\DAV\\Exception\\BadRequest: expected filesize 163 got 0","level":4,"time":"2014-07-24T11:16:19+00:00"}

Changing files and creating directories is working fine.

Setup Server: Debian with owncloud 7.0.0
Setup Client: Debian with davfs2 1.5.0-1

[DeepDiver1975]

@bastla the connection did break apart due to whatever reason. Not much we can do

[DeepDiver1975]

@paulepanter case closed?

[bastla]

@DeepDiver1975 Even tried it with a local mount. Still the same problem - connection doing great. :-S Do you have any idea?

[bastla]

@DeepDiver1975 Tested it with nautilus and konqueror - worked fine. Problem must be with davfs2. Sry for noise.

[paulepanter]

@DeepDiver1975, the other systems are in the same network and no problems are experienced otherwise. I think the issue should be left open until this has been properly debugged.

Could it be that some time-outs are involved?

Broken connections should not be a problem with HTTP, shouldn’t they?

[DeepDiver1975]

Best would be to find correlated log entries in server and client log to see what's going on.
But as long as the sync client is running and files are properly synced your systems should be fine

[znoxx]

This started for me after 6.x->7.0 upgrade
cadaver works fine, actually
May be some config tweaks for davfs ?

[IngLP]

Same issue here. OC 7.0.1 running on linux. many errors like that even syncing in local (same pc server/client)
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 4931584 2014-08-27T22:36:06+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 3956736 2014-08-27T22:33:56+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 3883008 2014-08-27T22:23:28+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 5472256 2014-08-27T22:17:32+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 3334144 2014-08-27T22:15:17+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 5496832 2014-08-27T22:09:21+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 3809280 2014-08-27T22:07:11+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 6012928 2014-08-27T22:01:15+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 3678208 2014-08-27T21:58:59+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 3842048 2014-08-27T21:53:04+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 2460128 got 1507328 2014-08-27T21:53:04+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 4030464 2014-08-27T21:50:42+00:00
Fatal webdav Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 491520 2014-08-27T21:21:49+00:00

[Blisk]

I have also that problem with OC 7.0.1 and client 1.6.2
And no files are copied to server

{"app":"webdav","message":"Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 5095424","level":4,"time":"2014-08-27T14:21:33+00:00"}
{"app":"webdav","message":"Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 3448832","level":4,"time":"2014-08-27T14:39:41+00:00"}
{"app":"webdav","message":"Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 7225344","level":4,"time":"2014-08-27T14:57:49+00:00"}

[OliverKohl]

@paulepanter, @bastla: Is it possible that you have something like a WebWasher or a firewall in between, that either scans your content, blocks certain parts of your upload or forces the upload to terminate after a certain amount of GB or time.

If not - is it possible that you have limited your upload size in PHP?

@Blisk: For you I think the latter one applies due to the fact that your file sizes are dividable by 1024 (10485760 / 1024 / 1024 or 5095424 / 1024 / 1024) without remainder.

If so please increase it.

Cheers

Oliver

[znoxx]

@OliverKohlDSc
I use localhost mount, even without https
and php.ini value is
upload_max_filesize = 16G
I don't think it makes sense for 32 bit system, but anyway
It fails even on 100mb files.
But, again, cadaver client works fine

[OliverKohl]

@znoxx: hmmm ....
I'm afraid in this case it must be a bug.
Do you have possibilities to debug the script invocation?
e.g. with Eclipse/FirePhp/Xdebug ...
(even the old fashioned var_dump is ok)

[znoxx]

@OliverKohlDSc, sorry, but I don't have such skill. My OC is running on headless Cubieboard2 server, and currently I'm accessing it only remotely.
Any other volunteers ?

[Blisk]

@OliverKohlDSc is that also apply if I upload via client?
Because I didn't upload ti by web browser but with client 1.6.2

[OliverKohl]

@Blisk: Yes it does.

[scolebrook]

See owncloud/client#2116 (comment)
Can you try using the different network setting in the client and see if that works? It will help isolate the issue.

[OliverKohl]

Absolutely! Maybe you want to check your upload limit and proxy settings.

[IngLP]

Hi, I definitely think it's a mirall 1.6 issue. Today I switched back to mirall 1.5.4 and I was able to sync many files that were always throwing error. I will report this also in the issue @scolebrook referenced.

[scolebrook]

Switching to upload limit automatically in the network tab uses the transfer code from 1.5.x from what I understand. This resolves the issue for my users. @loripino21 reports using 1.5.4 also works. If my understanding is correct, it's basically the same thing. So it would appear to be related to the new code in 1.6.

[Blisk]

I have changed in php.ini to upload file 4096MB but I still get the same error when uploading 3Gb file

[TheRealDude2]

Same errors here. I have trouble to upload bigger files (>250 MB) and found this error in my log file:

{"app":"webdav","message":"Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 5619712","level":4,"time":"2014-09-01T09:48:58+00:00"}

But isn't it strange the all people report the same expected filesize on owncloud 7.0.x "10485760"? Maybe a wrong const?

[scolebrook]

@TheRealDude2 The 10485760 is the default chunk size. So The server is expecting that size transfer for each piece of a file larger than 10MB.

[Octopus2]

I have perhaps a similar error with ic 7.0.2 and client 1.6.2:

Sabre\DAV\Exception\BadRequest: expected filesize 10485760 got 1048576

There is the 0 missing at the end...

[awnz]

I'm experiencing the same issue with sync client 1.6.2 for both Windows and Mac. The "upload limit" workaround works for Windows, haven't tested Mac yet but expect it will, I will report back if it doesn't work.

[avoine]

The problem looks to come from a LOCK request mistaken for a PUT request.

For this request:

LOCK /remote.php/webdav/TEST-Personnel/test_touch_davfs2 HTTP/1.1
User-Agent: davfs2/1.4.7 neon/0.30.0
Connection: TE
TE: trailers
Host: partages.auf.org
Content-Length: 177
Content-Type: application/xml
Depth: 0
Timeout: Second-1800
Authorization: Basic ...
If-None-Match: *

<?xml version="1.0" encoding="utf-8"?>
<lockinfo xmlns='DAV:'>
 <lockscope><exclusive/></lockscope>
<locktype><write/></locktype><owner>patrick@example.org</owner>
</lockinfo>

Owncloud reply:

HTTP/1.1 400 Bad request
<?xml version="1.0" encoding="utf-8"?>
<d:error xmlns:d="DAV:" xmlns:s="http://sabredav.org/ns">
  <s:exception>Sabre\DAV\Exception\BadRequest</s:exception>
  <s:message>expected filesize 177 got 0</s:message>
  <s:sabredav-version>1.8.10</s:sabredav-version>
</d:error>

This error was sent by this code in ./lib/private/connector/sabre/file.php

class OC_Connector_Sabre_File extends OC_Connector_Sabre_Node implements \Sabre\DAV\IFile {
...
                $expected = $_SERVER['CONTENT_LENGTH'];
                $actual = $this->fileView->filesize($partFilePath);
                if ($actual != $expected) {
                        $this->fileView->unlink($partFilePath);
                        throw new \Sabre\DAV\Exception\BadRequest('expected filesize ' . $expected . ' got ' . $actual);

It compares the request's CONTENT_LENGTH header variable of the LOCK request to the content length of the file it is trying to get the lock and obviouly there don't match.

[avoine]

Steps to reproduce

1. Enable the webdav application
2. Connect to it with davfs2
3. Try to create a file i.e.: touch my_file

Expected behaviour

The file should be created in owncloud

Actual behaviour

An error is return and no file is created.

touch: setting times of 'my_file': No such file or directory

Server configuration

Operating system:

Debian GNU/Linux 7 (wheezy)

Web server:

apache2 2.2.22-13+deb7u3

Database:

mysql-server-5.5 5.5.38-0+wheezy1

PHP version:

php5 5.4.4-14+deb7u14

ownCloud version: (see ownCloud admin page)

ownCloud 7.0.2 (stable)

Updated from an older ownCloud or fresh install:

fresh install

List of activated apps:

The content of config/config.php:

'/var/www/owncloud/data', 'dbtype' => 'mysql', 'version' => '7.0.2.1', 'dbname' => 'owncloud', 'dbhost' => 'localhost', 'dbtableprefix' => 'oc_', 'dbuser' => 'owncloud', 'dbpassword' => 'xxxx', 'installed' => true, 'instanceid' => 'ocxxxx', 'passwordsalt' => 'xxxx', 'trusted_domains' => array ( 0 => 'owncloud.example.org', ), 'maintenance' => false, 'user_webdavauth_url' => '', ); **Are you using external storage, if yes which one:** local/smb/sftp/... local **Are you using encryption:** yes/no no ### Client configuration **Operating system:** Ubuntu 14.04.1 LTS davfs2 1.4.7-3 ### Logs #### ownCloud log (data/owncloud.log) {"app":"webdav","message":"Sabre\DAV\Exception\BadRequest: expected filesize 177 got 0","level":4,"time":"2014-09-11T14:04:50+00:00"}

[LaurentLM2I]

Client: Version 2.1.1 (build 5837) sur machine Windows 10
OR
Client: Version 2.1.0 (build 5683) sur machine Windows 10
Server: 8.2.2 (stable)
Machine server: Debian Linux 8.3
Apache2 Version 2.4.10
PHP Version 5.6.17-0+deb8u1
MySQL Version 5.5.47

Error message when the client sync:

26/02/2016 15:28:25, Création/Blois_MySQL.xlsx, ownCloud,Operation canceled
26/02/2016 15:28:25, Création/Blois BSM 1.xlsx, ownCloud,Connexion fermée
26/02/2016 15:28:23, Création/Maintenance 2016.pdf, ownCloud,Conserver sur liste noire : Error downloading https://SERVEUR/owncloud/remote.php/web ... aintenance 2016.pdf - server replied: Bad Request (expected filesize 29954 got 8192)

Server logs:

{"reqId":"qpoxfH+DfcfkfuImTQCk","remoteAddr":"IP","app":"webdav","message":"Exception: {"Message":"HTTP/1.1 400 expected filesize 5242880 got 8192","Exception":"Sabre\DAV\Exception\BadRequest","Code":0,"Trace":"
#0 /var/www/owncloud/lib/private/connector/sabre/file.php(101): OC\Connector\Sabre\File->createFileChunked(Resource id #30)
#1 /var/www/owncloud/lib/private/connector/sabre/directory.php(115): OC\Connector\Sabre\File->put(Resource id #30)
#2 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(1053): OC\Connector\Sabre\Directory->createFile('Blois_MySQL.xls...', Resource id #30)
#3 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php(513): Sabre\DAV\Server->createFile('Création/...', Resource id #30, NULL)
#4 [internal function]: Sabre\DAV\CorePlugin->httpPut(Object(Sabre\HTTP\Request), Object(Sabre\HTTP\Response))
#5 /var/www/owncloud/3rdparty/sabre/event/lib/EventEmitterTrait.php(105): call_user_func_array(Array, Array)
#6 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(469): Sabre\Event\EventEmitter->emit('method:PUT', Array)
#7 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(254): Sabre\DAV\Server->invokeMethod(Object(Sabre\HTTP\Request), Object(Sabre\HTTP\Response))
#8 /var/www/owncloud/apps/files/appinfo/remote.php(56): Sabre\DAV\Server->exec()
#9 /var/www/owncloud/remote.php(137): require_once('/var/www/ownclo...')
#10 {main}","File":"/var/www/owncloud/lib/private/connector/sabre/file.php","Line":361}","level":4,"time":"2016-02-26T13:47:55+00:00"}
{"reqId":"MsZWEoFnwpcxhYugBGXU","remoteAddr":"IP","app":"webdav","message":"Exception: {"Message":"HTTP/1.1 400 expected filesize 5242880 got 8192","Exception":"Sabre\DAV\Exception\BadRequest","Code":0,"Trace":"
#0 /var/www/owncloud/lib/private/connector/sabre/file.php(101): OC\Connector\Sabre\File->createFileChunked(Resource id #30)
#1 /var/www/owncloud/lib/private/connector/sabre/directory.php(115): OC\Connector\Sabre\File->put(Resource id #30)
#2 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(1053): OC\Connector\Sabre\Directory->createFile('Blois BSM 1.xls...', Resource id #30)
#3 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php(513): Sabre\DAV\Server->createFile('Création/...', Resource id #30, NULL)
#4 [internal function]: Sabre\DAV\CorePlugin->httpPut(Object(Sabre\HTTP\Request), Object(Sabre\HTTP\Response))
#5 /var/www/owncloud/3rdparty/sabre/event/lib/EventEmitterTrait.php(105): call_user_func_array(Array, Array)
#6 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(469): Sabre\Event\EventEmitter->emit('method:PUT', Array)
#7 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(254): Sabre\DAV\Server->invokeMethod(Object(Sabre\HTTP\Request), Object(Sabre\HTTP\Response))
#8 /var/www/owncloud/apps/files/appinfo/remote.php(56): Sabre\DAV\Server->exec()
#9 /var/www/owncloud/remote.php(137): require_once('/var/www/ownclo...')
#10 {main}","File":"/var/www/owncloud/lib/private/connector/sabre/file.php","Line":361}","level":4,"time":"2016-02-26T13:47:56+00:00"}
{"reqId":"XcYRnW0qBv3Lj6OUEf4g","remoteAddr":"IP","app":"webdav","message":"Exception: {"Message":"HTTP/1.1 400 expected filesize 29954 got 8192","Exception":"Sabre\DAV\Exception\BadRequest","Code":0,"Trace":"
#0/var/www/owncloud/lib/private/connector/sabre/directory.php(115): OC\Connector\Sabre\File->put(Resource id #30)
#1 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(1053): OC\Connector\Sabre\Directory->createFile('Maintenance...', Resource id #30)
#2 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php(513): Sabre\DAV\Server->createFile('Création/...', Resource id #30, NULL)
#3 [internal function]: Sabre\DAV\CorePlugin->httpPut(Object(Sabre\HTTP\Request), Object(Sabre\HTTP\Response))
#4 /var/www/owncloud/3rdparty/sabre/event/lib/EventEmitterTrait.php(105): call_user_func_array(Array, Array)
#5 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(469): Sabre\Event\EventEmitter->emit('method:PUT', Array)
#6 /var/www/owncloud/3rdparty/sabre/dav/lib/DAV/Server.php(254): Sabre\DAV\Server->invokeMethod(Object(Sabre\HTTP\Request), Object(Sabre\HTTP\Response))
#7 /var/www/owncloud/apps/files/appinfo/remote.php(56): Sabre\DAV\Server->exec()
#8 /var/www/owncloud/remote.php(137): require_once('/var/www/ownclo...')
#9 {main}","File":"/var/www/owncloud/lib/private/connector/sabre/file.php","Line":139}","level":4,"time":"2016-02-26T14:28:57+00:00"}

I had to look this post: https://forum.owncloud.org/viewtopic.php?f=17&t=32517

I just read it in detail and tested the following changes (without success):

1. A bug in Apache https://github.com/owncloud/core/issues ... -148380791
2. A too small "SSLRenegBufferSize" Apache setting https://github.com/owncloud/core/issues ... t-90508358
3. A too small "LimitRequestBody" Apache setting https://github.com/owncloud/core/issues ... t-68443113
4. Timeouts on server side https://github.com/owncloud/core/issues ... t-85709557
5. Just a temporary network issue https://github.com/owncloud/core/issues ... t-86418646

and:

1. owncloud server> as administrator> I have set all of the users to quota = UNLIMITED
2. The Following option added to my apache config: 10486000 SSLRenegBufferSize
   the apache config Was Located in /etc/apache2/conf.d/owncloud.conf, and is shown below:

---------------------------------- ------------- Conf.d ----------------------
Alias ​​/ owncloud "/var/www/owncloud/"

SSLRenegBufferSize 10486000
Options + FollowSymLinks
AllowOverride All

<IfModule mod_dav.c>
  Dav off
</ IfModule>

SetEnv HOME /var/www/owncloud
SetEnv HTTP_HOME /var/www/owncloud

# Just in case if .htaccess gets disabled
Require all denied
----------------------------- ----------------- End conf.d -----------------

3. etc / php5 / apache2 / php.ini has-been changed from 2M to 16G: upload_max_filesize = 16G

4. /etc/apache2/httpd.conf point to server-tuning.conf Where I ensured
   KeepAlive On
   MaxKeepAliveRequests 500
   KeepAliveTimeout 500

Restarted server: apache2 restart systemctl

/etc/apache2/conf-available/owncloud.conf:

Alias /owncloud "/var/www/owncloud/"
<Directory /var/www/owncloud/>
SSLRenegBufferSize 10486000
Options +FollowSymLinks
AllowOverride All
SetEnv MOD_X_SENDFILE_ENABLED 1
XSendFile On
XSendFilePath /tmp/
</Directory>

/etc/apache2/sites-available/SERVEUR.conf:

<VirtualHost *:443>
DocumentRoot /var/www/owncloud
ServerName SERVEUR
<IfModule mod_headers.c>
Header always set Strict-Transport-Security "max-age=15768000; includeSubDomains; preload"
</IfModule>


SSLEngine on
SSLOptions +StdEnvVars
SSLStrictSNIVHostCheck off

SSLCertificateFile /etc/apache2/ssl/SERVEUR.crt
SSLCertificateKeyFile /etc/apache2/ssl/SERVEUR.key

</VirtualHost>

/var/www/owncloud/config/config.php:

<?php
$CONFIG = array (
'instanceid' => 'xxxxxxxxxxxxxxx',
'passwordsalt' => 'xxxxxxxxxxxxxxx',
'secret' => 'xxxxxxxxxxxxxxx',
'trusted_domains' => 
array (
0 => 'SERVEUR',
1 => 'IP',
),
'datadirectory' => '/var/www/owncloud/data',
'overwrite.cli.url' => 'https://SERVEUR/owncloud',
'dbtype' => 'mysql',
'version' => '8.2.2.2',
'dbname' => 'owncloud',
'dbhost' => 'localhost',
'dbtableprefix' => '',
'dbuser' => 'cloudAdmin',
'dbpassword' => 'xxxxxxxxxxxxxxx',
'logtimezone' => 'UTC',
'installed' => true,
'filelocking.enabled' => 'true',
'memcache.locking' => '\\OC\\Memcache\\Redis',
'redis' => 
array (
'host' => 'localhost',
'port' => 6379,
'timeout' => 500,
'password' => '',
'dbindex' => 0,
),
'memcache.local' => '\\OC\\Memcache\\APCu',
'theme' => '',
'log_type' => 'owncloud',
'logfile' => '/var/www/owncloud/data/owncloud.log',

'loglevel' => 0,
'log_rotate_size' => 10485760,

'maintenance' => false,
);

## impossible to synchronize new files. but if there are no new files, it works correctly ...

[LaurentLM2I]

Hello,

I just made a change in php.ini:

sys_temp_dir = "/ home / owncloud / tmp"

and now I no longer have the problem.

[awnz]

Because of client bug 4334, my workaround (above) no longer works under Linux :(

[guruz]

@awnz You should be able to start the client with OWNCLOUD_MAX_PARALLEL=1 owncloud

[awnz]

Thanks @guruz, I've replied in (4334)[https://github.com/owncloud/client/issues/4334#issuecomment-214220805]

[PVince81]

Please try with this potential solution: #24653 (comment)
So far it solves the problem when the received filesize is "0" but with a bit of luck it might work in some of your situations too.

[MorrisJobke]

We should close this as fixed within the scope of #24653 - if this still happens with all the next maintenance releases then we need to investigate further.

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.