diff mbox

CIFS: Simplify invalidate part (try #5)

Message ID BANLkTinsqwMoFzP+9+qX+W+Gr+LGae0Rdw@mail.gmail.com (mailing list archive)
State New, archived
Headers show

Commit Message

Pavel Shilovsky May 20, 2011, 9 a.m. UTC
2011/5/19 Jeff Layton <jlayton@redhat.com>:
> On Sat, 23 Apr 2011 17:30:17 +0400
> Pavel Shilovsky <piastry@etersoft.ru> wrote:
>
>> Simplify many places when we call cifs_revalidate/invalidate to make
>> it do what it exactly needs.
>>
>> Signed-off-by: Pavel Shilovsky <piastry@etersoft.ru>
>> ---
>>  fs/cifs/cifsfs.c |   33 +++++++++++-----
>>  fs/cifs/cifsfs.h |    4 +-
>>  fs/cifs/file.c   |   16 ++++++--
>>  fs/cifs/inode.c  |  117 ++++++++++++++++++++++++++++++++++-------------------
>>  4 files changed, 113 insertions(+), 57 deletions(-)
>>
>
> This patch is causing a regression in tests5:
>
> ./test5: read and write
>        ./test5: (/mnt/salusa/rawhide.test) 'bigfile' has size -2130066000, should be 1048576
> basic tests failed
>
> Pavel, can you track this down?
>
> Steve, in the meantime I suggest that this patch not be pushed when
> the merge window opens.
>

I figured it out.

Steve, I attach two diffs: 1) diff for this version of the patch and
2) new fixed version of the whole patch - you can use either one that
is more comfortable to you.

Comments

Jeff Layton May 20, 2011, 11:30 a.m. UTC | #1
On Fri, 20 May 2011 13:00:53 +0400
Pavel Shilovsky <piastry@etersoft.ru> wrote:

> 2011/5/19 Jeff Layton <jlayton@redhat.com>:
> > On Sat, 23 Apr 2011 17:30:17 +0400
> > Pavel Shilovsky <piastry@etersoft.ru> wrote:
> >
> >> Simplify many places when we call cifs_revalidate/invalidate to make
> >> it do what it exactly needs.
> >>
> >> Signed-off-by: Pavel Shilovsky <piastry@etersoft.ru>
> >> ---
> >>  fs/cifs/cifsfs.c |   33 +++++++++++-----
> >>  fs/cifs/cifsfs.h |    4 +-
> >>  fs/cifs/file.c   |   16 ++++++--
> >>  fs/cifs/inode.c  |  117 ++++++++++++++++++++++++++++++++++-------------------
> >>  4 files changed, 113 insertions(+), 57 deletions(-)
> >>
> >
> > This patch is causing a regression in tests5:
> >
> > ./test5: read and write
> >        ./test5: (/mnt/salusa/rawhide.test) 'bigfile' has size -2130066000, should be 1048576
> > basic tests failed
> >
> > Pavel, can you track this down?
> >
> > Steve, in the meantime I suggest that this patch not be pushed when
> > the merge window opens.
> >
> 
> I figured it out.
> 
> Steve, I attach two diffs: 1) diff for this version of the patch and
> 2) new fixed version of the whole patch - you can use either one that
> is more comfortable to you.
> 

Confirmed -- the patch seems to fix the issue. With that, all the
connectathon tests seem to now pass.
Steve French May 20, 2011, 4:50 p.m. UTC | #2
The fix makes sense, but it reminded me - would allowing
"mapping_set_error" when rc is zero reset/clear a saved error - and
would we want that (ie getattr or llseek able to flush a page which we
failed writing earlier could clear the saved error if we allowed
mapping_set_error on rc == 0)?


On Fri, May 20, 2011 at 4:00 AM, Pavel Shilovsky <piastry@etersoft.ru> wrote:
> 2011/5/19 Jeff Layton <jlayton@redhat.com>:
>> On Sat, 23 Apr 2011 17:30:17 +0400
>> Pavel Shilovsky <piastry@etersoft.ru> wrote:
>>
>>> Simplify many places when we call cifs_revalidate/invalidate to make
>>> it do what it exactly needs.
>>>
>>> Signed-off-by: Pavel Shilovsky <piastry@etersoft.ru>
>>> ---
>>>  fs/cifs/cifsfs.c |   33 +++++++++++-----
>>>  fs/cifs/cifsfs.h |    4 +-
>>>  fs/cifs/file.c   |   16 ++++++--
>>>  fs/cifs/inode.c  |  117 ++++++++++++++++++++++++++++++++++-------------------
>>>  4 files changed, 113 insertions(+), 57 deletions(-)
>>>
>>
>> This patch is causing a regression in tests5:
>>
>> ./test5: read and write
>>        ./test5: (/mnt/salusa/rawhide.test) 'bigfile' has size -2130066000, should be 1048576
>> basic tests failed
>>
>> Pavel, can you track this down?
>>
>> Steve, in the meantime I suggest that this patch not be pushed when
>> the merge window opens.
>>
>
> I figured it out.
>
> Steve, I attach two diffs: 1) diff for this version of the patch and
> 2) new fixed version of the whole patch - you can use either one that
> is more comfortable to you.
>
> --
> Best regards,
> Pavel Shilovsky.
>
Steve French May 20, 2011, 4:54 p.m. UTC | #3
On Fri, May 20, 2011 at 11:50 AM, Steve French <smfrench@gmail.com> wrote:
> The fix makes sense, but it reminded me - would allowing
> "mapping_set_error" when rc is zero reset/clear a saved error - and
> would we want that (ie getattr or llseek able to flush a page which we
> failed writing earlier could clear the saved error if we allowed
> mapping_set_error on rc == 0)?
>
Nevermind - mapping_set_error bails out when rc is 0.
Steve French May 20, 2011, 5:03 p.m. UTC | #4
merged

On Fri, May 20, 2011 at 6:30 AM, Jeff Layton <jlayton@redhat.com> wrote:
> On Fri, 20 May 2011 13:00:53 +0400
> Pavel Shilovsky <piastry@etersoft.ru> wrote:
>
>> 2011/5/19 Jeff Layton <jlayton@redhat.com>:
>> > On Sat, 23 Apr 2011 17:30:17 +0400
>> > Pavel Shilovsky <piastry@etersoft.ru> wrote:
>> >
>> >> Simplify many places when we call cifs_revalidate/invalidate to make
>> >> it do what it exactly needs.
>> >>
>> >> Signed-off-by: Pavel Shilovsky <piastry@etersoft.ru>
>> >> ---
>> >>  fs/cifs/cifsfs.c |   33 +++++++++++-----
>> >>  fs/cifs/cifsfs.h |    4 +-
>> >>  fs/cifs/file.c   |   16 ++++++--
>> >>  fs/cifs/inode.c  |  117 ++++++++++++++++++++++++++++++++++-------------------
>> >>  4 files changed, 113 insertions(+), 57 deletions(-)
>> >>
>> >
>> > This patch is causing a regression in tests5:
>> >
>> > ./test5: read and write
>> >        ./test5: (/mnt/salusa/rawhide.test) 'bigfile' has size -2130066000, should be 1048576
>> > basic tests failed
>> >
>> > Pavel, can you track this down?
>> >
>> > Steve, in the meantime I suggest that this patch not be pushed when
>> > the merge window opens.
>> >
>>
>> I figured it out.
>>
>> Steve, I attach two diffs: 1) diff for this version of the patch and
>> 2) new fixed version of the whole patch - you can use either one that
>> is more comfortable to you.
>>
>
> Confirmed -- the patch seems to fix the issue. With that, all the
> connectathon tests seem to now pass.
>
> --
> Jeff Layton <jlayton@redhat.com>
>
diff mbox

Patch

From d48c10e8001243c458b87812ad3f608ab7dd3095 Mon Sep 17 00:00:00 2001
From: Pavel Shilovsky <piastry@etersoft.ru>
Date: Thu, 7 Apr 2011 18:18:11 +0400
Subject: [PATCH] CIFS: Simplify invalidate part (try #6)

Simplify many places when we call cifs_revalidate/invalidate to make
it do what it exactly needs.

Reviewed-by: Jeff Layton <jlayton@samba.org>
Signed-off-by: Pavel Shilovsky <piastry@etersoft.ru>
Signed-off-by: Steve French <sfrench@us.ibm.com>
---
 fs/cifs/cifsfs.c |   35 +++++++++++-----
 fs/cifs/cifsfs.h |    4 +-
 fs/cifs/file.c   |   16 +++++--
 fs/cifs/inode.c  |  119 +++++++++++++++++++++++++++++++++++-------------------
 4 files changed, 117 insertions(+), 57 deletions(-)

diff --git a/fs/cifs/cifsfs.c b/fs/cifs/cifsfs.c
index f736d8a..07af482 100644
--- a/fs/cifs/cifsfs.c
+++ b/fs/cifs/cifsfs.c
@@ -618,16 +618,31 @@  static loff_t cifs_llseek(struct file *file, loff_t offset, int origin)
 {
 	/* origin == SEEK_END => we must revalidate the cached file length */
 	if (origin == SEEK_END) {
-		int retval;
-
-		/* some applications poll for the file length in this strange
-		   way so we must seek to end on non-oplocked files by
-		   setting the revalidate time to zero */
-		CIFS_I(file->f_path.dentry->d_inode)->time = 0;
-
-		retval = cifs_revalidate_file(file);
-		if (retval < 0)
-			return (loff_t)retval;
+		int rc;
+		struct inode *inode = file->f_path.dentry->d_inode;
+
+		/*
+		 * We need to be sure that all dirty pages are written and the
+		 * server has the newest file length.
+		 */
+		if (!CIFS_I(inode)->clientCanCacheRead && inode->i_mapping &&
+		    inode->i_mapping->nrpages != 0) {
+			rc = filemap_fdatawait(inode->i_mapping);
+			if (rc) {
+				mapping_set_error(inode->i_mapping, rc);
+				return rc;
+			}
+		}
+		/*
+		 * Some applications poll for the file length in this strange
+		 * way so we must seek to end on non-oplocked files by
+		 * setting the revalidate time to zero.
+		 */
+		CIFS_I(inode)->time = 0;
+
+		rc = cifs_revalidate_file_attr(file);
+		if (rc < 0)
+			return (loff_t)rc;
 	}
 	return generic_file_llseek_unlocked(file, offset, origin);
 }
diff --git a/fs/cifs/cifsfs.h b/fs/cifs/cifsfs.h
index bb64313..d304584 100644
--- a/fs/cifs/cifsfs.h
+++ b/fs/cifs/cifsfs.h
@@ -59,9 +59,11 @@  extern int cifs_mkdir(struct inode *, struct dentry *, int);
 extern int cifs_rmdir(struct inode *, struct dentry *);
 extern int cifs_rename(struct inode *, struct dentry *, struct inode *,
 		       struct dentry *);
+extern int cifs_revalidate_file_attr(struct file *filp);
+extern int cifs_revalidate_dentry_attr(struct dentry *);
 extern int cifs_revalidate_file(struct file *filp);
 extern int cifs_revalidate_dentry(struct dentry *);
-extern void cifs_invalidate_mapping(struct inode *inode);
+extern int cifs_invalidate_mapping(struct inode *inode);
 extern int cifs_getattr(struct vfsmount *, struct dentry *, struct kstat *);
 extern int cifs_setattr(struct dentry *, struct iattr *);
 
diff --git a/fs/cifs/file.c b/fs/cifs/file.c
index 0aeaaf7..c672afe 100644
--- a/fs/cifs/file.c
+++ b/fs/cifs/file.c
@@ -1445,8 +1445,13 @@  int cifs_strict_fsync(struct file *file, int datasync)
 	cFYI(1, "Sync file - name: %s datasync: 0x%x",
 		file->f_path.dentry->d_name.name, datasync);
 
-	if (!CIFS_I(inode)->clientCanCacheRead)
-		cifs_invalidate_mapping(inode);
+	if (!CIFS_I(inode)->clientCanCacheRead) {
+		rc = cifs_invalidate_mapping(inode);
+		if (rc) {
+			cFYI(1, "rc: %d during invalidate phase", rc);
+			rc = 0; /* don't care about it in fsync */
+		}
+	}
 
 	tcon = tlink_tcon(smbfile->tlink);
 	if (!(cifs_sb->mnt_cifs_flags & CIFS_MOUNT_NOSSYNC))
@@ -1903,8 +1908,11 @@  int cifs_file_strict_mmap(struct file *file, struct vm_area_struct *vma)
 
 	xid = GetXid();
 
-	if (!CIFS_I(inode)->clientCanCacheRead)
-		cifs_invalidate_mapping(inode);
+	if (!CIFS_I(inode)->clientCanCacheRead) {
+		rc = cifs_invalidate_mapping(inode);
+		if (rc)
+			return rc;
+	}
 
 	rc = generic_file_mmap(file, vma);
 	if (rc == 0)
diff --git a/fs/cifs/inode.c b/fs/cifs/inode.c
index fbe7d58..de02ed5 100644
--- a/fs/cifs/inode.c
+++ b/fs/cifs/inode.c
@@ -1683,18 +1683,15 @@  cifs_inode_needs_reval(struct inode *inode)
 /*
  * Zap the cache. Called when invalid_mapping flag is set.
  */
-void
+int
 cifs_invalidate_mapping(struct inode *inode)
 {
-	int rc;
+	int rc = 0;
 	struct cifsInodeInfo *cifs_i = CIFS_I(inode);
 
 	cifs_i->invalid_mapping = false;
 
 	if (inode->i_mapping && inode->i_mapping->nrpages != 0) {
-		/* write back any cached data */
-		rc = filemap_write_and_wait(inode->i_mapping);
-		mapping_set_error(inode->i_mapping, rc);
 		rc = invalidate_inode_pages2(inode->i_mapping);
 		if (rc) {
 			cERROR(1, "%s: could not invalidate inode %p", __func__,
@@ -1704,56 +1701,52 @@  cifs_invalidate_mapping(struct inode *inode)
 	}
 
 	cifs_fscache_reset_inode_cookie(inode);
+	return rc;
 }
 
-int cifs_revalidate_file(struct file *filp)
+int cifs_revalidate_file_attr(struct file *filp)
 {
 	int rc = 0;
 	struct inode *inode = filp->f_path.dentry->d_inode;
 	struct cifsFileInfo *cfile = (struct cifsFileInfo *) filp->private_data;
 
 	if (!cifs_inode_needs_reval(inode))
-		goto check_inval;
+		return rc;
 
 	if (tlink_tcon(cfile->tlink)->unix_ext)
 		rc = cifs_get_file_info_unix(filp);
 	else
 		rc = cifs_get_file_info(filp);
 
-check_inval:
-	if (CIFS_I(inode)->invalid_mapping)
-		cifs_invalidate_mapping(inode);
-
 	return rc;
 }
 
-/* revalidate a dentry's inode attributes */
-int cifs_revalidate_dentry(struct dentry *dentry)
+int cifs_revalidate_dentry_attr(struct dentry *dentry)
 {
 	int xid;
 	int rc = 0;
-	char *full_path = NULL;
 	struct inode *inode = dentry->d_inode;
 	struct super_block *sb = dentry->d_sb;
+	char *full_path = NULL;
 
 	if (inode == NULL)
 		return -ENOENT;
 
-	xid = GetXid();
-
 	if (!cifs_inode_needs_reval(inode))
-		goto check_inval;
+		return rc;
+
+	xid = GetXid();
 
 	/* can not safely grab the rename sem here if rename calls revalidate
 	   since that would deadlock */
 	full_path = build_path_from_dentry(dentry);
 	if (full_path == NULL) {
 		rc = -ENOMEM;
-		goto check_inval;
+		goto out;
 	}
 
-	cFYI(1, "Revalidate: %s inode 0x%p count %d dentry: 0x%p d_time %ld "
-		 "jiffies %ld", full_path, inode, inode->i_count.counter,
+	cFYI(1, "Update attributes: %s inode 0x%p count %d dentry: 0x%p d_time "
+		 "%ld jiffies %ld", full_path, inode, inode->i_count.counter,
 		 dentry, dentry->d_time, jiffies);
 
 	if (cifs_sb_master_tcon(CIFS_SB(sb))->unix_ext)
@@ -1762,41 +1755,83 @@  int cifs_revalidate_dentry(struct dentry *dentry)
 		rc = cifs_get_inode_info(&inode, full_path, NULL, sb,
 					 xid, NULL);
 
-check_inval:
-	if (CIFS_I(inode)->invalid_mapping)
-		cifs_invalidate_mapping(inode);
-
+out:
 	kfree(full_path);
 	FreeXid(xid);
 	return rc;
 }
 
+int cifs_revalidate_file(struct file *filp)
+{
+	int rc;
+	struct inode *inode = filp->f_path.dentry->d_inode;
+
+	rc = cifs_revalidate_file_attr(filp);
+	if (rc)
+		return rc;
+
+	if (CIFS_I(inode)->invalid_mapping)
+		rc = cifs_invalidate_mapping(inode);
+	return rc;
+}
+
+/* revalidate a dentry's inode attributes */
+int cifs_revalidate_dentry(struct dentry *dentry)
+{
+	int rc;
+	struct inode *inode = dentry->d_inode;
+
+	rc = cifs_revalidate_dentry_attr(dentry);
+	if (rc)
+		return rc;
+
+	if (CIFS_I(inode)->invalid_mapping)
+		rc = cifs_invalidate_mapping(inode);
+	return rc;
+}
+
 int cifs_getattr(struct vfsmount *mnt, struct dentry *dentry,
 		 struct kstat *stat)
 {
 	struct cifs_sb_info *cifs_sb = CIFS_SB(dentry->d_sb);
 	struct cifsTconInfo *tcon = cifs_sb_master_tcon(cifs_sb);
-	int err = cifs_revalidate_dentry(dentry);
-
-	if (!err) {
-		generic_fillattr(dentry->d_inode, stat);
-		stat->blksize = CIFS_MAX_MSGSIZE;
-		stat->ino = CIFS_I(dentry->d_inode)->uniqueid;
+	struct inode *inode = dentry->d_inode;
+	int rc;
 
-		/*
-		 * If on a multiuser mount without unix extensions, and the
-		 * admin hasn't overridden them, set the ownership to the
-		 * fsuid/fsgid of the current process.
-		 */
-		if ((cifs_sb->mnt_cifs_flags & CIFS_MOUNT_MULTIUSER) &&
-		    !tcon->unix_ext) {
-			if (!(cifs_sb->mnt_cifs_flags & CIFS_MOUNT_OVERR_UID))
-				stat->uid = current_fsuid();
-			if (!(cifs_sb->mnt_cifs_flags & CIFS_MOUNT_OVERR_GID))
-				stat->gid = current_fsgid();
+	/*
+	 * We need to be sure that all dirty pages are written and the server
+	 * has actual ctime, mtime and file length.
+	 */
+	if (!CIFS_I(inode)->clientCanCacheRead && inode->i_mapping &&
+	    inode->i_mapping->nrpages != 0) {
+		rc = filemap_fdatawait(inode->i_mapping);
+		if (rc) {
+			mapping_set_error(inode->i_mapping, rc);
+			return rc;
 		}
 	}
-	return err;
+
+	rc = cifs_revalidate_dentry_attr(dentry);
+	if (rc)
+		return rc;
+
+	generic_fillattr(inode, stat);
+	stat->blksize = CIFS_MAX_MSGSIZE;
+	stat->ino = CIFS_I(inode)->uniqueid;
+
+	/*
+	 * If on a multiuser mount without unix extensions, and the admin hasn't
+	 * overridden them, set the ownership to the fsuid/fsgid of the current
+	 * process.
+	 */
+	if ((cifs_sb->mnt_cifs_flags & CIFS_MOUNT_MULTIUSER) &&
+	    !tcon->unix_ext) {
+		if (!(cifs_sb->mnt_cifs_flags & CIFS_MOUNT_OVERR_UID))
+			stat->uid = current_fsuid();
+		if (!(cifs_sb->mnt_cifs_flags & CIFS_MOUNT_OVERR_GID))
+			stat->gid = current_fsgid();
+	}
+	return rc;
 }
 
 static int cifs_truncate_page(struct address_space *mapping, loff_t from)
-- 
1.7.1