diff mbox

[2/2] generic/042: add to auto group

Message ID 1465916890-28135-3-git-send-email-hch@lst.de (mailing list archive)
State New, archived
Headers show

Commit Message

Christoph Hellwig June 14, 2016, 3:08 p.m. UTC
This is an odd one as it's in the quick group but not the auto one.
And it actually fails on XFS for me..

Signed-off-by: Christoph Hellwig <hch@lst.de>
---
 tests/generic/group | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

Comments

Omer Zilberberg June 14, 2016, 3:44 p.m. UTC | #1
On 06/14/2016 06:08 PM, Christoph Hellwig wrote:
> This is an odd one as it's in the quick group but not the auto one.
> And it actually fails on XFS for me..
Please note that this was removed from 'auto' in commit:
7721b85 generic/042: remove from the 'auto' group
I don't know whether the original reasons for this are still relevant...
just FYI
> 
> Signed-off-by: Christoph Hellwig <hch@lst.de>
> ---
>  tests/generic/group | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
> 
> diff --git a/tests/generic/group b/tests/generic/group
> index 217ffaa..2daff9f 100644
> --- a/tests/generic/group
> +++ b/tests/generic/group
> @@ -44,7 +44,7 @@
>  039 metadata auto quick
>  040 metadata auto quick
>  041 metadata auto quick
> -042 quick rw
> +042 auto quick rw
>  043 metadata log auto
>  044 metadata log auto
>  045 metadata log auto
> 
--
To unsubscribe from this list: send the line "unsubscribe fstests" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Christoph Hellwig June 14, 2016, 4:51 p.m. UTC | #2
On Tue, Jun 14, 2016 at 06:44:40PM +0300, Omer Zilberberg wrote:
> 
> 
> On 06/14/2016 06:08 PM, Christoph Hellwig wrote:
> > This is an odd one as it's in the quick group but not the auto one.
> > And it actually fails on XFS for me..
> Please note that this was removed from 'auto' in commit:
> 7721b85 generic/042: remove from the 'auto' group
> I don't know whether the original reasons for this are still relevant...
> just FYI

I tend to disagree with the rationale, but even if we believe it it
should have been removed from the quick group as well.
--
To unsubscribe from this list: send the line "unsubscribe fstests" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Eryu Guan June 21, 2016, 8:12 a.m. UTC | #3
On Tue, Jun 14, 2016 at 06:51:25PM +0200, Christoph Hellwig wrote:
> On Tue, Jun 14, 2016 at 06:44:40PM +0300, Omer Zilberberg wrote:
> > 
> > 
> > On 06/14/2016 06:08 PM, Christoph Hellwig wrote:
> > > This is an odd one as it's in the quick group but not the auto one.
> > > And it actually fails on XFS for me..
> > Please note that this was removed from 'auto' in commit:
> > 7721b85 generic/042: remove from the 'auto' group
> > I don't know whether the original reasons for this are still relevant...
> > just FYI
> 
> I tend to disagree with the rationale, but even if we believe it it
> should have been removed from the quick group as well.

So the question is how do we define auto group, 7721b85 removed auto
group because "the auto group is for tests that *are* expected to
succeed".

I searched for Dave's explainations on 'auto' group in his reviews, and
got the following definitions:

- it should be a valid & reliable test (it's finished and have
  deterministic output) [1]
- it passes on current upstream kernels, if it fails, it's likely to be
  resolved in forseeable future [2]
- it should take no longer than 5 minutes to finish [3]

generic/042 is a valid & reliable regression test, and it finishes
within 5 seconds for me, but it fails on current upstream kernels, and I
don't see when it could be fixed (the test was added in Oct. 2014, it's
not fixed in almost two years).

So removing it from 'auto' group seems fine to me, but I'm not sure
about the 'quick' group. Is it related to auto?

Thanks,
Eryu

[1] http://www.spinics.net/lists/fstests/msg00938.html
[2] http://www.spinics.net/lists/fstests/msg01548.html
[3] http://www.spinics.net/lists/fstests/msg01719.html
> --
> To unsubscribe from this list: send the line "unsubscribe fstests" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe fstests" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Dave Chinner June 21, 2016, 11:49 p.m. UTC | #4
On Tue, Jun 21, 2016 at 04:12:42PM +0800, Eryu Guan wrote:
> On Tue, Jun 14, 2016 at 06:51:25PM +0200, Christoph Hellwig wrote:
> > On Tue, Jun 14, 2016 at 06:44:40PM +0300, Omer Zilberberg wrote:
> > > 
> > > 
> > > On 06/14/2016 06:08 PM, Christoph Hellwig wrote:
> > > > This is an odd one as it's in the quick group but not the auto one.
> > > > And it actually fails on XFS for me..
> > > Please note that this was removed from 'auto' in commit:
> > > 7721b85 generic/042: remove from the 'auto' group
> > > I don't know whether the original reasons for this are still relevant...
> > > just FYI
> > 
> > I tend to disagree with the rationale, but even if we believe it it
> > should have been removed from the quick group as well.
> 
> So the question is how do we define auto group, 7721b85 removed auto
> group because "the auto group is for tests that *are* expected to
> succeed".
> 
> I searched for Dave's explainations on 'auto' group in his reviews, and
> got the following definitions:
> 
> - it should be a valid & reliable test (it's finished and have
>   deterministic output) [1]
> - it passes on current upstream kernels, if it fails, it's likely to be
>   resolved in forseeable future [2]
> - it should take no longer than 5 minutes to finish [3]
> 
> generic/042 is a valid & reliable regression test, and it finishes
> within 5 seconds for me, but it fails on current upstream kernels, and I
> don't see when it could be fixed (the test was added in Oct. 2014, it's
> not fixed in almost two years).
> 
> So removing it from 'auto' group seems fine to me, but I'm not sure
> about the 'quick' group. Is it related to auto?

Yes. The only difference between quick and auto group criteria is
the test runtime.

Cheers,

Dave.
diff mbox

Patch

diff --git a/tests/generic/group b/tests/generic/group
index 217ffaa..2daff9f 100644
--- a/tests/generic/group
+++ b/tests/generic/group
@@ -44,7 +44,7 @@ 
 039 metadata auto quick
 040 metadata auto quick
 041 metadata auto quick
-042 quick rw
+042 auto quick rw
 043 metadata log auto
 044 metadata log auto
 045 metadata log auto