mbox series

[0/3] Running unionmount testsuite from xfstests

Message ID 20200531110156.6613-1-amir73il@gmail.com (mailing list archive)
Headers show
Series Running unionmount testsuite from xfstests | expand

Message

Amir Goldstein May 31, 2020, 11:01 a.m. UTC
Eryu,

unionmount testsuite has a lot more test coverage than the overlay
xfstests, but it has a lot less exposure to testers.

The various test setups that I have added to unionmount testsuite since
I took over the maintanace of the testsuite have even smaller exposure
to testers.

These patches add overlay tests that are used as a harness to run
different setups of unionmount testsuite.  I have been using this method
for over two year for testing my overlayfs branches.

What does it take to install unionmount testsuite?
As README.overlay says:

  git clone https://github.com/amir73il/unionmount-testsuite.git
  ln -s $PWD/unionmount-testsuite <path-to-xfstests>/src/

Thanks,
Amir.

Amir Goldstein (3):
  overlay: run unionmount testsuite test cases
  overlay: add unionmount tests with multi lower layers
  overlay: add unionmount tests with nested overlay

 README.overlay        | 15 ++++++++++++
 common/config         |  2 ++
 common/overlay        | 54 +++++++++++++++++++++++++++++++++++++++++++
 tests/overlay/100     | 38 ++++++++++++++++++++++++++++++
 tests/overlay/100.out |  2 ++
 tests/overlay/101     | 39 +++++++++++++++++++++++++++++++
 tests/overlay/101.out |  2 ++
 tests/overlay/102     | 40 ++++++++++++++++++++++++++++++++
 tests/overlay/102.out |  2 ++
 tests/overlay/103     | 38 ++++++++++++++++++++++++++++++
 tests/overlay/103.out |  2 ++
 tests/overlay/104     | 39 +++++++++++++++++++++++++++++++
 tests/overlay/104.out |  2 ++
 tests/overlay/105     | 40 ++++++++++++++++++++++++++++++++
 tests/overlay/105.out |  2 ++
 tests/overlay/106     | 41 ++++++++++++++++++++++++++++++++
 tests/overlay/106.out |  2 ++
 tests/overlay/107     | 41 ++++++++++++++++++++++++++++++++
 tests/overlay/107.out |  2 ++
 tests/overlay/108     | 41 ++++++++++++++++++++++++++++++++
 tests/overlay/108.out |  2 ++
 tests/overlay/109     | 41 ++++++++++++++++++++++++++++++++
 tests/overlay/109.out |  2 ++
 tests/overlay/110     | 39 +++++++++++++++++++++++++++++++
 tests/overlay/110.out |  2 ++
 tests/overlay/111     | 40 ++++++++++++++++++++++++++++++++
 tests/overlay/111.out |  2 ++
 tests/overlay/112     | 40 ++++++++++++++++++++++++++++++++
 tests/overlay/112.out |  2 ++
 tests/overlay/113     | 41 ++++++++++++++++++++++++++++++++
 tests/overlay/113.out |  2 ++
 tests/overlay/114     | 39 +++++++++++++++++++++++++++++++
 tests/overlay/114.out |  2 ++
 tests/overlay/115     | 40 ++++++++++++++++++++++++++++++++
 tests/overlay/115.out |  2 ++
 tests/overlay/116     | 40 ++++++++++++++++++++++++++++++++
 tests/overlay/116.out |  2 ++
 tests/overlay/117     | 41 ++++++++++++++++++++++++++++++++
 tests/overlay/117.out |  2 ++
 tests/overlay/group   | 18 +++++++++++++++
 40 files changed, 843 insertions(+)
 create mode 100755 tests/overlay/100
 create mode 100644 tests/overlay/100.out
 create mode 100755 tests/overlay/101
 create mode 100644 tests/overlay/101.out
 create mode 100755 tests/overlay/102
 create mode 100644 tests/overlay/102.out
 create mode 100755 tests/overlay/103
 create mode 100644 tests/overlay/103.out
 create mode 100755 tests/overlay/104
 create mode 100644 tests/overlay/104.out
 create mode 100755 tests/overlay/105
 create mode 100644 tests/overlay/105.out
 create mode 100755 tests/overlay/106
 create mode 100644 tests/overlay/106.out
 create mode 100755 tests/overlay/107
 create mode 100644 tests/overlay/107.out
 create mode 100755 tests/overlay/108
 create mode 100644 tests/overlay/108.out
 create mode 100755 tests/overlay/109
 create mode 100644 tests/overlay/109.out
 create mode 100755 tests/overlay/110
 create mode 100644 tests/overlay/110.out
 create mode 100755 tests/overlay/111
 create mode 100644 tests/overlay/111.out
 create mode 100755 tests/overlay/112
 create mode 100644 tests/overlay/112.out
 create mode 100755 tests/overlay/113
 create mode 100644 tests/overlay/113.out
 create mode 100755 tests/overlay/114
 create mode 100644 tests/overlay/114.out
 create mode 100755 tests/overlay/115
 create mode 100644 tests/overlay/115.out
 create mode 100755 tests/overlay/116
 create mode 100644 tests/overlay/116.out
 create mode 100755 tests/overlay/117
 create mode 100644 tests/overlay/117.out

Comments

Vivek Goyal June 1, 2020, 5:52 p.m. UTC | #1
On Sun, May 31, 2020 at 02:01:53PM +0300, Amir Goldstein wrote:
> Eryu,
> 
> unionmount testsuite has a lot more test coverage than the overlay
> xfstests, but it has a lot less exposure to testers.
> 
> The various test setups that I have added to unionmount testsuite since
> I took over the maintanace of the testsuite have even smaller exposure
> to testers.
> 
> These patches add overlay tests that are used as a harness to run
> different setups of unionmount testsuite.  I have been using this method
> for over two year for testing my overlayfs branches.

Hi Amir,

Is there a git branch somewhere with these changes. Its easier to pull
that one in and test.

Vivek

> 
> What does it take to install unionmount testsuite?
> As README.overlay says:
> 
>   git clone https://github.com/amir73il/unionmount-testsuite.git
>   ln -s $PWD/unionmount-testsuite <path-to-xfstests>/src/
> 
> Thanks,
> Amir.
> 
> Amir Goldstein (3):
>   overlay: run unionmount testsuite test cases
>   overlay: add unionmount tests with multi lower layers
>   overlay: add unionmount tests with nested overlay
> 
>  README.overlay        | 15 ++++++++++++
>  common/config         |  2 ++
>  common/overlay        | 54 +++++++++++++++++++++++++++++++++++++++++++
>  tests/overlay/100     | 38 ++++++++++++++++++++++++++++++
>  tests/overlay/100.out |  2 ++
>  tests/overlay/101     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/101.out |  2 ++
>  tests/overlay/102     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/102.out |  2 ++
>  tests/overlay/103     | 38 ++++++++++++++++++++++++++++++
>  tests/overlay/103.out |  2 ++
>  tests/overlay/104     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/104.out |  2 ++
>  tests/overlay/105     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/105.out |  2 ++
>  tests/overlay/106     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/106.out |  2 ++
>  tests/overlay/107     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/107.out |  2 ++
>  tests/overlay/108     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/108.out |  2 ++
>  tests/overlay/109     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/109.out |  2 ++
>  tests/overlay/110     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/110.out |  2 ++
>  tests/overlay/111     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/111.out |  2 ++
>  tests/overlay/112     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/112.out |  2 ++
>  tests/overlay/113     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/113.out |  2 ++
>  tests/overlay/114     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/114.out |  2 ++
>  tests/overlay/115     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/115.out |  2 ++
>  tests/overlay/116     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/116.out |  2 ++
>  tests/overlay/117     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/117.out |  2 ++
>  tests/overlay/group   | 18 +++++++++++++++
>  40 files changed, 843 insertions(+)
>  create mode 100755 tests/overlay/100
>  create mode 100644 tests/overlay/100.out
>  create mode 100755 tests/overlay/101
>  create mode 100644 tests/overlay/101.out
>  create mode 100755 tests/overlay/102
>  create mode 100644 tests/overlay/102.out
>  create mode 100755 tests/overlay/103
>  create mode 100644 tests/overlay/103.out
>  create mode 100755 tests/overlay/104
>  create mode 100644 tests/overlay/104.out
>  create mode 100755 tests/overlay/105
>  create mode 100644 tests/overlay/105.out
>  create mode 100755 tests/overlay/106
>  create mode 100644 tests/overlay/106.out
>  create mode 100755 tests/overlay/107
>  create mode 100644 tests/overlay/107.out
>  create mode 100755 tests/overlay/108
>  create mode 100644 tests/overlay/108.out
>  create mode 100755 tests/overlay/109
>  create mode 100644 tests/overlay/109.out
>  create mode 100755 tests/overlay/110
>  create mode 100644 tests/overlay/110.out
>  create mode 100755 tests/overlay/111
>  create mode 100644 tests/overlay/111.out
>  create mode 100755 tests/overlay/112
>  create mode 100644 tests/overlay/112.out
>  create mode 100755 tests/overlay/113
>  create mode 100644 tests/overlay/113.out
>  create mode 100755 tests/overlay/114
>  create mode 100644 tests/overlay/114.out
>  create mode 100755 tests/overlay/115
>  create mode 100644 tests/overlay/115.out
>  create mode 100755 tests/overlay/116
>  create mode 100644 tests/overlay/116.out
>  create mode 100755 tests/overlay/117
>  create mode 100644 tests/overlay/117.out
> 
> -- 
> 2.17.1
>
Amir Goldstein June 1, 2020, 7:18 p.m. UTC | #2
On Mon, Jun 1, 2020 at 8:52 PM Vivek Goyal <vgoyal@redhat.com> wrote:
>
> On Sun, May 31, 2020 at 02:01:53PM +0300, Amir Goldstein wrote:
> > Eryu,
> >
> > unionmount testsuite has a lot more test coverage than the overlay
> > xfstests, but it has a lot less exposure to testers.
> >
> > The various test setups that I have added to unionmount testsuite since
> > I took over the maintanace of the testsuite have even smaller exposure
> > to testers.
> >
> > These patches add overlay tests that are used as a harness to run
> > different setups of unionmount testsuite.  I have been using this method
> > for over two year for testing my overlayfs branches.
>
> Hi Amir,
>
> Is there a git branch somewhere with these changes. Its easier to pull
> that one in and test.
>

Of course. Forgot to mention.

https://github.com/amir73il/xfstests/commits/unionmount

Thanks,
Amir.
Eryu Guan July 19, 2020, 6:11 p.m. UTC | #3
Hi Amir,

On Sun, May 31, 2020 at 02:01:53PM +0300, Amir Goldstein wrote:
> Eryu,
> 
> unionmount testsuite has a lot more test coverage than the overlay
> xfstests, but it has a lot less exposure to testers.
> 
> The various test setups that I have added to unionmount testsuite since
> I took over the maintanace of the testsuite have even smaller exposure
> to testers.
> 
> These patches add overlay tests that are used as a harness to run
> different setups of unionmount testsuite.  I have been using this method
> for over two year for testing my overlayfs branches.
> 
> What does it take to install unionmount testsuite?
> As README.overlay says:
> 
>   git clone https://github.com/amir73il/unionmount-testsuite.git
>   ln -s $PWD/unionmount-testsuite <path-to-xfstests>/src/

I'm really sorry for the long-long delay..

The test itself looks really good to me, my only concern is that
the updates in unionmount repo are not visible to fstests, and may cause
new failures, which are out of fstests' control. But I'm not sure if
this really is a problem for people.

I came up with two options anyway
- add unionmount tests as a submodule of fstests
- put unionmount tests in fstests

I'd like to hear what people think about this patchset, any other
comments & suggestions are welcomed!

Thanks,
Eryu

> 
> Thanks,
> Amir.
> 
> Amir Goldstein (3):
>   overlay: run unionmount testsuite test cases
>   overlay: add unionmount tests with multi lower layers
>   overlay: add unionmount tests with nested overlay
> 
>  README.overlay        | 15 ++++++++++++
>  common/config         |  2 ++
>  common/overlay        | 54 +++++++++++++++++++++++++++++++++++++++++++
>  tests/overlay/100     | 38 ++++++++++++++++++++++++++++++
>  tests/overlay/100.out |  2 ++
>  tests/overlay/101     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/101.out |  2 ++
>  tests/overlay/102     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/102.out |  2 ++
>  tests/overlay/103     | 38 ++++++++++++++++++++++++++++++
>  tests/overlay/103.out |  2 ++
>  tests/overlay/104     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/104.out |  2 ++
>  tests/overlay/105     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/105.out |  2 ++
>  tests/overlay/106     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/106.out |  2 ++
>  tests/overlay/107     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/107.out |  2 ++
>  tests/overlay/108     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/108.out |  2 ++
>  tests/overlay/109     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/109.out |  2 ++
>  tests/overlay/110     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/110.out |  2 ++
>  tests/overlay/111     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/111.out |  2 ++
>  tests/overlay/112     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/112.out |  2 ++
>  tests/overlay/113     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/113.out |  2 ++
>  tests/overlay/114     | 39 +++++++++++++++++++++++++++++++
>  tests/overlay/114.out |  2 ++
>  tests/overlay/115     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/115.out |  2 ++
>  tests/overlay/116     | 40 ++++++++++++++++++++++++++++++++
>  tests/overlay/116.out |  2 ++
>  tests/overlay/117     | 41 ++++++++++++++++++++++++++++++++
>  tests/overlay/117.out |  2 ++
>  tests/overlay/group   | 18 +++++++++++++++
>  40 files changed, 843 insertions(+)
>  create mode 100755 tests/overlay/100
>  create mode 100644 tests/overlay/100.out
>  create mode 100755 tests/overlay/101
>  create mode 100644 tests/overlay/101.out
>  create mode 100755 tests/overlay/102
>  create mode 100644 tests/overlay/102.out
>  create mode 100755 tests/overlay/103
>  create mode 100644 tests/overlay/103.out
>  create mode 100755 tests/overlay/104
>  create mode 100644 tests/overlay/104.out
>  create mode 100755 tests/overlay/105
>  create mode 100644 tests/overlay/105.out
>  create mode 100755 tests/overlay/106
>  create mode 100644 tests/overlay/106.out
>  create mode 100755 tests/overlay/107
>  create mode 100644 tests/overlay/107.out
>  create mode 100755 tests/overlay/108
>  create mode 100644 tests/overlay/108.out
>  create mode 100755 tests/overlay/109
>  create mode 100644 tests/overlay/109.out
>  create mode 100755 tests/overlay/110
>  create mode 100644 tests/overlay/110.out
>  create mode 100755 tests/overlay/111
>  create mode 100644 tests/overlay/111.out
>  create mode 100755 tests/overlay/112
>  create mode 100644 tests/overlay/112.out
>  create mode 100755 tests/overlay/113
>  create mode 100644 tests/overlay/113.out
>  create mode 100755 tests/overlay/114
>  create mode 100644 tests/overlay/114.out
>  create mode 100755 tests/overlay/115
>  create mode 100644 tests/overlay/115.out
>  create mode 100755 tests/overlay/116
>  create mode 100644 tests/overlay/116.out
>  create mode 100755 tests/overlay/117
>  create mode 100644 tests/overlay/117.out
> 
> -- 
> 2.17.1
>
Amir Goldstein July 19, 2020, 6:36 p.m. UTC | #4
On Sun, Jul 19, 2020 at 9:11 PM Eryu Guan <guan@eryu.me> wrote:
>
> Hi Amir,
>
> On Sun, May 31, 2020 at 02:01:53PM +0300, Amir Goldstein wrote:
> > Eryu,
> >
> > unionmount testsuite has a lot more test coverage than the overlay
> > xfstests, but it has a lot less exposure to testers.
> >
> > The various test setups that I have added to unionmount testsuite since
> > I took over the maintanace of the testsuite have even smaller exposure
> > to testers.
> >
> > These patches add overlay tests that are used as a harness to run
> > different setups of unionmount testsuite.  I have been using this method
> > for over two year for testing my overlayfs branches.
> >
> > What does it take to install unionmount testsuite?
> > As README.overlay says:
> >
> >   git clone https://github.com/amir73il/unionmount-testsuite.git
> >   ln -s $PWD/unionmount-testsuite <path-to-xfstests>/src/
>
> I'm really sorry for the long-long delay..
>

No worries.

> The test itself looks really good to me, my only concern is that
> the updates in unionmount repo are not visible to fstests, and may cause
> new failures, which are out of fstests' control. But I'm not sure if
> this really is a problem for people.
>
> I came up with two options anyway
> - add unionmount tests as a submodule of fstests
> - put unionmount tests in fstests
>

I suppose you mean git submodule?
IMO that's a fairly good option.
I suspect that some people would want to continue running
unionmount independently of xfstests and I have some development
branches, so it's convenient to keep the unionmount repo independent
of xfstests repo and use git submodule as the "pull request" method
between us, for keeping control of the flow of changes from my repo
in the hands of xfstests maintainer.

But as I wrote before, I am also fine with "handing over" the official
upstream of unionmount src to xfstests project and be the
"sub-maintainer" for that module, but I think there is going to be more
chatter with that option compared to the submodule option.
Another argument in favor of submodule, is that we can always
graduate unionmount in the future from submodule to built-in.

Thanks,
Amir.

> I'd like to hear what people think about this patchset, any other
> comments & suggestions are welcomed!
>
> Thanks,
> Eryu
>
> >
> > Thanks,
> > Amir.
> >
> > Amir Goldstein (3):
> >   overlay: run unionmount testsuite test cases
> >   overlay: add unionmount tests with multi lower layers
> >   overlay: add unionmount tests with nested overlay
> >
> >  README.overlay        | 15 ++++++++++++
> >  common/config         |  2 ++
> >  common/overlay        | 54 +++++++++++++++++++++++++++++++++++++++++++
> >  tests/overlay/100     | 38 ++++++++++++++++++++++++++++++
> >  tests/overlay/100.out |  2 ++
> >  tests/overlay/101     | 39 +++++++++++++++++++++++++++++++
> >  tests/overlay/101.out |  2 ++
> >  tests/overlay/102     | 40 ++++++++++++++++++++++++++++++++
> >  tests/overlay/102.out |  2 ++
> >  tests/overlay/103     | 38 ++++++++++++++++++++++++++++++
> >  tests/overlay/103.out |  2 ++
> >  tests/overlay/104     | 39 +++++++++++++++++++++++++++++++
> >  tests/overlay/104.out |  2 ++
> >  tests/overlay/105     | 40 ++++++++++++++++++++++++++++++++
> >  tests/overlay/105.out |  2 ++
> >  tests/overlay/106     | 41 ++++++++++++++++++++++++++++++++
> >  tests/overlay/106.out |  2 ++
> >  tests/overlay/107     | 41 ++++++++++++++++++++++++++++++++
> >  tests/overlay/107.out |  2 ++
> >  tests/overlay/108     | 41 ++++++++++++++++++++++++++++++++
> >  tests/overlay/108.out |  2 ++
> >  tests/overlay/109     | 41 ++++++++++++++++++++++++++++++++
> >  tests/overlay/109.out |  2 ++
> >  tests/overlay/110     | 39 +++++++++++++++++++++++++++++++
> >  tests/overlay/110.out |  2 ++
> >  tests/overlay/111     | 40 ++++++++++++++++++++++++++++++++
> >  tests/overlay/111.out |  2 ++
> >  tests/overlay/112     | 40 ++++++++++++++++++++++++++++++++
> >  tests/overlay/112.out |  2 ++
> >  tests/overlay/113     | 41 ++++++++++++++++++++++++++++++++
> >  tests/overlay/113.out |  2 ++
> >  tests/overlay/114     | 39 +++++++++++++++++++++++++++++++
> >  tests/overlay/114.out |  2 ++
> >  tests/overlay/115     | 40 ++++++++++++++++++++++++++++++++
> >  tests/overlay/115.out |  2 ++
> >  tests/overlay/116     | 40 ++++++++++++++++++++++++++++++++
> >  tests/overlay/116.out |  2 ++
> >  tests/overlay/117     | 41 ++++++++++++++++++++++++++++++++
> >  tests/overlay/117.out |  2 ++
> >  tests/overlay/group   | 18 +++++++++++++++
> >  40 files changed, 843 insertions(+)
> >  create mode 100755 tests/overlay/100
> >  create mode 100644 tests/overlay/100.out
> >  create mode 100755 tests/overlay/101
> >  create mode 100644 tests/overlay/101.out
> >  create mode 100755 tests/overlay/102
> >  create mode 100644 tests/overlay/102.out
> >  create mode 100755 tests/overlay/103
> >  create mode 100644 tests/overlay/103.out
> >  create mode 100755 tests/overlay/104
> >  create mode 100644 tests/overlay/104.out
> >  create mode 100755 tests/overlay/105
> >  create mode 100644 tests/overlay/105.out
> >  create mode 100755 tests/overlay/106
> >  create mode 100644 tests/overlay/106.out
> >  create mode 100755 tests/overlay/107
> >  create mode 100644 tests/overlay/107.out
> >  create mode 100755 tests/overlay/108
> >  create mode 100644 tests/overlay/108.out
> >  create mode 100755 tests/overlay/109
> >  create mode 100644 tests/overlay/109.out
> >  create mode 100755 tests/overlay/110
> >  create mode 100644 tests/overlay/110.out
> >  create mode 100755 tests/overlay/111
> >  create mode 100644 tests/overlay/111.out
> >  create mode 100755 tests/overlay/112
> >  create mode 100644 tests/overlay/112.out
> >  create mode 100755 tests/overlay/113
> >  create mode 100644 tests/overlay/113.out
> >  create mode 100755 tests/overlay/114
> >  create mode 100644 tests/overlay/114.out
> >  create mode 100755 tests/overlay/115
> >  create mode 100644 tests/overlay/115.out
> >  create mode 100755 tests/overlay/116
> >  create mode 100644 tests/overlay/116.out
> >  create mode 100755 tests/overlay/117
> >  create mode 100644 tests/overlay/117.out
> >
> > --
> > 2.17.1
> >
Eryu Guan July 26, 2020, 3:16 p.m. UTC | #5
On Sun, Jul 19, 2020 at 09:36:39PM +0300, Amir Goldstein wrote:
> On Sun, Jul 19, 2020 at 9:11 PM Eryu Guan <guan@eryu.me> wrote:
> >
> > Hi Amir,
> >
> > On Sun, May 31, 2020 at 02:01:53PM +0300, Amir Goldstein wrote:
> > > Eryu,
> > >
> > > unionmount testsuite has a lot more test coverage than the overlay
> > > xfstests, but it has a lot less exposure to testers.
> > >
> > > The various test setups that I have added to unionmount testsuite since
> > > I took over the maintanace of the testsuite have even smaller exposure
> > > to testers.
> > >
> > > These patches add overlay tests that are used as a harness to run
> > > different setups of unionmount testsuite.  I have been using this method
> > > for over two year for testing my overlayfs branches.
> > >
> > > What does it take to install unionmount testsuite?
> > > As README.overlay says:
> > >
> > >   git clone https://github.com/amir73il/unionmount-testsuite.git
> > >   ln -s $PWD/unionmount-testsuite <path-to-xfstests>/src/
> >
> > I'm really sorry for the long-long delay..
> >
> 
> No worries.
> 
> > The test itself looks really good to me, my only concern is that
> > the updates in unionmount repo are not visible to fstests, and may cause
> > new failures, which are out of fstests' control. But I'm not sure if
> > this really is a problem for people.
> >
> > I came up with two options anyway
> > - add unionmount tests as a submodule of fstests
> > - put unionmount tests in fstests
> >
> 
> I suppose you mean git submodule?

Exactly.

But I think I'd merge it as-is, git submodule brings more maintain
burden on both maintainers and users, especially users that usually
don't care about overlay tests. Users that care about overlay tests
should setup unionmount tests explicitly and know that's unionmount
tests if there's any test failure.

> IMO that's a fairly good option.
> I suspect that some people would want to continue running
> unionmount independently of xfstests and I have some development
> branches, so it's convenient to keep the unionmount repo independent
> of xfstests repo and use git submodule as the "pull request" method
> between us, for keeping control of the flow of changes from my repo
> in the hands of xfstests maintainer.
> 
> But as I wrote before, I am also fine with "handing over" the official
> upstream of unionmount src to xfstests project and be the
> "sub-maintainer" for that module, but I think there is going to be more
> chatter with that option compared to the submodule option.
> Another argument in favor of submodule, is that we can always
> graduate unionmount in the future from submodule to built-in.

Agreed, I think making unionmount tests a built-in would be good in the
future.

Thanks!

Eryu

> 
> Thanks,
> Amir.
> 
> > I'd like to hear what people think about this patchset, any other
> > comments & suggestions are welcomed!
> >
> > Thanks,
> > Eryu
> >
> > >
> > > Thanks,
> > > Amir.
> > >
> > > Amir Goldstein (3):
> > >   overlay: run unionmount testsuite test cases
> > >   overlay: add unionmount tests with multi lower layers
> > >   overlay: add unionmount tests with nested overlay
> > >
> > >  README.overlay        | 15 ++++++++++++
> > >  common/config         |  2 ++
> > >  common/overlay        | 54 +++++++++++++++++++++++++++++++++++++++++++
> > >  tests/overlay/100     | 38 ++++++++++++++++++++++++++++++
> > >  tests/overlay/100.out |  2 ++
> > >  tests/overlay/101     | 39 +++++++++++++++++++++++++++++++
> > >  tests/overlay/101.out |  2 ++
> > >  tests/overlay/102     | 40 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/102.out |  2 ++
> > >  tests/overlay/103     | 38 ++++++++++++++++++++++++++++++
> > >  tests/overlay/103.out |  2 ++
> > >  tests/overlay/104     | 39 +++++++++++++++++++++++++++++++
> > >  tests/overlay/104.out |  2 ++
> > >  tests/overlay/105     | 40 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/105.out |  2 ++
> > >  tests/overlay/106     | 41 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/106.out |  2 ++
> > >  tests/overlay/107     | 41 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/107.out |  2 ++
> > >  tests/overlay/108     | 41 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/108.out |  2 ++
> > >  tests/overlay/109     | 41 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/109.out |  2 ++
> > >  tests/overlay/110     | 39 +++++++++++++++++++++++++++++++
> > >  tests/overlay/110.out |  2 ++
> > >  tests/overlay/111     | 40 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/111.out |  2 ++
> > >  tests/overlay/112     | 40 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/112.out |  2 ++
> > >  tests/overlay/113     | 41 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/113.out |  2 ++
> > >  tests/overlay/114     | 39 +++++++++++++++++++++++++++++++
> > >  tests/overlay/114.out |  2 ++
> > >  tests/overlay/115     | 40 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/115.out |  2 ++
> > >  tests/overlay/116     | 40 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/116.out |  2 ++
> > >  tests/overlay/117     | 41 ++++++++++++++++++++++++++++++++
> > >  tests/overlay/117.out |  2 ++
> > >  tests/overlay/group   | 18 +++++++++++++++
> > >  40 files changed, 843 insertions(+)
> > >  create mode 100755 tests/overlay/100
> > >  create mode 100644 tests/overlay/100.out
> > >  create mode 100755 tests/overlay/101
> > >  create mode 100644 tests/overlay/101.out
> > >  create mode 100755 tests/overlay/102
> > >  create mode 100644 tests/overlay/102.out
> > >  create mode 100755 tests/overlay/103
> > >  create mode 100644 tests/overlay/103.out
> > >  create mode 100755 tests/overlay/104
> > >  create mode 100644 tests/overlay/104.out
> > >  create mode 100755 tests/overlay/105
> > >  create mode 100644 tests/overlay/105.out
> > >  create mode 100755 tests/overlay/106
> > >  create mode 100644 tests/overlay/106.out
> > >  create mode 100755 tests/overlay/107
> > >  create mode 100644 tests/overlay/107.out
> > >  create mode 100755 tests/overlay/108
> > >  create mode 100644 tests/overlay/108.out
> > >  create mode 100755 tests/overlay/109
> > >  create mode 100644 tests/overlay/109.out
> > >  create mode 100755 tests/overlay/110
> > >  create mode 100644 tests/overlay/110.out
> > >  create mode 100755 tests/overlay/111
> > >  create mode 100644 tests/overlay/111.out
> > >  create mode 100755 tests/overlay/112
> > >  create mode 100644 tests/overlay/112.out
> > >  create mode 100755 tests/overlay/113
> > >  create mode 100644 tests/overlay/113.out
> > >  create mode 100755 tests/overlay/114
> > >  create mode 100644 tests/overlay/114.out
> > >  create mode 100755 tests/overlay/115
> > >  create mode 100644 tests/overlay/115.out
> > >  create mode 100755 tests/overlay/116
> > >  create mode 100644 tests/overlay/116.out
> > >  create mode 100755 tests/overlay/117
> > >  create mode 100644 tests/overlay/117.out
> > >
> > > --
> > > 2.17.1
> > >
Amir Goldstein July 26, 2020, 4:21 p.m. UTC | #6
> >
> > > The test itself looks really good to me, my only concern is that
> > > the updates in unionmount repo are not visible to fstests, and may cause
> > > new failures, which are out of fstests' control. But I'm not sure if
> > > this really is a problem for people.
> > >
> > > I came up with two options anyway
> > > - add unionmount tests as a submodule of fstests
> > > - put unionmount tests in fstests
> > >
> >
> > I suppose you mean git submodule?
>
> Exactly.
>
> But I think I'd merge it as-is, git submodule brings more maintain
> burden on both maintainers and users, especially users that usually
> don't care about overlay tests. Users that care about overlay tests
> should setup unionmount tests explicitly and know that's unionmount
> tests if there's any test failure.
>

Great!

I see you also kept my 100+N test numbering, which is very convenient :-)

I have a patch on my dev branch to run unionmount test cases with
metacopy enabled that Vivek requested.

Will post it this week.

Thanks!
Amir.