Message ID | 20220420084036.4101604-1-usama.anjum@collabora.com (mailing list archive) |
---|---|
State | New |
Headers | show |
Series | [v6,1/2] selftests: vm: bring common functions to a new file | expand |
On 20.04.22 10:40, Muhammad Usama Anjum wrote: > Bring common functions to a new file while keeping code as much same as > possible. These functions can be used in the new tests. This helps in > avoiding code duplication. > > Signed-off-by: Muhammad Usama Anjum <usama.anjum@collabora.com> > --- > Changes in V6: > - Correct header files inclusion > > Changes in V5: > Keep moved code as same as possible > - Updated macros names > - Removed macro used to show bit number of dirty bit, added a comment > instead > - Corrected indentation > --- > tools/testing/selftests/vm/Makefile | 7 +- > tools/testing/selftests/vm/madv_populate.c | 34 +----- > .../selftests/vm/split_huge_page_test.c | 79 +------------ > tools/testing/selftests/vm/vm_util.c | 108 ++++++++++++++++++ > tools/testing/selftests/vm/vm_util.h | 9 ++ > 5 files changed, 124 insertions(+), 113 deletions(-) > create mode 100644 tools/testing/selftests/vm/vm_util.c > create mode 100644 tools/testing/selftests/vm/vm_util.h > > diff --git a/tools/testing/selftests/vm/Makefile b/tools/testing/selftests/vm/Makefile > index 5e43f072f5b76..4e68edb26d6b6 100644 > --- a/tools/testing/selftests/vm/Makefile > +++ b/tools/testing/selftests/vm/Makefile > @@ -34,7 +34,7 @@ TEST_GEN_FILES += hugepage-mremap > TEST_GEN_FILES += hugepage-shm > TEST_GEN_FILES += hugepage-vmemmap > TEST_GEN_FILES += khugepaged > -TEST_GEN_FILES += madv_populate > +TEST_GEN_PROGS = madv_populate > TEST_GEN_FILES += map_fixed_noreplace > TEST_GEN_FILES += map_hugetlb > TEST_GEN_FILES += map_populate > @@ -47,7 +47,7 @@ TEST_GEN_FILES += on-fault-limit > TEST_GEN_FILES += thuge-gen > TEST_GEN_FILES += transhuge-stress > TEST_GEN_FILES += userfaultfd > -TEST_GEN_FILES += split_huge_page_test > +TEST_GEN_PROGS += split_huge_page_test > TEST_GEN_FILES += ksm_tests > > ifeq ($(MACHINE),x86_64) > @@ -91,6 +91,9 @@ TEST_FILES := test_vmalloc.sh > KSFT_KHDR_INSTALL := 1 > include ../lib.mk > Acked-by: David Hildenbrand <david@redhat.com> BTW, I realized that my madv_populate test fails when run without softdirty support in the kernel. Eventually we should sense support somehow and skip softdirty tests. Maybe we can sense by writing to some page and then testing if the page is reported as softdirty. If it isn't, we know the kernel doesn't support it (or is extremely buggy :D ). Such a sense check would be common functionality in the helper file as well.
On 4/20/22 04:40, Muhammad Usama Anjum wrote: > Bring common functions to a new file while keeping code as much same as > possible. These functions can be used in the new tests. This helps in > avoiding code duplication. This commit breaks a pattern in the way tests are run in the current scheme. Before this commit the only executable (or TEST_PROGS) that was executed was run_vmselftests.sh. Now both madv_populate and split_huge_page_test are being run as well. > > Signed-off-by: Muhammad Usama Anjum <usama.anjum@collabora.com> > --- > Changes in V6: > - Correct header files inclusion > > Changes in V5: > Keep moved code as same as possible > - Updated macros names > - Removed macro used to show bit number of dirty bit, added a comment > instead > - Corrected indentation > --- > tools/testing/selftests/vm/Makefile | 7 +- > tools/testing/selftests/vm/madv_populate.c | 34 +----- > .../selftests/vm/split_huge_page_test.c | 79 +------------ > tools/testing/selftests/vm/vm_util.c | 108 ++++++++++++++++++ > tools/testing/selftests/vm/vm_util.h | 9 ++ > 5 files changed, 124 insertions(+), 113 deletions(-) > create mode 100644 tools/testing/selftests/vm/vm_util.c > create mode 100644 tools/testing/selftests/vm/vm_util.h > > diff --git a/tools/testing/selftests/vm/Makefile b/tools/testing/selftests/vm/Makefile > index 5e43f072f5b76..4e68edb26d6b6 100644 > --- a/tools/testing/selftests/vm/Makefile > +++ b/tools/testing/selftests/vm/Makefile > @@ -34,7 +34,7 @@ TEST_GEN_FILES += hugepage-mremap > TEST_GEN_FILES += hugepage-shm > TEST_GEN_FILES += hugepage-vmemmap > TEST_GEN_FILES += khugepaged > -TEST_GEN_FILES += madv_populate > +TEST_GEN_PROGS = madv_populate madv_populate is already being run in run_vmselftests.sh > TEST_GEN_FILES += map_fixed_noreplace > TEST_GEN_FILES += map_hugetlb > TEST_GEN_FILES += map_populate > @@ -47,7 +47,7 @@ TEST_GEN_FILES += on-fault-limit > TEST_GEN_FILES += thuge-gen > TEST_GEN_FILES += transhuge-stress > TEST_GEN_FILES += userfaultfd > -TEST_GEN_FILES += split_huge_page_test > +TEST_GEN_PROGS += split_huge_page_test > TEST_GEN_FILES += ksm_tests > > ifeq ($(MACHINE),x86_64) > @@ -91,6 +91,9 @@ TEST_FILES := test_vmalloc.sh > KSFT_KHDR_INSTALL := 1 > include ../lib.mk > > +$(OUTPUT)/madv_populate: vm_util.c > +$(OUTPUT)/split_huge_page_test: vm_util.c Not sure what this does but if we add a run entry for split_huge_page_test in run_vmselftests.sh we wont really need this patch. I'm not sure the reduction in code size is worth the change in run behavior. Unless I'm missing something I suggest we revert this patch and add a run entry for split_huge_page_test in run_vmselftests.sh. I can do this if no one objects. Cheers, -- Nico
On 9/9/22 8:06 AM, Nico Pache wrote: > > > On 4/20/22 04:40, Muhammad Usama Anjum wrote: >> Bring common functions to a new file while keeping code as much same as >> possible. These functions can be used in the new tests. This helps in >> avoiding code duplication. > > This commit breaks a pattern in the way tests are run in the current scheme. > Before this commit the only executable (or TEST_PROGS) that was executed was > run_vmselftests.sh. Now both madv_populate and split_huge_page_test are being > run as well. >> >> Signed-off-by: Muhammad Usama Anjum <usama.anjum@collabora.com> >> --- >> Changes in V6: >> - Correct header files inclusion >> >> Changes in V5: >> Keep moved code as same as possible >> - Updated macros names >> - Removed macro used to show bit number of dirty bit, added a comment >> instead >> - Corrected indentation >> --- >> tools/testing/selftests/vm/Makefile | 7 +- >> tools/testing/selftests/vm/madv_populate.c | 34 +----- >> .../selftests/vm/split_huge_page_test.c | 79 +------------ >> tools/testing/selftests/vm/vm_util.c | 108 ++++++++++++++++++ >> tools/testing/selftests/vm/vm_util.h | 9 ++ >> 5 files changed, 124 insertions(+), 113 deletions(-) >> create mode 100644 tools/testing/selftests/vm/vm_util.c >> create mode 100644 tools/testing/selftests/vm/vm_util.h >> >> diff --git a/tools/testing/selftests/vm/Makefile b/tools/testing/selftests/vm/Makefile >> index 5e43f072f5b76..4e68edb26d6b6 100644 >> --- a/tools/testing/selftests/vm/Makefile >> +++ b/tools/testing/selftests/vm/Makefile >> @@ -34,7 +34,7 @@ TEST_GEN_FILES += hugepage-mremap >> TEST_GEN_FILES += hugepage-shm >> TEST_GEN_FILES += hugepage-vmemmap >> TEST_GEN_FILES += khugepaged >> -TEST_GEN_FILES += madv_populate >> +TEST_GEN_PROGS = madv_populate > madv_populate is already being run in run_vmselftests.sh >> TEST_GEN_FILES += map_fixed_noreplace >> TEST_GEN_FILES += map_hugetlb >> TEST_GEN_FILES += map_populate >> @@ -47,7 +47,7 @@ TEST_GEN_FILES += on-fault-limit >> TEST_GEN_FILES += thuge-gen >> TEST_GEN_FILES += transhuge-stress >> TEST_GEN_FILES += userfaultfd >> -TEST_GEN_FILES += split_huge_page_test >> +TEST_GEN_PROGS += split_huge_page_test >> TEST_GEN_FILES += ksm_tests >> >> ifeq ($(MACHINE),x86_64) >> @@ -91,6 +91,9 @@ TEST_FILES := test_vmalloc.sh >> KSFT_KHDR_INSTALL := 1 >> include ../lib.mk >> >> +$(OUTPUT)/madv_populate: vm_util.c >> +$(OUTPUT)/split_huge_page_test: vm_util.c > Not sure what this does but if we add a run entry for split_huge_page_test in > run_vmselftests.sh we wont really need this patch. > > I'm not sure the reduction in code size is worth the change in run behavior. > > Unless I'm missing something I suggest we revert this patch and add a run entry > for split_huge_page_test in run_vmselftests.sh. I can do this if no one objects. The run behavior isn't being changed here. Only the build behavior is being changed as we want to keep the common code in one file. You can add the run entry as required. I don't know why do you think the Makefile has changed the run behavior. > > Cheers, > -- Nico >
On Wed, Sep 21, 2022 at 5:06 AM Muhammad Usama Anjum <usama.anjum@collabora.com> wrote: > > On 9/9/22 8:06 AM, Nico Pache wrote: > > > > > > On 4/20/22 04:40, Muhammad Usama Anjum wrote: > >> Bring common functions to a new file while keeping code as much same as > >> possible. These functions can be used in the new tests. This helps in > >> avoiding code duplication. > > > > This commit breaks a pattern in the way tests are run in the current scheme. > > Before this commit the only executable (or TEST_PROGS) that was executed was > > run_vmselftests.sh. Now both madv_populate and split_huge_page_test are being > > run as well. > >> > >> Signed-off-by: Muhammad Usama Anjum <usama.anjum@collabora.com> > >> --- > >> Changes in V6: > >> - Correct header files inclusion > >> > >> Changes in V5: > >> Keep moved code as same as possible > >> - Updated macros names > >> - Removed macro used to show bit number of dirty bit, added a comment > >> instead > >> - Corrected indentation > >> --- > >> tools/testing/selftests/vm/Makefile | 7 +- > >> tools/testing/selftests/vm/madv_populate.c | 34 +----- > >> .../selftests/vm/split_huge_page_test.c | 79 +------------ > >> tools/testing/selftests/vm/vm_util.c | 108 ++++++++++++++++++ > >> tools/testing/selftests/vm/vm_util.h | 9 ++ > >> 5 files changed, 124 insertions(+), 113 deletions(-) > >> create mode 100644 tools/testing/selftests/vm/vm_util.c > >> create mode 100644 tools/testing/selftests/vm/vm_util.h > >> > >> diff --git a/tools/testing/selftests/vm/Makefile b/tools/testing/selftests/vm/Makefile > >> index 5e43f072f5b76..4e68edb26d6b6 100644 > >> --- a/tools/testing/selftests/vm/Makefile > >> +++ b/tools/testing/selftests/vm/Makefile > >> @@ -34,7 +34,7 @@ TEST_GEN_FILES += hugepage-mremap > >> TEST_GEN_FILES += hugepage-shm > >> TEST_GEN_FILES += hugepage-vmemmap > >> TEST_GEN_FILES += khugepaged > >> -TEST_GEN_FILES += madv_populate > >> +TEST_GEN_PROGS = madv_populate > > madv_populate is already being run in run_vmselftests.sh > >> TEST_GEN_FILES += map_fixed_noreplace > >> TEST_GEN_FILES += map_hugetlb > >> TEST_GEN_FILES += map_populate > >> @@ -47,7 +47,7 @@ TEST_GEN_FILES += on-fault-limit > >> TEST_GEN_FILES += thuge-gen > >> TEST_GEN_FILES += transhuge-stress > >> TEST_GEN_FILES += userfaultfd > >> -TEST_GEN_FILES += split_huge_page_test > >> +TEST_GEN_PROGS += split_huge_page_test > >> TEST_GEN_FILES += ksm_tests > >> > >> ifeq ($(MACHINE),x86_64) > >> @@ -91,6 +91,9 @@ TEST_FILES := test_vmalloc.sh > >> KSFT_KHDR_INSTALL := 1 > >> include ../lib.mk > >> > >> +$(OUTPUT)/madv_populate: vm_util.c > >> +$(OUTPUT)/split_huge_page_test: vm_util.c > > Not sure what this does but if we add a run entry for split_huge_page_test in > > run_vmselftests.sh we wont really need this patch. > > > > I'm not sure the reduction in code size is worth the change in run behavior. > > > > Unless I'm missing something I suggest we revert this patch and add a run entry > > for split_huge_page_test in run_vmselftests.sh. I can do this if no one objects. > The run behavior isn't being changed here. Only the build behavior is > being changed as we want to keep the common code in one file. You can > add the run entry as required. I don't know why do you think the > Makefile has changed the run behavior. Before your commit running `make TARGETS=vm; make TARGETS=vm run_tests` had the following run behavior: - The only thing executed via the run_tests wrapper is run_vmtests.sh - TAP output is 1/1: TAP version 13 1..1 # selftests: vm: run_vmtests.sh # arm64 ia64 mips64 parisc64 ppc64 ppc64le riscv64 s390x sh64 sparc64 x86_64 # ----------------------- # running ./hugepage-mmap # ----------------------- .... After your commit: - Multiple executables (madv_populate, soft-dirty, split_huge_page_test, run_vmtests.sh) are defined and ran: # selftests: vm: madv_populate not ok 1 selftests: vm: madv_populate # exit=1 # selftests: vm: soft-dirty ok 2 selftests: vm: soft-dirty # selftests: vm: split_huge_page_test ok 3 selftests: vm: split_huge_page_test # selftests: vm: run_vmtests.sh ok 4 selftests: vm: run_vmtests.sh # SKIP I'm not saying utilizing the TEST_GEN_PROG variable is incorrect, I'm just pointing out that we have a sudden change in run behavior via the run_test wrapper. I personally think the TEST_GEN_PROG output is cleaner, but having two different ways of outputting results may be harder/confusing to parser. Additionally there is still the issue that madv_populate is being run twice for no reason. Cheers, -- Nico > > > > > Cheers, > > -- Nico > > > > -- > Muhammad Usama Anjum >
On 9/24/22 3:35 AM, Nico Pache wrote: > On Wed, Sep 21, 2022 at 5:06 AM Muhammad Usama Anjum > <usama.anjum@collabora.com> wrote: >> >> On 9/9/22 8:06 AM, Nico Pache wrote: >>> >>> >>> On 4/20/22 04:40, Muhammad Usama Anjum wrote: >>>> Bring common functions to a new file while keeping code as much same as >>>> possible. These functions can be used in the new tests. This helps in >>>> avoiding code duplication. >>> >>> This commit breaks a pattern in the way tests are run in the current scheme. >>> Before this commit the only executable (or TEST_PROGS) that was executed was >>> run_vmselftests.sh. Now both madv_populate and split_huge_page_test are being >>> run as well. >>>> >>>> Signed-off-by: Muhammad Usama Anjum <usama.anjum@collabora.com> >>>> --- >>>> Changes in V6: >>>> - Correct header files inclusion >>>> >>>> Changes in V5: >>>> Keep moved code as same as possible >>>> - Updated macros names >>>> - Removed macro used to show bit number of dirty bit, added a comment >>>> instead >>>> - Corrected indentation >>>> --- >>>> tools/testing/selftests/vm/Makefile | 7 +- >>>> tools/testing/selftests/vm/madv_populate.c | 34 +----- >>>> .../selftests/vm/split_huge_page_test.c | 79 +------------ >>>> tools/testing/selftests/vm/vm_util.c | 108 ++++++++++++++++++ >>>> tools/testing/selftests/vm/vm_util.h | 9 ++ >>>> 5 files changed, 124 insertions(+), 113 deletions(-) >>>> create mode 100644 tools/testing/selftests/vm/vm_util.c >>>> create mode 100644 tools/testing/selftests/vm/vm_util.h >>>> >>>> diff --git a/tools/testing/selftests/vm/Makefile b/tools/testing/selftests/vm/Makefile >>>> index 5e43f072f5b76..4e68edb26d6b6 100644 >>>> --- a/tools/testing/selftests/vm/Makefile >>>> +++ b/tools/testing/selftests/vm/Makefile >>>> @@ -34,7 +34,7 @@ TEST_GEN_FILES += hugepage-mremap >>>> TEST_GEN_FILES += hugepage-shm >>>> TEST_GEN_FILES += hugepage-vmemmap >>>> TEST_GEN_FILES += khugepaged >>>> -TEST_GEN_FILES += madv_populate >>>> +TEST_GEN_PROGS = madv_populate >>> madv_populate is already being run in run_vmselftests.sh >>>> TEST_GEN_FILES += map_fixed_noreplace >>>> TEST_GEN_FILES += map_hugetlb >>>> TEST_GEN_FILES += map_populate >>>> @@ -47,7 +47,7 @@ TEST_GEN_FILES += on-fault-limit >>>> TEST_GEN_FILES += thuge-gen >>>> TEST_GEN_FILES += transhuge-stress >>>> TEST_GEN_FILES += userfaultfd >>>> -TEST_GEN_FILES += split_huge_page_test >>>> +TEST_GEN_PROGS += split_huge_page_test >>>> TEST_GEN_FILES += ksm_tests >>>> >>>> ifeq ($(MACHINE),x86_64) >>>> @@ -91,6 +91,9 @@ TEST_FILES := test_vmalloc.sh >>>> KSFT_KHDR_INSTALL := 1 >>>> include ../lib.mk >>>> >>>> +$(OUTPUT)/madv_populate: vm_util.c >>>> +$(OUTPUT)/split_huge_page_test: vm_util.c >>> Not sure what this does but if we add a run entry for split_huge_page_test in >>> run_vmselftests.sh we wont really need this patch. >>> >>> I'm not sure the reduction in code size is worth the change in run behavior. >>> >>> Unless I'm missing something I suggest we revert this patch and add a run entry >>> for split_huge_page_test in run_vmselftests.sh. I can do this if no one objects. >> The run behavior isn't being changed here. Only the build behavior is >> being changed as we want to keep the common code in one file. You can >> add the run entry as required. I don't know why do you think the >> Makefile has changed the run behavior. > > Before your commit running > `make TARGETS=vm; make TARGETS=vm run_tests` > had the following run behavior: > - The only thing executed via the run_tests wrapper is run_vmtests.sh > - TAP output is 1/1: > TAP version 13 > 1..1 > # selftests: vm: run_vmtests.sh > # arm64 ia64 mips64 parisc64 ppc64 ppc64le riscv64 s390x sh64 > sparc64 x86_64 > # ----------------------- > # running ./hugepage-mmap > # ----------------------- > .... > > After your commit: > - Multiple executables (madv_populate, soft-dirty, > split_huge_page_test, run_vmtests.sh) are defined and ran: > # selftests: vm: madv_populate > not ok 1 selftests: vm: madv_populate # exit=1 > # selftests: vm: soft-dirty > ok 2 selftests: vm: soft-dirty > # selftests: vm: split_huge_page_test > ok 3 selftests: vm: split_huge_page_test > # selftests: vm: run_vmtests.sh > ok 4 selftests: vm: run_vmtests.sh # SKIP > > I'm not saying utilizing the TEST_GEN_PROG variable is incorrect, I'm > just pointing out that we have a sudden change in run behavior via the > run_test wrapper. I personally think the TEST_GEN_PROG output is > cleaner, but having two different ways of outputting results may be > harder/confusing to parser. Additionally there is still the issue that > madv_populate is being run twice for no reason. Thank you for sharing. A directory inside selftests like selftests/vm can have multiple individual tests. To me, it means that it can have multiple binaries to run as individual tests. For selftests/vm, historically we have this run_vmtests.sh as the only script which runs all the tests inside the directory. This kind of script isn't present in other selftests. So normally contributors are not aware of this script. People use different ways to run selftests. So it doesn't get caught easily. The tests can be run with different arguments through run_vmtests.sh. But we shouldn't depend on run_vmtests.sh to run all the tests as there are tests which have multiple source files and their binary gets listed separately. At this point, the parser can be updated. The duplicate runs of the tests should be removed: diff --git a/tools/testing/selftests/vm/run_vmtests.sh b/tools/testing/selftests/vm/run_vmtests.sh index e780e76c26b8..3bf946437ad9 100755 --- a/tools/testing/selftests/vm/run_vmtests.sh +++ b/tools/testing/selftests/vm/run_vmtests.sh @@ -166,9 +166,6 @@ run_test ./mremap_dontunmap run_test ./test_hmm.sh smoke -# MADV_POPULATE_READ and MADV_POPULATE_WRITE tests -run_test ./madv_populate - run_test ./memfd_secret # KSM MADV_MERGEABLE test with 10 identical pages The separate binaries are being run as I'd used TEST_GEN_PROGS. I hadn't found any other way to build test with more than one source file. If there is some other way, that should be used and supremacy of the run_vmtests.sh can be kept. > > Cheers, > -- Nico > >> >>> >>> Cheers, >>> -- Nico >>> >> >> -- >> Muhammad Usama Anjum >> >
diff --git a/tools/testing/selftests/vm/Makefile b/tools/testing/selftests/vm/Makefile index 5e43f072f5b76..4e68edb26d6b6 100644 --- a/tools/testing/selftests/vm/Makefile +++ b/tools/testing/selftests/vm/Makefile @@ -34,7 +34,7 @@ TEST_GEN_FILES += hugepage-mremap TEST_GEN_FILES += hugepage-shm TEST_GEN_FILES += hugepage-vmemmap TEST_GEN_FILES += khugepaged -TEST_GEN_FILES += madv_populate +TEST_GEN_PROGS = madv_populate TEST_GEN_FILES += map_fixed_noreplace TEST_GEN_FILES += map_hugetlb TEST_GEN_FILES += map_populate @@ -47,7 +47,7 @@ TEST_GEN_FILES += on-fault-limit TEST_GEN_FILES += thuge-gen TEST_GEN_FILES += transhuge-stress TEST_GEN_FILES += userfaultfd -TEST_GEN_FILES += split_huge_page_test +TEST_GEN_PROGS += split_huge_page_test TEST_GEN_FILES += ksm_tests ifeq ($(MACHINE),x86_64) @@ -91,6 +91,9 @@ TEST_FILES := test_vmalloc.sh KSFT_KHDR_INSTALL := 1 include ../lib.mk +$(OUTPUT)/madv_populate: vm_util.c +$(OUTPUT)/split_huge_page_test: vm_util.c + ifeq ($(MACHINE),x86_64) BINARIES_32 := $(patsubst %,$(OUTPUT)/%,$(BINARIES_32)) BINARIES_64 := $(patsubst %,$(OUTPUT)/%,$(BINARIES_64)) diff --git a/tools/testing/selftests/vm/madv_populate.c b/tools/testing/selftests/vm/madv_populate.c index 3ee0e82756002..715a42e8e2cdb 100644 --- a/tools/testing/selftests/vm/madv_populate.c +++ b/tools/testing/selftests/vm/madv_populate.c @@ -18,6 +18,7 @@ #include <sys/mman.h> #include "../kselftest.h" +#include "vm_util.h" /* * For now, we're using 2 MiB of private anonymous memory for all tests. @@ -26,18 +27,6 @@ static size_t pagesize; -static uint64_t pagemap_get_entry(int fd, char *start) -{ - const unsigned long pfn = (unsigned long)start / pagesize; - uint64_t entry; - int ret; - - ret = pread(fd, &entry, sizeof(entry), pfn * sizeof(entry)); - if (ret != sizeof(entry)) - ksft_exit_fail_msg("reading pagemap failed\n"); - return entry; -} - static bool pagemap_is_populated(int fd, char *start) { uint64_t entry = pagemap_get_entry(fd, start); @@ -46,13 +35,6 @@ static bool pagemap_is_populated(int fd, char *start) return entry & 0xc000000000000000ull; } -static bool pagemap_is_softdirty(int fd, char *start) -{ - uint64_t entry = pagemap_get_entry(fd, start); - - return entry & 0x0080000000000000ull; -} - static void sense_support(void) { char *addr; @@ -258,20 +240,6 @@ static bool range_is_not_softdirty(char *start, ssize_t size) return ret; } -static void clear_softdirty(void) -{ - int fd = open("/proc/self/clear_refs", O_WRONLY); - const char *ctrl = "4"; - int ret; - - if (fd < 0) - ksft_exit_fail_msg("opening clear_refs failed\n"); - ret = write(fd, ctrl, strlen(ctrl)); - if (ret != strlen(ctrl)) - ksft_exit_fail_msg("writing clear_refs failed\n"); - close(fd); -} - static void test_softdirty(void) { char *addr; diff --git a/tools/testing/selftests/vm/split_huge_page_test.c b/tools/testing/selftests/vm/split_huge_page_test.c index 52497b7b9f1db..6aa2b8253aeda 100644 --- a/tools/testing/selftests/vm/split_huge_page_test.c +++ b/tools/testing/selftests/vm/split_huge_page_test.c @@ -16,14 +16,13 @@ #include <sys/mount.h> #include <malloc.h> #include <stdbool.h> +#include "vm_util.h" uint64_t pagesize; unsigned int pageshift; uint64_t pmd_pagesize; -#define PMD_SIZE_PATH "/sys/kernel/mm/transparent_hugepage/hpage_pmd_size" #define SPLIT_DEBUGFS "/sys/kernel/debug/split_huge_pages" -#define SMAP_PATH "/proc/self/smaps" #define INPUT_MAX 80 #define PID_FMT "%d,0x%lx,0x%lx" @@ -51,30 +50,6 @@ int is_backed_by_thp(char *vaddr, int pagemap_file, int kpageflags_file) return 0; } - -static uint64_t read_pmd_pagesize(void) -{ - int fd; - char buf[20]; - ssize_t num_read; - - fd = open(PMD_SIZE_PATH, O_RDONLY); - if (fd == -1) { - perror("Open hpage_pmd_size failed"); - exit(EXIT_FAILURE); - } - num_read = read(fd, buf, 19); - if (num_read < 1) { - close(fd); - perror("Read hpage_pmd_size failed"); - exit(EXIT_FAILURE); - } - buf[num_read] = '\0'; - close(fd); - - return strtoul(buf, NULL, 10); -} - static int write_file(const char *path, const char *buf, size_t buflen) { int fd; @@ -113,58 +88,6 @@ static void write_debugfs(const char *fmt, ...) } } -#define MAX_LINE_LENGTH 500 - -static bool check_for_pattern(FILE *fp, const char *pattern, char *buf) -{ - while (fgets(buf, MAX_LINE_LENGTH, fp) != NULL) { - if (!strncmp(buf, pattern, strlen(pattern))) - return true; - } - return false; -} - -static uint64_t check_huge(void *addr) -{ - uint64_t thp = 0; - int ret; - FILE *fp; - char buffer[MAX_LINE_LENGTH]; - char addr_pattern[MAX_LINE_LENGTH]; - - ret = snprintf(addr_pattern, MAX_LINE_LENGTH, "%08lx-", - (unsigned long) addr); - if (ret >= MAX_LINE_LENGTH) { - printf("%s: Pattern is too long\n", __func__); - exit(EXIT_FAILURE); - } - - - fp = fopen(SMAP_PATH, "r"); - if (!fp) { - printf("%s: Failed to open file %s\n", __func__, SMAP_PATH); - exit(EXIT_FAILURE); - } - if (!check_for_pattern(fp, addr_pattern, buffer)) - goto err_out; - - /* - * Fetch the AnonHugePages: in the same block and check the number of - * hugepages. - */ - if (!check_for_pattern(fp, "AnonHugePages:", buffer)) - goto err_out; - - if (sscanf(buffer, "AnonHugePages:%10ld kB", &thp) != 1) { - printf("Reading smap error\n"); - exit(EXIT_FAILURE); - } - -err_out: - fclose(fp); - return thp; -} - void split_pmd_thp(void) { char *one_page; diff --git a/tools/testing/selftests/vm/vm_util.c b/tools/testing/selftests/vm/vm_util.c new file mode 100644 index 0000000000000..b58ab11a7a302 --- /dev/null +++ b/tools/testing/selftests/vm/vm_util.c @@ -0,0 +1,108 @@ +// SPDX-License-Identifier: GPL-2.0 +#include <string.h> +#include <fcntl.h> +#include "../kselftest.h" +#include "vm_util.h" + +#define PMD_SIZE_FILE_PATH "/sys/kernel/mm/transparent_hugepage/hpage_pmd_size" +#define SMAP_FILE_PATH "/proc/self/smaps" +#define MAX_LINE_LENGTH 500 + +uint64_t pagemap_get_entry(int fd, char *start) +{ + const unsigned long pfn = (unsigned long)start / getpagesize(); + uint64_t entry; + int ret; + + ret = pread(fd, &entry, sizeof(entry), pfn * sizeof(entry)); + if (ret != sizeof(entry)) + ksft_exit_fail_msg("reading pagemap failed\n"); + return entry; +} + +bool pagemap_is_softdirty(int fd, char *start) +{ + uint64_t entry = pagemap_get_entry(fd, start); + + // Check if dirty bit (55th bit) is set + return entry & 0x0080000000000000ull; +} + +void clear_softdirty(void) +{ + int ret; + const char *ctrl = "4"; + int fd = open("/proc/self/clear_refs", O_WRONLY); + + if (fd < 0) + ksft_exit_fail_msg("opening clear_refs failed\n"); + ret = write(fd, ctrl, strlen(ctrl)); + close(fd); + if (ret != strlen(ctrl)) + ksft_exit_fail_msg("writing clear_refs failed\n"); +} + +static bool check_for_pattern(FILE *fp, const char *pattern, char *buf) +{ + while (fgets(buf, MAX_LINE_LENGTH, fp) != NULL) { + if (!strncmp(buf, pattern, strlen(pattern))) + return true; + } + return false; +} + +uint64_t read_pmd_pagesize(void) +{ + int fd; + char buf[20]; + ssize_t num_read; + + fd = open(PMD_SIZE_FILE_PATH, O_RDONLY); + if (fd == -1) + ksft_exit_fail_msg("Open hpage_pmd_size failed\n"); + + num_read = read(fd, buf, 19); + if (num_read < 1) { + close(fd); + ksft_exit_fail_msg("Read hpage_pmd_size failed\n"); + } + buf[num_read] = '\0'; + close(fd); + + return strtoul(buf, NULL, 10); +} + +uint64_t check_huge(void *addr) +{ + uint64_t thp = 0; + int ret; + FILE *fp; + char buffer[MAX_LINE_LENGTH]; + char addr_pattern[MAX_LINE_LENGTH]; + + ret = snprintf(addr_pattern, MAX_LINE_LENGTH, "%08lx-", + (unsigned long) addr); + if (ret >= MAX_LINE_LENGTH) + ksft_exit_fail_msg("%s: Pattern is too long\n", __func__); + + fp = fopen(SMAP_FILE_PATH, "r"); + if (!fp) + ksft_exit_fail_msg("%s: Failed to open file %s\n", __func__, SMAP_FILE_PATH); + + if (!check_for_pattern(fp, addr_pattern, buffer)) + goto err_out; + + /* + * Fetch the AnonHugePages: in the same block and check the number of + * hugepages. + */ + if (!check_for_pattern(fp, "AnonHugePages:", buffer)) + goto err_out; + + if (sscanf(buffer, "AnonHugePages:%10ld kB", &thp) != 1) + ksft_exit_fail_msg("Reading smap error\n"); + +err_out: + fclose(fp); + return thp; +} diff --git a/tools/testing/selftests/vm/vm_util.h b/tools/testing/selftests/vm/vm_util.h new file mode 100644 index 0000000000000..2e512bd57ae14 --- /dev/null +++ b/tools/testing/selftests/vm/vm_util.h @@ -0,0 +1,9 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#include <stdint.h> +#include <stdbool.h> + +uint64_t pagemap_get_entry(int fd, char *start); +bool pagemap_is_softdirty(int fd, char *start); +void clear_softdirty(void); +uint64_t read_pmd_pagesize(void); +uint64_t check_huge(void *addr);
Bring common functions to a new file while keeping code as much same as possible. These functions can be used in the new tests. This helps in avoiding code duplication. Signed-off-by: Muhammad Usama Anjum <usama.anjum@collabora.com> --- Changes in V6: - Correct header files inclusion Changes in V5: Keep moved code as same as possible - Updated macros names - Removed macro used to show bit number of dirty bit, added a comment instead - Corrected indentation --- tools/testing/selftests/vm/Makefile | 7 +- tools/testing/selftests/vm/madv_populate.c | 34 +----- .../selftests/vm/split_huge_page_test.c | 79 +------------ tools/testing/selftests/vm/vm_util.c | 108 ++++++++++++++++++ tools/testing/selftests/vm/vm_util.h | 9 ++ 5 files changed, 124 insertions(+), 113 deletions(-) create mode 100644 tools/testing/selftests/vm/vm_util.c create mode 100644 tools/testing/selftests/vm/vm_util.h