From patchwork Tue Mar 13 20:57:59 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Thomas Lindroth X-Patchwork-Id: 10280739 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 992B8602BD for ; Tue, 13 Mar 2018 20:58:14 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 8722628437 for ; Tue, 13 Mar 2018 20:58:14 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 7B35B284B3; Tue, 13 Mar 2018 20:58:14 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.8 required=2.0 tests=BAYES_00, DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED, FREEMAIL_FROM, RCVD_IN_DNSWL_HI, T_DKIM_INVALID autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 60C5628437 for ; Tue, 13 Mar 2018 20:58:11 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752800AbeCMU6K (ORCPT ); Tue, 13 Mar 2018 16:58:10 -0400 Received: from mail-lf0-f66.google.com ([209.85.215.66]:46129 "EHLO mail-lf0-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752226AbeCMU6F (ORCPT ); Tue, 13 Mar 2018 16:58:05 -0400 Received: by mail-lf0-f66.google.com with SMTP id w16-v6so1472127lfc.13 for ; Tue, 13 Mar 2018 13:58:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=Otjc8Mdqnpkj8jL5nAkrGK4QHiVQzeUA8isu9GEBMp0=; b=OlqjlrPIgaG34mx9iIfwDwieQKJ++uIMbyhX/Tu7bpaOG+8EgJ6mb9oHITkEI86ug9 PBTYh5OKDIDrAw8eaZfYjtfsfMpSfX+ayh8fyKWhHCJOGHag30maKJolGNXb9Hf2ntBo 7lvWWf4XV+Golg5dsn541nk4o0klDZhYQGwROdmEuzwnmKveJLJy6HG26PeDPxkXg4OV yS/KLvCQSvMd2MovIQCEgWe+o6qCt5LMF/iI5Tdh9/8N4T7NpgGl0lVBHaEKo7o5JfXM OeB17KL3KrUTGn3hkXqBurfT/Jdp+DBJeUsXcgz4b/zffYOVu6RcWzlKPhKXDyTcpoO9 eJqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Otjc8Mdqnpkj8jL5nAkrGK4QHiVQzeUA8isu9GEBMp0=; b=SVMpZh+BwowjyNvM8JFhh/Dx3CZDOJyE/sglYdvw2qnfxp/OzNZWR3mZ6BK/x0tZkV wZBWwzQZYn2vH8Ronayxxx11M7t18tiSV7eOsw0jKuSkt/KAwnkoQd39Hb77T6p3ldkx ysHSlvvQz+FrqCnPErUpKZr0ZdXPSi8si4kjg6wkARbzCiY+1g/fMqKZCXe0tCwlgSR2 YFMhrOvMjOqg14YUa2di4WSSz5L1co/UtWV9uS5t+bmIpwLvlObzF0brGJn3nMd/N1EN mQeuxbMMOLT37KSMWwwwohFxJ5rILZt6JCsMwAjra3eYwrDQR5oN/3fpBETVyIIEsk2n BOYw== X-Gm-Message-State: AElRT7FTfSB1FGVl/t3aIIXu6wZ7HX8pRJ6/EVR9zeSHouY2HqvOpV0l icCO/Jc1aWGShwbdgeGNMiBIIw== X-Google-Smtp-Source: AG47ELsfNNcm5lHNNBZaALCPrxMtvUU0zSynOabK6D7xMy8oV53VBdoPpzhytlrJxNNHbfXRSwr+uQ== X-Received: by 10.46.33.230 with SMTP id h99mr1535454lji.47.1520974681251; Tue, 13 Mar 2018 13:58:01 -0700 (PDT) Received: from [84.217.170.228] (c-e4aad954.501502050104-0-757473696b74.cust.bredbandsbolaget.se. [84.217.170.228]) by smtp.gmail.com with ESMTPSA id x4-v6sm233916lfa.83.2018.03.13.13.57.59 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 13 Mar 2018 13:58:00 -0700 (PDT) Subject: Re: Intermittent build failure with TRIM_UNUSED_KSYMS and related problems To: Nicolas Pitre , Masahiro Yamada Cc: Linux Kbuild mailing list References: From: Thomas Lindroth Message-ID: <4bbfeb74-c912-74e5-4f4d-287ec7ad065d@gmail.com> Date: Tue, 13 Mar 2018 21:57:59 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US Sender: linux-kbuild-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kbuild@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP On 03/12/2018 08:15 PM, Nicolas Pitre wrote: >>> When I build the kernel I get a line like "KSYMS symbols: >>> before=1872, after=1871, changed=17" followed by rebuild of a few >>> files. One of the rebuilt files is always drivers/pci/access.c which >>> looks suspicions based on the error I get. > > What exactly did you do between the build that gave you the above KSYMS > line and the build that preceded it? Did you modify your kernel config? Yes. I basically ran something like this: $ make xconfig (toggled things that looked relevant to my VM problem) $ make clean $ make -j8 # make install # make modules_install Then tested the new kernel and repeat again until I found which option caused my VM problems. >>> EXPORT_SYMBOL_GPL(pci_user_read_config_##size); >>> EXPORT_SYMBOL_GPL(pci_user_write_config_##size); >>> >>> drivers/pci/access.c got these two exports. They stand out because >>> they are macros instead of functions. > > If you look in drivers/pci/.access.o.cmd you should see lines like: > > $(wildcard include/config/ksym/pci/bus/read/config/byte.h) \ > $(wildcard include/config/ksym/pci/bus/read/config/word.h) \ > $(wildcard include/config/ksym/pci/bus/read/config/dword.h) \ > $(wildcard include/config/ksym/pci/bus/write/config/byte.h) \ > $(wildcard include/config/ksym/pci/bus/write/config/word.h) \ > $(wildcard include/config/ksym/pci/bus/write/config/dword.h) \ > > Those are the result of the above two EXPORT_SYMBOL lines when the macro > containing them are expanded. If you don't have those then > drivers/pci/access.c would not be rebuilt when needed in some cases. Here are all the ksym includes from drivers/pci/.access.o.cmd: $(wildcard include/config/ksym/pci/bus/read/config/byte.h) \ $(wildcard include/config/ksym/pci/bus/read/config/word.h) \ $(wildcard include/config/ksym/pci/bus/read/config/dword.h) \ $(wildcard include/config/ksym/pci/bus/write/config/byte.h) \ $(wildcard include/config/ksym/pci/bus/write/config/word.h) \ $(wildcard include/config/ksym/pci/bus/write/config/dword.h) \ $(wildcard include/config/ksym/pci/generic/config/read.h) \ $(wildcard include/config/ksym/pci/generic/config/write.h) \ $(wildcard include/config/ksym/pci/generic/config/read32.h) \ $(wildcard include/config/ksym/pci/generic/config/write32.h) \ $(wildcard include/config/ksym/pci/bus/set/ops.h) \ $(wildcard include/config/ksym/pci/user/read/config/byte.h) \ $(wildcard include/config/ksym/pci/user/read/config/word.h) \ $(wildcard include/config/ksym/pci/user/read/config/dword.h) \ $(wildcard include/config/ksym/pci/user/write/config/byte.h) \ $(wildcard include/config/ksym/pci/user/write/config/word.h) \ $(wildcard include/config/ksym/pci/user/write/config/dword.h) \ $(wildcard include/config/ksym/pci/read/vpd.h) \ $(wildcard include/config/ksym/pci/write/vpd.h) \ $(wildcard include/config/ksym/pci/set/vpd/size.h) \ $(wildcard include/config/ksym/pci/cfg/access/lock.h) \ $(wildcard include/config/ksym/pci/cfg/access/trylock.h) \ $(wildcard include/config/ksym/pci/cfg/access/unlock.h) \ $(wildcard include/config/ksym/pcie/capability/read/word.h) \ $(wildcard include/config/ksym/pcie/capability/read/dword.h) \ $(wildcard include/config/ksym/pcie/capability/write/word.h) \ $(wildcard include/config/ksym/pcie/capability/write/dword.h) \ $(wildcard include/config/ksym/pcie/capability/clear/and/set/word.h) \ $(wildcard include/config/ksym/pcie/capability/clear/and/set/dword.h) \ $(wildcard include/config/ksym/pci/read/config/byte.h) \ $(wildcard include/config/ksym/pci/read/config/word.h) \ $(wildcard include/config/ksym/pci/read/config/dword.h) \ $(wildcard include/config/ksym/pci/write/config/byte.h) \ $(wildcard include/config/ksym/pci/write/config/word.h) \ $(wildcard include/config/ksym/pci/write/config/dword.h) \ I'm guessing you meant these: $(wildcard include/config/ksym/pci/user/read/config/byte.h) \ $(wildcard include/config/ksym/pci/user/read/config/word.h) \ $(wildcard include/config/ksym/pci/user/read/config/dword.h) \ $(wildcard include/config/ksym/pci/user/write/config/byte.h) \ $(wildcard include/config/ksym/pci/user/write/config/word.h) \ $(wildcard include/config/ksym/pci/user/write/config/dword.h) \ They exist but most of the corresponding files like include/config/ksym/pci/user/read/config/byte.h do not. I guess that's normal since vfio is built into the kernel and no other module use those exports. They should get trimmed and include/config/ksym entries don't exist for trimmed symbols? >>> The build failure always looks something like this but the undefined symbols varies: >>> Building modules, stage 2. >>> MODPOST 146 modules >>> ERROR: "__put_user_2" [net/ipv4/netfilter/ip_tables.ko] undefined! >>> ERROR: "__put_user_2" [net/ipv4/netfilter/arp_tables.ko] undefined! >>> ERROR: "__put_user_8" [fs/udf/udf.ko] undefined! >>> ERROR: "__put_user_4" [fs/udf/udf.ko] undefined! >>> ERROR: "__put_user_8" [fs/fat/fat.ko] undefined! >>> ERROR: "__put_user_1" [fs/fat/fat.ko] undefined! > [...] > > Clearly something failed to rebuild arch/x86/lib/putuser.S that provides > those symbols. When that happens, make sure your > arch/x86/lib/.putuser.o.cmd has the following lines: > > $(wildcard include/config/ksym///put/user/1.h) \ > $(wildcard include/config/ksym///put/user/2.h) \ > $(wildcard include/config/ksym///put/user/4.h) \ > $(wildcard include/config/ksym///put/user/8.h) \ > > You just have to replace _ with / to search for those symbols. Then look > at the file date for those actual files i.e.: I don't have the build directory for that failure any more but I ran some more builds until I got a build failure like this: ERROR: "clear_user" [drivers/media/v4l2-core/videodev.ko] undefined! ERROR: "__clear_user" [arch/x86/kvm/kvm.ko] undefined! Those missing exports are part of arch/x86/lib/usercopy_64.c and the relevant ksym parts of arch/x86/lib/.usercopy_64.o.cmd look like this: $(wildcard include/config/ksym///clear/user.h) \ $(wildcard include/config/ksym/clear/user.h) \ $(wildcard include/config/ksym/arch/wb/cache/pmem.h) \ $(wildcard include/config/ksym/memcpy/flushcache.h) \ That's identical to how it looks when the build succeeds. > $ ls --full-time include/config/ksym///put/user/1.h > -rw-rw-r-- 1 nico nico 0 2018-03-12 13:51:07.176136516 -0400 include/config/ksym///put/user/1.h > > And that ought to be older than the kernel file: > > $ ls --full-time vmlinux.o > -rw-rw-r-- 1 nico nico 547474544 2018-03-12 13:52:35.728357983 -0400 vmlinux.o $ ls --full-time linux-fail/include/config/ksym///clear/user.h -rw-r--r-- 1 cocobo cocobo 0 2018-03-13 17:16:53.000000000 +0100 linux-fail/include/config/ksym///clear/user.h $ ls --full-time linux-fail/vmlinux.o -rw-r--r-- 1 cocobo cocobo 545613144 2018-03-13 17:20:57.000000000 +0100 linux-fail/vmlinux.o Looks fine. > If so then verify that include/generated/autoksyms.h has the > corresponding defines: > > $ grep __put_user_ include/generated/autoksyms.h > #define __KSYM___put_user_1 1 > #define __KSYM___put_user_2 1 > #define __KSYM___put_user_4 1 > #define __KSYM___put_user_8 1 linux-fail/include/generated/autoksyms.h: #define __KSYM___clear_user 1 #define __KSYM_clear_user 1 That file's content is also identical to how it looks when the build succeeds. >>> The only difference between the two pasted build logs is that the failing build doesn't rebuild arch/x86/lib/retpoline.S. >> >> Indeed. retpoline.o is not recompiled in the first log. >> Is the content of arch/x86/lib/.retpoline.o.cmd between the success >> case and the failure? > > Would be good to see the difference if any. I don't have that build folder but since arch/x86/lib/.usercopy_64.o.cmd was identical when the build failed with "clear_user" arch/x86/lib/.retpoline.o.cmd was probably identical when it failed with "__put_user_2" > The list of symbols it provides is: > > $(wildcard include/config/ksym///x86/indirect/thunk/rax.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/rbx.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/rcx.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/rdx.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/rsi.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/rdi.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/rbp.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r8.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r9.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r10.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r11.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r12.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r13.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r14.h) \ > $(wildcard include/config/ksym///x86/indirect/thunk/r15.h) \ > $(wildcard include/config/ksym///fill/rsb.h) \ > $(wildcard include/config/ksym///clear/rsb.h) \ > > Do you get any of those in your modpost error list? > > Also... is the build always failing because of symbols starting with one > or more underscores? The type of failures I've seen so far are: ERROR: "clear_user" [drivers/media/v4l2-core/videodev.ko] undefined! ERROR: "__clear_user" [arch/x86/kvm/kvm.ko] undefined! ERROR: "__fill_rsb" [arch/x86/kvm/kvm-intel.ko] undefined! ERROR: "__put_user_2" [net/ipv4/netfilter/ip_tables.ko] undefined! ERROR: "__put_user_2" [net/ipv4/netfilter/arp_tables.ko] undefined! ERROR: "__put_user_8" [fs/udf/udf.ko] undefined! ERROR: "__put_user_4" [fs/udf/udf.ko] undefined! ERROR: "__put_user_8" [fs/fat/fat.ko] undefined! ERROR: "__put_user_1" [fs/fat/fat.ko] undefined! ERROR: "__put_user_4" [fs/fat/fat.ko] undefined! ERROR: "__put_user_2" [fs/fat/fat.ko] undefined! ERROR: "__put_user_4" [drivers/net/tap.ko] undefined! ERROR: "__put_user_2" [drivers/net/tap.ko] undefined! ERROR: "__put_user_8" [drivers/media/v4l2-core/videodev.ko] undefined! ERROR: "__put_user_1" [drivers/media/v4l2-core/videodev.ko] undefined! ERROR: "__put_user_4" [drivers/media/v4l2-core/videodev.ko] undefined! ERROR: "__put_user_8" [drivers/input/joydev.ko] undefined! ERROR: "__put_user_1" [drivers/input/joydev.ko] undefined! ERROR: "__put_user_4" [drivers/input/joydev.ko] undefined! ERROR: "__fill_rsb" [arch/x86/kvm/kvm-intel.ko] undefined! There might have been others but I didn't save every error message. > What filesystem are you using on your build system? Ext4 but it's an old filesystem with 128B inode size created before mkfs.ext4 defaulted to 256B inode size. Without 256B inodes there is no support for nanosecond resolution file timestamps. Perhaps there is some race that only occurs because of the low resolution timestamps? Here is what dumpe2fs -h looks like: Filesystem volume name: Last mounted on: / Filesystem UUID: aba63f98-03a3-4a45-8f33-806484403b42 Filesystem magic number: 0xEF53 Filesystem revision #: 1 (dynamic) Filesystem features: has_journal ext_attr resize_inode dir_index filetype needs_recovery extent flex_bg sparse_super large_file huge_file uninit_bg dir_nlink extra_isize Filesystem flags: signed_directory_hash Default mount options: user_xattr acl Filesystem state: clean Errors behavior: Continue Filesystem OS type: Linux Inode count: 6553600 Block count: 26214400 Reserved block count: 1310720 Free blocks: 3654940 Free inodes: 4653181 First block: 0 Block size: 4096 Fragment size: 4096 Reserved GDT blocks: 1017 Blocks per group: 32768 Fragments per group: 32768 Inodes per group: 8192 Inode blocks per group: 256 Flex block group size: 16 Filesystem created: Sat Dec 22 23:19:28 2012 Last mount time: Mon Mar 12 09:59:50 2018 Last write time: Fri Feb 9 20:31:41 2018 Mount count: 1426 Maximum mount count: -1 Last checked: Thu Aug 14 09:53:55 2014 Check interval: 0 () Lifetime writes: 19 TB Reserved blocks uid: 0 (user root) Reserved blocks gid: 0 (group root) First inode: 11 Inode size: 128 Journal inode: 8 First orphan inode: 6171922 Default directory hash: half_md4 Directory Hash Seed: 005d4e21-62e4-451e-b0a8-d1c99e6a4fcd Journal backup: inode blocks Journal features: journal_incompat_revoke Journal size: 128M Journal length: 32768 Journal sequence: 0x019af2a1 Journal start: 22507 To debug some more I untared a fresh 4.14.23 kernel, built it with that .config and got the "clear_user" error. Then I did the same thing again in another folder and the build was a success. Then I did some comparison between those build folders. The build success folder got more files since it finished building everything. Here is a list of the unique files: Only in linux-success/arch/x86/crypto: chacha20-x86_64.ko Only in linux-success/arch/x86/crypto: .chacha20-x86_64.ko.cmd Only in linux-success/arch/x86/crypto: chacha20-x86_64.mod.o Only in linux-success/arch/x86/crypto: .chacha20-x86_64.mod.o.cmd Only in linux-success/arch/x86/crypto: crc32-pclmul.ko Only in linux-success/arch/x86/crypto: .crc32-pclmul.ko.cmd Only in linux-success/arch/x86/crypto: crc32-pclmul.mod.o Only in linux-success/arch/x86/crypto: .crc32-pclmul.mod.o.cmd Only in linux-success/arch/x86/crypto: poly1305-x86_64.ko Only in linux-success/arch/x86/crypto: .poly1305-x86_64.ko.cmd Only in linux-success/arch/x86/crypto: poly1305-x86_64.mod.o Only in linux-success/arch/x86/crypto: .poly1305-x86_64.mod.o.cmd Only in linux-success/arch/x86/crypto: sha1-ssse3.ko Only in linux-success/arch/x86/crypto: .sha1-ssse3.ko.cmd Only in linux-success/arch/x86/crypto: sha1-ssse3.mod.o Only in linux-success/arch/x86/crypto: .sha1-ssse3.mod.o.cmd Only in linux-success/arch/x86/crypto: sha256-ssse3.ko Only in linux-success/arch/x86/crypto: .sha256-ssse3.ko.cmd Only in linux-success/arch/x86/crypto: sha256-ssse3.mod.o Only in linux-success/arch/x86/crypto: .sha256-ssse3.mod.o.cmd Only in linux-success/arch/x86/crypto: sha512-ssse3.ko Only in linux-success/arch/x86/crypto: .sha512-ssse3.ko.cmd Only in linux-success/arch/x86/crypto: sha512-ssse3.mod.o Only in linux-success/arch/x86/crypto: .sha512-ssse3.mod.o.cmd Only in linux-success/arch/x86/kvm: kvm-intel.ko Only in linux-success/arch/x86/kvm: .kvm-intel.ko.cmd Only in linux-success/arch/x86/kvm: kvm-intel.mod.o Only in linux-success/arch/x86/kvm: .kvm-intel.mod.o.cmd Only in linux-success/arch/x86/kvm: kvm.ko Only in linux-success/arch/x86/kvm: .kvm.ko.cmd Only in linux-success/arch/x86/kvm: kvm.mod.o Only in linux-success/arch/x86/kvm: .kvm.mod.o.cmd Only in linux-success/crypto: af_alg.ko Only in linux-success/crypto: .af_alg.ko.cmd Only in linux-success/crypto: af_alg.mod.o Only in linux-success/crypto: .af_alg.mod.o.cmd Only in linux-success/crypto: algif_aead.ko Only in linux-success/crypto: .algif_aead.ko.cmd Only in linux-success/crypto: algif_aead.mod.o Only in linux-success/crypto: .algif_aead.mod.o.cmd Only in linux-success/crypto: algif_hash.ko Only in linux-success/crypto: .algif_hash.ko.cmd Only in linux-success/crypto: algif_hash.mod.o Only in linux-success/crypto: .algif_hash.mod.o.cmd Only in linux-success/crypto: algif_rng.ko Only in linux-success/crypto: .algif_rng.ko.cmd Only in linux-success/crypto: algif_rng.mod.o Only in linux-success/crypto: .algif_rng.mod.o.cmd Only in linux-success/crypto: algif_skcipher.ko Only in linux-success/crypto: .algif_skcipher.ko.cmd Only in linux-success/crypto: algif_skcipher.mod.o Only in linux-success/crypto: .algif_skcipher.mod.o.cmd Only in linux-success/crypto: arc4.ko Only in linux-success/crypto: .arc4.ko.cmd Only in linux-success/crypto: arc4.mod.o Only in linux-success/crypto: .arc4.mod.o.cmd Only in linux-success/crypto: ccm.ko Only in linux-success/crypto: .ccm.ko.cmd Only in linux-success/crypto: ccm.mod.o Only in linux-success/crypto: .ccm.mod.o.cmd Only in linux-success/crypto: chacha20_generic.ko Only in linux-success/crypto: .chacha20_generic.ko.cmd Only in linux-success/crypto: chacha20_generic.mod.o Only in linux-success/crypto: .chacha20_generic.mod.o.cmd Only in linux-success/crypto: chacha20poly1305.ko Only in linux-success/crypto: .chacha20poly1305.ko.cmd Only in linux-success/crypto: chacha20poly1305.mod.o Only in linux-success/crypto: .chacha20poly1305.mod.o.cmd Only in linux-success/crypto: cmac.ko Only in linux-success/crypto: .cmac.ko.cmd Only in linux-success/crypto: cmac.mod.o Only in linux-success/crypto: .cmac.mod.o.cmd Only in linux-success/crypto: crc32_generic.ko Only in linux-success/crypto: .crc32_generic.ko.cmd Only in linux-success/crypto: crc32_generic.mod.o Only in linux-success/crypto: .crc32_generic.mod.o.cmd Only in linux-success/crypto: ctr.ko Only in linux-success/crypto: .ctr.ko.cmd Only in linux-success/crypto: ctr.mod.o Only in linux-success/crypto: .ctr.mod.o.cmd Only in linux-success/crypto: cts.ko Only in linux-success/crypto: .cts.ko.cmd Only in linux-success/crypto: cts.mod.o Only in linux-success/crypto: .cts.mod.o.cmd Only in linux-success/crypto: echainiv.ko Only in linux-success/crypto: .echainiv.ko.cmd Only in linux-success/crypto: echainiv.mod.o Only in linux-success/crypto: .echainiv.mod.o.cmd Only in linux-success/crypto: gcm.ko Only in linux-success/crypto: .gcm.ko.cmd Only in linux-success/crypto: gcm.mod.o Only in linux-success/crypto: .gcm.mod.o.cmd Only in linux-success/crypto: ghash-generic.ko Only in linux-success/crypto: .ghash-generic.ko.cmd Only in linux-success/crypto: ghash-generic.mod.o Only in linux-success/crypto: .ghash-generic.mod.o.cmd Only in linux-success/crypto: keywrap.ko Only in linux-success/crypto: .keywrap.ko.cmd Only in linux-success/crypto: keywrap.mod.o Only in linux-success/crypto: .keywrap.mod.o.cmd Only in linux-success/crypto: md4.ko Only in linux-success/crypto: .md4.ko.cmd Only in linux-success/crypto: md4.mod.o Only in linux-success/crypto: .md4.mod.o.cmd Only in linux-success/crypto: md5.ko Only in linux-success/crypto: .md5.ko.cmd Only in linux-success/crypto: md5.mod.o Only in linux-success/crypto: .md5.mod.o.cmd Only in linux-success/crypto: pcbc.ko Only in linux-success/crypto: .pcbc.ko.cmd Only in linux-success/crypto: pcbc.mod.o Only in linux-success/crypto: .pcbc.mod.o.cmd Only in linux-success/crypto: poly1305_generic.ko Only in linux-success/crypto: .poly1305_generic.ko.cmd Only in linux-success/crypto: poly1305_generic.mod.o Only in linux-success/crypto: .poly1305_generic.mod.o.cmd Only in linux-success/crypto: rmd128.ko Only in linux-success/crypto: .rmd128.ko.cmd Only in linux-success/crypto: rmd128.mod.o Only in linux-success/crypto: .rmd128.mod.o.cmd Only in linux-success/crypto: rmd160.ko Only in linux-success/crypto: .rmd160.ko.cmd Only in linux-success/crypto: rmd160.mod.o Only in linux-success/crypto: .rmd160.mod.o.cmd Only in linux-success/crypto: rmd256.ko Only in linux-success/crypto: .rmd256.ko.cmd Only in linux-success/crypto: rmd256.mod.o Only in linux-success/crypto: .rmd256.mod.o.cmd Only in linux-success/crypto: rmd320.ko Only in linux-success/crypto: .rmd320.ko.cmd Only in linux-success/crypto: rmd320.mod.o Only in linux-success/crypto: .rmd320.mod.o.cmd Only in linux-success/crypto: seqiv.ko Only in linux-success/crypto: .seqiv.ko.cmd Only in linux-success/crypto: seqiv.mod.o Only in linux-success/crypto: .seqiv.mod.o.cmd Only in linux-success/crypto: sha1_generic.ko Only in linux-success/crypto: .sha1_generic.ko.cmd Only in linux-success/crypto: sha1_generic.mod.o Only in linux-success/crypto: .sha1_generic.mod.o.cmd Only in linux-success/crypto: vmac.ko Only in linux-success/crypto: .vmac.ko.cmd Only in linux-success/crypto: vmac.mod.o Only in linux-success/crypto: .vmac.mod.o.cmd Only in linux-success/crypto: xcbc.ko Only in linux-success/crypto: .xcbc.ko.cmd Only in linux-success/crypto: xcbc.mod.o Only in linux-success/crypto: .xcbc.mod.o.cmd Only in linux-success/drivers/hid: hid-logitech.ko Only in linux-success/drivers/hid: .hid-logitech.ko.cmd Only in linux-success/drivers/hid: hid-logitech.mod.o Only in linux-success/drivers/hid: .hid-logitech.mod.o.cmd Only in linux-success/drivers/i2c: i2c-mux.ko Only in linux-success/drivers/i2c: .i2c-mux.ko.cmd Only in linux-success/drivers/i2c: i2c-mux.mod.o Only in linux-success/drivers/i2c: .i2c-mux.mod.o.cmd Only in linux-success/drivers/input: joydev.ko Only in linux-success/drivers/input: .joydev.ko.cmd Only in linux-success/drivers/input: joydev.mod.o Only in linux-success/drivers/input: .joydev.mod.o.cmd Only in linux-success/drivers/media/usb/gspca: gspca_main.ko Only in linux-success/drivers/media/usb/gspca: .gspca_main.ko.cmd Only in linux-success/drivers/media/usb/gspca: gspca_main.mod.o Only in linux-success/drivers/media/usb/gspca: .gspca_main.mod.o.cmd Only in linux-success/drivers/media/usb/gspca: gspca_pac7311.ko Only in linux-success/drivers/media/usb/gspca: .gspca_pac7311.ko.cmd Only in linux-success/drivers/media/usb/gspca: gspca_pac7311.mod.o Only in linux-success/drivers/media/usb/gspca: .gspca_pac7311.mod.o.cmd Only in linux-success/drivers/media/v4l2-core: v4l2-common.ko Only in linux-success/drivers/media/v4l2-core: .v4l2-common.ko.cmd Only in linux-success/drivers/media/v4l2-core: v4l2-common.mod.o Only in linux-success/drivers/media/v4l2-core: .v4l2-common.mod.o.cmd Only in linux-success/drivers/media/v4l2-core: v4l2-dv-timings.ko Only in linux-success/drivers/media/v4l2-core: .v4l2-dv-timings.ko.cmd Only in linux-success/drivers/media/v4l2-core: v4l2-dv-timings.mod.o Only in linux-success/drivers/media/v4l2-core: .v4l2-dv-timings.mod.o.cmd Only in linux-success/drivers/media/v4l2-core: videodev.ko Only in linux-success/drivers/media/v4l2-core: .videodev.ko.cmd Only in linux-success/drivers/media/v4l2-core: videodev.mod.o Only in linux-success/drivers/media/v4l2-core: .videodev.mod.o.cmd Only in linux-success/drivers/mfd: lpc_ich.ko Only in linux-success/drivers/mfd: .lpc_ich.ko.cmd Only in linux-success/drivers/mfd: lpc_ich.mod.o Only in linux-success/drivers/mfd: .lpc_ich.mod.o.cmd Only in linux-success/drivers/mfd: lpc_sch.ko Only in linux-success/drivers/mfd: .lpc_sch.ko.cmd Only in linux-success/drivers/mfd: lpc_sch.mod.o Only in linux-success/drivers/mfd: .lpc_sch.mod.o.cmd Only in linux-success/drivers/mfd: mfd-core.ko Only in linux-success/drivers/mfd: .mfd-core.ko.cmd Only in linux-success/drivers/mfd: mfd-core.mod.o Only in linux-success/drivers/mfd: .mfd-core.mod.o.cmd Only in linux-success/drivers/net: macvlan.ko Only in linux-success/drivers/net: .macvlan.ko.cmd Only in linux-success/drivers/net: macvlan.mod.o Only in linux-success/drivers/net: .macvlan.mod.o.cmd Only in linux-success/drivers/net: macvtap.ko Only in linux-success/drivers/net: .macvtap.ko.cmd Only in linux-success/drivers/net: macvtap.mod.o Only in linux-success/drivers/net: .macvtap.mod.o.cmd Only in linux-success/drivers/net: tap.ko Only in linux-success/drivers/net: .tap.ko.cmd Only in linux-success/drivers/net: tap.mod.o Only in linux-success/drivers/net: .tap.mod.o.cmd Only in linux-success/drivers/net: veth.ko Only in linux-success/drivers/net: .veth.ko.cmd Only in linux-success/drivers/net: veth.mod.o Only in linux-success/drivers/net: .veth.mod.o.cmd Only in linux-success/drivers/net/wireless/ath/ath9k: ath9k_common.ko Only in linux-success/drivers/net/wireless/ath/ath9k: .ath9k_common.ko.cmd Only in linux-success/drivers/net/wireless/ath/ath9k: ath9k_common.mod.o Only in linux-success/drivers/net/wireless/ath/ath9k: .ath9k_common.mod.o.cmd Only in linux-success/drivers/net/wireless/ath/ath9k: ath9k_htc.ko Only in linux-success/drivers/net/wireless/ath/ath9k: .ath9k_htc.ko.cmd Only in linux-success/drivers/net/wireless/ath/ath9k: ath9k_htc.mod.o Only in linux-success/drivers/net/wireless/ath/ath9k: .ath9k_htc.mod.o.cmd Only in linux-success/drivers/net/wireless/ath/ath9k: ath9k_hw.ko Only in linux-success/drivers/net/wireless/ath/ath9k: .ath9k_hw.ko.cmd Only in linux-success/drivers/net/wireless/ath/ath9k: ath9k_hw.mod.o Only in linux-success/drivers/net/wireless/ath/ath9k: .ath9k_hw.mod.o.cmd Only in linux-success/drivers/net/wireless/ath: ath.ko Only in linux-success/drivers/net/wireless/ath: .ath.ko.cmd Only in linux-success/drivers/net/wireless/ath: ath.mod.o Only in linux-success/drivers/net/wireless/ath: .ath.mod.o.cmd Only in linux-success/drivers/usb/class: cdc-acm.ko Only in linux-success/drivers/usb/class: .cdc-acm.ko.cmd Only in linux-success/drivers/usb/class: cdc-acm.mod.o Only in linux-success/drivers/usb/class: .cdc-acm.mod.o.cmd Only in linux-success/drivers/usb/storage: uas.ko Only in linux-success/drivers/usb/storage: .uas.ko.cmd Only in linux-success/drivers/usb/storage: uas.mod.o Only in linux-success/drivers/usb/storage: .uas.mod.o.cmd Only in linux-success/drivers/usb/storage: usb-storage.ko Only in linux-success/drivers/usb/storage: .usb-storage.ko.cmd Only in linux-success/drivers/usb/storage: usb-storage.mod.o Only in linux-success/drivers/usb/storage: .usb-storage.mod.o.cmd Only in linux-success/drivers/vhost: vhost.ko Only in linux-success/drivers/vhost: .vhost.ko.cmd Only in linux-success/drivers/vhost: vhost.mod.o Only in linux-success/drivers/vhost: .vhost.mod.o.cmd Only in linux-success/drivers/vhost: vhost_net.ko Only in linux-success/drivers/vhost: .vhost_net.ko.cmd Only in linux-success/drivers/vhost: vhost_net.mod.o Only in linux-success/drivers/vhost: .vhost_net.mod.o.cmd Only in linux-success/drivers/virtio: virtio_balloon.ko Only in linux-success/drivers/virtio: .virtio_balloon.ko.cmd Only in linux-success/drivers/virtio: virtio_balloon.mod.o Only in linux-success/drivers/virtio: .virtio_balloon.mod.o.cmd Only in linux-success/drivers/virtio: virtio.ko Only in linux-success/drivers/virtio: .virtio.ko.cmd Only in linux-success/drivers/virtio: virtio.mod.o Only in linux-success/drivers/virtio: .virtio.mod.o.cmd Only in linux-success/drivers/virtio: virtio_pci.ko Only in linux-success/drivers/virtio: .virtio_pci.ko.cmd Only in linux-success/drivers/virtio: virtio_pci.mod.o Only in linux-success/drivers/virtio: .virtio_pci.mod.o.cmd Only in linux-success/drivers/virtio: virtio_ring.ko Only in linux-success/drivers/virtio: .virtio_ring.ko.cmd Only in linux-success/drivers/virtio: virtio_ring.mod.o Only in linux-success/drivers/virtio: .virtio_ring.mod.o.cmd Only in linux-success/fs/fat: fat.ko Only in linux-success/fs/fat: .fat.ko.cmd Only in linux-success/fs/fat: fat.mod.o Only in linux-success/fs/fat: .fat.mod.o.cmd Only in linux-success/fs/fat: vfat.ko Only in linux-success/fs/fat: .vfat.ko.cmd Only in linux-success/fs/fat: vfat.mod.o Only in linux-success/fs/fat: .vfat.mod.o.cmd Only in linux-success/fs/isofs: isofs.ko Only in linux-success/fs/isofs: .isofs.ko.cmd Only in linux-success/fs/isofs: isofs.mod.o Only in linux-success/fs/isofs: .isofs.mod.o.cmd Only in linux-success/fs/nls: nls_cp437.ko Only in linux-success/fs/nls: .nls_cp437.ko.cmd Only in linux-success/fs/nls: nls_cp437.mod.o Only in linux-success/fs/nls: .nls_cp437.mod.o.cmd Only in linux-success/fs/nls: nls_iso8859-1.ko Only in linux-success/fs/nls: .nls_iso8859-1.ko.cmd Only in linux-success/fs/nls: nls_iso8859-1.mod.o Only in linux-success/fs/nls: .nls_iso8859-1.mod.o.cmd Only in linux-success/fs/ntfs: ntfs.ko Only in linux-success/fs/ntfs: .ntfs.ko.cmd Only in linux-success/fs/ntfs: ntfs.mod.o Only in linux-success/fs/ntfs: .ntfs.mod.o.cmd Only in linux-success/fs/udf: udf.ko Only in linux-success/fs/udf: .udf.ko.cmd Only in linux-success/fs/udf: udf.mod.o Only in linux-success/fs/udf: .udf.mod.o.cmd Only in linux-success/lib: crc-itu-t.ko Only in linux-success/lib: .crc-itu-t.ko.cmd Only in linux-success/lib: crc-itu-t.mod.o Only in linux-success/lib: .crc-itu-t.mod.o.cmd Only in linux-success/lib: ts_bm.ko Only in linux-success/lib: .ts_bm.ko.cmd Only in linux-success/lib: ts_bm.mod.o Only in linux-success/lib: .ts_bm.mod.o.cmd Only in linux-success/lib: ts_fsm.ko Only in linux-success/lib: .ts_fsm.ko.cmd Only in linux-success/lib: ts_fsm.mod.o Only in linux-success/lib: .ts_fsm.mod.o.cmd Only in linux-success/lib: ts_kmp.ko Only in linux-success/lib: .ts_kmp.ko.cmd Only in linux-success/lib: ts_kmp.mod.o Only in linux-success/lib: .ts_kmp.mod.o.cmd Only in linux-success/net/8021q: 8021q.ko Only in linux-success/net/8021q: .8021q.ko.cmd Only in linux-success/net/8021q: 8021q.mod.o Only in linux-success/net/8021q: .8021q.mod.o.cmd Only in linux-success/net/ipv4/netfilter: arptable_filter.ko Only in linux-success/net/ipv4/netfilter: .arptable_filter.ko.cmd Only in linux-success/net/ipv4/netfilter: arptable_filter.mod.o Only in linux-success/net/ipv4/netfilter: .arptable_filter.mod.o.cmd Only in linux-success/net/ipv4/netfilter: arp_tables.ko Only in linux-success/net/ipv4/netfilter: .arp_tables.ko.cmd Only in linux-success/net/ipv4/netfilter: arp_tables.mod.o Only in linux-success/net/ipv4/netfilter: .arp_tables.mod.o.cmd Only in linux-success/net/ipv4/netfilter: arpt_mangle.ko Only in linux-success/net/ipv4/netfilter: .arpt_mangle.ko.cmd Only in linux-success/net/ipv4/netfilter: arpt_mangle.mod.o Only in linux-success/net/ipv4/netfilter: .arpt_mangle.mod.o.cmd Only in linux-success/net/ipv4/netfilter: iptable_filter.ko Only in linux-success/net/ipv4/netfilter: .iptable_filter.ko.cmd Only in linux-success/net/ipv4/netfilter: iptable_filter.mod.o Only in linux-success/net/ipv4/netfilter: .iptable_filter.mod.o.cmd Only in linux-success/net/ipv4/netfilter: iptable_mangle.ko Only in linux-success/net/ipv4/netfilter: .iptable_mangle.ko.cmd Only in linux-success/net/ipv4/netfilter: iptable_mangle.mod.o Only in linux-success/net/ipv4/netfilter: .iptable_mangle.mod.o.cmd Only in linux-success/net/ipv4/netfilter: iptable_nat.ko Only in linux-success/net/ipv4/netfilter: .iptable_nat.ko.cmd Only in linux-success/net/ipv4/netfilter: iptable_nat.mod.o Only in linux-success/net/ipv4/netfilter: .iptable_nat.mod.o.cmd Only in linux-success/net/ipv4/netfilter: iptable_raw.ko Only in linux-success/net/ipv4/netfilter: .iptable_raw.ko.cmd Only in linux-success/net/ipv4/netfilter: iptable_raw.mod.o Only in linux-success/net/ipv4/netfilter: .iptable_raw.mod.o.cmd Only in linux-success/net/ipv4/netfilter: ip_tables.ko Only in linux-success/net/ipv4/netfilter: .ip_tables.ko.cmd Only in linux-success/net/ipv4/netfilter: ip_tables.mod.o Only in linux-success/net/ipv4/netfilter: .ip_tables.mod.o.cmd Only in linux-success/net/ipv4/netfilter: ipt_ah.ko Only in linux-success/net/ipv4/netfilter: .ipt_ah.ko.cmd Only in linux-success/net/ipv4/netfilter: ipt_ah.mod.o Only in linux-success/net/ipv4/netfilter: .ipt_ah.mod.o.cmd Only in linux-success/net/ipv4/netfilter: ipt_CLUSTERIP.ko Only in linux-success/net/ipv4/netfilter: .ipt_CLUSTERIP.ko.cmd Only in linux-success/net/ipv4/netfilter: ipt_CLUSTERIP.mod.o Only in linux-success/net/ipv4/netfilter: .ipt_CLUSTERIP.mod.o.cmd Only in linux-success/net/ipv4/netfilter: ipt_ECN.ko Only in linux-success/net/ipv4/netfilter: .ipt_ECN.ko.cmd Only in linux-success/net/ipv4/netfilter: ipt_ECN.mod.o Only in linux-success/net/ipv4/netfilter: .ipt_ECN.mod.o.cmd Only in linux-success/net/ipv4/netfilter: ipt_MASQUERADE.ko Only in linux-success/net/ipv4/netfilter: .ipt_MASQUERADE.ko.cmd Only in linux-success/net/ipv4/netfilter: ipt_MASQUERADE.mod.o Only in linux-success/net/ipv4/netfilter: .ipt_MASQUERADE.mod.o.cmd Only in linux-success/net/ipv4/netfilter: ipt_REJECT.ko Only in linux-success/net/ipv4/netfilter: .ipt_REJECT.ko.cmd Only in linux-success/net/ipv4/netfilter: ipt_REJECT.mod.o Only in linux-success/net/ipv4/netfilter: .ipt_REJECT.mod.o.cmd Only in linux-success/net/ipv4/netfilter: nf_dup_ipv4.ko Only in linux-success/net/ipv4/netfilter: .nf_dup_ipv4.ko.cmd Only in linux-success/net/ipv4/netfilter: nf_dup_ipv4.mod.o Only in linux-success/net/ipv4/netfilter: .nf_dup_ipv4.mod.o.cmd Only in linux-success/net/ipv4/netfilter: nf_nat_ipv4.ko Only in linux-success/net/ipv4/netfilter: .nf_nat_ipv4.ko.cmd Only in linux-success/net/ipv4/netfilter: nf_nat_ipv4.mod.o Only in linux-success/net/ipv4/netfilter: .nf_nat_ipv4.mod.o.cmd Only in linux-success/net/ipv4/netfilter: nf_nat_masquerade_ipv4.ko Only in linux-success/net/ipv4/netfilter: .nf_nat_masquerade_ipv4.ko.cmd Only in linux-success/net/ipv4/netfilter: nf_nat_masquerade_ipv4.mod.o Only in linux-success/net/ipv4/netfilter: .nf_nat_masquerade_ipv4.mod.o.cmd Only in linux-success/net/ipv4/netfilter: nf_reject_ipv4.ko Only in linux-success/net/ipv4/netfilter: .nf_reject_ipv4.ko.cmd Only in linux-success/net/ipv4/netfilter: nf_reject_ipv4.mod.o Only in linux-success/net/ipv4/netfilter: .nf_reject_ipv4.mod.o.cmd Only in linux-success/net/mac80211: mac80211.ko Only in linux-success/net/mac80211: .mac80211.ko.cmd Only in linux-success/net/mac80211: mac80211.mod.o Only in linux-success/net/mac80211: .mac80211.mod.o.cmd Only in linux-success/net/netfilter: nf_nat_ftp.ko Only in linux-success/net/netfilter: .nf_nat_ftp.ko.cmd Only in linux-success/net/netfilter: nf_nat_ftp.mod.o Only in linux-success/net/netfilter: .nf_nat_ftp.mod.o.cmd Only in linux-success/net/netfilter: nf_nat_irc.ko Only in linux-success/net/netfilter: .nf_nat_irc.ko.cmd Only in linux-success/net/netfilter: nf_nat_irc.mod.o Only in linux-success/net/netfilter: .nf_nat_irc.mod.o.cmd Only in linux-success/net/netfilter: nf_nat.ko Only in linux-success/net/netfilter: .nf_nat.ko.cmd Only in linux-success/net/netfilter: nf_nat.mod.o Only in linux-success/net/netfilter: .nf_nat.mod.o.cmd Only in linux-success/net/netfilter: nf_nat_redirect.ko Only in linux-success/net/netfilter: .nf_nat_redirect.ko.cmd Only in linux-success/net/netfilter: nf_nat_redirect.mod.o Only in linux-success/net/netfilter: .nf_nat_redirect.mod.o.cmd Only in linux-success/net/netfilter: nfnetlink_acct.ko Only in linux-success/net/netfilter: .nfnetlink_acct.ko.cmd Only in linux-success/net/netfilter: nfnetlink_acct.mod.o Only in linux-success/net/netfilter: .nfnetlink_acct.mod.o.cmd Only in linux-success/net/netfilter: nfnetlink_log.ko Only in linux-success/net/netfilter: .nfnetlink_log.ko.cmd Only in linux-success/net/netfilter: nfnetlink_log.mod.o Only in linux-success/net/netfilter: .nfnetlink_log.mod.o.cmd Only in linux-success/net/netfilter: nfnetlink_queue.ko Only in linux-success/net/netfilter: .nfnetlink_queue.ko.cmd Only in linux-success/net/netfilter: nfnetlink_queue.mod.o Only in linux-success/net/netfilter: .nfnetlink_queue.mod.o.cmd Only in linux-success/net/netfilter: xt_CLASSIFY.ko Only in linux-success/net/netfilter: .xt_CLASSIFY.ko.cmd Only in linux-success/net/netfilter: xt_CLASSIFY.mod.o Only in linux-success/net/netfilter: .xt_CLASSIFY.mod.o.cmd Only in linux-success/net/netfilter: xt_cluster.ko Only in linux-success/net/netfilter: .xt_cluster.ko.cmd Only in linux-success/net/netfilter: xt_cluster.mod.o Only in linux-success/net/netfilter: .xt_cluster.mod.o.cmd Only in linux-success/net/netfilter: xt_comment.ko Only in linux-success/net/netfilter: .xt_comment.ko.cmd Only in linux-success/net/netfilter: xt_comment.mod.o Only in linux-success/net/netfilter: .xt_comment.mod.o.cmd Only in linux-success/net/netfilter: xt_connbytes.ko Only in linux-success/net/netfilter: .xt_connbytes.ko.cmd Only in linux-success/net/netfilter: xt_connbytes.mod.o Only in linux-success/net/netfilter: .xt_connbytes.mod.o.cmd Only in linux-success/net/netfilter: xt_connlimit.ko Only in linux-success/net/netfilter: .xt_connlimit.ko.cmd Only in linux-success/net/netfilter: xt_connlimit.mod.o Only in linux-success/net/netfilter: .xt_connlimit.mod.o.cmd Only in linux-success/net/netfilter: xt_connmark.ko Only in linux-success/net/netfilter: .xt_connmark.ko.cmd Only in linux-success/net/netfilter: xt_connmark.mod.o Only in linux-success/net/netfilter: .xt_connmark.mod.o.cmd Only in linux-success/net/netfilter: xt_conntrack.ko Only in linux-success/net/netfilter: .xt_conntrack.ko.cmd Only in linux-success/net/netfilter: xt_conntrack.mod.o Only in linux-success/net/netfilter: .xt_conntrack.mod.o.cmd Only in linux-success/net/netfilter: xt_cpu.ko Only in linux-success/net/netfilter: .xt_cpu.ko.cmd Only in linux-success/net/netfilter: xt_cpu.mod.o Only in linux-success/net/netfilter: .xt_cpu.mod.o.cmd Only in linux-success/net/netfilter: xt_ecn.ko Only in linux-success/net/netfilter: .xt_ecn.ko.cmd Only in linux-success/net/netfilter: xt_ecn.mod.o Only in linux-success/net/netfilter: .xt_ecn.mod.o.cmd Only in linux-success/net/netfilter: xt_esp.ko Only in linux-success/net/netfilter: .xt_esp.ko.cmd Only in linux-success/net/netfilter: xt_esp.mod.o Only in linux-success/net/netfilter: .xt_esp.mod.o.cmd Only in linux-success/net/netfilter: xt_hashlimit.ko Only in linux-success/net/netfilter: .xt_hashlimit.ko.cmd Only in linux-success/net/netfilter: xt_hashlimit.mod.o Only in linux-success/net/netfilter: .xt_hashlimit.mod.o.cmd Only in linux-success/net/netfilter: xt_helper.ko Only in linux-success/net/netfilter: .xt_helper.ko.cmd Only in linux-success/net/netfilter: xt_helper.mod.o Only in linux-success/net/netfilter: .xt_helper.mod.o.cmd Only in linux-success/net/netfilter: xt_hl.ko Only in linux-success/net/netfilter: xt_HL.ko Only in linux-success/net/netfilter: .xt_hl.ko.cmd Only in linux-success/net/netfilter: .xt_HL.ko.cmd Only in linux-success/net/netfilter: xt_hl.mod.o Only in linux-success/net/netfilter: xt_HL.mod.o Only in linux-success/net/netfilter: .xt_hl.mod.o.cmd Only in linux-success/net/netfilter: .xt_HL.mod.o.cmd Only in linux-success/net/netfilter: xt_IDLETIMER.ko Only in linux-success/net/netfilter: .xt_IDLETIMER.ko.cmd Only in linux-success/net/netfilter: xt_IDLETIMER.mod.o Only in linux-success/net/netfilter: .xt_IDLETIMER.mod.o.cmd Only in linux-success/net/netfilter: xt_iprange.ko Only in linux-success/net/netfilter: .xt_iprange.ko.cmd Only in linux-success/net/netfilter: xt_iprange.mod.o Only in linux-success/net/netfilter: .xt_iprange.mod.o.cmd Only in linux-success/net/netfilter: xt_length.ko Only in linux-success/net/netfilter: .xt_length.ko.cmd Only in linux-success/net/netfilter: xt_length.mod.o Only in linux-success/net/netfilter: .xt_length.mod.o.cmd Only in linux-success/net/netfilter: xt_limit.ko Only in linux-success/net/netfilter: .xt_limit.ko.cmd Only in linux-success/net/netfilter: xt_limit.mod.o Only in linux-success/net/netfilter: .xt_limit.mod.o.cmd Only in linux-success/net/netfilter: xt_mac.ko Only in linux-success/net/netfilter: .xt_mac.ko.cmd Only in linux-success/net/netfilter: xt_mac.mod.o Only in linux-success/net/netfilter: .xt_mac.mod.o.cmd Only in linux-success/net/netfilter: xt_mark.ko Only in linux-success/net/netfilter: .xt_mark.ko.cmd Only in linux-success/net/netfilter: xt_mark.mod.o Only in linux-success/net/netfilter: .xt_mark.mod.o.cmd Only in linux-success/net/netfilter: xt_multiport.ko Only in linux-success/net/netfilter: .xt_multiport.ko.cmd Only in linux-success/net/netfilter: xt_multiport.mod.o Only in linux-success/net/netfilter: .xt_multiport.mod.o.cmd Only in linux-success/net/netfilter: xt_nat.ko Only in linux-success/net/netfilter: .xt_nat.ko.cmd Only in linux-success/net/netfilter: xt_nat.mod.o Only in linux-success/net/netfilter: .xt_nat.mod.o.cmd Only in linux-success/net/netfilter: xt_NETMAP.ko Only in linux-success/net/netfilter: .xt_NETMAP.ko.cmd Only in linux-success/net/netfilter: xt_NETMAP.mod.o Only in linux-success/net/netfilter: .xt_NETMAP.mod.o.cmd Only in linux-success/net/netfilter: xt_nfacct.ko Only in linux-success/net/netfilter: .xt_nfacct.ko.cmd Only in linux-success/net/netfilter: xt_nfacct.mod.o Only in linux-success/net/netfilter: .xt_nfacct.mod.o.cmd Only in linux-success/net/netfilter: xt_NFLOG.ko Only in linux-success/net/netfilter: .xt_NFLOG.ko.cmd Only in linux-success/net/netfilter: xt_NFLOG.mod.o Only in linux-success/net/netfilter: .xt_NFLOG.mod.o.cmd Only in linux-success/net/netfilter: xt_NFQUEUE.ko Only in linux-success/net/netfilter: .xt_NFQUEUE.ko.cmd Only in linux-success/net/netfilter: xt_NFQUEUE.mod.o Only in linux-success/net/netfilter: .xt_NFQUEUE.mod.o.cmd Only in linux-success/net/netfilter: xt_osf.ko Only in linux-success/net/netfilter: .xt_osf.ko.cmd Only in linux-success/net/netfilter: xt_osf.mod.o Only in linux-success/net/netfilter: .xt_osf.mod.o.cmd Only in linux-success/net/netfilter: xt_owner.ko Only in linux-success/net/netfilter: .xt_owner.ko.cmd Only in linux-success/net/netfilter: xt_owner.mod.o Only in linux-success/net/netfilter: .xt_owner.mod.o.cmd Only in linux-success/net/netfilter: xt_pkttype.ko Only in linux-success/net/netfilter: .xt_pkttype.ko.cmd Only in linux-success/net/netfilter: xt_pkttype.mod.o Only in linux-success/net/netfilter: .xt_pkttype.mod.o.cmd Only in linux-success/net/netfilter: xt_quota.ko Only in linux-success/net/netfilter: .xt_quota.ko.cmd Only in linux-success/net/netfilter: xt_quota.mod.o Only in linux-success/net/netfilter: .xt_quota.mod.o.cmd Only in linux-success/net/netfilter: xt_rateest.ko Only in linux-success/net/netfilter: xt_RATEEST.ko Only in linux-success/net/netfilter: .xt_rateest.ko.cmd Only in linux-success/net/netfilter: .xt_RATEEST.ko.cmd Only in linux-success/net/netfilter: xt_rateest.mod.o Only in linux-success/net/netfilter: xt_RATEEST.mod.o Only in linux-success/net/netfilter: .xt_rateest.mod.o.cmd Only in linux-success/net/netfilter: .xt_RATEEST.mod.o.cmd Only in linux-success/net/netfilter: xt_realm.ko Only in linux-success/net/netfilter: .xt_realm.ko.cmd Only in linux-success/net/netfilter: xt_realm.mod.o Only in linux-success/net/netfilter: .xt_realm.mod.o.cmd Only in linux-success/net/netfilter: xt_recent.ko Only in linux-success/net/netfilter: .xt_recent.ko.cmd Only in linux-success/net/netfilter: xt_recent.mod.o Only in linux-success/net/netfilter: .xt_recent.mod.o.cmd Only in linux-success/net/netfilter: xt_REDIRECT.ko Only in linux-success/net/netfilter: .xt_REDIRECT.ko.cmd Only in linux-success/net/netfilter: xt_REDIRECT.mod.o Only in linux-success/net/netfilter: .xt_REDIRECT.mod.o.cmd Only in linux-success/net/netfilter: xt_state.ko Only in linux-success/net/netfilter: .xt_state.ko.cmd Only in linux-success/net/netfilter: xt_state.mod.o Only in linux-success/net/netfilter: .xt_state.mod.o.cmd Only in linux-success/net/netfilter: xt_statistic.ko Only in linux-success/net/netfilter: .xt_statistic.ko.cmd Only in linux-success/net/netfilter: xt_statistic.mod.o Only in linux-success/net/netfilter: .xt_statistic.mod.o.cmd Only in linux-success/net/netfilter: xt_string.ko Only in linux-success/net/netfilter: .xt_string.ko.cmd Only in linux-success/net/netfilter: xt_string.mod.o Only in linux-success/net/netfilter: .xt_string.mod.o.cmd Only in linux-success/net/netfilter: xt_tcpmss.ko Only in linux-success/net/netfilter: xt_TCPMSS.ko Only in linux-success/net/netfilter: .xt_tcpmss.ko.cmd Only in linux-success/net/netfilter: .xt_TCPMSS.ko.cmd Only in linux-success/net/netfilter: xt_tcpmss.mod.o Only in linux-success/net/netfilter: xt_TCPMSS.mod.o Only in linux-success/net/netfilter: .xt_tcpmss.mod.o.cmd Only in linux-success/net/netfilter: .xt_TCPMSS.mod.o.cmd Only in linux-success/net/netfilter: xt_TEE.ko Only in linux-success/net/netfilter: .xt_TEE.ko.cmd Only in linux-success/net/netfilter: xt_TEE.mod.o Only in linux-success/net/netfilter: .xt_TEE.mod.o.cmd Only in linux-success/net/netfilter: xt_time.ko Only in linux-success/net/netfilter: .xt_time.ko.cmd Only in linux-success/net/netfilter: xt_time.mod.o Only in linux-success/net/netfilter: .xt_time.mod.o.cmd Only in linux-success/net/netfilter: xt_u32.ko Only in linux-success/net/netfilter: .xt_u32.ko.cmd Only in linux-success/net/netfilter: xt_u32.mod.o Only in linux-success/net/netfilter: .xt_u32.mod.o.cmd Only in linux-success/net/wireless: cfg80211.ko Only in linux-success/net/wireless: .cfg80211.ko.cmd Only in linux-success/net/wireless: cfg80211.mod.o Only in linux-success/net/wireless: .cfg80211.mod.o.cmd It looks like the only missing files in the build failure folder are modules that didn't build because of the error. Doing a full "diff -urp linux-success linux-fail" shows a lot of changed binary files as expected. There are some irrelevant changes to files like include/generated/compile.h, arch/x86/boot/zoffset.h arch/x86/boot/compressed/piggy.S, certs/signing_key.pem, etc. The only relevant change I can spot is: diff -u linux-success/Module.symvers linux-fail/Module.symvers -0x00000000 __clear_user vmlinux EXPORT_SYMBOL -0x00000000 clear_user vmlinux EXPORT_SYMBOL diff -u <(cut -d " " -f 2- ./linux-success/System.map) <(cut -d " " -f 2- ./linux-fail/System.map) -r __ksymtab___clear_user -r __ksymtab_clear_user -r __kstrtab_clear_user -r __kstrtab___clear_user diff -u <(cut -d " " -f 2- ./linux-success/.tmp_System.map) <(cut -d " " -f 2- ./linux-fail/.tmp_System.map) -r __ksymtab___clear_user -r __ksymtab_clear_user -r __kstrtab_clear_user -r __kstrtab___clear_user I had to cut away the first field from the system.map files because it always differ. .tmp_kallsyms[12].S also differ a lot but I don't know what to make of those files. There is no difference to any file in include/config/ksym or any *.cmd file except some *.cmd files related to modules only exist in the success folder. I patched the kernel with "kbuild: show the list of exported symbols with V=1 for TRIM_UNUSED_KSYMS" and ran the build with V=1 until I got a failure. Here is the full output: success: https://gist.githubusercontent.com/anonymous/86325ce634568f1e1d31c23b5b9df295/raw/a897c77f34499a990505057f0221b4a935db4a16/gistfile1.txt fail: https://gist.githubusercontent.com/anonymous/279a7925f1a8cd05dcad78dca0720688/raw/9e407b262fdac284b15ae07f2d7a7824051d56cc/gistfile1.txt The error was: ERROR: "clear_user" [drivers/media/v4l2-core/videodev.ko] undefined! ERROR: "__clear_user" [arch/x86/kvm/kvm.ko] undefined! and the relevant part of the diff of the build: --- kernel_build_debug_patch_success 2018-03-13 14:47:24.000000000 +0100 +++ kernel_build_debug_patch_fail 2018-03-13 15:12:33.000000000 +0100 @@ -45298,13 +45298,6 @@ KSYM___x86_indirect_thunk_r15 KSYM___fill_rsb KSYM___clear_rsb - gcc -Wp,-MD,arch/x86/lib/.usercopy_64.o.d -nostdinc -isystem /usr/lib/gcc/x86_64-pc-linux-gnu/6.4.0/include -I./arch/x86/include -I./arch/x86/include/generated -I./include -I./arch/x86/include/uapi -I./arch/x86/include/generated/uapi -I./include/uapi -I./include/generated/uapi -include ./include/linux/kconfig.h -D__KERNEL__ -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -fshort-wchar -Werror-implicit-function-declaration -Wno-format-security -std=gnu89 -fno-PIE -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -m64 -falign-jumps=1 -falign-loops=1 -mno-80387 -mno-fp-ret-in-387 -mpreferred-stack-boundary=3 -mskip-rax-setup -march=core2 -mno-red-zone -mcmodel=kernel -funit-at-a-time -DCONFIG_AS_CFI=1 -DCONFIG_AS_CFI_SIGNAL_FRAME=1 -DCONFIG_AS_CFI_SECTIONS=1 -DCONFIG_AS_FXSAVEQ=1 -DCONFIG_AS_SSSE3=1 -DCONFIG_AS_CRC32=1 -DCONFIG_AS_AVX=1 -DCONFIG_AS_AVX2=1 -DCONFIG_AS_AVX512=1 -DCONFIG_AS_SHA1_NI=1 -DCONFIG_AS_SHA256_NI=1 -pipe -Wno-sign-compare -fno-asynchronous-unwind-tables -fno-delete-null-pointer-checks -Wno-frame-address -O2 --param=allow-store-data-races=0 -DCC_HAVE_ASM_GOTO -fplugin=./scripts/gcc-plugins/latent_entropy_plugin.so -fplugin=./scripts/gcc-plugins/structleak_plugin.so -DLATENT_ENTROPY_PLUGIN -fplugin-arg-structleak_plugin-byref-all -DSTRUCTLEAK_PLUGIN -Wframe-larger-than=1024 -fstack-protector-strong -Wno-unused-but-set-variable -Wno-unused-const-variable -fno-var-tracking-assignments -g -pg -mfentry -DCC_USING_FENTRY -fno-inline-functions-called-once -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-overflow -fno-stack-check -fconserve-stack -Werror=implicit-int -Werror=strict-prototypes -Werror=date-time -Werror=incompatible-pointer-types -Werror=designated-init -DKBUILD_BASENAME='"usercopy_64"' -DKBUILD_MODNAME='"usercopy_64"' -c -o arch/x86/lib/usercopy_64.o arch/x86/lib/usercopy_64.c -KSYM___clear_user -KSYM_clear_user -KSYM_arch_wb_cache_pmem -KSYM_memcpy_flushcache - ./tools/objtool/objtool orc generate --no-fp "arch/x86/lib/usercopy_64.o"; - if [ "-pg" = "-pg" ]; then if [ arch/x86/lib/usercopy_64.o != "scripts/mod/empty.o" ]; then ./scripts/recordmcount "arch/x86/lib/usercopy_64.o"; fi; fi; rm -f arch/x86/lib/lib.a; ar rcsTPD arch/x86/lib/lib.a arch/x86/lib/clear_page_64.o arch/x86/lib/cmdline.o arch/x86/lib/cmpxchg16b_emu.o arch/x86/lib/copy_page_64.o arch/x86/lib/copy_user_64.o arch/x86/lib/cpu.o arch/x86/lib/csum-copy_64.o arch/x86/lib/csum-partial_64.o arch/x86/lib/csum-wrappers_64.o arch/x86/lib/delay.o arch/x86/lib/getuser.o arch/x86/lib/inat.o arch/x86/lib/insn.o arch/x86/lib/kaslr.o arch/x86/lib/memcpy_64.o arch/x86/lib/memmove_64.o arch/x86/lib/memset_64.o arch/x86/lib/misc.o arch/x86/lib/putuser.o arch/x86/lib/retpoline.o arch/x86/lib/rwsem.o arch/x86/lib/usercopy.o arch/x86/lib/usercopy_64.o objdump -h arch/x86/lib/lib.a | sed -ne '/___ksymtab/s/.*+\([^ ]*\).*/EXTERN(\1)/p' >arch/x86/lib/.lib-ksyms.o.lds; rm -f arch/x86/lib/.lib_exports.o; echo | gcc -Wp,-MD,arch/x86/lib/.lib-ksyms.o.d -nostdinc -isystem /usr/lib/gcc/x86_64-pc-linux-gnu/6.4.0/include -I./arch/x86/include -I./arch/x86/include/generated -I./include -I./arch/x86/include/uapi -I./arch/x86/include/generated/uapi -I./include/uapi -I./include/generated/uapi -include ./include/linux/kconfig.h -D__KERNEL__ -D__ASSEMBLY__ -fno-PIE -m64 -DCONFIG_AS_CFI=1 -DCONFIG_AS_CFI_SIGNAL_FRAME=1 -DCONFIG_AS_CFI_SECTIONS=1 -DCONFIG_AS_FXSAVEQ=1 -DCONFIG_AS_SSSE3=1 -DCONFIG_AS_CRC32=1 -DCONFIG_AS_AVX=1 -DCONFIG_AS_AVX2=1 -DCONFIG_AS_AVX512=1 -DCONFIG_AS_SHA1_NI=1 -DCONFIG_AS_SHA256_NI=1 -DCC_HAVE_ASM_GOTO -Wa,-gdwarf-2 -mfentry -DCC_USING_FENTRY -c -o arch/x86/lib/.lib_exports.o -x assembler -; ld -m elf_x86_64 -r -o arch/x86/lib/lib-ksyms.o -T arch/x86/lib/.lib-ksyms.o.lds arch/x86/lib/.lib_exports.o; rm arch/x86/lib/.lib_exports.o arch/x86/lib/.lib-ksyms.o.lds rm -f arch/x86/lib/built-in.o; ar rcSTPD arch/x86/lib/built-in.o arch/x86/lib/msr-smp.o arch/x86/lib/cache-smp.o arch/x86/lib/msr.o arch/x86/lib/msr-reg.o arch/x86/lib/msr-reg-export.o arch/x86/lib/hweight.o arch/x86/lib/iomap_copy_64.o arch/x86/lib/lib-ksyms.o ; scripts/mod/modpost arch/x86/lib/built-in.o