SCIENTIFIC-LINUX-USERS Archives

May 2018

SCIENTIFIC-LINUX-USERS@LISTSERV.FNAL.GOV

Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Reply To:
Date:
Tue, 15 May 2018 21:07:39 +0800
Content-Type:
text/plain
Parts/Attachments:
text/plain (470 lines)
Hi:
   I tried to upgrade our servers to SL 7.5. but one vpn box (intel
j1900 cpu with 4 e1000 port) failed to boot. downgrade to 7.4 kernel
3.10.0-693.21.1 works fine. but with SL 7.5 kernel 3.10.0-862.2.3 or
3.10.0-862 the system will hang randomly during boot process. I have
tried boot parameter "acpi_rev_override=1" and "maxcpus=1" but
useless.  are there other boot parameter worth to try?

   one of the boot messages like below. sometimes I can see " NMI
watchdog: BUG: soft lockup - CPU#0 stuck", sometimes there are no
messages at all, just hang somewhere.

[    0.000000] Linux version 3.10.0-862.el7.x86_64
([log in to unmask]) (gcc version 4.8.5 20150623 (Red Hat
4.8.5-28) (GCC) ) #1 SMP Thu Apr 12 09:09:37 CDT 2018
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.10.0-862.el7.x86_64
root=/dev/mapper/rootvg-root ro rd.lvm.lv=rootvg/swap
video=1024x768@60 rd.lvm.lv=rootvg/root selinux=0 nodmraid c8
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x0000000000089bff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000089c00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001effffff] usable
[    0.000000] BIOS-e820: [mem 0x000000001f000000-0x000000001f0fffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000001f100000-0x000000001fffffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000020000000-0x00000000200fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000020100000-0x0000000079874fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000079875000-0x00000000798a4fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000798a5000-0x00000000798b4fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000798b5000-0x0000000079a29fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000079a2a000-0x0000000079b88fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000079b89000-0x0000000079b89fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000079b8a000-0x0000000079bcbfff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000079bcc000-0x0000000079d3afff] usable
[    0.000000] BIOS-e820: [mem 0x0000000079d3b000-0x0000000079ff9fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000079ffa000-0x0000000079ffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed01000-0x00000000fed01fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed03000-0x00000000fed03fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed08000-0x00000000fed08fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed0c000-0x00000000fed0ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1cfff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fef00000-0x00000000feffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffb00000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.8 present.
[    0.000000] e820: last_pfn = 0x180000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC
[    0.000000] total RAM covered: 4008M
[    0.000000] Found optimal setting for mtrr clean up
[    0.000000]  gran_size: 64K  chunk_size: 128M        num_reg: 5
 lose cover RAM: 0G
[    0.000000] e820: last_pfn = 0x7a000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fd700-0x000fd70f]
mapped at [ffffffffff200700]
[    0.000000] RAMDISK: [mem 0x361bd000-0x370d6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f04a0 00024 (v02 ALASKA)
[    0.000000] ACPI: XSDT 00000000798a8078 00074 (v01 ALASKA   A M I
01072009 AMI  00010013)
[    0.000000] ACPI: FACP 00000000798b3708 0010C (v05 ALASKA   A M I
01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 00000000798a8180 0B586 (v02 ALASKA   A M I
01072009 INTL 20120913)
[    0.000000] ACPI: FACS 0000000079a29f80 00040
[    0.000000] ACPI: APIC 00000000798b3818 00084 (v03 ALASKA   A M I
01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 00000000798b38a0 00044 (v01 ALASKA   A M I
01072009 AMI  00010013)
[    0.000000] ACPI: LPIT 00000000798b38e8 00104 (v01 ALASKA   A M I
00000003 VLV2 0100000D)
[    0.000000] ACPI: MCFG 00000000798b39f0 0003C (v01 ALASKA   A M I
01072009 MSFT 00000097)
[    0.000000] ACPI: HPET 00000000798b3a30 00038 (v01 ALASKA   A M I
01072009 AMI. 00000005)
[    0.000000] ACPI: SSDT 00000000798b3a68 00763 (v01  PmRef    CpuPm
00003000 INTL 20061109)
[    0.000000] ACPI: SSDT 00000000798b41d0 00290 (v01  PmRef  Cpu0Tst
00003000 INTL 20061109)
[    0.000000] ACPI: SSDT 00000000798b4460 0017A (v01  PmRef    ApTst
00003000 INTL 20061109)
[    0.000000] ACPI: UEFI 00000000798b45e0 00042 (v01 ALASKA   A M I
00000000      00000000)
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000017fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x17ffd8000-0x17fffefff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x17fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x00088fff]
[    0.000000]   node   0: [mem 0x00100000-0x1effffff]
[    0.000000]   node   0: [mem 0x1f100000-0x1fffffff]
[    0.000000]   node   0: [mem 0x20100000-0x79874fff]
[    0.000000]   node   0: [mem 0x79b89000-0x79b89fff]
[    0.000000]   node   0: [mem 0x79bcc000-0x79d3afff]
[    0.000000]   node   0: [mem 0x79ffa000-0x79ffffff]
[    0.000000]   node   0: [mem 0x100000000-0x17fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x17fffffff]
[    0.000000] x86/hpet: Will disable the HPET for this platform
because it's not reliable
[    0.000000] Reserving Intel graphics memory at
0x000000007b000000-0x000000007effffff
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-86
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00089000-0x00089fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0008a000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x1f000000-0x1f0fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x20000000-0x200fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x79875000-0x798a4fff]
[    0.000000] PM: Registered nosave memory: [mem 0x798a5000-0x798b4fff]
[    0.000000] PM: Registered nosave memory: [mem 0x798b5000-0x79a29fff]
[    0.000000] PM: Registered nosave memory: [mem 0x79a2a000-0x79b88fff]
[    0.000000] PM: Registered nosave memory: [mem 0x79b8a000-0x79bcbfff]
[    0.000000] PM: Registered nosave memory: [mem 0x79d3b000-0x79ff9fff]
[    0.000000] PM: Registered nosave memory: [mem 0x7a000000-0x7affffff]
[    0.000000] PM: Registered nosave memory: [mem 0x7b000000-0x7effffff]
[    0.000000] PM: Registered nosave memory: [mem 0x7f000000-0xdfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed01000-0xfed01fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed02000-0xfed02fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed03000-0xfed03fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed04000-0xfed07fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed08000-0xfed08fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed09000-0xfed0bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed0c000-0xfed0ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed10000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1cfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1d000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xfeefffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfef00000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffafffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffb00000-0xffffffff]
[    0.000000] e820: [mem 0x7f000000-0xdfffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4
nr_cpu_ids:4 nr_node_ids:1
[    0.000000] PERCPU: Embedded 35 pages/cpu @ffff8912ffc00000 s104856
r8192 d30312 u524288
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
Total pages: 1005822
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line:
BOOT_IMAGE=/vmlinuz-3.10.0-862.el7.x86_64 root=/dev/mapper/rootvg-root
ro rd.lvm.lv=rootvg/swap video=1024x768@60 rd.lvm.lv=rootvg/root
selinux=0 nod8
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Memory: 3920468k/6291456k available (7324k kernel code,
2204212k absent, 166776k reserved, 6305k data, 1832k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4.
[    0.000000] NR_IRQS:327936 nr_irqs:1024 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 16777216 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't
want memory cgroups
[    0.000000] Maximum core-clock to bus-clock ratio: 0x18
[    0.000000] Resolved frequency ID: 0, frequency: 83200 KHz
[    0.000000] TSC runs at 1996800 KHz
[    0.000000] lapic_timer_frequency = 83200
[    0.000000] tsc: Detected 1996.800 MHz processor
[    0.000046] Calibrating delay loop (skipped), value calculated
using timer frequency.. 3993.60 BogoMIPS (lpj=1996800)
[    0.010710] pid_max: default: 32768 minimum: 301
[    0.015388] Security Framework initialized
[    0.019514] SELinux:  Disabled at boot.
[    0.023376] Yama: becoming mindful.
[    0.027586] Dentry cache hash table entries: 524288 (order: 10,
4194304 bytes)
[    0.036820] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.044787] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes)
[    0.051538] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes)
[    0.059040] Initializing cgroup subsys memory
[    0.063441] Initializing cgroup subsys devices
[    0.067909] Initializing cgroup subsys freezer
[    0.072378] Initializing cgroup subsys net_cls
[    0.076841] Initializing cgroup subsys blkio
[    0.081128] Initializing cgroup subsys perf_event
[    0.085852] Initializing cgroup subsys hugetlb
[    0.090322] Initializing cgroup subsys pids
[    0.094531] Initializing cgroup subsys net_prio
[    0.099130] CPU: Physical Processor ID: 0
[    0.103161] CPU: Processor Core ID: 0
[    0.106854] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.112882] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.124746] mce: CPU supports 6 MCE banks
[    0.128782] CPU0: Thermal monitoring enabled (TM1)
[    0.133601] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.138933] Last level dTLB entries: 4KB 128, 2MB 0, 4MB 0
[    0.144435] tlb_flushall_shift: 6
[    0.147768] FEATURE SPEC_CTRL Not Present
[    0.151796] FEATURE IBPB_SUPPORT Not Present
[    0.156238] Spectre V2 : Vulnerable: Retpoline without IBPB
[    0.161964] Freeing SMP alternatives: 24k freed
[    0.169014] ACPI: Core revision 20130517
[    0.187686] ACPI: All ACPI Tables successfully acquired
[    0.193508] ftrace: allocating 28047 entries in 110 pages
[    0.227017] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.242875] smpboot: CPU0: Intel(R) Celeron(R) CPU  J1900  @
1.99GHz (fam: 06, model: 37, stepping: 08)
[    0.252406] Performance Events: PEBS fmt2+, 8-deep LBR, Silvermont
events, full-width counters, Intel PMU driver.
[    0.262828] ... version:                3
[    0.266853] ... bit width:              40
[    0.270966] ... generic registers:      2
[    0.274987] ... value mask:             000000ffffffffff
[    0.280315] ... max period:             0000007fffffffff
[    0.285646] ... fixed-purpose events:   3
[    0.289673] ... event mask:             0000000700000003
[    0.297833] smpboot: Booting Node   0, Processors  #1[    0.307896]
NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU
counter.
 #2 #3 OK
[    0.327115] Brought up 4 CPUs
[    0.330102] smpboot: Max logical packages: 1
[    0.334391] smpboot: Total of 4 processors activated (15974.40 BogoMIPS)
[    0.342216] devtmpfs: initialized
[    0.353215] EVM: security.selinux
[    0.356553] EVM: security.ima
[    0.359536] EVM: security.capability
[    0.363296] PM: Registering ACPI NVS region [mem
0x798b5000-0x79a29fff] (1527808 bytes)
[    0.373612] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    0.380513] pinctrl core: initialized pinctrl subsystem
[    0.385811] RTC time:  1:02:03, date: 05/14/18
[    0.390450] NET: Registered protocol family 16
[    0.395365] ACPI FADT declares the system doesn't support PCIe
ASPM, so disable it
[    0.402949] ACPI: bus type PCI registered
[    0.406976] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.413560] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
0xe0000000-0xefffffff] (base 0xe0000000)
[    0.422884] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[    0.429713] PCI: Using configuration type 1 for base access
[    0.442950] ACPI: Added _OSI(Module Device)
[    0.447154] ACPI: Added _OSI(Processor Device)
[    0.451613] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.456335] ACPI: Added _OSI(Processor Aggregator Device)
[   28.455616] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s!
[swapper/0:1]
[   28.462935] Modules linked in:
[   28.466026] CPU: 0 PID: 1 Comm: swapper/0 Not tainted
3.10.0-862.el7.x86_64 #1
[   28.473254] Hardware name: To be filled by O.E.M. To be filled by
O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015
[   28.482832] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti:
ffff8912f946c000
[   28.490323] RIP: 0010:[<ffffffff86d0779a>]  [<ffffffff86d0779a>]
generic_exec_single+0xfa/0x1b0
[   28.499063] RSP: 0000:ffff8912f946fc00  EFLAGS: 00000202
[   28.504386] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000
[   28.511528] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286
[   28.518674] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00
[   28.525816] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067
[   28.532962] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14
[   28.540108] FS:  0000000000000000(0000) GS:ffff8912ffc00000(0000)
knlGS:0000000000000000
[   28.548203] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   28.553959] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0
[   28.561105] Call Trace:
[   28.563567]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   28.570020]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   28.576471]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   28.582919]  [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0
[   28.589286]  [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50
[   28.595132]  [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270
[   28.601498]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   28.607945]  [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70
[   28.613615]  [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20
[   28.619718]  [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190
[   28.625472]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   28.631924]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   28.638121]  [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250
[   28.643961]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   28.650154]  [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12
[   28.656004]  [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d
[   28.662461]  [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a
[   28.668738]  [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd
[   28.673885]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   28.680074]  [<ffffffff86c0210a>] do_one_initcall+0xba/0x240
[   28.685744]  [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f
[   28.691940]  [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0
[   28.697956]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[   28.703190]  [<ffffffff872fc6be>] kernel_init+0xe/0xf0
[   28.708338]  [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21
[   28.714874]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[   28.720108] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48
89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f
1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c
[   56.782218] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s!
[swapper/0:1]
[   56.789540] Modules linked in:
[   56.792635] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G             L
------------   3.10.0-862.el7.x86_64 #1
[   56.802301] Hardware name: To be filled by O.E.M. To be filled by
O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015
[   56.811878] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti:
ffff8912f946c000
[   56.819368] RIP: 0010:[<ffffffff86d0779a>]  [<ffffffff86d0779a>]
generic_exec_single+0xfa/0x1b0
[   56.828100] RSP: 0000:ffff8912f946fc00  EFLAGS: 00000202
[   56.833422] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000
[   56.840567] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286
[   56.847709] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00
[   56.854855] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067
[   56.862000] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14
[   56.869144] FS:  0000000000000000(0000) GS:ffff8912ffc00000(0000)
knlGS:0000000000000000
[   56.877242] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   56.882998] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0
[   56.890140] Call Trace:
[   56.892601]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   56.899058]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   56.905508]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   56.911959]  [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0
[   56.918322]  [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50
[   56.924162]  [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270
[   56.930524]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   56.936975]  [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70
[   56.942644]  [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20
[   56.948746]  [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190
[   56.954501]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   56.960952]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   56.967140]  [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250
[   56.972983]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   56.979172]  [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12
[   56.985015]  [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d
[   56.991472]  [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a
[   56.997749]  [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd
[   57.002896]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   57.009084]  [<ffffffff86c0210a>] do_one_initcall+0xba/0x240
[   57.014753]  [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f
[   57.020944]  [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0
[   57.026958]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[   57.032192]  [<ffffffff872fc6be>] kernel_init+0xe/0xf0
[   57.037342]  [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21
[   57.043884]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[   57.049117] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48
89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f
1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c
[   85.111036] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s!
[swapper/0:1]
[   85.118352] Modules linked in:
[   85.121444] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G             L
------------   3.10.0-862.el7.x86_64 #1
[   85.131106] Hardware name: To be filled by O.E.M. To be filled by
O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015
[   85.140680] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti:
ffff8912f946c000
[   85.148171] RIP: 0010:[<ffffffff86d0779a>]  [<ffffffff86d0779a>]
generic_exec_single+0xfa/0x1b0
[   85.156905] RSP: 0000:ffff8912f946fc00  EFLAGS: 00000202
[   85.162224] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000
[   85.169369] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286
[   85.176515] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00
[   85.183657] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067
[   85.190803] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14
[   85.197946] FS:  0000000000000000(0000) GS:ffff8912ffc00000(0000)
knlGS:0000000000000000
[   85.206045] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   85.211800] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0
[   85.218945] Call Trace:
[   85.221404]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   85.227860]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   85.234311]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   85.240761]  [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0
[   85.247124]  [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50
[   85.252964]  [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270
[   85.259329]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   85.265777]  [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70
[   85.271446]  [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20
[   85.277549]  [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190
[   85.283303]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[   85.289754]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   85.295942]  [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250
[   85.301786]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   85.307974]  [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12
[   85.313818]  [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d
[   85.320266]  [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a
[   85.326543]  [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd
[   85.331690]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[   85.337881]  [<ffffffff86c0210a>] do_one_initcall+0xba/0x240
[   85.343547]  [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f
[   85.349737]  [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0
[   85.355751]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[   85.360986]  [<ffffffff872fc6be>] kernel_init+0xe/0xf0
[   85.366136]  [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21
[   85.372681]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[   85.377920] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48
89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f
1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c
[  113.440071] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s!
[swapper/0:1]
[  113.447391] Modules linked in:
[  113.450482] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G             L
------------   3.10.0-862.el7.x86_64 #1
[  113.460141] Hardware name: To be filled by O.E.M. To be filled by
O.E.M./Aptio CRB, BIOS 5.6.5 10/07/2015
[  113.469716] task: ffff8912f9470000 ti: ffff8912f946c000 task.ti:
ffff8912f946c000
[  113.477209] RIP: 0010:[<ffffffff86d0779a>]  [<ffffffff86d0779a>]
generic_exec_single+0xfa/0x1b0
[  113.485941] RSP: 0000:ffff8912f946fc00  EFLAGS: 00000202
[  113.491262] RAX: 00000000000400f6 RBX: 0000000000000000 RCX: 0000000000000000
[  113.498407] RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286
[  113.505550] RBP: ffff8912f946fc48 R08: 0000000000000001 R09: ffff8912f979cc00
[  113.512695] R10: ffff8912fb001500 R11: ffffffff86f4a32f R12: ffffffff86ffb067
[  113.519838] R13: ffff8912f946fb90 R14: ffff8912f97a1438 R15: ffffffff86ffca14
[  113.526983] FS:  0000000000000000(0000) GS:ffff8912ffc00000(0000)
knlGS:0000000000000000
[  113.535082] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[  113.540838] CR2: ffff8912fffff000 CR3: 000000010ae0e000 CR4: 00000000001007f0
[  113.547980] Call Trace:
[  113.550441]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[  113.556898]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[  113.563348]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[  113.569798]  [<ffffffff86d078af>] smp_call_function_single+0x5f/0xa0
[  113.576161]  [<ffffffff86f4a275>] ? cpumask_next_and+0x35/0x50
[  113.582001]  [<ffffffff86d07e5b>] smp_call_function_many+0x22b/0x270
[  113.588364]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[  113.594814]  [<ffffffff86d07f89>] on_each_cpu_mask+0x29/0x70
[  113.600484]  [<ffffffff86df2240>] ? arch_local_irq_save+0x20/0x20
[  113.606586]  [<ffffffff86d08094>] on_each_cpu_cond+0xc4/0x190
[  113.612340]  [<ffffffff86df56c0>] ? kmem_cache_alloc_bulk+0x140/0x140
[  113.618792]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[  113.624979]  [<ffffffff86df8bd2>] kmem_cache_shrink+0x62/0x250
[  113.630823]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[  113.637011]  [<ffffffff86fcf8a8>] acpi_os_purge_cache+0xe/0x12
[  113.642855]  [<ffffffff86ffdad3>] acpi_purge_cached_objects+0x2d/0x3d
[  113.649311]  [<ffffffff879b8991>] acpi_initialize_objects+0x40/0x4a
[  113.655588]  [<ffffffff879b72d1>] acpi_init+0x9d/0x2bd
[  113.660735]  [<ffffffff879b7234>] ? acpi_sleep_proc_init+0x2a/0x2a
[  113.666924]  [<ffffffff86c0210a>] do_one_initcall+0xba/0x240
[  113.672592]  [<ffffffff8796c362>] kernel_init_freeable+0x180/0x21f
[  113.678783]  [<ffffffff8796bb1f>] ? initcall_blacklist+0xb0/0xb0
[  113.684797]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[  113.690032]  [<ffffffff872fc6be>] kernel_init+0xe/0xf0
[  113.695181]  [<ffffffff8731f637>] ret_from_fork_nospec_begin+0x21/0x21
[  113.701717]  [<ffffffff872fc6b0>] ? rest_init+0x80/0x80
[  113.706950] Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 93 87 48
89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f
1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c

ATOM RSS1 RSS2