openstlinux/linux-st
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
6972096a03ae40f1365d2829f92fd19202b2b326
linux-st/kernel
History
Joerg Roedel 763802b53a x86/mm: split vmalloc_sync_all() 
Commit 3f8fd02b1b ("mm/vmalloc: Sync unmappings in
__purge_vmap_area_lazy()") introduced a call to vmalloc_sync_all() in
the vunmap() code-path.  While this change was necessary to maintain
correctness on x86-32-pae kernels, it also adds additional cycles for
architectures that don't need it.

Specifically on x86-64 with CONFIG_VMAP_STACK=y some people reported
severe performance regressions in micro-benchmarks because it now also
calls the x86-64 implementation of vmalloc_sync_all() on vunmap().  But
the vmalloc_sync_all() implementation on x86-64 is only needed for newly
created mappings.

To avoid the unnecessary work on x86-64 and to gain the performance
back, split up vmalloc_sync_all() into two functions:

	* vmalloc_sync_mappings(), and
	* vmalloc_sync_unmappings()

Most call-sites to vmalloc_sync_all() only care about new mappings being
synchronized.  The only exception is the new call-site added in the
above mentioned commit.

Shile Zhang directed us to a report of an 80% regression in reaim
throughput.

Fixes: 3f8fd02b1b ("mm/vmalloc: Sync unmappings in __purge_vmap_area_lazy()")
Reported-by: kernel test robot <oliver.sang@intel.com>
Reported-by: Shile Zhang <shile.zhang@linux.alibaba.com>
Signed-off-by: Joerg Roedel <jroedel@suse.de>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Tested-by: Borislav Petkov <bp@suse.de>
Acked-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>	[GHES]
Cc: Dave Hansen <dave.hansen@linux.intel.com>
Cc: Andy Lutomirski <luto@kernel.org>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Thomas Gleixner <tglx@linutronix.de>
Cc: Ingo Molnar <mingo@redhat.com>
Cc: <stable@vger.kernel.org>
Link: http://lkml.kernel.org/r/20191009124418.8286-1-joro@8bytes.org
Link: https://lists.01.org/hyperkitty/list/lkp@lists.01.org/thread/4D3JPPHBNOSPFK2KEPC6KGKS6J25AIDB/
Link: http://lkml.kernel.org/r/20191113095530.228959-1-shile.zhang@linux.alibaba.com
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2020-03-21 18:56:06 -07:00
..
bpf
bpf: Fix a potential deadlock with bpf_map_do_batch
2020-02-19 16:01:25 -08:00
cgroup
Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
2020-03-12 16:19:19 -07:00
configs
…
debug
Revert "kdb: Get rid of confusing diag msg from "rd" if current task has no regs"
2020-02-06 11:40:09 +00:00
dma
dma-direct: improve DMA mask overflow reporting
2020-02-05 18:53:41 +01:00
events
Merge tag 'perf-urgent-2020-02-09' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2020-02-09 12:04:09 -08:00
gcov
Revert "um: Enable CONFIG_CONSTRUCTORS"
2020-01-19 22:42:06 +01:00
irq
genirq/proc: Reject invalid affinity masks (again)
2020-02-14 09:43:17 +01:00
livepatch
…
locking
proc: convert everything to "struct proc_ops"
2020-02-04 03:05:26 +00:00
power
PM / hibernate: fix typo "reserverd_size" -> "reserved_size"
2020-02-20 11:58:01 +01:00
printk
…
rcu
rcu: Forgive slow expedited grace periods at boot time
2020-01-25 12:00:40 -08:00
sched
sched/fair: Fix statistics for find_idlest_group()
2020-02-27 10:08:27 +01:00
time
y2038: remove unused time32 interfaces
2020-02-21 11:22:15 -08:00
trace
Merge tag 'trace-v5.6-rc4' of git://git.kernel.org/pub/scm/linux/kernel/git/rostedt/linux-trace
2020-03-11 09:54:59 -07:00
.gitignore
…
acct.c
…
async.c
…
audit_fsnotify.c
…
audit_tree.c
…
audit_watch.c
…
audit.c
audit: always check the netlink payload length in audit_receive_msg()
2020-02-24 16:38:57 -05:00
audit.h
…
auditfilter.c
audit: fix error handling in audit_data_to_entry()
2020-02-22 20:36:47 -05:00
auditsc.c
…
backtracetest.c
…
bounds.c
…
capability.c
…
compat.c
y2038: remove unused time32 interfaces
2020-02-21 11:22:15 -08:00
configs.c
proc: convert everything to "struct proc_ops"
2020-02-04 03:05:26 +00:00
context_tracking.c
…
cpu_pm.c
…
cpu.c
Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2020-01-28 10:07:09 -08:00
crash_core.c
…
crash_dump.c
…
cred.c
…
delayacct.c
…
dma.c
…
elfcore.c
…
exec_domain.c
…
exit.c
exit: Fix Sparse errors and warnings
2020-02-28 13:34:39 +01:00
extable.c
bpf: Allow to resolve bpf trampoline and dispatcher in unwind
2020-01-25 07:12:40 -08:00
fail_function.c
…
fork.c
fork: Use RCU_INIT_POINTER() instead of rcu_access_pointer()
2020-02-28 13:34:36 +01:00
freezer.c
…
futex.c
futex: Unbreak futex hashing
2020-03-09 22:33:09 +01:00
gen_kheaders.sh
…
groups.c
…
hung_task.c
…
iomem.c
…
irq_work.c
…
jump_label.c
…
kallsyms.c
Merge tag 'kbuild-v5.6-2' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-kbuild
2020-02-09 16:05:50 -08:00
kcmp.c
…
Kconfig.freezer
…
Kconfig.hz
…
Kconfig.locks
…
Kconfig.preempt
…
kcov.c
…
kexec_core.c
…
kexec_elf.c
…
kexec_file.c
…
kexec_internal.h
…
kexec.c
…
kheaders.c
…
kmod.c
…
kprobes.c
…
ksysfs.c
…
kthread.c
…
latencytop.c
proc: convert everything to "struct proc_ops"
2020-02-04 03:05:26 +00:00
Makefile
kcov: ignore fault-inject and stacktrace
2020-01-31 10:30:41 -08:00
module_signature.c
…
module_signing.c
…
module-internal.h
…
module.c
proc: convert everything to "struct proc_ops"
2020-02-04 03:05:26 +00:00
notifier.c
x86/mm: split vmalloc_sync_all()
2020-03-21 18:56:06 -07:00
nsproxy.c
…
padata.c
…
panic.c
…
params.c
…
pid_namespace.c
…
pid.c
pid: make ENOMEM return value more obvious
2020-03-09 23:40:05 +01:00
profile.c
proc: convert everything to "struct proc_ops"
2020-02-04 03:05:26 +00:00
ptrace.c
ptrace: reintroduce usage of subjective credentials in ptrace_has_cap()
2020-01-18 13:51:39 +01:00
range.c
…
reboot.c
…
relay.c
…
resource.c
…
rseq.c
…
seccomp.c
…
signal.c
signal: avoid double atomic counter increments for user accounting
2020-02-26 09:54:03 -08:00
smp.c
smp: Remove superfluous cond_func check in smp_call_function_many_cond()
2020-01-28 15:43:00 +01:00
smpboot.c
…
smpboot.h
…
softirq.c
…
stackleak.c
…
stacktrace.c
…
stop_machine.c
stop_machine: Make stop_cpus() static
2020-01-17 10:19:21 +01:00
sys_ni.c
…
sys.c
sys/sysinfo: Respect boottime inside time namespace
2020-03-03 19:34:32 +01:00
sysctl_binary.c
…
sysctl-test.c
…
sysctl.c
s390: remove obsolete ieee_emulation_warnings
2020-02-19 13:51:46 +01:00
task_work.c
…
taskstats.c
…
test_kprobes.c
…
torture.c
…
tracepoint.c
…
tsacct.c
…
ucount.c
…
uid16.c
…
uid16.h
…
umh.c
…
up.c
smp/up: Make smp_call_function_single() match SMP semantics
2020-02-07 15:34:12 +01:00
user_namespace.c
…
user-return-notifier.c
…
user.c
…
utsname_sysctl.c
…
utsname.c
…
watchdog_hld.c
…
watchdog.c
watchdog/softlockup: Enforce that timestamp is valid on boot
2020-01-17 11:19:22 +01:00
workqueue_internal.h
…
workqueue.c
workqueue: don't use wq_select_unbound_cpu() for bound works
2020-03-10 10:30:51 -04:00