Commit 72a920ea authored by Rik van Riel's avatar Rik van Riel Committed by Ingo Molnar
Browse files

x86/mm: Use broadcast TLB flushing in page reclaim 



Page reclaim tracks only the CPU(s) where the TLB needs to be flushed, rather
than all the individual mappings that may be getting invalidated.

Use broadcast TLB flushing when that is available.

  [ bp: Massage commit message. ]

Signed-off-by: default avatarRik van Riel <riel@surriel.com>
Signed-off-by: default avatarBorislav Petkov (AMD) <bp@alien8.de>
Signed-off-by: default avatarIngo Molnar <mingo@kernel.org>
Link: https://lore.kernel.org/r/20250226030129.530345-7-riel@surriel.com
parent 82378c6c

arch/x86/mm/tlb.c

+3 −1
Original line number Diff line number Diff line
@@ -1320,7 +1320,9 @@ void arch_tlbbatch_flush(struct arch_tlbflush_unmap_batch *batch) 
	 * a local TLB flush is needed. Optimize this use-case by calling

	 * flush_tlb_func_local() directly in this case.

	 */

	if (cpumask_any_but(&batch->cpumask, cpu) < nr_cpu_ids) {

	if (cpu_feature_enabled(X86_FEATURE_INVLPGB)) {

		invlpgb_flush_all_nonglobals();

	} else if (cpumask_any_but(&batch->cpumask, cpu) < nr_cpu_ids) {

		flush_tlb_multi(&batch->cpumask, info);

	} else if (cpumask_test_cpu(cpu, &batch->cpumask)) {

		lockdep_assert_irqs_enabled();