Commit 7f9bb84f authored by Hao Li's avatar Hao Li Committed by Vlastimil Babka (SUSE)
Browse files

slub: use N_NORMAL_MEMORY in can_free_to_pcs to handle remote frees 



Memory hotplug now keeps N_NORMAL_MEMORY up to date correctly, so make
can_free_to_pcs() use it.

As a result, when freeing objects on memoryless nodes, or on nodes that
have memory but only in ZONE_MOVABLE, the objects can be freed to the
sheaf instead of going through the slow path.

Signed-off-by: default avatarHao Li <hao.li@linux.dev>
Acked-by: default avatarHarry Yoo (Oracle) <harry@kernel.org>
Acked-by: default avatarDavid Rientjes <rientjes@google.com>
Link: https://patch.msgid.link/20260403073958.8722-1-hao.li@linux.dev


Signed-off-by: default avatarVlastimil Babka (SUSE) <vbabka@kernel.org>
parent e65d4301

mm/slub.c

+3 −2
Original line number Diff line number Diff line
@@ -6022,14 +6022,15 @@ static __always_inline bool can_free_to_pcs(struct slab *slab) 
		goto check_pfmemalloc;



	/*

	 * Freed object isn't from this cpu's node, but that node is memoryless.

	 * Freed object isn't from this cpu's node, but that node is memoryless

	 * or only has ZONE_MOVABLE memory, which slab cannot allocate from.

	 * Proceed as it's better to cache remote objects than falling back to

	 * the slowpath for everything. The allocation side can never obtain

	 * a local object anyway, if none exist. We don't have numa_mem_id() to

	 * point to the closest node as we would on a proper memoryless node

	 * setup.

	 */

	if (unlikely(!node_state(numa_node, N_MEMORY)))

	if (unlikely(!node_state(numa_node, N_NORMAL_MEMORY)))

		goto check_pfmemalloc;

#endif