Commit 6471658d authored by Eric Dumazet's avatar Eric Dumazet Committed by Paolo Abeni
Browse files

udp: use skb_attempt_defer_free()



Move skb freeing from udp recvmsg() path to the cpu
which allocated/received it, as TCP did in linux-5.17.

This increases max thoughput by 20% to 30%, depending
on number of BH producers.

Signed-off-by: default avatarEric Dumazet <edumazet@google.com>
Acked-by: default avatarWillem de Bruijn <willemb@google.com>
Reviewed-by: default avatarDavid Ahern <dsahern@kernel.org>
Reviewed-by: default avatarKuniyuki Iwashima <kuniyu@google.com>
Link: https://patch.msgid.link/20250916160951.541279-11-edumazet@google.com


Reviewed-by: default avatarJakub Kicinski <kuba@kernel.org>
Signed-off-by: default avatarPaolo Abeni <pabeni@redhat.com>
parent 3cd04c8f
Loading
Loading
Loading
Loading
+7 −0
Original line number Diff line number Diff line
@@ -1825,6 +1825,13 @@ void skb_consume_udp(struct sock *sk, struct sk_buff *skb, int len)
	if (unlikely(READ_ONCE(udp_sk(sk)->peeking_with_offset)))
		sk_peek_offset_bwd(sk, len);

	if (!skb_shared(skb)) {
		if (unlikely(udp_skb_has_head_state(skb)))
			skb_release_head_state(skb);
		skb_attempt_defer_free(skb);
		return;
	}

	if (!skb_unref(skb))
		return;