Pavel Begunkov af0a2ffef0 io_uring: avoid normal tw intermediate fallback ...

When a DEFER_TASKRUN io_uring is terminating it requeues deferred task
work items as normal tw, which can further fallback to kthread
execution. Avoid this extra step and always push them to the fallback
kthread.

Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Link: https://lore.kernel.org/r/d1cd472cec2230c66bd1c8d412a5833f0af75384.1730772720.git.asml.silence@gmail.com
Signed-off-by: Jens Axboe <axboe@kernel.dk>

2024-11-06 13:55:38 -07:00

..

advise.c

io_uring/advise: support 64-bit lengths

2024-06-16 14:54:55 -06:00

advise.h

…

alloc_cache.h

io_uring/alloc_cache: switch to array based caching

2024-04-15 08:10:25 -06:00

cancel.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

cancel.h

io_uring/cancel: get rid of init_hash_table() helper

2024-10-29 13:43:27 -06:00

epoll.c

…

epoll.h

…

eventfd.c

io_uring/eventfd: move ctx->evfd_last_cq_tail into io_ev_fd

2024-10-29 13:43:26 -06:00

eventfd.h

io_uring/eventfd: move eventfd handling to separate file

2024-06-16 14:54:55 -06:00

fdinfo.c

io_uring/napi: add static napi tracking strategy

2024-11-06 13:55:38 -07:00

fdinfo.h

…

filetable.c

io_uring/rsrc: add io_reset_rsrc_node() helper

2024-11-02 15:45:30 -06:00

filetable.h

io_uring/filetable: kill io_reset_alloc_hint() helper

2024-11-02 15:45:30 -06:00

fs.c

…

fs.h

…

futex.c

io_uring: move cancelations to be io_uring_task based

2024-11-06 13:55:38 -07:00

futex.h

io_uring: move cancelations to be io_uring_task based

2024-11-06 13:55:38 -07:00

io_uring.c

io_uring: avoid normal tw intermediate fallback

2024-11-06 13:55:38 -07:00

io_uring.h

io_uring: avoid normal tw intermediate fallback

2024-11-06 13:55:38 -07:00

io-wq.c

io_uring/io-wq: inherit cpuset of cgroup in io worker

2024-09-11 07:27:56 -06:00

io-wq.h

io_uring/io-wq: make io_wq_work flags atomic

2024-06-16 14:54:55 -06:00

kbuf.c

Merge tag 'for-6.12/io_uring-20240913' of git://git.kernel.dk/linux

2024-09-16 13:29:00 +02:00

kbuf.h

io_uring/kbuf: add support for incremental buffer consumption

2024-08-29 08:44:58 -06:00

Makefile

io_uring: add GCOV_PROFILE_URING Kconfig option

2024-08-30 10:52:02 -06:00

memmap.c

io_uring/register: add IORING_REGISTER_RESIZE_RINGS

2024-10-29 13:43:27 -06:00

memmap.h

io_uring: move mapping/allocation helpers to a separate file

2024-04-15 08:10:26 -06:00

msg_ring.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

msg_ring.h

io_uring/msg_ring: add support for sending a sync message

2024-10-29 13:43:26 -06:00

napi.c

io_uring/napi: add static napi tracking strategy

2024-11-06 13:55:38 -07:00

napi.h

io_uring/napi: add static napi tracking strategy

2024-11-06 13:55:38 -07:00

net.c

io_uring/rsrc: split io_kiocb node type assignments

2024-11-06 13:55:36 -07:00

net.h

io_uring: Introduce IORING_OP_LISTEN

2024-06-19 07:57:21 -06:00

nop.c

io_uring/rsrc: split io_kiocb node type assignments

2024-11-06 13:55:36 -07:00

nop.h

…

notif.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

notif.h

io_uring/notif: implement notification stacking

2024-04-22 19:31:18 -06:00

opdef.c

io_uring/splice: open code 2nd direct file assignment

2024-10-29 13:43:28 -06:00

opdef.h

io_uring: Fix probe of disabled operations

2024-06-19 08:58:00 -06:00

openclose.c

…

openclose.h

…

poll.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

poll.h

io_uring: move cancelations to be io_uring_task based

2024-11-06 13:55:38 -07:00

refs.h

io_uring: kill dead code in io_req_complete_post

2024-04-15 08:10:26 -06:00

register.c

io_uring/rsrc: unify file and buffer resource tables

2024-11-02 15:45:23 -06:00

register.h

io_uring: add support for fixed wait regions

2024-10-29 13:43:28 -06:00

rsrc.c

io_uring/rsrc: encode node type and ctx together

2024-11-06 13:54:15 -07:00

rsrc.h

io_uring/rsrc: split io_kiocb node type assignments

2024-11-06 13:55:36 -07:00

rw.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

rw.h

io_uring/alloc_cache: switch to array based caching

2024-04-15 08:10:25 -06:00

slist.h

…

splice.c

io_uring/rsrc: get rid of the empty node and dummy_ubuf

2024-11-02 15:45:30 -06:00

splice.h

io_uring/splice: open code 2nd direct file assignment

2024-10-29 13:43:28 -06:00

sqpoll.c

io_uring/sqpoll: wait on sqd->wait for thread parking

2024-10-29 13:43:27 -06:00

sqpoll.h

io_uring/sqpoll: statistics of the true utilization of sq threads

2024-03-01 06:28:19 -07:00

statx.c

vfs: retire user_path_at_empty and drop empty arg from getname_flags

2024-06-05 17:03:57 +02:00

statx.h

…

sync.c

…

sync.h

…

tctx.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

tctx.h

…

timeout.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

timeout.h

io_uring: move cancelations to be io_uring_task based

2024-11-06 13:55:38 -07:00

truncate.c

…

truncate.h

…

uring_cmd.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

uring_cmd.h

io_uring: move cancelations to be io_uring_task based

2024-11-06 13:55:38 -07:00

waitid.c

io_uring: move struct io_kiocb from task_struct to io_uring_task

2024-11-06 13:55:38 -07:00

waitid.h

io_uring: move cancelations to be io_uring_task based

2024-11-06 13:55:38 -07:00

xattr.c

vfs: retire user_path_at_empty and drop empty arg from getname_flags

2024-06-05 17:03:57 +02:00

xattr.h

…