diff options
author | Jens Axboe <axboe@kernel.dk> | 2022-06-16 03:51:11 +0200 |
---|---|---|
committer | Jens Axboe <axboe@kernel.dk> | 2022-06-16 15:14:44 +0200 |
commit | a76c0b31eef50fdb8b21d53a6d050f59241fb88e (patch) | |
tree | dfa5c6e86f7a6054822d6ffb84c118d8211a5ef6 /fs/io_uring.c | |
parent | io_uring: make io_fill_cqe_aux honour CQE32 (diff) | |
download | linux-a76c0b31eef50fdb8b21d53a6d050f59241fb88e.tar.xz linux-a76c0b31eef50fdb8b21d53a6d050f59241fb88e.zip |
io_uring: commit non-pollable provided mapped buffers upfront
For recv/recvmsg, IO either completes immediately or gets queued for a
retry. This isn't the case for read/readv, if eg a normal file or a block
device is used. Here, an operation can get queued with the block layer.
If this happens, ring mapped buffers must get committed immediately to
avoid that the next read can consume the same buffer.
Check if we're dealing with pollable file, when getting a new ring mapped
provided buffer. If it's not, commit it immediately rather than wait post
issue. If we don't wait, we can race with completions coming in, or just
plain buffer reuse by committing after a retry where others could have
grabbed the same buffer.
Fixes: c7fb19428d67 ("io_uring: add support for ring mapped supplied buffers")
Reviewed-by: Hao Xu <howeyxu@tencent.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Diffstat (limited to 'fs/io_uring.c')
-rw-r--r-- | fs/io_uring.c | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/fs/io_uring.c b/fs/io_uring.c index 5d479428d8e5..b6e75f69c6b1 100644 --- a/fs/io_uring.c +++ b/fs/io_uring.c @@ -3836,7 +3836,7 @@ static void __user *io_ring_buffer_select(struct io_kiocb *req, size_t *len, req->buf_list = bl; req->buf_index = buf->bid; - if (issue_flags & IO_URING_F_UNLOCKED) { + if (issue_flags & IO_URING_F_UNLOCKED || !file_can_poll(req->file)) { /* * If we came in unlocked, we have no choice but to consume the * buffer here. This does mean it'll be pinned until the IO |