Ming Lei 2a5a24aa83 scsi: blk-mq: Return budget token from .get_budget callback ...

SCSI uses a global atomic variable to track queue depth for each
LUN/request queue.

This doesn't scale well when there are lots of CPU cores and the disk is
very fast. It has been observed that IOPS is affected a lot by tracking
queue depth via sdev->device_busy in the I/O path.

Return budget token from .get_budget callback. The budget token can be
passed to driver so that we can replace the atomic variable with
sbitmap_queue and alleviate the scaling problems that way.

Link: https://lore.kernel.org/r/20210122023317.687987-9-ming.lei@redhat.com
Cc: Omar Sandoval <osandov@fb.com>
Cc: Kashyap Desai <kashyap.desai@broadcom.com>
Cc: Sumanesh Samanta <sumanesh.samanta@broadcom.com>
Cc: Ewan D. Milne <emilne@redhat.com>
Tested-by: Sumanesh Samanta <sumanesh.samanta@broadcom.com>
Reviewed-by: Hannes Reinecke <hare@suse.de>
Signed-off-by: Ming Lei <ming.lei@redhat.com>
Signed-off-by: Martin K. Petersen <martin.petersen@oracle.com>

2021-03-04 17:36:59 -05:00

..

partitions

Merge tag 'for-5.12/block-2021-02-17' of git://git.kernel.dk/linux-block

2021-02-21 11:02:48 -08:00

badblocks.c

…

bfq-cgroup.c

…

bfq-iosched.c

block: get rid of the trace rq insert wrapper

2021-02-22 06:37:41 -07:00

bfq-iosched.h

block, bfq: make waker-queue detection more robust

2021-01-25 14:18:37 -07:00

bfq-wf2q.c

bfq: don't duplicate code for different paths

2021-01-24 18:20:47 -07:00

bio-integrity.c

block: use bi_max_vecs to find the bvec pool

2021-02-08 08:33:16 -07:00

bio.c

Merge tag 'for-5.12/block-2021-02-17' of git://git.kernel.dk/linux-block

2021-02-21 11:02:48 -08:00

blk-cgroup-rwstat.c

…

blk-cgroup-rwstat.h

…

blk-cgroup.c

Merge tag 'for-5.12/block-2021-02-17' of git://git.kernel.dk/linux-block

2021-02-21 11:02:48 -08:00

blk-core.c

block: get rid of the trace rq insert wrapper

2021-02-22 06:37:41 -07:00

blk-crypto-fallback.c

block-crypto-fallback: use a bio_set for splitting bios

2021-02-24 08:55:00 -07:00

blk-crypto-internal.h

…

blk-crypto.c

dm: support key eviction from keyslot managers of underlying devices

2021-02-11 09:45:25 -05:00

blk-exec.c

block: drop removed argument from kernel-doc of blk_execute_rq()

2021-01-29 07:43:29 -07:00

blk-flush.c

block: use an on-stack bio in blkdev_issue_flush

2021-01-27 09:51:48 -07:00

blk-integrity.c

…

blk-ioc.c

…

blk-iocost.c

blk-iocost: fix NULL iocg deref from racing against initialization

2021-01-05 11:33:32 -07:00

blk-iolatency.c

…

blk-lib.c

block: move the start_sect field to struct block_device

2020-12-01 14:53:40 -07:00

blk-map.c

block: Add bio_max_segs

2021-02-26 15:49:51 -07:00

blk-merge.c

block: store a block_device pointer in struct bio

2021-01-24 18:17:20 -07:00

blk-mq-cpumap.c

blk-mq: remove the calling of local_memory_node()

2020-10-20 07:08:17 -06:00

blk-mq-debugfs-zoned.c

…

blk-mq-debugfs.c

Merge tag 'block-5.11-2021-01-10' of git://git.kernel.dk/linux-block

2021-01-10 12:53:08 -08:00

blk-mq-debugfs.h

…

blk-mq-pci.c

…

blk-mq-rdma.c

…

blk-mq-sched.c

scsi: blk-mq: Return budget token from .get_budget callback

2021-03-04 17:36:59 -05:00

blk-mq-sched.h

block: get rid of the trace rq insert wrapper

2021-02-22 06:37:41 -07:00

blk-mq-sysfs.c

blk-mq: move cancel of hctx->run_work to the front of blk_exit_queue

2020-10-09 12:46:28 -06:00

blk-mq-tag.c

…

blk-mq-tag.h

…

blk-mq-virtio.c

…

blk-mq.c

scsi: blk-mq: Return budget token from .get_budget callback

2021-03-04 17:36:59 -05:00

blk-mq.h

scsi: blk-mq: Return budget token from .get_budget callback

2021-03-04 17:36:59 -05:00

blk-pm.c

scsi: block: Fix a race in the runtime power management code

2020-12-09 11:41:41 -05:00

blk-pm.h

block: Remove unused blk_pm_*() function definitions

2021-02-22 06:33:48 -07:00

blk-rq-qos.c

…

blk-rq-qos.h

…

blk-settings.c

blk-settings: align max_sectors on "logical_block_size" boundary

2021-02-23 19:25:36 -07:00

blk-stat.c

…

blk-stat.h

…

blk-sysfs.c

block: fix potential IO hang when turning off io_poll

2021-02-22 06:40:02 -07:00

blk-throttle.c

block: store a block_device pointer in struct bio

2021-01-24 18:17:20 -07:00

blk-timeout.c

…

blk-wbt.c

blk: wbt: remove unused parameter from wbt_should_throttle

2021-01-26 13:13:00 -07:00

blk-wbt.h

…

blk-zoned.c

block: introduce blk_queue_clear_zone_settings()

2021-02-10 07:44:41 -07:00

blk.h

block: introduce blk_queue_clear_zone_settings()

2021-02-10 07:44:41 -07:00

bounce.c

block: memory allocations in bounce_clone_bio must not fail

2021-02-24 08:55:00 -07:00

bsg-lib.c

…

bsg.c

block: remove unnecessary argument from blk_execute_rq

2021-01-24 21:52:39 -07:00

cmdline-parser.c

…

elevator.c

…

genhd.c

block: fix logging on capacity change

2021-02-23 19:28:51 -07:00

ioctl.c

block: reopen the device in blkdev_reread_part

2021-02-23 19:23:22 -07:00

ioprio.c

…

Kconfig

…

Kconfig.iosched

…

keyslot-manager.c

Merge tag 'for-5.12/dm-changes' of git://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm

2021-02-22 10:22:54 -08:00

kyber-iosched.c

scsi: sbitmap: Move allocation hint into sbitmap

2021-03-04 17:36:59 -05:00

Makefile

…

mq-deadline.c

block: get rid of the trace rq insert wrapper

2021-02-22 06:37:41 -07:00

opal_proto.h

…

scsi_ioctl.c

block: remove unnecessary argument from blk_execute_rq

2021-01-24 21:52:39 -07:00

sed-opal.c

…

t10-pi.c

…