Jack Steiner db1b1fefc2
[PATCH] sched: reduce overhead of calc_load ...
Currently, count_active_tasks() calls both nr_running() &
nr_interruptible(). Each of these functions does a "for_each_cpu" & reads
values from the runqueue of each cpu. Although this is not a lot of
instructions, each runqueue may be located on different node. Depending on
the architecture, a unique TLB entry may be required to access each
runqueue.
Since there may be more runqueues than cpu TLB entries, a scan of all
runqueues can trash the TLB. Each memory reference incurs a TLB miss &
refill.
In addition, the runqueue cacheline that contains nr_running &
nr_uninterruptible may be evicted from the cache between the two passes.
This causes unnecessary cache misses.
Combining nr_running() & nr_interruptible() into a single function
substantially reduces the TLB & cache misses on large systems. This should
have no measureable effect on smaller systems.
On a 128p IA64 system running a memory stress workload, the new function
reduced the overhead of calc_load() from 605 usec/call to 324 usec/call.
Signed-off-by: Jack Steiner <steiner@sgi.com >
Acked-by: Ingo Molnar <mingo@elte.hu >
Signed-off-by: Andrew Morton <akpm@osdl.org >
Signed-off-by: Linus Torvalds <torvalds@osdl.org >
2006-03-31 12:18:58 -08:00
2006-03-26 23:13:39 +01:00
2006-03-31 12:18:48 -08:00
2006-03-22 13:56:56 -08:00
2006-03-22 13:56:56 -08:00
2006-03-27 08:44:50 -08:00
2006-03-22 13:56:56 -08:00
2006-03-27 08:44:43 -08:00
2006-03-27 08:45:03 -08:00
2006-03-28 09:16:05 -08:00
2006-03-27 08:44:50 -08:00
2006-03-27 08:44:40 -08:00
2006-03-24 07:33:20 -08:00
2006-03-26 08:57:15 -08:00
2006-03-28 13:03:44 +02:00
2006-03-23 20:00:26 +01:00
2006-03-27 08:44:47 -08:00
2006-03-26 08:57:01 -08:00
2006-03-23 07:38:10 -08:00
2006-03-25 08:22:56 -08:00
2006-03-28 09:16:05 -08:00
2006-03-23 07:38:09 -08:00
2006-03-25 18:15:24 +00:00
2006-03-28 09:16:06 -08:00
2006-03-27 08:44:59 -08:00
2006-03-27 08:44:49 -08:00
2006-03-25 08:23:01 -08:00
2006-03-28 09:16:04 -08:00
2006-03-24 07:33:22 -08:00
2006-03-28 09:16:06 -08:00
2006-03-25 08:22:53 -08:00
2006-03-28 09:16:05 -08:00
2006-03-27 08:44:59 -08:00
2006-03-22 10:58:05 -08:00
2006-03-25 08:22:53 -08:00
2006-03-27 08:44:59 -08:00
2006-03-28 09:16:07 -08:00
2006-03-25 09:10:54 -08:00
2006-03-26 08:56:54 -08:00
2006-03-28 09:16:06 -08:00
2006-03-23 07:38:17 -08:00
2006-03-23 07:38:14 -08:00
2006-03-28 09:16:06 -08:00
2006-03-31 12:18:54 -08:00
2006-03-28 09:16:08 -08:00
2006-03-23 07:38:09 -08:00
2006-03-31 12:18:54 -08:00
2006-03-25 09:24:53 -08:00
2006-03-27 08:44:50 -08:00
2006-03-26 08:57:09 -08:00
2006-03-23 07:38:14 -08:00
2006-03-28 09:16:05 -08:00
2006-03-26 08:57:05 -08:00
2006-03-26 08:56:53 -08:00
2006-03-26 08:56:56 -08:00
2006-03-31 12:18:58 -08:00
2006-03-28 09:16:06 -08:00
2006-03-23 14:21:50 -08:00
2006-03-27 08:44:51 -08:00
2006-03-23 14:21:51 -08:00
2006-03-26 08:57:00 -08:00
2006-03-24 07:33:28 -08:00
2006-03-28 18:36:41 -08:00
2006-03-25 08:22:56 -08:00
2006-03-25 08:22:53 -08:00
2006-03-28 09:16:05 -08:00
2006-03-26 08:56:56 -08:00
2006-03-31 12:18:54 -08:00
2006-03-26 08:56:56 -08:00
2006-03-25 08:22:55 -08:00
2006-03-26 08:56:55 -08:00
2006-03-28 09:16:05 -08:00
2006-03-27 08:44:50 -08:00
2006-03-23 07:38:12 -08:00
2006-03-26 08:57:03 -08:00
2006-03-31 12:18:57 -08:00
2006-03-29 19:30:28 -05:00
2006-03-24 07:33:25 -08:00
2006-03-23 07:38:12 -08:00
2006-03-27 08:44:52 -08:00
2006-03-25 08:22:53 -08:00
2006-03-27 08:44:50 -08:00
2006-03-24 07:33:23 -08:00
2006-03-26 08:57:00 -08:00
2006-03-31 12:18:49 -08:00
2006-03-28 09:16:05 -08:00
2006-03-27 08:44:48 -08:00
2006-03-25 08:39:20 -08:00
2006-03-25 08:22:52 -08:00
2006-03-28 09:16:06 -08:00
2006-03-23 07:38:13 -08:00
2006-03-23 07:38:14 -08:00
2006-03-23 07:38:14 -08:00
2006-03-28 09:16:06 -08:00
2006-03-28 09:16:06 -08:00
2006-03-27 08:44:47 -08:00
2006-03-27 08:44:50 -08:00
2006-03-28 09:16:05 -08:00
2006-03-31 12:18:49 -08:00
2006-03-29 13:24:50 +11:00
2006-03-23 14:35:16 -08:00
2006-03-27 08:44:48 -08:00
2006-03-28 18:36:44 -08:00
2006-03-30 12:28:18 -08:00
2006-03-23 07:38:07 -08:00
2006-03-28 09:16:04 -08:00
2006-03-25 08:22:53 -08:00
2006-03-28 09:16:06 -08:00
2006-03-23 07:38:16 -08:00
2006-03-28 09:16:06 -08:00
2006-03-25 08:22:51 -08:00
2006-03-25 08:22:59 -08:00
2006-03-28 09:16:06 -08:00
2006-03-23 07:38:17 -08:00
2006-03-28 09:16:06 -08:00
2006-03-25 08:22:53 -08:00
2006-03-23 19:56:55 +01:00
2006-03-27 08:44:51 -08:00
2006-03-23 01:16:06 -08:00
2006-03-31 12:18:58 -08:00
2006-03-25 09:24:53 -08:00
2006-03-23 07:38:12 -08:00
2006-03-25 23:03:13 +00:00
2006-03-22 17:33:12 -08:00
2006-03-26 08:57:09 -08:00
2006-03-28 18:36:43 -08:00
2006-03-28 18:36:42 -08:00
2006-03-26 08:56:55 -08:00
2006-03-28 09:16:05 -08:00
2006-03-26 08:57:00 -08:00
2006-03-26 08:57:00 -08:00
2006-03-24 07:33:31 -08:00
2006-03-23 07:38:07 -08:00
2006-03-28 09:16:02 -08:00
2006-03-31 12:18:54 -08:00
2006-03-27 08:44:49 -08:00
2006-03-26 08:57:03 -08:00
2006-03-31 12:18:52 -08:00
2006-03-26 08:56:57 -08:00
2006-03-31 12:18:56 -08:00
2006-03-27 08:44:43 -08:00
2006-03-25 08:22:52 -08:00
2006-03-23 07:38:11 -08:00
2006-03-26 08:57:00 -08:00
2006-03-25 08:23:01 -08:00
2006-03-23 07:38:14 -08:00
2006-03-28 09:16:06 -08:00
2006-03-28 09:16:05 -08:00
2006-03-28 09:16:05 -08:00
2006-03-23 07:38:08 -08:00
2006-03-23 07:12:57 -05:00
2006-03-24 07:33:26 -08:00
2006-03-25 08:22:53 -08:00
db1b1fefc2