breeze/linux
1
0
Fork 0
mirror of https://github.com/torvalds/linux.git synced 2026-01-25 15:03:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
58efe9f696cf908f40d6672aeca81cb2ad2bc762
linux/lib
History
Christophe Leroy 58efe9f696 lib/vdso: Mark do_hres_timens() and do_coarse_timens() __always_inline() 
In the same spirit as commit c966533f8c ("lib/vdso: Mark do_hres()
and do_coarse() as __always_inline"), mark do_hres_timens() and
do_coarse_timens() __always_inline.

The measurement below in on a non timens process, ie on the fastest path.

On powerpc32, without the patch:

clock-gettime-monotonic-raw:    vdso: 1155 nsec/call
clock-gettime-monotonic-coarse:    vdso: 813 nsec/call
clock-gettime-monotonic:    vdso: 1076 nsec/call

With the patch:

clock-gettime-monotonic-raw:    vdso: 1100 nsec/call
clock-gettime-monotonic-coarse:    vdso: 667 nsec/call
clock-gettime-monotonic:    vdso: 1025 nsec/call

Signed-off-by: Christophe Leroy <christophe.leroy@csgroup.eu>
Reviewed-by: Thomas Gleixner <tglx@linutronix.de>
Reviewed-by: Vincenzo Frascino <vincenzo.frascino@arm.com>
Signed-off-by: Michael Ellerman <mpe@ellerman.id.au>
Link: https://lore.kernel.org/r/90dcf45ebadfd5a07f24241551c62f619d1cb930.1617209142.git.christophe.leroy@csgroup.eu
2021-04-14 23:04:44 +10:00
..
842
kbuild: trace functions in subdirectories of lib/
2020-08-10 01:32:59 +09:00
crypto
crypto: lib/chacha20poly1305 - define empty module exit function
2021-01-22 14:58:03 +11:00
dim
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
fonts
Fonts: font_ter16x32: Update font with new upstream Terminus release
2021-01-07 21:06:25 +01:00
kunit
kunit: add kunit.filter_glob cmdline option to filter suites
2021-02-08 16:09:27 -07:00
livepatch
Merge tag 'kbuild-v5.9' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-kbuild
2020-08-09 14:10:26 -07:00
lz4
lib/lz4: explicitly support in-place decompression
2020-12-15 22:46:16 -08:00
lzo
lib/lzo/lzo1x_compress.c: make lzogeneric1x_1_compress() static
2020-12-15 22:46:19 -08:00
math
kernel.h: split out mathematical helpers
2020-12-15 22:46:15 -08:00
mpi
lib/mpi: Remove unused scalar_copied
2020-10-30 17:34:45 +11:00
pldmfw
Add pldmfw library for PLDM firmware update
2020-07-28 17:07:06 -07:00
raid6
lib/raid6: Let $(UNROLL) rules work with macOS userland
2021-01-04 10:38:11 +09:00
reed_solomon
kbuild: trace functions in subdirectories of lib/
2020-08-10 01:32:59 +09:00
vdso
lib/vdso: Mark do_hres_timens() and do_coarse_timens() __always_inline()
2021-04-14 23:04:44 +10:00
xz
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
zlib_deflate
kbuild: trace functions in subdirectories of lib/
2020-08-10 01:32:59 +09:00
zlib_dfltcc
zlib: move EXPORT_SYMBOL() and MODULE_LICENSE() out of dfltcc_syms.c
2020-12-29 15:36:49 -08:00
zlib_inflate
lib: Fix fall-through warnings for Clang
2020-11-19 07:23:47 -06:00
zstd
lib: Fix fall-through warnings for Clang
2020-11-19 07:23:47 -06:00
.gitignore
.gitignore: add SPDX License Identifier
2020-03-25 11:50:48 +01:00
argv_split.c
…
ashldi3.c
…
ashrdi3.c
…
asn1_decoder.c
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
assoc_array.c
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
atomic64_test.c
…
atomic64.c
…
audit.c
…
bcd.c
…
bch.c
lib/bch: Allow easy bit swapping
2020-05-24 20:48:11 +02:00
bitfield_kunit.c
lib: kunit: Fix compilation test when using TEST_BIT_FIELD_COMPILE
2020-10-16 13:25:14 -06:00
bitmap.c
lib: bitmap: delete duplicated words
2020-10-16 11:11:19 -07:00
bitrev.c
…
bootconfig.c
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
bsearch.c
lib/bsearch: Provide __always_inline variant
2020-06-11 15:14:53 +02:00
btree.c
…
bucket_locks.c
…
bug.c
module: mark module_mutex static
2021-02-08 12:24:26 +01:00
build_OID_registry
…
buildid.c
bpf: Add size arg to build_id_parse function
2021-01-14 19:29:58 -08:00
bust_spinlocks.c
…
check_signature.c
…
checksum.c
unify generic instances of csum_partial_copy_nocheck()
2020-08-20 15:45:14 -04:00
clz_ctz.c
…
clz_tab.c
…
cmdline_kunit.c
lib/cmdline: Allow get_options() to take 0 to validate the input
2021-02-15 11:43:31 +01:00
cmdline.c
lib/cmdline: remove an unneeded local variable in next_arg()
2021-02-26 09:41:04 -08:00
cmpdi2.c
…
compat_audit.c
…
cpu_rmap.c
lib: cpu_rmap: Use pr_warn instead of pr_warning
2019-10-18 15:01:57 +02:00
cpumask.c
Revert "lib: Restrict cpumask_local_spread to houskeeping CPUs"
2021-02-05 23:28:29 +01:00
crc4.c
…
crc7.c
lib/crc7: fix a kernel-doc markup
2021-01-21 14:06:00 -07:00
crc8.c
…
crc16.c
…
crc32.c
lib/crc32.c: fix trivial typo in preprocessor condition
2020-10-16 11:11:20 -07:00
crc32defs.h
…
crc32test.c
lib/crc32test: remove extra local_irq_disable/enable
2020-11-02 12:14:19 -08:00
crc64.c
lib/: replace HTTP links with HTTPS ones
2020-08-12 10:58:00 -07:00
crc-ccitt.c
…
crc-itu-t.c
…
crc-t10dif.c
crc-t10dif: clean up some more things
2020-06-18 17:26:43 +10:00
ctype.c
…
debug_info.c
…
debug_locks.c
lockdep: Prepare for noinstr sections
2020-05-19 15:47:21 +02:00
debugobjects.c
debugobjects: Free per CPU pool after CPU unplug
2020-10-01 16:13:54 +02:00
dec_and_lock.c
…
decompress_bunzip2.c
lib: decompress_bunzip2: delete duplicated words
2020-10-16 11:11:19 -07:00
decompress_inflate.c
lib/zlib: add s390 hardware support for kernel zlib_inflate
2020-01-31 10:30:40 -08:00
decompress_unlz4.c
…
decompress_unlzma.c
lib/: replace HTTP links with HTTPS ones
2020-08-12 10:58:00 -07:00
decompress_unlzo.c
…
decompress_unxz.c
…
decompress_unzstd.c
lib: decompress_unzstd: Limit output size
2020-09-03 10:13:09 +02:00
decompress.c
lib: Add zstd support to decompress
2020-07-31 11:49:08 +02:00
devmem_is_allowed.c
lib: Add a generic version of devmem_is_allowed()
2020-12-11 12:28:08 -08:00
devres.c
driver core: platform: Document return type of more functions
2020-09-10 18:30:01 +02:00
digsig.c
crypto: sha - split sha.h into sha1.h and sha2.h
2020-11-20 14:45:33 +11:00
dump_stack.c
stop_machine: Add function and caller debug info
2020-11-10 18:38:57 +01:00
dynamic_debug.c
dyndbg: fix use before null check
2020-12-09 20:10:12 +01:00
dynamic_queue_limits.c
lib: dynamic_queue_limits: delete duplicated words + fix typo
2020-10-16 11:11:20 -07:00
earlycpio.c
lib: earlycpio: delete duplicated words
2020-10-16 11:11:20 -07:00
errname.c
kernel.h: split out mathematical helpers
2020-12-15 22:46:15 -08:00
error-inject.c
fault-injection: handle EI_ETYPE_TRUE
2020-12-15 22:46:19 -08:00
errseq.c
kernel.h: split out mathematical helpers
2020-12-15 22:46:15 -08:00
extable.c
sparc32: switch to generic extables
2021-01-03 20:05:18 -05:00
fault-inject-usercopy.c
lib, include/linux: add usercopy failure capability
2020-10-16 11:11:22 -07:00
fault-inject.c
fault_inject: Don't rely on "return value" from WRITE_ONCE()
2020-04-15 21:36:41 +01:00
fdt_addresses.c
libfdt: include fdt_addresses.c
2020-01-08 16:59:19 +00:00
fdt_empty_tree.c
…
fdt_ro.c
…
fdt_rw.c
…
fdt_strerror.c
…
fdt_sw.c
…
fdt_wip.c
…
fdt.c
…
find_bit_benchmark.c
…
find_bit.c
kernel.h: split out mathematical helpers
2020-12-15 22:46:15 -08:00
flex_proportions.c
lib/flex_proportions.c: cleanup __fprop_inc_percpu_max
2020-06-04 19:06:25 -07:00
gen_crc32table.c
…
gen_crc64table.c
…
genalloc.c
lib/genalloc.c: change return type to unsigned long for bitmap_set_ll
2021-02-26 09:41:04 -08:00
generic-radix-tree.c
lib/generic-radix-tree.c: add kmemleak annotations
2019-10-14 15:04:00 -07:00
glob.c
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
globtest.c
…
hexdump.c
kernel.h: split out min()/max() et al. helpers
2020-10-16 11:11:19 -07:00
hweight.c
…
idr.c
Merge tag 'xarray-5.9' of git://git.infradead.org/users/willy/xarray
2020-10-20 14:39:37 -07:00
inflate.c
…
interval_tree_test.c
…
interval_tree.c
…
iomap_copy.c
…
iomap.c
iomap: constify ioreadX() iomem argument (as in generic implementation)
2020-08-14 19:56:57 -07:00
iommu-helper.c
…
iov_iter.c
Merge branch 'kmap-conversion-for-5.12' of git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux
2021-03-01 11:24:18 -08:00
irq_poll.c
…
irq_regs.c
…
is_single_threaded.c
…
kasprintf.c
…
Kconfig
lib: stackdepot: add support to configure STACK_HASH_SIZE
2021-02-26 09:41:04 -08:00
Kconfig.debug
mm: add Kernel Electric-Fence infrastructure
2021-02-26 09:41:02 -08:00
Kconfig.kasan
kasan: fix KASAN_STACK dependency for HW_TAGS
2021-03-13 11:27:31 -08:00
Kconfig.kcsan
kcsan: Test support for compound instrumentation
2020-08-24 15:09:58 -07:00
Kconfig.kfence
kfence: add test suite
2021-02-26 09:41:02 -08:00
Kconfig.kgdb
kgdb: Honour the kprobe blocklist when setting breakpoints
2020-09-28 12:14:08 +01:00
Kconfig.ubsan
ubsan: remove overflow checks
2021-02-26 09:41:05 -08:00
kfifo.c
Partially revert "kfifo: fix kfifo_alloc() and kfifo_init()"
2019-08-30 18:47:15 -07:00
klist.c
…
kobject_uevent.c
…
kobject.c
kobject: Drop unneeded conditional in __kobject_del()
2020-09-07 11:24:17 +02:00
kstrtox.c
lib: Fix fall-through warnings for Clang
2020-11-19 07:23:47 -06:00
kstrtox.h
…
libcrc32c.c
lib: libcrc32c: delete duplicated words
2020-10-16 11:11:19 -07:00
linear_ranges.c
lib/linear_ranges: fix repeated words & one typo
2020-12-28 12:24:47 +00:00
list_debug.c
…
list_sort.c
…
list-test.c
Fix linked-list KUnit test when run multiple times
2020-03-25 16:38:39 -06:00
llist.c
…
locking-selftest-hardirq.h
…
locking-selftest-mutex.h
…
locking-selftest-rlock-hardirq.h
…
locking-selftest-rlock-softirq.h
…
locking-selftest-rlock.h
…
locking-selftest-rsem.h
…
locking-selftest-rtmutex.h
…
locking-selftest-softirq.h
…
locking-selftest-spin-hardirq.h
…
locking-selftest-spin-softirq.h
…
locking-selftest-spin.h
…
locking-selftest-wlock-hardirq.h
…
locking-selftest-wlock-softirq.h
…
locking-selftest-wlock.h
…
locking-selftest-wsem.h
…
locking-selftest.c
locking/selftests: Add local_lock inversion tests
2021-01-14 11:20:18 +01:00
lockref.c
…
logic_pio.c
PCI: Fix pci_register_io_range() memory leak
2021-02-17 17:31:06 -06:00
lru_cache.c
…
lshrdi3.c
…
Makefile
kasan: rename CONFIG_TEST_KASAN_MODULE
2021-02-24 13:38:31 -08:00
memcat_p.c
…
memory-notifier-error-inject.c
…
memregion.c
lib/memregion.c: include memregion.h
2020-09-26 10:33:57 -07:00
memweight.c
…
muldi3.c
…
net_utils.c
…
netdev-notifier-error-inject.c
…
nlattr.c
Merge tag 'fallthrough-fixes-clang-5.11-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/gustavoars/linux
2020-12-16 00:24:16 -08:00
nmi_backtrace.c
lib: Add backtrace_idle parameter to force backtrace of idle CPUs
2020-08-24 14:24:25 -07:00
nodemask.c
…
notifier-error-inject.c
…
notifier-error-inject.h
…
objagg.c
lib: objagg: Replace zero-length arrays with flexible-array member
2020-02-16 18:33:00 -08:00
of-reconfig-notifier-error-inject.c
…
oid_registry.c
…
once.c
…
packing.c
lib: packing: add documentation for pbuflen argument
2020-06-28 20:45:27 -07:00
parman.c
lib/parman: Delete newline
2021-02-15 15:31:52 -08:00
parser.c
parser: Fix kernel-doc markups
2021-02-03 19:10:42 +01:00
pci_iomap.c
…
percpu_counter.c
lib/percpu_counter.c: use helper macro abs()
2020-10-16 11:11:20 -07:00
percpu_test.c
…
percpu-refcount.c
percpu_ref: Dump mem_dump_obj() info upon reference-count underflow
2021-01-22 15:24:23 -08:00
plist.c
…
pm-notifier-error-inject.c
…
radix-tree.c
Merge tag 'xarray-5.9' of git://git.infradead.org/users/willy/xarray
2020-10-20 14:39:37 -07:00
random32.c
random32: add a selftest for the prandom32 code
2020-10-24 20:21:57 +02:00
ratelimit.c
…
rbtree_test.c
augmented rbtree: add new RB_DECLARE_CALLBACKS_MAX macro
2019-09-25 17:51:39 -07:00
rbtree.c
lib/: replace HTTP links with HTTPS ones
2020-08-12 10:58:00 -07:00
refcount.c
locking/refcount: Consolidate implementations of refcount_t
2019-11-25 09:15:32 +01:00
rhashtable.c
rhashtable: Restore RCU marking on rhash_lock_head
2020-07-28 17:09:49 -07:00
sbitmap.c
sbitmap: simplify wrap check
2020-12-07 17:12:49 -07:00
scatterlist.c
lib/scatterlist: use consistent sg_copy_buffer() return type
2020-10-29 08:55:45 -06:00
seq_buf.c
seq_buf: Export seq_buf_printf
2020-06-15 18:22:43 -07:00
sg_pool.c
Merge tag 'scsi-sg' of git://git.kernel.org/pub/scm/linux/kernel/git/jejb/scsi
2019-07-11 15:17:41 -07:00
sg_split.c
lib: scatterlist: Fix to support no mapped sg
2019-08-08 07:45:01 -06:00
sha1.c
crypto: sha - split sha.h into sha1.h and sha2.h
2020-11-20 14:45:33 +11:00
show_mem.c
mm: remove quicklist page table caches
2019-09-24 15:54:09 -07:00
siphash.c
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
smp_processor_id.c
sched: Make migrate_disable/enable() independent of RT
2020-11-24 11:25:44 +01:00
sort.c
lib/sort: Move swap, cmp and cmp_r function types for wider use
2019-11-14 13:15:11 -05:00
stackdepot.c
lib: stackdepot: fix ignoring return value warning
2021-02-26 09:41:04 -08:00
stmp_device.c
…
string_helpers.c
lib: string_helpers: provide kfree_strarray()
2020-09-30 10:50:30 +02:00
string.c
lib/string: remove unnecessary #undefs
2020-12-15 22:46:16 -08:00
strncpy_from_user.c
lib/strncpy_from_user.c: Mask out bytes after NUL terminator.
2020-11-19 11:56:16 -08:00
strnlen_user.c
uaccess: Selectively open read or write user access
2020-05-01 12:35:21 +10:00
syscall.c
lib/syscall: fix syscall registers retrieval on 32-bit platforms
2020-12-03 09:52:44 -08:00
test_bitmap.c
lib: use KSTM_MODULE_GLOBALS macro in kselftest drivers
2021-02-15 11:01:42 +01:00
test_bitops.c
lib/test_bitops: do the full test during module init
2020-08-12 10:57:59 -07:00
test_bits.c
lib/test_bits.c: add tests of GENMASK
2020-08-12 10:58:00 -07:00
test_blackhole_dev.c
…
test_bpf.c
test_bpf: Remove EXPECTED_FAIL flag from bpf_fill_maxinsns11
2021-01-20 14:13:48 -08:00
test_debug_virtual.c
…
test_firmware.c
lib: cleanup kstrto*() usage
2020-12-15 22:46:16 -08:00
test_fpu.c
selftests/fpu: Fix debugfs_simple_attr.cocci warning
2021-01-18 11:03:26 +01:00
test_free_pages.c
lib/test_free_pages.c: add basic progress indicators
2020-12-15 22:46:16 -08:00
test_hash.c
…
test_hexdump.c
…
test_hmm_uapi.h
mm/hmm: add tests for hmm_pfn_to_map_order()
2020-07-10 16:24:28 -03:00
test_hmm.c
lib/test_hmm.c: fix an error code in dmirror_allocate_chunk()
2020-10-16 11:11:20 -07:00
test_ida.c
…
test_kasan_module.c
kasan: clean up comments in tests
2021-02-24 13:38:30 -08:00
test_kasan.c
kasan, mm: fail krealloc on freed objects
2021-02-26 09:41:03 -08:00
test_kmod.c
lib: cleanup kstrto*() usage
2020-12-15 22:46:16 -08:00
test_linear_ranges.c
lib/test_linear_ranges: add a test for the 'linear_ranges'
2020-05-08 18:18:12 +01:00
test_list_sort.c
…
test_lockup.c
lib/test_lockup.c: minimum fix to get it compiled on PREEMPT_RT
2020-12-15 22:46:16 -08:00
test_memcat_p.c
…
test_meminit.c
lib/test_meminit.c: add bulk alloc/free tests
2019-12-04 19:44:13 -08:00
test_min_heap.c
lib: Introduce generic min-heap
2020-03-06 11:56:59 +01:00
test_module.c
…
test_objagg.c
test_objagg: Fix potential memory leak in error handling
2020-06-15 13:32:11 -07:00
test_overflow.c
lib/test_overflow.c: avoid tainting the kernel and fix wrap size
2019-07-16 19:23:22 -07:00
test_parman.c
…
test_printf.c
Merge tag 'printk-for-5.12' of git://git.kernel.org/pub/scm/linux/kernel/git/printk/linux
2021-02-22 11:04:36 -08:00
test_rhashtable.c
rhashtable: fix indentation of a continue statement
2020-09-20 14:10:06 -07:00
test_siphash.c
…
test_sort.c
…
test_stackinit.c
lib: test_stackinit.c: XFAIL switch variable init tests
2020-04-07 10:43:43 -07:00
test_static_key_base.c
…
test_static_keys.c
…
test_string.c
lib/test_string.c: add some testcases for strchr and strnchr
2019-07-16 19:23:22 -07:00
test_strscpy.c
…
test_sysctl.c
lib: test_sysctl: delete duplicated words
2020-10-16 11:11:20 -07:00
test_ubsan.c
ubsan: remove overflow checks
2021-02-26 09:41:05 -08:00
test_user_copy.c
usercopy: Avoid soft lockups in test_check_nonzero_user()
2019-10-16 14:56:21 +02:00
test_uuid.c
…
test_vmalloc.c
lib/test_vmalloc.c: Add test cases for kvfree_rcu()
2020-06-29 11:59:26 -07:00
test_xarray.c
Merge tag 'xarray-5.9' of git://git.infradead.org/users/willy/xarray
2020-10-20 14:39:37 -07:00
test-kstrtox.c
…
test-string_helpers.c
lib/test-string_helpers.c: Add string_upper() and string_lower() tests
2020-07-15 12:45:06 +03:00
textsearch.c
lib: textsearch: fix escapes in example code
2019-10-03 12:12:23 -04:00
timerqueue.c
rbtree, timerqueue: Use rb_add_cached()
2021-02-17 14:08:01 +01:00
ts_bm.c
lib/: replace HTTP links with HTTPS ones
2020-08-12 10:58:00 -07:00
ts_fsm.c
Revert "lib: Revert use of fallthrough pseudo-keyword in lib/"
2020-11-18 14:15:17 -06:00
ts_kmp.c
lib/ts_kmp.c: replace zero-length array with flexible-array member
2020-04-07 10:43:43 -07:00
ubsan.c
ubsan: remove overflow checks
2021-02-26 09:41:05 -08:00
ubsan.h
ubsan: implement __ubsan_handle_alignment_assumption
2021-02-05 11:03:47 -08:00
ucmpdi2.c
…
ucs2_string.c
…
usercopy.c
lib, uaccess: add failure injection to usercopy functions
2020-10-16 11:11:22 -07:00
uuid.c
uuid: Provide a GUID generator for raw buffer
2020-03-23 17:01:47 +01:00
vsprintf.c
lib/vsprintf: no_hash_pointers prints all addresses as unhashed
2021-02-15 11:08:32 +01:00
win_minmax.c
…
xarray.c
Merge tag 'xarray-5.9' of git://git.infradead.org/users/willy/xarray
2020-10-20 14:39:37 -07:00
xxhash.c
lib/: replace HTTP links with HTTPS ones
2020-08-12 10:58:00 -07:00