Chris Sidebottom 37fc3bbca0 Add Infrastructure for SHGEMV ...

This adds all the relevant bits and pieces to add a `shgemv` path as
well as a future `hgemm`/`hgemv` path in a similar model to `sb` and `b`
interfaces.

I've also fixed a few bits and pieces around `shgemm` which didn't build
in a few situations.

2025-10-07 15:03:24 +00:00

..

cabs.c

…

conversion_macros.h

Add Infrastructure for SHGEMV

2025-10-07 15:03:24 +00:00

dot.c

…

geadd.c

…

gemm_beta.c

Add infrastructure for BGEMM

2025-07-08 16:22:41 +01:00

gemm_ncopy_1.c

…

gemm_ncopy_2.c

…

gemm_ncopy_4.c

…

gemm_ncopy_6.c

…

gemm_ncopy_8.c

…

gemm_ncopy_16.c

…

gemm_small_matrix_kernel_nn.c

…

gemm_small_matrix_kernel_nt.c

…

gemm_small_matrix_kernel_tn.c

…

gemm_small_matrix_kernel_tt.c

…

gemm_small_matrix_permit.c

…

gemm_tcopy_1.c

…

gemm_tcopy_2.c

…

gemm_tcopy_4.c

…

gemm_tcopy_6.c

…

gemm_tcopy_8.c

…

gemm_tcopy_16.c

…

gemmkernel_2x2.c

Add Infrastructure for SHGEMV

2025-10-07 15:03:24 +00:00

gemv_n.c

Add Infrastructure for SHGEMV

2025-10-07 15:03:24 +00:00

gemv_t.c

Add Infrastructure for SHGEMV

2025-10-07 15:03:24 +00:00

ger.c

…

imatcopy_cn.c

…

imatcopy_ct.c

…

imatcopy_rn.c

…

imatcopy_rt.c

…

laswp_ncopy_1.c

…

laswp_ncopy_2.c

…

laswp_ncopy_4.c

…

laswp_ncopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

laswp_ncopy_8.c

…

lsame.c

…

neg_tcopy_1.c

…

neg_tcopy_2.c

…

neg_tcopy_4.c

…

neg_tcopy_8.c

…

neg_tcopy_16.c

…

rotm.c

Further rearranged the rotm kernel for the different architectures.

2025-01-22 11:41:12 +08:00

scal.c

Add infrastructure for bgemv/bscal

2025-07-15 14:48:57 +01:00

symm_lcopy_1.c

…

symm_lcopy_2.c

…

symm_lcopy_4.c

…

symm_lcopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

symm_lcopy_8.c

…

symm_lcopy_16.c

…

symm_ucopy_1.c

…

symm_ucopy_2.c

…

symm_ucopy_4.c

…

symm_ucopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

symm_ucopy_8.c

…

symm_ucopy_16.c

…

symv_k.c

…

trmm_lncopy_1.c

…

trmm_lncopy_2.c

…

trmm_lncopy_4.c

…

trmm_lncopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trmm_lncopy_8.c

…

trmm_lncopy_16.c

…

trmm_ltcopy_1.c

…

trmm_ltcopy_2.c

…

trmm_ltcopy_4.c

…

trmm_ltcopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trmm_ltcopy_8.c

…

trmm_ltcopy_16.c

…

trmm_uncopy_1.c

…

trmm_uncopy_2.c

…

trmm_uncopy_4.c

…

trmm_uncopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trmm_uncopy_8.c

…

trmm_uncopy_16.c

…

trmm_utcopy_1.c

…

trmm_utcopy_2.c

…

trmm_utcopy_4.c

…

trmm_utcopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trmm_utcopy_8.c

…

trmm_utcopy_16.c

…

trmmkernel_2x2.c

…

trmmkernel_4x4.c

…

trmmkernel_4x8.c

…

trmmkernel_8x2.c

…

trmmkernel_8x4.c

…

trmmkernel_8x8.c

…

trmmkernel_16x2.c

…

trmmkernel_16x4.c

…

trmmkernel_16x8.c

…

trsm_kernel_LN.c

…

trsm_kernel_LT.c

…

trsm_kernel_RN.c

…

trsm_kernel_RT.c

…

trsm_lncopy_1.c

…

trsm_lncopy_2.c

…

trsm_lncopy_4.c

…

trsm_lncopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trsm_lncopy_8.c

…

trsm_lncopy_16.c

…

trsm_ltcopy_1.c

…

trsm_ltcopy_2.c

…

trsm_ltcopy_4.c

…

trsm_ltcopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trsm_ltcopy_8.c

…

trsm_ltcopy_16.c

…

trsm_uncopy_1.c

…

trsm_uncopy_2.c

…

trsm_uncopy_4.c

…

trsm_uncopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trsm_uncopy_8.c

…

trsm_uncopy_16.c

…

trsm_utcopy_1.c

…

trsm_utcopy_2.c

…

trsm_utcopy_4.c

…

trsm_utcopy_6.c

loongarch64: Update dgemm_kernel_16x4 to dgemm_kernel_16x6

2024-05-08 10:10:26 +08:00

trsm_utcopy_8.c

…

trsm_utcopy_16.c

…

zgeadd.c

…

zgemm3m_ncopy_1.c

…

zgemm3m_ncopy_2.c

…

zgemm3m_ncopy_4.c

…

zgemm3m_ncopy_8.c

…

zgemm3m_tcopy_1.c

…

zgemm3m_tcopy_2.c

…

zgemm3m_tcopy_4.c

…

zgemm3m_tcopy_8.c

…

zgemm3mkernel_dump.c

have the dummy GEMM3M kernel at least forward to regular GEMM

2024-08-07 19:39:02 +02:00

zgemm_beta.c

convert the beta=0 branch to a for loop as well

2025-01-09 23:11:26 +01:00

zgemm_ncopy_1.c

…

zgemm_ncopy_2.c

…

zgemm_ncopy_4_sandy.c

…

zgemm_ncopy_4.c

…

zgemm_ncopy_8_sandy.c

…

zgemm_ncopy_8.c

…

zgemm_ncopy_16.c

Loongarch64: add C functions of zgemm_ncopy_16

2025-05-13 16:09:12 +08:00

zgemm_small_matrix_kernel_nn.c

…

zgemm_small_matrix_kernel_nt.c

…

zgemm_small_matrix_kernel_tn.c

…

zgemm_small_matrix_kernel_tt.c

…

zgemm_small_matrix_permit.c

…

zgemm_tcopy_1.c

…

zgemm_tcopy_2.c

…

zgemm_tcopy_4_sandy.c

…

zgemm_tcopy_4.c

…

zgemm_tcopy_8_sandy.c

…

zgemm_tcopy_8.c

…

zgemmkernel_2x2.c

…

zger.c

…

zhemm3m_lcopy_1.c

…

zhemm3m_lcopy_2.c

…

zhemm3m_lcopy_4.c

…

zhemm3m_lcopy_8.c

…

zhemm3m_ucopy_1.c

…

zhemm3m_ucopy_2.c

…

zhemm3m_ucopy_4.c

…

zhemm3m_ucopy_8.c

…

zhemm_ltcopy_1.c

…

zhemm_ltcopy_2.c

…

zhemm_ltcopy_4.c

…

zhemm_ltcopy_8.c

…

zhemm_ltcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

zhemm_utcopy_1.c

…

zhemm_utcopy_2.c

…

zhemm_utcopy_4.c

…

zhemm_utcopy_8.c

…

zhemm_utcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

zhemv_k.c

…

zimatcopy_cn.c

…

zimatcopy_cnc.c

Fix BLAS, BLAS-like functions and Generic RISC-V kernels

2024-01-18 23:19:52 +03:00

zimatcopy_ct.c

…

zimatcopy_ctc.c

…

zimatcopy_rn.c

…

zimatcopy_rnc.c

…

zimatcopy_rt.c

…

zimatcopy_rtc.c

…

zlaswp_ncopy_1.c

…

zlaswp_ncopy_2.c

…

zlaswp_ncopy_4.c

…

zlaswp_ncopy_8.c

…

zneg_tcopy_1.c

…

zneg_tcopy_2.c

…

zneg_tcopy_4.c

…

zneg_tcopy_8.c

…

zneg_tcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

zsymm3m_lcopy_1.c

…

zsymm3m_lcopy_2.c

…

zsymm3m_lcopy_4.c

…

zsymm3m_lcopy_8.c

…

zsymm3m_ucopy_1.c

…

zsymm3m_ucopy_2.c

…

zsymm3m_ucopy_4.c

…

zsymm3m_ucopy_8.c

…

zsymm_lcopy_1.c

…

zsymm_lcopy_2.c

…

zsymm_lcopy_4.c

…

zsymm_lcopy_8.c

…

zsymm_lcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

zsymm_ucopy_1.c

…

zsymm_ucopy_2.c

…

zsymm_ucopy_4.c

…

zsymm_ucopy_8.c

…

zsymm_ucopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

zsymv_k.c

…

ztrmm_lncopy_1.c

…

ztrmm_lncopy_2.c

…

ztrmm_lncopy_4.c

…

ztrmm_lncopy_8.c

…

ztrmm_lncopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

ztrmm_ltcopy_1.c

…

ztrmm_ltcopy_2.c

…

ztrmm_ltcopy_4.c

…

ztrmm_ltcopy_8.c

…

ztrmm_ltcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

ztrmm_uncopy_1.c

…

ztrmm_uncopy_2.c

…

ztrmm_uncopy_4.c

…

ztrmm_uncopy_8.c

…

ztrmm_uncopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

ztrmm_utcopy_1.c

…

ztrmm_utcopy_2.c

…

ztrmm_utcopy_4.c

…

ztrmm_utcopy_8.c

…

ztrmm_utcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

ztrmmkernel_2x2.c

…

ztrmmkernel_4x4.c

Fix file permissions (issue 4095)

2023-07-23 20:37:07 +02:00

ztrsm_lncopy_1.c

…

ztrsm_lncopy_2.c

…

ztrsm_lncopy_4.c

…

ztrsm_lncopy_8.c

…

ztrsm_lncopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

ztrsm_ltcopy_1.c

…

ztrsm_ltcopy_2.c

…

ztrsm_ltcopy_4.c

…

ztrsm_ltcopy_8.c

…

ztrsm_ltcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

ztrsm_uncopy_1.c

…

ztrsm_uncopy_2.c

…

ztrsm_uncopy_4.c

…

ztrsm_uncopy_8.c

…

ztrsm_uncopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00

ztrsm_utcopy_1.c

…

ztrsm_utcopy_2.c

Restore initialization of data variables

2023-07-13 23:23:12 +02:00

ztrsm_utcopy_4.c

…

ztrsm_utcopy_8.c

…

ztrsm_utcopy_16.c

Optimized cgemm kernel 16x4 LASX for LoongArch

2024-02-21 15:28:47 +08:00