Qi Yuhang

hp_rms_norm. High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)

expert_specialization_moe. Expert Specialization MoE Solution based on CUTLASS

cute_reduce. Reduce kernel based on CUTLASS CuTe and TMA.

cutlass_cute_experiments. Cuda

cuda_prefetch_experiment. Prefetch experiments codes.

CUDASynchronizePrimitives. Benchmark sync primitives

cutedsl_experiment. Some code snippet for CuTeDSL

swizzled_layout_gemm. Using a swizzled hierarchical layout for GEMM

GPU-Cache-Operator. Cuda

CUDA_Practice. This is a repository with some CUDA examples.

tma_multicast_demo. Simple Code Snippet for TMA Multicast.

MPI_practice. A repository with some MPI programming examples.

OpenMP_practice. This is a repository with some OpenMP examples.

sglang. SGLang is a fast serving framework for large language models and vision language models.

NVGPUMicroBenchmark. Instruction-level benchmarks for NVGPUs

peer_access_demo. Cache operator demo code for peer access

POSIX_pthread_practice. This is a repository with some POSIX pthread interface.