NVIDIA CUDA — a programming model, toolchain, and library collection for general-purpose parallel computing on GPUs. It covers kernel authoring in CUDA C++/Python, the PTX ISA instruction set, tuning for the Blackwell architecture, and high-performance GEMM implementations using CUTLASS/CuTe.
Directory structure
skills/nvidia-cuda/
SKILL.md
references/
programming-model/
README.md
introduction.md
programming-model.md
cuda-platform.md
intro-to-cuda-cpp.md
intro-to-cuda-python.md
writing-cuda-kernels.md
writing-tile-kernels.md
asynchronous-execution.md
understanding-memory.md
nvcc.md
advanced/
README.md
core/
README.md
advanced-host-programming.md
advanced-kernel-programming.md
driver-api.md
multi-gpu-systems.md
feature-survey.md
features/
README.md
unified-memory.md
cuda-graphs.md
stream-ordered-memory-allocation.md
cooperative-groups.md
programmatic-dependent-launch.md
green-contexts.md
lazy-loading.md
error-log-management.md
async-barriers.md
pipelines.md
async-copies.md
cluster-launch-control.md
l2-cache-control.md
memory-sync-domains.md
inter-process-communication.md
virtual-memory-management.md
extended-gpu-memory.md
dynamic-parallelism.md
graphics-interop.md
driver-entry-point-access.md
appendices/
README.md
compute-capabilities.md
environment-variables.md
cpp-language-support.md
cpp-language-extensions.md
mathematical-functions.md
device-callable-apis.md
cuda-cpp-memory-model.md
cuda-cpp-execution-model.md
ptx-isa/
README.md
introduction.md
programming-model.md
machine-model.md
syntax.md
state-spaces-types-variables.md
instruction-operands.md
abi.md
memory-consistency-model.md
instruction-set-overview.md
instructions-arithmetic.md
instructions-comparison-logic.md
instructions-data-movement.md
instructions-texture-surface.md
instructions-control-flow.md
instructions-sync-communication.md
instructions-matrix-multiply.md
instructions-video-misc.md
special-registers.md
directives.md
pragma-strings.md
release-notes.md
blackwell-tuning/
README.md
architecture.md
best-practices.md
streaming-multiprocessor.md
memory-system.md
nvlink.md
cutlass/
README.md
cute-dsl/
README.md
overview.md
functionality.md
quick-start.md
cute-dsl.md
dsl-introduction.md
dsl-code-generation.md
dsl-control-flow.md
dsl-jit-arg-generation.md
dsl-dynamic-layout.md
dsl-struct-types.md
dsl-jit-caching.md
dsl-jit-compilation-options.md
dsl-types.md
framework-integration.md
debugging.md
iket-profiling.md
autotuning-gemm.md
compile-with-tvm-ffi.md
dsl-ahead-of-time-compilation.md
naming-conventions.md
deprecation-policy.md
mma-intro.md
mma-wmma-programming.md
mma-wgmma-programming.md
mma-tcgen05-programming.md
limitations.md
faqs.md
api-overview.md
api-cute.md
api-cute-arch.md
api-cute-runtime.md
api-cute-nvgpu.md
api-cute-nvgpu-common.md
api-cute-nvgpu-warp.md
api-cute-nvgpu-warpgroup.md
api-cute-nvgpu-cpasync.md
api-cute-nvgpu-tcgen05.md
api-pipeline.md
api-utils.md
api-utils-sm90.md
api-utils-sm100.md
operator-api/
README.md
overview.md
tutorials.md
tutorial-000-gemm.md
tutorial-001-gemm-fused-epilogue.md
tutorial-002-bring-your-own-kernel.md
tutorial-003-host-latency-best-practices.md
tutorial-004-fake-tensors.md
tutorial-005-grouped-gemm-contiguous-offset.md
tutorial-006-block-scaled-gemm.md
api-reference.md
api-operator.md
api-arguments.md
api-discovery.md
api-metadata.md
api-misc.md
cpp/
README.md
overview.md
getting-started.md
quickstart.md
ide-setup.md
build.md
build-windows-visual-studio.md
build-clang-host-compiler.md
functionality.md
terminology.md
fundamental-types.md
programming-guidelines.md
gemm-heuristics.md
efficient-gemm.md
pipeline.md
profiler.md
gemm-performance-measurement.md
dependent-kernel-launch.md
blackwell.md
blackwell-sm100-gemm.md
blackwell-cluster-launch-control.md
code-organization.md
cute.md
cute-quickstart.md
cute-layout.md
cute-layout-algebra.md
cute-tensor.md
cute-algorithms.md
cute-mma-atom.md
cute-gemm-tutorial.md
cute-predication.md
cute-tma-tensors.md
cutlass-3x.md
cutlass-3x-design.md
cutlass-3x-backwards-compatibility.md
gemm-api-3x.md
cutlass-2x.md
layout-2x.md
gemm-api-2x.md
tile-iterator-concept.md
utilities.md
grouped-scheduler.md
implicit-gemm-convolution.md
samples/
README.md
async-copy-pipeline.md
cooperative-groups-reduction.md
cuda-graph-explicit-nodes.md
cuda-graph-stream-capture.md
cute-dsl-gemm.md
cutlass-cpp-device-gemm.md
cutlass-operator-api-gemm.md
explicit-memory-transfer.md
multi-gpu-peer-to-peer.md
shared-memory-tiled-matmul.md
stream-ordered-allocation.md
stream-overlap.md
tile-kernel-vector-add.md
unified-memory.md
vector-add-kernel.md
scripts/
README.md
install.md
nvcc-build.md
binary-utilities.md
sanitize.md
debug.md
nsight-systems.md
nsight-compute.md
gpu-query.md
cutlass-build.md
Exploration procedure
Look up the category from the task, and identify the target page in the category's README.md:
- Find the category corresponding to the task in the mapping table below
- that category's
references/{category}/README.md（advanced/cutlass/(the README.md of the subdirectory) to identify the target page - Read the
.mdof the relevant page to check the details
For hardware specifications of an actual GB10 Grace Blackwell machine, DGX OS, PXE/fleet operations, and playbook startup procedures, see the dgx-spark skill;
for remote connection management and desktop application operations such as launching VS Code, see the nvidia-sync skill.
This skill covers how to write CUDA C++/Python, PTX instructions, and the CUTLASS API.
Task → Category Mapping
| Task | Category | Reference README |
|---|---|---|
| I want to know what CUDA is, the GPU hierarchy model, and the overall picture of the CUDA platform | programming-model | references/programming-model/README.md |
| I want to write kernels in CUDA C++/Python, build with nvcc, and handle asynchronous execution and streams | programming-model | references/programming-model/README.md |
| I want to check the overall structure of the advanced category (core / features / appendices) | advanced | references/advanced/README.md |
| I want to look up the Driver API, multi-GPU, and advanced host/kernel programming | advanced/core | references/advanced/core/README.md |
| I want to look up feature APIs such as CUDA Graphs / Cooperative Groups / Unified Memory / VMM / IPC | advanced/features | references/advanced/features/README.md |
| I want to look up technical appendices on Compute Capability, environment variables, C++ language extensions, and the memory/execution model | advanced/appendices | references/advanced/appendices/README.md |
| I want to look up the PTX instruction set, state spaces, registers, and the memory consistency model | ptx-isa | references/ptx-isa/README.md |
| I want to know about tuning the Blackwell architecture, SM occupancy, NVLink, and the memory system | blackwell-tuning | references/blackwell-tuning/README.md |
| I want to check the overall category structure of CUTLASS/CuTe (CuTe DSL / Operator API / C++) | cutlass | references/cutlass/README.md |
| I want to write GEMM, MMA, and layouts in the CuTe DSL (Python) | cutlass/cute-dsl | references/cutlass/cute-dsl/README.md |
| I want to use the CUTLASS Operator API (Python, calling compiled kernels) | cutlass/operator-api | references/cutlass/operator-api/README.md |
| I want to implement template-based GEMM kernels in CUTLASS C++ / CuTe C++ | cutlass/cpp | references/cutlass/cpp/README.md |
| I want to know typical usage (vector add, tiled matmul, GEMM, CUDA Graphs, etc.) | samples | samples/README.md |
| I want to know about installation, nvcc builds, nsight profiling, and compute-sanitizer commands | scripts | scripts/README.md |