A reference distilled from the official documentation on drawing, composition, camera, and audio/video playback for Windows apps. It covers vector drawing and text layout with Direct2D/DirectWrite, low-level GPU drawing with Direct3D 11/12, the composition visual layer with Microsoft.UI.Composition, camera/screen capture with MediaCapture, and audio/video playback with the Windows.Media.Playback family. Depending on the user's task, read the appropriate README.md and follow it to the individual files.
Directory structure
skills/windows-graphics-media/
SKILL.md
references/
direct2d-directwrite/
README.md
d2d1createfactory.md
direct2d-direct3d-interop.md
dwrite-text-metrics.md
dwritecore.md
id2d1bitmap1.md
id2d1bitmapbrush.md
id2d1commandlist.md
id2d1device.md
id2d1devicecontext.md
id2d1effect.md
id2d1factory.md
id2d1factory1.md
id2d1geometry.md
id2d1geometrysink.md
id2d1imagebrush.md
id2d1layer.md
id2d1lineargradientbrush.md
id2d1pathgeometry.md
id2d1radialgradientbrush.md
id2d1rendertarget.md
id2d1solidcolorbrush.md
id2d1strokestyle.md
id2d1svgdocument.md
idwritefactory.md
idwritefontcollection.md
idwritefontface.md
idwritetextformat.md
idwritetextlayout.md
wic-interop.md
direct3d-directx/
README.md
d3d11-blend-rasterizer.md
d3d11-compute-shader.md
d3d11-depth-stencil.md
d3d11-device-context.md
d3d11-resources.md
d3d11-sampler-srv.md
d3d11-shaders-drawing.md
d3d12-barriers-descriptors.md
d3d12-enhanced-barriers.md
d3d12-overview.md
d3d12-raytracing.md
directcomposition.md
directx-winui3-integration.md
directx-xaml-composition.md
dxgi-factory-adapter.md
dxgi-swap-chain.md
hlsl-shader-compilation.md
composition-visuals/
README.md
animation-controller.md
composition-drawing-surface.md
composition-effect-brush.md
composition-gradient-brush.md
composition-light.md
composition-property-set.md
composition-surface-brush.md
compositor.md
container-visual.md
desktop-acrylic-controller.md
drop-shadow.md
element-composition-preview.md
expression-animation.md
implicit-animation-collection.md
interaction-tracker.md
key-frame-animation.md
layer-visual.md
loaded-image-surface.md
mica-controller.md
natural-motion-animation.md
shape-visual.md
sprite-visual.md
visual-interaction-source.md
visual.md
camera-capture/
README.md
advanced-photo-capture.md
camera-capabilities-privacy.md
camera-capture-ui.md
camera-profiles.md
camera-stream-state.md
device-enumeration.md
direct3d11-capture-frame-pool.md
effects-for-video-capture.md
face-detector.md
face-tracker.md
get-a-preview-frame.md
graphics-capture-item.md
graphics-capture-picker.md
graphics-capture-session.md
handle-device-orientation-with-mediacapture.md
low-lag-media-recording.md
low-lag-photo-capture.md
media-capture-initialization-settings.md
media-capture.md
media-frame-reader.md
media-frame-source-group.md
scene-analysis-face-detection-effects.md
set-media-encoding-properties.md
simple-camera-preview-access.md
software-bitmap.md
variable-photo-sequence.md
video-device-controller.md
windows-studio-effects.md
audio-video-playback/
README.md
adaptive-media-source.md
audio-device-output-node.md
audio-file-input-node.md
audio-frame-input-node.md
audio-graph.md
audio-state-monitor.md
custom-video-audio-effects.md
drm-playready.md
media-binder.md
media-break-manager.md
media-capture-integration.md
media-clip.md
media-composition.md
media-playback-command-manager.md
media-playback-item.md
media-playback-list.md
media-playback-session.md
media-player-element.md
media-player-surface.md
media-player.md
media-source.md
media-timeline-controller.md
media-transcoder.md
media-transport-controls.md
midi-services.md
midi.md
system-media-transport-controls.md
timed-metadata-track.md
timed-text-source.md
Exploration procedure
Derive the category from the task, and identify the target page in the category's README.md:
- Find the category corresponding to the task in the mapping table below
- For that category,
references/{category}/README.mdto identify the target page - Read the target page's
.mdto check the details
Task → Category Mapping
| Task | Category | Reference README |
|---|---|---|
| I want to draw vector shapes, brushes, and geometry with Direct2D | direct2d-directwrite | references/direct2d-directwrite/README.md |
| I want to do text layout and font measurement with DirectWrite | direct2d-directwrite | references/direct2d-directwrite/README.md |
| I want to interoperate Direct2D with Direct3D/WIC | direct2d-directwrite | references/direct2d-directwrite/README.md |
| I want to build a device initialization and shader drawing pipeline with Direct3D 11/12 | direct3d-directx | references/direct3d-directx/README.md |
| I want to handle DXGI SwapChain and HLSL shader compilation | direct3d-directx | references/direct3d-directx/README.md |
| I want to embed DirectX drawing results into WinUI 3 XAML | direct3d-directx | references/direct3d-directx/README.md |
| I want to build a custom composition visual tree with Compositor / Visual | composition-visuals | references/composition-visuals/README.md |
| I want to implement input-linked animation with ExpressionAnimation / InteractionTracker | composition-visuals | references/composition-visuals/README.md |
| I want to apply the Mica / Acrylic system backdrop materials | composition-visuals | references/composition-visuals/README.md |
| I want to capture photos, videos, and audio from the camera with MediaCapture | camera-capture | references/camera-capture/README.md |
| I want to control camera devices such as focus, exposure, and zoom | camera-capture | references/camera-capture/README.md |
| I want to use screen capture (GraphicsCaptureSession) and Windows Studio Effects | camera-capture | references/camera-capture/README.md |
| I want to know implementation procedures such as preview display, device rotation correction, and encoding property settings | camera-capture | references/camera-capture/README.md |
| I want to play video and audio with MediaPlayer / MediaPlayerElement | audio-video-playback | references/audio-video-playback/README.md |
| I want to handle streaming playback and protected content with AdaptiveMediaSource / DRM | audio-video-playback | references/audio-video-playback/README.md |
| I want to do audio processing and video editing with AudioGraph / MediaTranscoder / MediaComposition | audio-video-playback | references/audio-video-playback/README.md |
This skill handles only the APIs for DirectX (Direct2D/DirectWrite/Direct3D), Microsoft.UI.Composition, and WinRT media (camera capture and audio/video playback). Control UI is handled by windows-winui-controls, general UI such as layout and styling is handled by windows-winui-ui, and the overall picture of the Windows App SDK is handled by windows-app-sdk.