Skip to content

Support FlexKV Layerwise#428

Draft
Clebrate wants to merge 1 commit into
NVIDIA:mainfrom
Clebrate:lyl_FlexKV_layerwise
Draft

Support FlexKV Layerwise#428
Clebrate wants to merge 1 commit into
NVIDIA:mainfrom
Clebrate:lyl_FlexKV_layerwise

Conversation

@Clebrate

Copy link
Copy Markdown
Collaborator

Description

Add FlexKV layerwise transfer support for the RecSys KVcache manager.

This PR wires the RecSys FlexKV backend to FlexKV's layerwise launch path by:

  • adding an optional RECSYS_FLEXKV_ENABLE_LAYERWISE switch;
  • passing layerwise_transfer and counter_id to FlexKV onboard launches when enabled;
  • adding a RecSys-side eventfd sender for FlexKV layerwise synchronization;
  • covering the layerwise onboard path in test_flexkv.py.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@Clebrate Clebrate force-pushed the lyl_FlexKV_layerwise branch from b2ae455 to 42ddf58 Compare June 23, 2026 01:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant