vllm.distributed.kv_transfer.kv_connector.v1.nixl.utils
¶
Shared constants, lazy imports and helpers for the NIXL connector.
Functions:
-
get_base_request_id–Strip the per-request
-<8 hex>randomization suffix, if present. -
get_dcp_replicated_group_ids–MLA groups held whole on every DCP rank, e.g. a draft running at DCP=1
-
zmq_ctx–Context manager for a ZMQ socket.
get_base_request_id(request_id)
¶
Strip the per-request -<8 hex> randomization suffix, if present.
get_dcp_replicated_group_ids(groups)
¶
MLA groups held whole on every DCP rank, e.g. a draft running at DCP=1 under a DCP target.
Source code in vllm/distributed/kv_transfer/kv_connector/v1/nixl/utils.py
zmq_ctx(socket_type, addr)
¶
Context manager for a ZMQ socket.