Skip to content

Commit 9356742

Browse files
committed
use cudagraph for mpk
1 parent ed46211 commit 9356742

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

vllm/config/vllm.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -690,10 +690,9 @@ def has_blocked_weights():
690690
)
691691
self.compilation_config.cudagraph_mode = CUDAGraphMode.PIECEWISE
692692

693-
# disable cudagraph when enforce eager execution or mirage backend is used
693+
# disable cudagraph when enforce eager execution
694694
disable_cuda_graph = (
695695
(self.model_config is not None and self.model_config.enforce_eager)
696-
or (self.compilation_config.backend == "mirage_byname")
697696
)
698697
if disable_cuda_graph:
699698
logger.info("Cudagraph is disabled under eager mode")

0 commit comments

Comments
 (0)