Skip to content

Commit 1fce1d6

Browse files
committed
nit: fix dynamic axes integer access
Signed-off-by: Vinayak Baddi <[email protected]>
1 parent 02eaaa8 commit 1fce1d6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

QEfficient/transformers/models/modeling_auto.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2388,7 +2388,7 @@ def export(self, export_dir: Optional[str] = None) -> str:
23882388
pkv_dynamic_axes[i][0] = "full_batch_size" if self.continuous_batching else "batch_size"
23892389
for kv in ["key", "value"]:
23902390
example_inputs["past_key_values"][i].append(torch.zeros(kv_cache_shape, dtype=torch.float32))
2391-
dynamic_axes[f"past_{kv}.{i}"] = pkv_dynamic_axes
2391+
dynamic_axes[f"past_{kv}.{i}"] = pkv_dynamic_axes[i]
23922392
output_names.append(f"past_{kv}.{i}_InternalRetainedState")
23932393

23942394
if self.continuous_batching:

0 commit comments

Comments
 (0)