Skip to content

Conversation

@Zhaeong
Copy link

@Zhaeong Zhaeong commented Nov 26, 2025

When SetProviderOption is called with a new options, it creates a new provider_option that gets appended to the existing provider_option array set by the json config, and since the first one is used it doesn't enable that option for that provider.

This commit here seems to only erase the options in the first element:
9cff9fe

This seems to be the behavior

// After calling set_provider_option("NvTensorRtRtx", "enable_cuda_graph", "0")
provider_options = [
  {"name": "NvTensorRtRtx", "options": []},  // Original from genai_config.json erased by SetProviderOption 
  {"name": "NvTensorRtRtx", "options": [("enable_cuda_graph", "0")]}   // Newly appended
]

This fix will clear provider_options when ClearProviders is called so when SetProviderOption is used it only adds single array

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant