[Feature Request] Keep Dynamic Config Overrides up to date.

[chaptersix]

Is your feature request related to a problem? Please describe.

#1046 (comment)

Describe the solution you'd like

unit test that overrides are not no-op. If the server version is changed to a version that has enabled that feature is should fail so the PR author can rmeove the override.

Additional context