Enable the Show / Hide Button Active Option
To set the button to be active as soon as the page loads, enable the option at:
Show / Hide Button Settings > Content > Active State > Active
Note that when the button is subsequently deactivated, e.g. by clicking on it, the active state will be removed.
The option is available in Divi Show / Hide Button v1.3.9 onwards.