When I change my default shell to fish via chsh, OpenInWSL no longer works (I'm afraid I haven't tried with zsh), regardless of how my config.fish file is set up. Keeping bash as the default shell and launching fish from .bashrc for interactive shells is a workaround I'm using for now, but it would be nice if this wasn't needed.