Discovery Services Oauth

We have our discovery service load balanced but we keep getting 400 error from the discovery service using Oauth, how can I make all my servers recognize Oauth tokens from regardless of which discovery service it hits?