Thread:Extension talk:OpenID/OpenID login and return links don't use short URL/reply

Never mind, I found that setting the TrustRoot just to http://my.domain/ fixed the problem. Don't know why I didn't think of trying that earlier. It might be wise to add this to the documentation though.