Don't trust member list if source user isn't there

Don't trust member list if source user isn't there #508