Your favorite, Visitor: Author says there were ‘real concerns’ about David Walliams within publishing industry