Don't inspect sources if the backend isn't confident about offering good results
Makes it consistent with the hover display
BUG: 401844