11 'Faux Pas' That Are Actually Okay to Make With Your free dataset

https://cs.astronomy.com/members/millinxcgb/default.aspx

This allows Goggle (consumer-agent name GoogleBot) to go to each website page and Listing, while simultaneously banning Ask Jeeves within the web-site completely