

Package metadata isn’t stored in text files because there’s an amazing technology called the database.
All you have to do is learn how to use your package manager. Spend time reading the man pages and learn the options, and you can query everything you need.
Is ignoring robots.txt considered “honest”?