Posts Tagged ‘Search Spiders’
Robots.txt
Posted by David | Filed under Web Design Tips | Read Full Article
A Robots.txt is especially important for those of us with WordPress or similar CMS that have directories we don’t really want Google poking its spider nose into! For example I don’t want Google rummaging through wp-admin/ wp-content/ or wp-includes/ so how can I stop that happening?
Simple - Googlebots along with many other good bots obey a [...]
Tags: Googlebots, Robots, Robots.txt, Search Spiders, Spiders
Search
Student Poll
Loading ...Top Posts
- The Student Essentials Guide to Fancy Dress Ideas -- 9,779 Hits
- Student Discount Cards -- 2,639 Hits
- Tips on How to Make Friends at University -- 1,703 Hits
- The Essential Student Cooking Guide (Eggless Meatballs) -- 1,648 Hits
- The Student Essentials Guide (Self-Catered and Private Rented) -- 1,613 Hits
Recent Posts
- To All University Freshers NOT enjoying Freshers’ Week
- The Essential Student Cooking Guide (Chicken in Creamy Tomato Sauce)
- Vegetable shopping too expensive as a student? Start buying frozen veg instead!
- Fresher’s Packing and General Advice
- The Student Essentials Guide to Washing and Drying Clothes
Student Cookbooks
Random Posts
- Tips for General University Student Life
- Tips on How to Make Friends at University
- Struggling to make friends or unhappy at University?
Categories
- Hardware (8)
- My Lab Project (1)
- Software (8)
- Student Saving Tips (26)
- The Essential Student Cooking Guide (15)
- The Web (20)
- University Life (23)
- Web Design Tips (17)
- Web Software (7)