{"id":91,"date":"2003-10-28T21:25:36","date_gmt":"2003-10-29T02:25:36","guid":{"rendered":"http:\/\/www.brianarner.com\/weblog\/wordpress\/2003\/10\/robotstxt_revisited\/"},"modified":"2003-10-28T21:25:36","modified_gmt":"2003-10-29T02:25:36","slug":"robotstxt_revisited","status":"publish","type":"post","link":"http:\/\/www.brianarner.com\/weblog\/2003\/10\/robotstxt_revisited\/","title":{"rendered":"Robots.txt Revisited"},"content":{"rendered":"<p>Yesterday I wrote on <a href=\"http:\/\/www.brianarner.com\/weblog\/archives\/000080.html\">a suspicious change<\/a> to the <a href=\"http:\/\/www.whitehouse.gov\/robots.txt\">robots.txt file<\/a> at the White House website.<br \/>\nAccording to 2600 NEWS, this change may merely have been <a href=\"http:\/\/www.2600.com\/news\/view\/article\/1803\">an innocent oversight<\/a> which occurred as the White House was modifying the website template.<br \/>\n2600 NEWS seems satisfied with the explanation, so I&#8217;ll take their word on it.  I certainly don&#8217;t have the technical expertise to argue otherwise.<br \/>\nVia <a href=\"http:\/\/www.deadparrots.net\/archives\/politics\/0310sinister_doings_at_whitehousegov.html\">The Dead Parrot Society<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<a href=\"http:\/\/www.brianarner.com\/weblog\/2003\/10\/robotstxt_revisited\/\" rel=\"bookmark\" title=\"Permalink to Robots.txt Revisited\"><p>Yesterday I wrote on a suspicious change to the robots.txt file at the White House website. According to 2600 NEWS, this change may merely have been an innocent oversight which occurred as the White House was modifying the website template. 2600 NEWS seems satisfied with the explanation, so I&#8217;ll take their word on it. I [&hellip;]<\/p>\n<\/a>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[1],"tags":[],"class_list":{"0":"post-91","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-uncategorized","7":"h-entry","8":"hentry"},"_links":{"self":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/posts\/91","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/comments?post=91"}],"version-history":[{"count":0,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/posts\/91\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/media?parent=91"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/categories?post=91"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/tags?post=91"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}