{"id":86,"date":"2003-10-27T14:35:29","date_gmt":"2003-10-27T19:35:29","guid":{"rendered":"http:\/\/www.brianarner.com\/weblog\/wordpress\/2003\/10\/circumventing_the_google_filte\/"},"modified":"2003-10-27T14:35:29","modified_gmt":"2003-10-27T19:35:29","slug":"circumventing_the_google_filte","status":"publish","type":"post","link":"http:\/\/www.brianarner.com\/weblog\/2003\/10\/circumventing_the_google_filte\/","title":{"rendered":"Circumventing the Google Filter"},"content":{"rendered":"

I’m wandering into dangerous technical territory. But from what I gather here<\/a> and here<\/a>, the White House website<\/a> recently changed its robots.txt file<\/a> to disallow external search engine robots, such as Google’s<\/a>, from indexing files in its Iraq-related directories.
\nUsers can still pull up these web pages using the internal White House site search, but this change makes it harder for web surfers to pull up past White House pronouncements on Iraq using the most popular search engines.
\nWhy might the administration be doing this? Jesse Berney<\/a>:<\/p>\n

It’s easy enough to understand the reasoning if you look at past White House actions. Earlier this year<\/a>, the White House revised pages on its website claiming that “combat” was over in Iraq, changing them to say “major combat.”
\nOne of the reasons some alert readers noticed the change \ufffd and were able to prove it \ufffd was that Google had archived the pages before the change occurred. Now that all of the White House pages about Iraq are no longer archived by Google, such historical revisionism will be harder to catch.<\/p><\/blockquote>\n

That sounds like a reasonable explanation. After all, this White House hardly has a track record in openness, disclosure, and accountability.
\nVia Calpundit<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

I’m wandering into dangerous technical territory. But from what I gather here and here, the White House website recently changed its robots.txt file to disallow external search engine robots, such as Google’s, from indexing files in its Iraq-related directories. Users can still pull up these web pages using the internal White House site search, but […]<\/p>\n<\/a>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[1],"tags":[],"class_list":{"0":"post-86","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-uncategorized","7":"h-entry","8":"hentry"},"_links":{"self":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/posts\/86","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/comments?post=86"}],"version-history":[{"count":0,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/posts\/86\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/media?parent=86"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/categories?post=86"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.brianarner.com\/weblog\/wp-json\/wp\/v2\/tags?post=86"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}