by

Robots.txt Revisited

Yesterday I wrote on a suspicious change to the robots.txt file at the White House website.
According to 2600 NEWS, this change may merely have been an innocent oversight which occurred as the White House was modifying the website template.
2600 NEWS seems satisfied with the explanation, so I’ll take their word on it. I certainly don’t have the technical expertise to argue otherwise.
Via The Dead Parrot Society.