Today, researchers at the University of Illinois released a study showing how the White House has deleted or modified portions of its website.  Their findings are, sadly, unsurprising:

Legacies are in the air as President Bush prepares to leave the White House. How future historians will judge the president remains to be seen, but one thing is certain: future historians won’t have all the facts needed to make that judgment. One legacy at risk of being forgotten is the way the Bush White House has quietly deleted or modified key documents in the public record that are maintained under its direct control.

Remember the “Coalition of the Willing” that sided with the United States during the 2003 invasion of Iraq? If you search the White House web site today you’ll find a press release dated March 27, 2003 listing 49 countries forming the coalition. A key piece of evidence in the historical record, but also a troubling one. It is an impostor.

And although there were only 45 coalition members on the eve of the Iraq invasion, later deletions and revisions to key documents make it seem that there were always 49.

The study is a disturbing read.  Rightly or not, a primary source of history for many researchers is the web.  And any effort by the government to modify or delete historical records is appalling.  As the authors note:

Updating lists to keep up with the times is one thing. Deleting original documents from the White House archives is another. Back-dating later documents and using them to replace the originals goes beyond irresponsible stewardship of the public record. It is rewriting history.

H/T: New York Times.

However, a new application may significantly expand our ability to data-mine archived webdata. Reports give a sneak peek at Zoetrope, an application being developed by researchers at Adobe and the University of Washington.  As put by the researchers:

The Web is ephemeral. Pages change frequently, and it is nearly impossible to find data or follow a link after the underlying page evolves. We present Zoetrope, a system that enables interaction with the historical Web (pages, links, and embedded data) that would otherwise be lost to time. Using a number of novel interactions, the temporal Web can be manipulated, queried, and analyzed from the context of familar [sic] pages. Zoetrope is based on a set of operators for manipulating content streams. We describe these primitives and the associated indexing strategies for handling temporal Web data. They form the basis of Zoetrope and enable our construction of new temporal interactions and visualizations.

The demo video shows how historical webdata could be manipulated and compared, as the authors note, in a variety of “novel” ways.  Even more significantly, researcher Eytan Adar “hopes to eventually incorporate information from the Internet Archive’s nearly 14 years of records.” Such a combination would massively increase the utility of web archives, but would also — as discussed in a paper I’m writing — exacerbate concerns over informational autonomy.

Click here to view the embedded video.

The research paper can be found here.

Just a few days ago, I wrote about the Library of Congress’ new report on digital preservation (which itself followed the report of the Section 108 Study Group issued last March).  Now, the Commission of the European Communities has released a green paper entitled Copyright in the Knowledge Economy, which discusses, among other things, digital preservation, the making available of digitized works, and orphan works.

Hat tip: LibraryJournal.com

The report studies problems of digital preservation by looking at the copyright laws of four countries, including the United States.  It finds:

Digital preservation is vital to ensure that works created and distributed in digital form will continue to be available over time to researchers, scholars and other users. Digital works are ephemeral, and unless preservation efforts are begun soon after such works are created, they will be lost to future generations. Although copyright and related laws are not the only obstacle to digital preservation activities, there is no question that those laws present significant challenges.

See also the Section 108 Study Group Report, issued earlier this year, which discusses copyright law and digital preservation.

Although NARA [i.e., the National Archives and Records Administration] has responsibilities for oversight of agencies’ records and records management programs and practices, including conducting inspections or surveys, performing studies, and reporting results to the Congress and the Office of Management and Budget (OMB), in recent years NARA’s oversight activities have been primarily limited to performing studies. NARA has conducted no inspections of agency records management programs since 2000, because it uses inspections only to address cases of the highest risk, and no recent cases have met its criteria. In addition, NARA has not consistently reported details on records management problems or recommended practices that were discovered as a result of its studies. Without more comprehensive evaluations of agency records management, NARA has limited assurance that agencies are appropriately managing the records in their custody and that important records are not lost.

Meanwhile, the White House is threatening a veto of the Electronic Message Preservation Act.  According to the National Coalition for History, the bill “would direct the National Archives and Records Administration (NARA) to establish standards for the capture, management, preservation and retrieval of federal agency and presidential electronic messages that are records in an electronic format.”  (Further info on the bill here, and on issues concerning the White House’s e-mail retention practices here.)

Hat tip regarding the GAO report to David Mattison at the Ten-Thousand Year Blog.  Hat tip regarding the bill to BNA’s Privacy Law Watch.

It’s our blog and so we made an editorial decision, like we do every single day. We didn’t attempt to silence Violet. We unpublished our own work. There’s a big difference between that and censorship.

We hope you’ll respect our choice to keep the reasons behind this private. We do understand the confusion this caused for some, especially since we fight hard for openness and transparency. We were trying to do the right thing quietly and respectfully, without embarrassing the parties involved.

Clearly, that didn’t work out. In attempting to defuse drama, we inadvertently ignited more. Mind you, we weren’t the ones splashing gasoline around; but we did make the fire possible. We’re sorry about that. In the meantime, Boing Boing’s past content is indexed on the Wayback Machine, a basic Internet resource; so the material should still be available for those who would like to read it.

Oddly, BoingBoing speaks in terms of “unpublishing” rather than deletion.   (Their policy page states “We reserve the right to unpublish or refuse to unpublish anything for any or no reason.”)  Sure, “unpublishing” sounds less big-brothery than deletion, but I don’t really see the difference.

Moreover, “unpublishing” isn’t quite accurate: BoingBoing doesn’t mean “unpublished” in the sense of a book (or blog posting) that has yet to be published.  They mean disabling public access to something that has already been posted, like in the DMCA 512(c) sense where material is removed or access to it is disabled.  (WordPress does have an “unpublishing” function, but that’s still a misnomer.)  A more accurate term might be deposting, depublishing, or good ‘ol deletion.

Nevertheless, it’s useful to explore a potential distinction between deletion and depublishing, and other questions raised when a blogger wants to remove posted materials:

• As a starting point, what is the meaning of “publication” in an age where materials can be changed or removed?
• Under what circumstances is depublication justified?
• What practices are needed to distinguish “depublication” from “deletion?”  Is a reservation of rights declaring a right of depublication sufficient?  Should a notice be posted where the materials used to be (as Dan Markel suggests)?
• BoingBoing notes that the removed materials remain on the Wayback Machine web archive.  Do web archives help to justify depublication?
• Does depublication serve an important social function by severing the association between author and depublished content?

Hat tip to Noam Cohen.  And a disclaimer: I did make some edits to this post after posting.

By the way, the picture in the sidebar is the National Archives building being built way-back when.

Happy Independence Day!

ADDENDUM: Wired has posted a short, interesting piece on the early mistreatment of the document, and more recent efforts to preserve it.

More serious may be the loss of the circulating 35-millimeter theatrical prints.  While not original masters, these are the copies made for screenings at repertory theaters, art museum retrospectives and in college classes. . . .

. . . .

This latest fire, I hope, will prompt Universal and its fellow majors to better preserve not just key titles like “Duck Soup,” “Dracula” or “Vertigo” — which will surely be reprinted and return to circulation — but also the other 90 percent of their inventories, the less famous and therefore more vulnerable titles that the studio may not feel justify spending thousands to save. These are exquisite samples of 20th-century American culture and deserve to always be seen in their extravagant, sensual, big-screen glory.

It sounds like after the fire, some of Universals’ assets no longer exist beyond a single remaining master copy.  That’s troubling for several reasons.  First, should the masters be destroyed, the best (and in some cases, only) copies will be lost.  Second, for cultural use to be made of the materials, new copies must be made.

What does this have to do with law students?  The same thing: the importance of archiving and the dangers of failing to do so.  Every term, students suffer data catastrophes — hard drive crashes, stolen laptops, etc. — leading to lost class notes, outlines, paper drafts, etc.  Law school is stressful enough without the added strain of losing a 100-page outline two days before the final exam. But sadly, it seems to happen every term.

Back up your essential files, do so regularly, and keep them in secure and geographically distinct places, such as multiple computers, external hard drives kept elsewhere, network storage, and/or online storage.  Or do simple and quick backups: periodically email your essential files to yourself.

Advice part I (life and stress) here.
Advice part II (studying and attitudes) here.
Advice part III (back up your data) here.
Advice part IV (essay exams) here.
Advice part V (conclusory argumentation) here.
Advice part VI (incomplete argumentation) here.

According to the article, researchers have developed an effective technique to erase hard drives in minutes rather than hours:

The researchers concluded that permanent magnets are the best solution. Other methods, including burning disks with heat-generating thermite, crushing drives in presses, chemically destroying the media or frying them with microwaves all proved susceptible to sensitive, patient, recovery efforts.

The military need for such technology is obvious and is a simple no-brainer. But additionally interesting are the potential commercial and consumer applications of such technology. According to the article, the researchers claimed the magnetic eraser could be used to quickly erase VHS tapes, floppy drives, data cassettes and hard drives. Maybe someday soon, it will be unacceptable and even illegal for corporations and government agencies to keep sensitive information — like your social security number — on easily stolen laptops, unless those machines are equipped an effective auto-erasure mechanism.

What happens to . . . web logs if a person dies and their executor notifies [the weblog's host] of their demise. Can one leave their account, username, password and API key number to another person in their will?

What a great question! It reminds me of the case last year of Lance Corporal Justin Ellsworth, who died in Iraq. After his death, his family asked Yahoo for access to his emails. Yahoo refused. After a court ordered Yahoo to hand over the contents of the account, Yahoo complied. But the parallel to Ellsworth has its limits. With emails, there are significant concerns over privacy: it just cannot be assumed that every deceased person wants his or her executors and heirs poring through their private and potentially embarrassing emails.

In contrast, blogs are intended for some level of public consumption and the privacy issues generally don’t run as high. (Though even with blogs, privacy concerns can exist, such as with David Lat, the formerly anonymous “Article III Groupie” who writes Underneath Their Robes.) Indeed, although many blogs are quickly abandoned, others are intended to serve as lasting statements of authorship, whether professional or personal (or both). As timethief noted in a later post, “Blogging is now and will remain part of what defined me as a unique individual.” But blogs aren’t books or magazines. After we’re gone, existing copies of books we wrote can continue to exist without additional effort on the part of our estates or heirs. And our estates and heirs can’t force consumers to return legally acquired copies of books.

But the book analogy is hard to apply to blogs. Blogs aren’t material objects and they’ll disappear without maintenance or preservation. But long-term maintenance isn’t really practical, at least yet, for blogs whose owners have passed away. If hosting accounts aren’t kept active, or applicable payments stop, or hosting providers go out of business, or computers fail, or blogging code & databases become incompatible with future technologies, our blogs — like other web-only publications — may disappear or break. Plus, a blog might be shut down by an author’s estate or heirs, unless perhaps some sort of enforceable provisions can be made by the author that the blog be maintained posthumously.

Communal blogs like The Volokh Conspiracy stand a better chance of lengthy lives, since maintenance tasks can be undertaken as new members arrive. But most other sites, even highly successful ones like Howard Bashman’s How Appealing, are run by only one person. For an estate or heir, long-term maintenance after an author’s demise is not necessarily simple or — excuse the pun — appealing. In a rare case, successful blogs like Bashman’s could be valuable estate assets that would encourage continued maintenance and even eventual profitable transfer, but most blogs will utterly lack any such kind of maintenance incentive. (Of course, this is all illustrative, and Eugene and Howard should be blogging for many decades to come!)

This raises the question of digital preservation. Because long-term maintenance may not always be feasible, digital preservation of old sites becomes really important, and the utility of the Internet Archive’s Wayback Machine can’t be overstated. But I think that Wayback Machine is just the beginning of a dialogue over how — and when — to preserve web-only materials. Putting copyright issues to the side for the moment, the Internet Archive doesn’t archive all sites, and when it does, it archives some sites more often than others. Plus, it’s not entirely clear whether the Wayback Machine is currently capable of properly archiving all types of blogs: the Internet Archive states that sites that are database-driven or that generate dynamic web pages can’t be archived. I’d think this limitation could apply to at least some blogs (such as this WordPress blog, which is driven by a PHP & MySQL database).

But a quick review of the Wayback Machine suggests that, despite the disclaimer, the Internet Archive may be improving its ability to archive blogs — here’s links to a WordPress-run site that was archived incorrectly in March 2004, but appears to be much better represented in an archive from November 2004. Hopefully, the Internet Archive is continuing to improve its capability to archive different kinds of webpages. Needless to say, as web publishing technologies evolve, it will remain a struggle to find ways to accurately and authoritatively preserve such materials. My quick review of a number of blawgs suggests that some appear to have been pretty nicely archived, whereas others have not. I’ll address this more in a future post.

Thus, I think that timethief’s question — a really good one — leads to additional questions about whether web-only materials should be kept online, and if so, to even more questions about how, where, and by whom they should be maintained or preserved. I don’t think the answers to these questions are easy or obvious.