Thomas Hodgson
image/svg+xml Follow

What can I read to learn about best practice for storing data in a digital humanities project? In particular, a database of historical records.


could you be a bit more specific? are you asking about backup best practices, or designing a project so that the data is future proof and accessible?

I know some things about the latter, but most of what I've learned I've picked up from people in the field.

@omniadisce I was thinking more about best practice than backups. Not that backups aren't good.

@twsh @omniadisce I can think of worst practices for data sets that I've seen in the medical literature :P


if what you're asking about is the way to take a set of historical records, edit them, and publish them in a robust and futureproof digital format, I think most people would agree that TEI-XML is the currently the standard for scholarly textual markup, which can then be served to users in a variety of ways

detailed examples here:

XML presupposes you're OK with data in a hierarchical data model. if you're working with literary texts this can be problematic


do let me know if you want specific advice about tools, programs, or further reading

as it happens, I'm in the early stages of planning a TEI project for some historical materials myself

@omniadisce I might well do that when I have a clearer idea of what it is I'm doing.


all of the replacements for TEI are pretty bleeding edge and/or experimental at this point

but for historians, the issues with the XML data model may be unimportant (and in fact, many many lit scholars are fine with the tradeoff)

Sign in to participate in the conversation
Scholar Social

A Mastodon instance for academics

Scholar Social is meant for: researchers, grad students, librarians, archivists, undergrads, academically inclined high schoolers, educators of all levels, journal editors, research assistants, professors, administrators—anyone involved in academia who is willing to engage with others respectfully.

We strive to be a safe space for queer people and other minorities, recognizing that there can only be academic freedom where the existence and validity of interlocutors' identities is taken as axiomatic.

"A Mastodon profile you can be proud to put on the last slide of a presentation at a conference"

"Official" monthly journal club!

(Participation is, of course, optional)

Scholar Social features a monthly "official" journal club, in which we try to read and comment on a paper of interest.

Any user of Scholar Social can suggest an article by sending the DOI by direct message to and one will be chosen by random lottery on the last day of the month. We ask that you only submit articles that are from *outside* your own field of study to try to ensure that the papers we read are accessible and interesting to non-experts.

Read more ...