Building an Archive in Public: Websites as a Strategy for Generating Research

Michael J. Gagnon

Judge Augustin Smith Clayton (1783–1839). Courtesy of Hargrett Rare Book and Manuscript Library / University of Georgia Libraries.

I started my website, EarlyUSHistory.net, following a pedagogy workshop at Emory University entitled “A Domain of One’s Own,” in 2014 to organize my research on a biography of Augustin Smith Clayton, a jurist and politician from Georgia. He played a supporting role in all the major national events from 1831 to 1835: Indian removal, the Bank War, the Democratic Party’s first national convention, the Nullification Crisis, and the formation of the Whig Party. While mentioned as a possible Whig vice-presidential nominee in 1835, Clayton’s health declined and he died at the age of 56 in 1839. People across the U.S. in the 1830s knew “Judge Clayton of Georgia” for better or for worse, and newspapers all over the country printed his obituary. When Thomas Hart Benton wrote his memoir of the era many years later, he wrote Clayton out of the story because nobody outside Georgia remembered him.

I had already started the research on Clayton before the workshop piqued my interest in using a website as a means of organizing and sharing my research. In researching my dissertation in the 1990s, I had used a database system called askSam to sort my research, but that approach required tremendous hours of transcription. Then askSam became obsolete, and I was forced to find something else, preferably something easier. A webpage seemed the answer for several reasons. First, it allowed me to lay out my sources chronologically so that I could “read” the story as it emerged, and see how nuances evolved as I inserted new sources into the existing chronology. Second, it provided a form of cloud storage of my research so I would not worry about losing data if something happened to my computer. Most important, it allowed me to share my research with others without having to make special efforts. Given the length of time it takes to publish, I think I owe those strangers, who opened their homes to me to share what they possessed, early access to what I’m doing with the sources entrusted to them for posterity. As my webpage grew, I divided my research thematically into separate webpages, and then posted the research chronologically within that themed webpage. Thus, I wound up with a website rather than a single webpage, and eventually created two domains: one for my personal life and another for my professional research.

The process of posting the research is pretty simple, and demonstrates that I came to academic history through a career in files management and archives. After discovering a newspaper article in a historic newspaper database like Chronicling America, I download the pdf of the page and open it in Adobe Acrobat, crop out the columns I need and weave them together as pages within the file, if need be. For documents found in archives or people’s homes, I convert the photo image of a document into a pdf. Occasionally I will transcribe a document obtained from an archive or published source if I am worried about copyright issues. For basic filing of Adobe files, I use the date (in numeric form) of the original creation of the document as the first part of the document title, starting with year, and then month and date. I complete the name with a lengthy note of provenance and short note describing the information it contains. Then I upload the documents to the storage for my website, and insert links to them in the appropriate webpage in the correct chronological order. For every document, I attempt to give a full citation, and credit to any specific place or person who provided it to me. I do the same for links to documents I find on the web.

For researching published primary documents, I came to rely on Google Books and the Internet Archive for full text scans. Sadly, searches in these databases rarely result in quickly finding what you want, so I organized pages of links in order to find things quickly for myself. On the main 19th Century Newspapers page, I have links to full runs of Niles’ Register, DeBow’s Review, Hunts’ Merchant Magazine, and Missionary Herald, among others. Each collection of external links that constitute a “run” took about 40 hours of work to save myself and everyone else future hours of labor. I don’t provide modern indexes to these sources, but if you have citations, you can find what you need.

From the start, I planned to share my research with my students to get them to write interesting term papers. I was encouraged to act on my impulses when my college funded some of my research trips with a requirement that I create something useful for pedagogy from my research. My research on Clayton provides plenty of primary information with which to explore any number of early republic and southern history topics. I teach my students to share their research as I have done, even if they find something really good, because nobody else is ever going to bring to the writing of the paper what they know and choose to focus upon. I try to teach that sharing broadens all of our knowledge and does not diminish what we can accomplish.

This upcoming year, I will use several Clayton pages in my upper division classes. Early republic students will use the Bank Warpage to explore the day-to-day business of the Bank Committee leaving Washington to investigate the BUS in Philadelphia in March & April 1832, taking testimony, and interacting with other committee members. The links to John Quincy Adams’s diary entries for this time are particularly great for this, and Adams doesn’t hold back in privately expressing his contempt for Clayton, even after participating in social outings together. I also use these sources for creating short activities not unlike “reacting to the past” in which students research primary documents on historical events to work with a script to re-enact the event from a more personal perspective. The early republic class will spend a day re-enacting the 1832 Baltimore Democratic National Conventionto nominate Martin Van Buren for the vice presidency. In my southern history class, students will similarly access the Cherokee Removal webpage to explore the trial (which took place in the town in which my college is located) of the missionaries to the Cherokee in 1831 that led to the 1832 Worcester v. Georgia Supreme Court decision. I like to get students to think about history as a set of processes rather than a set of facts, and using these sources allows me to do that.

United States Hotel in Philadelphia immediately across Chestnut Street from the 2nd BUS, served as home base for the Bank Investigating Committee in 1832. Image courtesy of the Library Company of Philadelphia.

Finally, this past year I found using a website particularly useful in organizing an edited collection of essays for scholarly publication. After my co-editor and I recruited about 15 scholars to write essays for this collection, we posted drafts of chapters in hidden webpages as we went along so all participants could see where we stood at each turning point in the process. This is great for projects that need a little, but not a lot, of security. Our scholarly press downloaded our manuscript and suggested images from that website, and we made corrections requested by the press and again posted the revised files to the website, which proved easier than using something like Dropbox or Sharepoint for sharing our files. Watch for the book’s publication early next year.

Since starting the use of webpages, I tried using other new software as a means of organizing my research. For example, I found Zotero a bit clunky, and it clearly was not really intended to use for sharing. I prefer using the webpages because they are more visual, and I don’t mind working out the citations by hand, which gives me better knowledge of each document than I would have from merely copying, reading, and filing it. As original research, I’d still need to enter similar information into Zotero too, so it doesn’t seem all that much more work to me.

I started this project as a private domain rather than as a page in my school’s website because it gave me greater control over the look of the webpage, since most colleges today like to standardize websites for branding purposes. That doesn’t mean I won’t eventually turn the site over to my college. That would save me $100 per year in costs and guarantee continuity of the website after I move on to other things.

The real payout to me is the hope that I won’t be the last person to use the data I spent so much time collecting and assembling. While I will publish a biography of Clayton eventually, I want others to take my raw data in directions I did not imagine. I want these webpages to excite others to generate their own analysis of topics I care about. Like the senior (often retiring) scholars who shared their sources with me when I was new to the field, and encouraged me to mold them to my own purposes, I want to do the same.

30 July 2021

About the Author

Michael J. Gagnon is associate professor of history at Georgia Gwinnett College.

Share this Post
13 replies
  1. Matthew Schoenbachler
    Matthew Schoenbachler says:

    Michael’s websites are an amazing resource. His Niles’ Register page, for example, neatly chronologically presents the publication’s entire run from 1811 to 1849.
    The Bank War collection is likewise very impressive. Check it out.

    Reply
  2. Steve Campbell
    Steve Campbell says:

    I have long admired and took advantage of Michael’s website. As his post demonstrates, he has always been ahead of the curve when it comes to adopting new technology in a logical and well organized fashion. In particular, I recommend looking at his Bank War page, which presents primary source material related to the House select committee led by Clayton that was charged with investigating the Second Bank of the United States in the spring of 1832. The culmination of the investigation resulted in a three-part 500+ page congressional report, H.R. 460, originally published in the Congressional Serial Set and now digitized and available to the public. This is a topic I cover in my book and a must-see for any historian interested in the Bank War or Jacksonian Era politics writ large.

    Reply
  3. William Earle
    William Earle says:

    With regard to the 75 volumes of Niles’ Register, my own particular hobbyhorse, Michael Gagnon’s webpages greatly simplify the process of getting to a particular volume. It’s a very useful service for those of us who refer to the Register frequently. For anyone seeking a citation to track down in the volumes of the Register, try my own index to the 75 volumes, which can be found at the Maryland State Archives —

    http://speccol.msa.maryland.gov/NilesRegister/pages/NilesRegisterSearch.aspx

    William Earle, Editor, Niles’ Register Cumulative Index

    Reply
  4. Nan Clarke
    Nan Clarke says:

    Michael’s Missionary Herald links are a godsend for anyone researching evangelicalism in the first half of the nineteenth century, and the foreign mission movement it spawned. Each yearly issue includes hundreds of pages of correspondence, reports and journal entries that passed between missionaries stationed overseas and their sponsoring board in Boston.
    The pages are searchable, so if the researcher is looking for, say, cholera in Bombay in the 1821 Missionary Herald, he can make quick work of that task.

    Reply
  5. Julia Brock
    Julia Brock says:

    Thanks for this post, Michael. I’d echo your thoughts on the importance of digital work for scholarship and teaching. A website like the one you’ve created is also a tool for public engagement. I wonder if the site has led to interaction with/reactions from the interested public?

    Reply
    • Michael Gagnon
      Michael Gagnon says:

      Julia
      Most of the responses from the general public are very specific, “do you have anything about … ?” But that does mean that people do find and read my website. I once received a request for information on African-American newspapers in response to my newspapers page. I responded with a long post on the blog associated with my website. I intended to post more on “how to” search for information so the general public could do their own searches to turn up things, much like I have done. It took a bit of time to think the blog post through, and given the limits of what counts for promotion, I put future blog posts like that on hold for the foreseeable future. It is sad when tenure or promotion considerations limit our intellectual horizons instead of expanding them.

      Reply
  6. Phil Agee
    Phil Agee says:

    The highly granular views into the bank war and Cherokee removal have been exceedingly helpful. An archive of this size built by one person is especially impressive when one considers that there is a description and citation for each of the 400+ items on the Clayton family, 550+ items on Cherokee removal, 750+ items on banking, and 850+ items on additional related topics. The site would seem to fill a crucial space between immense archives such as NARA or LOC and archives such as the visually immersive Digital Paxton project. It might be a stretch, but perhaps the “raw data” approach could be likened to the vinyl record versus the CD or the MP3, offering both a higher fidelity to and a more transparent view into the scholar’s sources. Digital archive platforms such as Scalar have their benefits, especially for environments such as primary and secondary level education. Archives with light annotating by the historian offer students in higher education and researchers equally important curation, plus unobstructed access to the artifacts. In addition to making the most out of the time collecting and assembling, earlyushistory.net offers a model for others to follow for their own archives. The question becomes how can scholars’ own public-domain archives be open-sourced with a minimum of manual effort. I might suggest to the extent permissible using a couple of plugins: a PDF-Lightbox viewer that would allow the reader to easily click through, select, and view documents and a plugin for full text searching of the PDFs.

    Reply
    • Michael Gagnon
      Michael Gagnon says:

      Phil
      Thank-you for such a thoughtful reply. I’ll have to look at the plug-ins as I migrate my websites to my school’s Digital Humanities Center over the next year. My school, the School of Liberal Arts at Georgia Gwinnett College, only decided to take on my site as one of 3 center pieces for the opening of their collection early next year.. My webpages won’t suddenly disappear as many such sites have done in the past. Once migrated, I will post announcements on my website well in advance, and then maintain the original sites for a year or so after I migrated all the content for permanent access by scholars and the general public. I share your hope that this will serve as a model for others to emulate, and I hope that the field will recognize this sort of effort as scholarship. After all, if I wrote an article about this in a scholarly journal, that would count as scholarship. Shouldn’t doing something you could later write about also count? People don’t usually review archives, they use them. As more work goes digital, hopefully those who regulate what constitutes scholarship will understand that what constitutes the forms of scholarship is changing too.

      Reply
  7. Lisa Crutchfield
    Lisa Crutchfield says:

    I have used Michael’s collections for both my own scholarly work and as a great resource for class assignments and student research. I’m grateful to have quick, organized, easy access to so much primary source material on a variety of Jacksonian era topics. But I’m most appreciative of Michael’s willingness to share–and to read here his articulations of why that is important and how the digital humanities can help us succeed in those goals.

    Reply

Leave a Reply

Want to join the discussion?
Feel free to contribute!

Leave a Reply to Julia Brock Cancel reply

Your email address will not be published. Required fields are marked *