Q. Which Harvard Library databases are available for text mining?

Several of Harvard Library's databases allow text and data mining for research purposes under certain conditions: 

ProQuest

A large amount of content that Harvard subscribes to through ProQuest is available through their Text Data Mining platform (contact a librarian to learn more). Some highlights include:

• ProQuest American Periodicals 
• ProQuest Congressional: 
  • Congressional Record, 1789-1997 
    (For additional date ranges of the Congressional Record, you can also try the API developed by the University of North Texas.)
  • House and Senate Published Hearings, 1824-2003 
  • House Unpublished Hearings, 1973-1980  
  • Senate Unpublished Hearings, 1985-1990 
  • NOTE: Congressional materials are not available by default, but may be upon request.
• ProQuest Historical Annual Reports, 1844-2008
• ProQuest Historical Newspapers, including: 
  • Atlanta Constitution, 1868-1930
  • New York Times, 1851-1933
  • New York Times Index, 1851-1993
  • Wall Street Journal, 1889-1932
  • More information on newspapers available for TDM via ProQuest is available from Baker Library at HBS.

Gale NewsVault 

• British Library Newspapers, parts I-V, 1800-1950
• Daily Mail Historical Archive 
• Economist Historical Archive, 1843-2012 
• Times Digital Archive, 1785-2006

JSTOR

Some JSTOR text-analysis functionality is available using their Constellate service, though programmatic access to the data itself is not available to Harvard users.

HathiTrust

HathiTrust allows text mining, subject to certain conditions, via the HathiTrust Research Center (HTRC). The HathiTrust policies are posted at http://www.hathitrust.org/datasets.

ScienceDirect 

Elsevier allows some text mining of content in its ScienceDirect database that Harvard subscribes to. For details on Elsevier's policy, as well instructions for accessing and using their API, please consult the Elsevier website. 

Please contact an HKS Librarian for more information about text-mining the above resources.