Enlightenment Ideals and Belief in Progress in the Run-up to the Industrial Revolution: A Textual Analysis

This paper tests Joel Mokyr’s claim that Britain’s industrialization was preceded and enabled by a cultural shift — specifically, that Enlightenment ideals produced a “progress-oriented” view of science that diffused to artisans and craftsmen. The central research question is whether and when the language of science became more progress-oriented in the build-up to the Industrial Revolution, and whether this shift was concentrated in volumes directly linked to industrial production.

The authors assemble 173,031 unique volumes printed in England and written in English between 1500 and 1900, drawn from the Hathitrust Digital Library. Because copyright law prohibits downloading full text, they use HDL’s Extracted-Features “bag of words” dataset. After removing duplicates and Latin-language volumes from an initial set of 420,081, they apply Latent Dirichlet Allocation (LDA) with cross-validated perplexity minimization to identify an optimal T=60 topics. Topic-pair co-occurrence analysis identifies three categories — science, religion, and political economy — each anchored by three defining topics. Volume-level category weights are derived by multiplying each topic’s weight by its category coefficient. The resulting classification yields 50,090 science volumes, 102,565 political economy volumes, and 14,124 religion volumes.

Austin Kennedy | Macro Paper Warehouse

Enlightenment Ideals and Belief in Progress in the Run-up to the Industrial Revolution: A Textual Analysis