Abashed the Devil Stood

Zachary  ·  February 22, 2026

Milton is an experiment in training a language model entirely on — you guessed it — John Milton’s 80,000-word epic Paradise Lost. First published in 1667, Paradise Lost spans every facet of the human condition across 10,565 lines and 12 books. Of slight coincidence, I happen to collect early printings of Paradise Lost. I think my oldest copy is from the early 1700s. Regardless, Milton is now a 35 million parameter SLM that lives in my laptop.

Abashed the devil stood, / And felt how awful goodness is, and saw / Virtue in her shape how lovely — saw, and pined / His loss; but chiefly to find here observed / His lustre visibly impaired; yet seemed / Undaunted.

Paradise Lost, Book IV, lines 846–851
View Experiment Title page of a 1770 printing of Paradise Lost