Publishing houses are sitting on one of the most undervalued asset classes in the content economy: the backlist. Decades of titles, many existing only as print editions, film, or early digital files with no usable structure, represent content that cannot be searched, licensed, analyzed, or surfaced by any modern system. The frontlist gets the marketing budget. The backlist, which often spans thousands to tens of thousands of titles per publisher, sits in warehouses and archive rooms as inventory rather than as data.
Two market shifts have changed the economics of that neglect. The first is AI licensing. In late 2024, HarperCollins became the first Big Five publisher to license part of its backlist for AI training: an opt-in, three-year deal covering select nonfiction titles, at $ 5,000 per title, split evenly between author and publisher, with Bloomberg reporting that Microsoft was the counterparty.
Penguin Random House moved the opposite direction, adding explicit no-AI-training language to its copyright pages. Whatever position a publisher takes, both moves establish the same fact: the backlist is now a negotiable asset with a market price, and the market for licensed datasets in research and publishing was estimated at 381.8 million dollars in 2024 and projected to reach 1.59 billion dollars by 2030. The second shift is discoverability: recommendation systems, retail search, and AI-driven content surfaces can only recommend what they can read, and a title with no usable metadata is invisible to all of them.
Both opportunities run through the same gate: the catalog has to exist as rights-cleared, machine-readable data before any of it is possible. This blog covers what that conversion actually involves, from scanning through structure extraction, metadata enrichment, and the rights documentation that determines what can be licensed at all. AI data preparation services and text annotation services are the two capabilities most directly involved.
Key Takeaways
- The backlist has become a priced asset. The HarperCollins deal and the growth of the dataset licensing market established a commercial reality: legacy catalogs carry licensing value, but only in structured, rights-documented form.
- A scanned book is not an asset; a structured one is. Licensing, discoverability, and internal AI use all require machine-readable text with chapter organization, metadata, and rights status, none of which scanning alone produces.
- Rights metadata is the gating layer. A publisher cannot license what it cannot prove it controls. Contract-level rights documentation, digitized alongside the content, is what converts a catalog from an archive into a licensable portfolio.
- Legacy typography and formats break standard OCR. Pre-digital typesetting, hyphenation conventions, footnote layouts, and older typefaces produce systematic optical character recognition (OCR) errors that require publishing-specific correction workflows, not generic pipelines.
- Metadata drives the discoverability return. Rich subject, audience, and description metadata, aligned to industry standards such as ONIX, is what lets recommendation and retail systems surface backlist titles that have been commercially invisible for years.
Why the Backlist Went From Cost Center to Asset Class
The AI Licensing Market Arrived
Until recently, the commercial case for digitizing a deep backlist rested on modest ebook conversion revenue, which for slow-moving titles rarely justified the cost. AI licensing changed the arithmetic. Model developers need large volumes of high-quality, professionally edited long-form text, which is precisely what a publishing backlist is. The HarperCollins precedent demonstrated a per-title price and an opt-in structure that other publishers can now negotiate against. The surrounding litigation landscape has only increased the value of properly licensed content relative to scraped content. A publisher’s negotiating position in that market is determined by one thing it fully controls: whether its catalog exists as clean, rights-documented data that a counterparty can actually evaluate and ingest.
Discoverability Compounds Quietly
The second return stream is less headline-grabbing and more durable. Backlist titles fail to sell primarily because they fail to surface. Retail search, recommendation engines, and increasingly AI-mediated discovery all operate on metadata, and titles that predate modern metadata practice effectively do not exist to those systems. Publishers that have enriched backlist metadata consistently report renewed sales on titles that had been dormant for years, not because demand appeared, but because the supply finally became visible to the systems that route demand.
What Conversion Actually Involves
Stage 1: Intake and Condition Assessment
A legacy catalog arrives in mixed physical states: bound copies in good condition, brittle acidic paper from mid-century printings, film and fiche from earlier preservation efforts, and early digital files in obsolete typesetting formats. Intake assessment classifies each title by source condition and routes it accordingly, because the scanning approach for a fragile 1950s printing differs from a 1990s paperback, and a surviving typesetting file may bypass scanning entirely. Condition assessment also sets priority: deteriorating titles carry irreversible loss risk and jump the queue regardless of commercial ranking.
Stage 2: Capture and Publishing-Specific OCR
Book scanning at production quality is a solved logistics problem; accurate text extraction from legacy typography is not. Pre-digital typesetting produces systematic OCR failures that generic pipelines pass through silently: end-of-line hyphenation rejoined incorrectly, ligatures in older typefaces misread as character pairs, footnotes and running heads interleaved into body text, drop caps breaking the first sentence of every chapter, and multi-column or verse layouts scrambled into reading-order errors. A publishing-specific pipeline layers correction models tuned to these patterns and applies confidence-based routing, in which low-confidence pages go to human review rather than into the corpus with silent errors.
The scale of the difference is easy to state concretely. A 300-page book runs on the order of 600,000 characters, so a corpus delivered at 99.5 percent character accuracy still carries roughly 3,000 character errors per title, while 99.95 percent brings that to about 300. In our experience with legacy typeset material, the routing threshold that makes the second number achievable at catalog scale is confidence-based: pages where OCR confidence falls below roughly 80 to 85 percent go to human review, which concentrates reviewer time on the small fraction of pages where correction models are least reliable. For licensing use cases, this arithmetic matters commercially: text quality is inspectable by the counterparty, and a corpus with visible OCR noise is a corpus that prices lower.
Stage 3: Structure Extraction
Machine-readable text without structure is a single undifferentiated string. Structure extraction identifies the document architecture: front matter, chapters and sections, footnotes and endnotes linked to their anchors, tables, verse and quotation blocks, and back matter including indexes and bibliographies. This architectural layer is what makes the content usable beyond simple reading: chapter-level licensing, excerpt generation, accessibility formats, and any AI application that needs to know where one logical unit ends and the next begins all depend on it.
Stage 4: Metadata Enrichment
Descriptive metadata is where discoverability lives. Subject classification against current schemes, audience and reading-level indicators, series and edition relationships, contributor roles, and rich descriptions are organized into industry-standard formats, with ONIX (the publishing industry’s standard for communicating product information, currently ONIX 3.0) as the distribution baseline. For deep backlists, the enrichment work is substantial precisely because the older the title, the thinner its existing metadata. Text annotation services with publishing-domain training handle the classification and description work at catalog scale while holding consistency across thousands of titles, which is the property that catalog-wide enrichment lives or dies on.
Stage 5: Rights Documentation, the Gating Layer
This is the stage that determines whether the licensing opportunity is real. A publisher cannot license what it cannot prove it controls, and for legacy titles the controlling documents are author contracts, amendments, reversion clauses, and territory grants that themselves exist on paper in filing rooms. Rights conversion runs the same digitization discipline against the contract archive: capture, extraction of the operative terms, and a rights database built to answer, per title, the questions a licensing counterparty will ask. Which rights are held, in which territories, with what reversion conditions, and with what obligations to authors, including whether AI training use requires new consent, as the opt-in design of the HarperCollins deal reflects. In our experience, publishers consistently underestimate this stage; it is also the one that most directly converts the catalog from an archive into a portfolio.
Stage 6: Quality Assurance and Delivery
Catalog conversion is a volume operation, and QA at volume is statistical: sampling designs calibrated to title value, text-accuracy verification against the scanned source, structural validation, and metadata consistency checks across the catalog rather than within single titles. Delivery formats follow the use case: EPUB 3 and ONIX 3.0 feeds for distribution, XML or TEI markup where scholarly and archival structure matters, JSONL corpus formats for licensing data rooms, and database loads for internal search and analytics.
If your backlist strategy conversation has reached the licensing question but not the rights-documentation question, it has skipped the gating step. Talk to an expert.
How Digital Divide Data Can Help
Whether a publisher builds this capability internally or with a partner, the conversion program needs the same components: publishing-tuned extraction, catalog-scale enrichment, a rights database, and delivery pipelines. Producing those is the work we do.
The text layer comes first: AI data preparation runs capture, and OCR tuned to legacy typography, with the confidence-routed human review described above, so hyphenation, ligature, and layout errors are corrected rather than silently passed into the corpus.
On top of it, text annotation teams handle structure extraction, ONIX-aligned metadata enrichment, and the contract-level rights extraction that turns a filing room into a queryable rights database, the layer that decides what can be licensed at all.
And because the value is realized in systems, data engineering for AI builds the delivery pipelines: licensing-ready corpus formats, distribution feeds, and internal search that make the converted catalog usable rather than merely converted.
If your catalog assessment starts with two questions, what condition is the archive in, and where are the contracts, that is the assessment we run. Talk to an expert.
Conclusion
The backlist stopped being a storage problem the moment it acquired a market price. Whether a publisher’s strategy is to license, to withhold and protect, or to rebuild discoverability revenue, every option requires the same underlying conversion: from shelves of print and filing rooms of contracts into machine-readable text, rich metadata, and documented rights. The publishers moving first are not necessarily the largest; they are the ones that treated conversion as asset development rather than archiving.
The clarifying question for any publishing leadership team is direct: if a licensing counterparty asked tomorrow which titles you could deliver as clean text with documented AI-training rights, how many of your thousands of backlist titles could you actually put on that list?
References
Publishers Weekly. (2024, November). Agents, authors question HarperCollins AI deal. https://www.publishersweekly.com/pw/by-topic/industry-news/publisher-news/article/96533-agents-authors-question-harpercollins-ai-deal.html
ManuscriptReport. (2026). AI in publishing: 2026 statistics and primary sources. https://manuscriptreport.com/data/ai-publishing-statistics
Grand View Research. (2025). AI datasets and licensing for academic research and publishing market report, 2030. https://www.grandviewresearch.com/industry-analysis/ai-datasets-licensing-academic-research-publishing-market-report
Frequently Asked Questions
Q1. Our backlist is already available as ebooks. Doesn’t that mean the conversion work is done?
Partially, and usually less than expected. Ebook files produced during early conversion waves frequently contain the OCR errors of their era, lack markup beyond basic chapter breaks, and carry minimal metadata. More importantly, an ebook file answers the reading use case, not the licensing one: a licensing counterparty evaluates text accuracy, structural cleanliness, and rights documentation, and an early-2000s conversion typically satisfies none of the three at portfolio standard. An audit that samples the existing ebook files against these criteria is the fast way to learn how much of the work genuinely remains.
Q2. Should we license our catalog for AI training or protect it? Does conversion commit us to a position?
Conversion is deliberately position-neutral, which is part of its value. The HarperCollins licensing path and the Penguin Random House protective path both depend on the same underlying asset: knowing precisely what the catalog contains and what rights attach to each title. A publisher that withholds needs the rights database to enforce and to detect infringement; a publisher that licenses needs it to negotiate and to compensate authors correctly under opt-in models. The strategic decision can be deferred; the conversion that enables either decision cannot, because its lead time is measured in quarters.
Q3. How should a publisher prioritize which titles to convert first?
Three factors, weighted by strategy. Physical condition leads regardless of strategy, because deteriorating titles are the only irreversible category. Commercial signal comes second: titles with existing demand evidence, series attached to active frontlist, or subject areas with licensing interest. Rights clarity is the third and most overlooked factor: titles whose contracts are already located and unambiguous can reach licensable status quickly, while titles with missing or contested documentation should enter the rights-research queue early precisely because that queue is the slowest. In our experience, sequencing by rights clarity rather than purely by sales rank shortens the time to a first licensable tranche considerably.
Q4. What accuracy standard does AI licensing actually require for the text?
There is no single published threshold, and counterparties evaluate corpora individually, but the commercial logic is consistent: text quality is inspectable, and visible OCR noise gives the buyer both a quality argument and a price argument. The practical standard is that systematic error classes, hyphenation artifacts, ligature misreads, and interleaved footnotes are eliminated as classes rather than caught title by title, with human review concentrated on the low-confidence pages where correction models are least reliable. A corpus that can document its QA methodology, sampling rates, and measured accuracy negotiates from a materially stronger position than one that asserts quality without evidence.
Q5. Our author contracts predate AI entirely. Can those titles be licensed at all?
This is a legal determination that belongs with publishing counsel, and the honest general answer is that it depends on the grant language in each contract, which is exactly why the rights documentation stage exists. What the conversion program contributes is the factual foundation: extracting the operative clauses so counsel evaluates actual language rather than institutional memory, and flagging the title-by-title distinctions, broad grants, narrow grants, reverted rights, and silent contracts that determine which titles need author consent mechanisms of the kind established by the opt-in precedent. Publishers that route this through a well-built rights database resolve the question per title; publishers that route it through filing cabinets resolve it per lawsuit.
Asit Dubey is a global operations leader with almost 30 years of experience across digitization, publishing, AI/ML, and LegalTech, currently serving as Executive Vice President at Digital Divide Data. He has led large-scale operations (3,500+ workforce) across APAC, EMEA, and North America, driving AI-led transformation and process excellence. A Six Sigma Black Belt, he specializes in automation, solutioning, and cost optimization, delivering productivity gains of over 300% and significant margin improvements. He has successfully scaled revenues from $750K to $3M+ monthly while turning around underperforming units. His expertise spans global delivery setup, GTM strategy, and client engagement. He is known for building resilient, multi-geo delivery models and enabling organizations to transition to AI-powered services.
