Hand-written Text Recognition: Harnessing the Power of Artificial Intelligence to Transcribe and Search

Yvette Hoitink, MLitt, CG®, QG
Jun 27, 2025
641 views
CC
SyllabusSyllabus
SyllabusSyllabus

About this webinar

Hand-written text recognition software can turn manuscripts into searchable transcriptions. Learn how to use these tools and what they can (and cannot) do for you. The presentation includes a demonstration of Transkribus.

About the speaker

Yvette Hoitink, MLitt, CG®, QG TM is a professional genealogist, writer, and lecturer from the Netherlands who specializes in researching Dutch ancestors. Her Dutch Genealogy website has helped thousa...
Learn more...

Key points and insights

As part of the exclusive “Artificial Intelligence for Genealogists” series, this webinar explores how AI-powered tools—specifically the software Transkribus—are revolutionizing the transcription of historical handwritten records. For genealogists, this technology represents a transformative opportunity to uncover hidden ancestral details, make vast record sets searchable, and overcome longstanding research brick walls with increased accuracy and efficiency.

Key Takeaways:

  • Transkribus Offers Powerful AI-Driven Transcription for Handwritten Records:
    Transkribus uses advanced neural networks trained on historical documents to convert scanned handwritten texts into searchable machine-readable formats. This makes it especially useful for processing large, unindexed archives, even in unfamiliar languages or difficult handwriting styles.

  • Handwritten Text Recognition (HTR) Outperforms Large Language Models (LLMs) for Transcription Accuracy:
    Hoitink’s comparison between Transkribus and tools like ChatGPT revealed that purpose-built HTR systems provide significantly more reliable and text-faithful transcriptions, especially with obscure names or foreign scripts. Unlike LLMs, Transkribus does not “hallucinate” plausible but incorrect content.

  • HTR Enables Advanced Research Strategies and Breakthrough Discoveries:
    By transcribing thousands of pages from Dutch court records, Hoitink uncovered over 100 relevant documents for a single client, reconstructing family lines back to the early 1500s. She also shared methods for using HTR outputs in full-text searches—such as wildcard searches, associative name targeting, and land description matching—to find records beyond traditional indexing systems.

To see how this powerful technology can elevate your own research, be sure to watch the full webinar. Yvette Hoitink’s hands-on demonstrations and real-world case studies provide practical guidance and a clear understanding of both the strengths and limitations of AI-driven transcription tools.

For those ready to dive deeper, don't miss the wealth of supplemental materials provided in the webinar syllabus. It includes step-by-step instructions, model selection advice, and links to further tutorials—essential tools for any genealogist looking to expand their digital skillset and uncover new ancestral insights through the power of AI.

Comments (105)

Sort byNewest
  1. JM
    Joy Metcalf
    6 months ago

    I have had very little success using Transkribus with 1800's Italian script. What I got was total gobbledygook, resembling no language I could think of. Running it through a translation program gave me back pretty much what went in Even AI couldn't figure it out.\n\nWhat is my greatest question, though, is how to get a good transcription from an image that combines printing and handwriting.

    1Reply
    • YH
      Yvette Hoitink
      6 months ago

      That is too bad. It all depends on the availability of good models. Have you tried different models? Have you verified that the language is in fact Italian rather than say Latin? Worst case, if you have a lot of pages to transcribe, you could try transcribing 20 images and train your own model.

  2. VR
    Vicki Roberts
    7 months ago

    I used ChatGPT for transcribing a deed and it totally hallucinated. It was a good reminder to check everything after a transcription.

    1Reply
    • YH
      Yvette Hoitink
      6 months ago

      Yes, that is why I prefer Transkribus fo this task.

  3. ES
    Elsa Santillan
    7 months ago

    Sorr, I meant 18th century Spanish.

  4. ES
    Elsa Santillan
    7 months ago

    Can this app transcribe from 18th Spanish?

    1Reply
    • YH
      Yvette Hoitink
      7 months ago

      There are several models for Spanish that are trained on a variety of records, which I think should be able to handle 18th century. The free model Coloso Español is trained on texts from the medieval to the modern period, so that's where I would start.

  5. CP
    Carol Pena
    7 months ago

    Fantastic presentation with very thorough examples and explanations. Loved the side-by-side example of a transcription between Transkribus and ChatGPT. I myself have had the experience of the LLM completely hallucinating the results of the document. I feel prepared to give Transkribus a try! Thank you!

  6. WV
    Webinar Viewer
    7 months ago

    Wow! I had never heard of Transkribus. It certainly sounds like it will be worth investigating, especially from a genealogy angle!

  7. WV
    Webinar Viewer
    7 months ago

    Yvette is a fantastic presenter! And great slides.

  8. WV
    Webinar Viewer
    7 months ago

    Fascinating topic well explained! Can't wait to try it out!!

Related webinars

The Best Uses of AI for Genealogists
Play video01:44:06
AI Video Creation for Genealogy
Play video01:13:05
AI Video Creation for Genealogy
241 views
CC
Five Reasons to Build a Genealogy Website
Play video00:19:11
Five Reasons to Build a Genealogy Website
537 views
CC
Shared DNA at a glance: the new DNA matrix tool
Play video01:04:18
Shared DNA at a glance: the new DNA matrix tool
3.1K views
CCFree
Hand-written Text Recognition: Harnessing the Power of Artificial Intelligence to Transcribe and Search - Legacy Family Tree Webinars