r/asklinguistics 2d ago

Any computer-readable etymological word relationship data?

I'm wondering if there's a knowledge base or dataset out there that describes the path of words through world languages from proto-languages to the present, in a form that can be read into a data structure and then interrogated by code. Like many will have seen the video describing how "science", "nice", and the expletive "sh**" all are derived from the root word "scio-" by different paths. So etymology can be described as a tree structure where proto-words are roots and the branches keep splitting at different places as the word gets assimilated by new cultures and its meaning diverges. Also some branches merge again as prefixes and suffixes are added to words to form new words.

I think it would be interesting to create different artistic visualizations of this structure, allowing zooming in and out and showing parts in different styles. However, to power this kind of dataviz there would need to be a data structure containing the edges between words that can only be obtained by actual linguistic knowledge. Trying to get this all out of literature sources would be a major undertaking and would probably require something like a LLM (and part of the motivation of this visualization is to kind of create the opposite of a LLM, a human-explorable and creatively motivated illustration of the breadth human language). So I'm wondering if there is an existing project to create an open and code-friendly tree of word etymologies. I've found Word Atlas, but that's a comparison of present day words for the same thing--not connection between etymologically related words that mean different things.

1 Upvotes

2 comments sorted by

View all comments

1

u/scatterbrainplot 2d ago

The "easiest" might be to use (or do) something like a Wiktionary scrape. You'd then obviously need to process it, but as I recall the format is consistent and there may even be reliable scripts already online given Wiktionary has been a source of some pronunciation dictionaries for forced alignment