Skip to content
This repository has been archived by the owner on Aug 3, 2024. It is now read-only.
/ lingo Public archive

Various (linguistic) applications of the BHSA data

License

Notifications You must be signed in to change notification settings

ETCBC/lingo

Repository files navigation

SWH Project Status: Unsupported – The project has reached a stable, usable state but the author(s) have ceased all work on it. A new maintainer may be desired.

lingo

Various (linguistic) applications of the BHSA data:

Minimal pairs

Compute pairs of words that have a limited edit distance. If the distance is 1, both words differ in exactly one character.

Various decisions have to be taken:

  • do we feed lexemes (lemmas) or word occurrences (both of course)
  • do we retain accents?
  • do use unicode normalization or denormalization?

We do not provide all options here. But the code is reasonably clear, so, clone it and go your own way!

Done for Hebrew and Greek.

Trees

Generate syntax trees from the Hebrew data. The notebook does all BHSA versions. De trees are exported in plain text in bracket notation. The output is in the repo.

Vocabulary

A simple notebook to produce list of Hebrew and Aramaic lexemes in order of decreasing frequency.

Voyant

If you want to put the data in a corpus form, you can use the notebook prepare.ipynb.

You can choose a text format and a granularity, and then the notebook will create a corpus for that in a local _temp directory. Then you can zip it and upload to text processing services such as Voyant.

Heads

Export edge relationships between phrases and their head words. A head word is defined as "the word that determines the syntactic category of that phrase" (wikipedia).

Author

Dirk Roorda