Skip to content

Showcase visualizations about Common Japanese Morphemes in YOASOBI Lyrics

Notifications You must be signed in to change notification settings

sakan811/Common-Japanese-Morphemes-in-YOASOBI-Lyrics

Repository files navigation

Table of Contents

Updates

Common Japanese Morphemes in YOASOBI Lyrics:

  • Project Latest Update: 24 July 2024

Common Japanese Words in YOASOBI Lyrics:

  • Project Latest Update: 24 July 2024

Disclaimers

  • Lyrics were based on genius.com
  • Lyrics of 26 YOASOBI songs

Visualizations

Common Japanese Morphemes in YOASOBI Lyrics:

Common Japanese Words in YOASOBI Lyrics:

Common Japanese Morphemes in YOASOBI Lyrics

Showcase visualizations about the common Japanese morphemes in YOASOBI's songs' lyrics.

Morphemes are the smallest units of meaning in a language.

Project Details

Japanese morphemes were extracted using SudachiPy and romanized using Cutlet.

Common Japanese Words in YOASOBI Lyrics

Showcase visualizations about the common Japanese words in YOASOBI's songs' lyrics.

This project is built on top of Common Japanese Morphemes in YOASOBI Lyrics project.

Project Details

Find the Japanese words by combining morphemes into words by looking up at the dictionary.

Japanese morphemes were extracted using SudachiPy and romanized using Cutlet.

JMdict was used for words look-up.

Codebase Details

Common Japanese Morphemes in YOASOBI Lyrics and Common Japanese Words in YOASOBI Lyrics projects share the same codebase.

Test Status

CodeQL

Scraper Test

To Scrape Japanese Morphemes from YOASOBI's Songs

  • Go to main.py
  • Run the script.
  • Data is saved to a SQLite database named yoasobi.db by default.
    • The database is created automatically if not exist in the given path.
    • You can adjust the name of the database as defined in main.py
      db_dir = 'yoasobi.db'  # adjust this variable to change the database's name
      

To Scrape Japanese Words from YOASOBI's Songs

  • Go to convert_morpheme_to_word.py
  • Run the script.
  • Data is saved to a SQLite database named yoasobi.db by default.
    • The database is created automatically if not exist in the given path.
    • You can adjust the name of the database as defined in convert_morpheme_to_word.py
      db = 'yoasobi.db'  # adjust this variable to change the database's name
      

scraper Package

data_extractor.py

  • Contain functions related to extracting the desired data.

data_transformer.py

  • Contain functions to transform the data.

sql_query.py

  • Return a specific SQL query.

utils.py

  • Contain utility functions.

web_scraper.py

  • Contain functions related to fetching content from the webpage.

db_func.py

  • Contain functions to related to the database.