Song Lyrics Generator is a Deep Learning model, particularly an RNN model, it is able to generate music lyrics starting from a string input.
Song Lyrics Generator is an RNN model, it is able to predict a song lyrics starting from an input string. An RNN model is a Deep Learning model, designed for Sequence-based tasks. The problem of generating the lyrics of a song from an input is modeled as predict next word multiple times, from the input to a fixed length text.
The data used in this project is aviable at https://www.kaggle.com/paultimothymooney/poetry. The dataset contains different song lyrics of multiple artists, like:
Kanye West, Lil Wayne, Adele, Beatles
Song Lyrics Dataset contains a file for each artist and each file contains different song lyrics of the artist. The total number of artists is 49.
Like mentioned before we used an RNN model.
RNN is a particular type of Neural Network, it is very usefull for sequence-based tasks or time series tasks. RNNs can take one or more input vectors and produce one or more output vectors and the output(s) are influenced not just by weights applied on inputs like a regular NN, but also by a “hidden” state vector representing the context based on prior input(s)/output(s).
The RNNs equations are the following:
Where:
- x(t) is the input at time t
- h(t) is the hidden state at time t, we can imagine it like a "memory"
- o(t) is the output at time t
- y(t) is the softmax of o(t)
- W, V and U are the network weights
Song Lyrics Generator model is the following:
Where embedding layer create the embedding of the input text, GRU is a type of RNN similar to LSTM but with fewer parameters, at the end the Output layer is a simple Dense Layer.
The parameters of the network are:
# Length of the vocabulary in chars
vocab_size = len(vocab)
# The embedding dimension
embedding_dim = 256
# Number of RNN units
rnn_units = 1024
INPUT: It's a rain day
OUTPUT:
It's a rain day
I'd love somebody for me My body [Chorus: x2] Delirious
(Yeah!)
(all night long)
Tell me what's new all again
(Bring the night is gone)
Why do niggaz?
Lett! This Korn Nos Foreward
Jaber not gonna go out nuttift
Prove that magic first chance
I wake up in a truer, sir, [Missy] No show, Maria, mamamage of a frage
And still, his spot tank (yeah)
Your gotta lose heard of kisses
I ain't saying you want to tell her hoe
Young and Id I got niggled in the risk
They say I'm the baddes, monster brings you goodless plan, I'm not too old bag its got an I skin
All birthday, all night (Woo, ah, ah, ah, a-ay-ay-ay-ay-ay-ay)
Alone shall Uhhuh but we suck him up
Well, I may be the only girl
And I'm a liabi-a-Beck it goe
It's been a long time
Since I cant never even sellion who u done
See now you're the liquor without your baby
Nobody but you, baby
Yeah, yeah, niggas know what it goes (arejbosh 'Cause that's making some change sense Oh boy, ot can cut you down) (I still go, to you who and you'll
To use the model you must download "model" folder from this repository and then use this function to load the model:
from tensorflow import keras
def get_trained_model(model_path):
model = keras.models.load_model(model_path)
return modelmodel_path is the path where you downloaded model folder
Samir Salman