Fine-tuning an LLM to generate musical micro-genres
-
Updated
Aug 5, 2024 - Python
Fine-tuning an LLM to generate musical micro-genres
The task of this project is to Convert Natural Language to SQL Queries
PEFT and LoRA to fine-tune large language models for dialogue summarization, reducing computational resources for broader application.
My lab work of “Generative AI with Large Language Models” course offered by DeepLearning.AI and Amazon Web Services on coursera.
High Quality Image Generation Model - Powered with NVIDIA A100
Comparing popular Parameter Efficient Fine-Tuning (PEFT) techniques for Large Language Models
[SIGIR'24] The official implementation code of MOELoRA.
FineTuning LLMs on conversational medical dataset.
A GPT-Neo model is fine tuned on a custom dataset using huggingface transformers package
For this project, I fine-tuned two separate models for three tasks: document summarization, dialogue summarization and text classification
PEFT is a wonderful tool that enables training a very large model in a low resource environment. Quantization and PEFT will enable widespread adoption of LLM.
[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
A bash scripting assistant that helps you automate tasks. Powered by a streamlit chat interface, A finetuned nl2bash model generates bash code from natural language descriptions provided by the user
Fine Tuning pegasus and flan-t5 pre-trained language model on dialogsum datasets for conversation summarization to to optimize context window in RAG-LLMs
Fine-tuning Llama3 8b to generate JSON formats for arithmetic questions and process the output to perform calculations.
Mistral and Mixtral (MoE) from scratch
memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B
This repo contains everything about transformers and NLP.
LLM projects
Add a description, image, and links to the peft-fine-tuning-llm topic page so that developers can more easily learn about it.
To associate your repository with the peft-fine-tuning-llm topic, visit your repo's landing page and select "manage topics."