We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When I run the following command, an error will be reported. My command is as follows: `deepspeed --include localhost:0,1 --master_port 65500 --module tevatron.retriever.driver.train --deepspeed ../deepspeed/ds_zero3_config.json --output_dir retriever-mistral-v0.1 --model_name_or_path ../../e5-mistral-7b-instruct/ --lora --lora_target_modules q_proj,k_proj,v_proj,o_proj,down_proj,up_proj,gate_proj --save_steps 50 --dataset_path ../../data/train_demo.jsonl --query_prefix "Query: " --passage_prefix "Passage: " --bf16 --pooling eos --append_eos_token --normalize --temperature 0.01 --per_device_train_batch_size 8 --gradient_checkpointing --train_group_size 16 --learning_rate 1e-4 --query_max_len 32 --passage_max_len 156 --num_train_epochs 1 --logging_steps 10 --overwrite_output_dir --gradient_accumulation_steps 4 --lora_name_or_path ../../e5-mistral-7b-instruct
The text was updated successfully, but these errors were encountered:
No branches or pull requests
When I run the following command, an error will be reported.
![image](https://private-user-images.githubusercontent.com/39084644/320467676-1406d4e1-49bb-414a-b6b6-72cae0ce0e2d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQzNzE5OTIsIm5iZiI6MTcyNDM3MTY5MiwicGF0aCI6Ii8zOTA4NDY0NC8zMjA0Njc2NzYtMTQwNmQ0ZTEtNDliYi00MTRhLWI2YjYtNzJjYWUwY2UwZTJkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODIzVDAwMDgxMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTk1OWY4OWRiMWQ0MDI4MjhhZDQwMTAxNWY4NjBhM2UwYTY5OGExOTg2NGZhNDhkZjEyYWQ5YTlkMDVhMmJlYjImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.fNEGLkXqJsZ0OF3LeDgZ87MWEtJHmCNgDnWsGoPmqbo)
My command is as follows:
`deepspeed --include localhost:0,1 --master_port 65500 --module tevatron.retriever.driver.train --deepspeed ../deepspeed/ds_zero3_config.json --output_dir retriever-mistral-v0.1 --model_name_or_path ../../e5-mistral-7b-instruct/ --lora --lora_target_modules q_proj,k_proj,v_proj,o_proj,down_proj,up_proj,gate_proj --save_steps 50 --dataset_path ../../data/train_demo.jsonl --query_prefix "Query: " --passage_prefix "Passage: " --bf16 --pooling eos --append_eos_token --normalize --temperature 0.01 --per_device_train_batch_size 8 --gradient_checkpointing --train_group_size 16 --learning_rate 1e-4 --query_max_len 32 --passage_max_len 156 --num_train_epochs 1 --logging_steps 10 --overwrite_output_dir --gradient_accumulation_steps 4 --lora_name_or_path ../../e5-mistral-7b-instruct
The text was updated successfully, but these errors were encountered: