Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LFX Mentorship Autumn 2024 Pretest - FuryMartin #139

Closed
wants to merge 10 commits into from

Conversation

FuryMartin
Copy link
Contributor

What type of PR is this?

/kind design

What this PR does / why we need it:

This is a demo for #130. I have implemented a cloud-edge collaborative strategy named query-routing.

The whole principle for query-routing is as below, which will route user's query to cloud or edge model based on its difficulty coefficiency:
image

For task 1, I used a modified Sedna package to support jsonl data evaluation.
For task 2, I implemented query-routing based on Ianvs.
For task 3, I left the results in README.md. The design details can be found in cloud-edge-collaboration-inference-for-llm

Which issue(s) this PR fixes:

Fixes #130

FuryMartin and others added 10 commits July 18, 2024 10:18
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
Signed-off-by: Yu Fan <fany@buaa.edu.cn>
@kubeedge-bot kubeedge-bot added the kind/design Categorizes issue or PR as related to design. label Aug 24, 2024
@kubeedge-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
To complete the pull request process, please assign jaypume after the PR has been reviewed.
You can assign the PR to them by writing /assign @jaypume in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@kubeedge-bot kubeedge-bot added the size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. label Aug 24, 2024
@FuryMartin
Copy link
Contributor Author

This PR should be reviewed by @hsj576.

Copy link
Member

@hsj576 hsj576 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The overall work is good, basically completed the pretest requirements.

@FuryMartin
Copy link
Contributor Author

The overall work is good, basically completed the pretest requirements.

Thanks!

Considering that this PR is just a demonstration, should I close it?

@FuryMartin FuryMartin closed this Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/design Categorizes issue or PR as related to design. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

LFX Mentorship Autumn 2024 Pretest - for #126
3 participants