Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SN1-195: add inference task #365

Merged
merged 108 commits into from
Sep 4, 2024
Merged

SN1-195: add inference task #365

merged 108 commits into from
Sep 4, 2024

Conversation

Hollyqui
Copy link
Collaborator

@Hollyqui Hollyqui commented Sep 4, 2024

No description provided.

Hollyqui and others added 30 commits July 29, 2024 14:35
@Hollyqui
SN1-152: Fixing styling & minor refactors
511d7e5
@Hollyqui
SN1-152: Continuing refactor: eliminating configs in favour of proper…
c1f7001 
… typing
@Hollyqui
SN1-152: Continuing refactors; adding demo notebook
3452cb5
@Hollyqui
SN1-152: Fixing reward models & reward calculation
da5c30c
@Hollyqui
SN1-152: Fixing bugs with refactor
bd4630a
@Hollyqui
SN1-152: Improving demo.ipynb
d7960cc
@Hollyqui
SN1-152: Adding back jupyter notebooks
3cc2e90
@Hollyqui
SN1-152: Updating demo.ipynb
ac59bd4
@Hollyqui
SN1-152: Adding .env file and settings.py in favour of passing args
7abc2ee
@Hollyqui
SN1-152: Moving torch -> numpy everywhere possible
520a65f
@Hollyqui
SN1-152: FIxing remaining issues produced by refactor and producing r…
e0edc66 
…unning validator
@Hollyqui
SN1-152: Removing license from all files except for LICENSE
ebb0d62
@Hollyqui
SN1-152: Restructuring files into more sensible folder structure
93075d4
@Hollyqui
SN1-152: Removing unnecessary files, minor cleanups
a2afcb8
@Hollyqui
SN1-152: Improving README
7ccf112
@Hollyqui
SN1-152: Adding storage folder to .gitignore
6fa0fc1
@Hollyqui
SN1-152: Integrating organic scoring
170a802
@Hollyqui
SN1-150: Fixing suggestions from comments
77a1528
@Hollyqui
Merge branch 'pre-staging' into SN1-150-remove-low-value-subcompetitions
c55271f
@Hollyqui
SN1-152: Fixing issues introduced by merge commit
100d1e9
@Hollyqui
SN1-152: Improving organic scoring implementation
d2afd13
@Hollyqui
SN1-152: Making RewardConfigs non-initialisable
880c433
@Hollyqui
SN1-152: Minor improvements/addressing comments
411f9fa
@dbobrenko
Enable organic weight set, fix WASM errors (#324)
3582d67 
- Enable organic scoring weight setting.
- Fix bittensor WASM errors by switching to another bittensor branch.
@dbobrenko
Fix Mock model and pipeline (#326)
3a1efb0 
Fix 'MockPipeline' object has no attribute 'generate' errors when using --neuron.model_id mock.
@bkb2135
Fix wikipedia summary and date (#325)
2914af4 
Fix AttributeError (no attribute ‘isdigit’) for Wikipedia Summary and Date.
@dbobrenko
Increase version to 2.6.1 (#327)
b63beed
@dbobrenko
Merge branch 'main' into staging
42e4974
@dbobrenko
Remove code duplicate (#330)
2851ebf
@dbobrenko
Add miner UIDs to wandb
42f4ba1
dbobrenko and others added 24 commits August 27, 2024 20:29
@dbobrenko
v2.7.0 (#350)
8256369 
Changes:
- New multi-choice benchmarking task;
- Refactor changes (.env config-based, decoupled parts of the code);
- Poetry setup;
- Only 5 tasks are included: QA, DateQA, Summary, MultiChoice, Organic.
@dbobrenko
Merge main into staging branch (#354)
5459ddf
@bkb2135
v2.7.1 (#357)
66db048 
Changes:
- Add multi-GPU support.
@Hollyqui
SN1-195: Adding weight setting
71663f0
@dbobrenko
Merge branch 'main' into staging
0e91e8d
@Hollyqui
SN1-195: Removing issues with namespaces
5b14c48
@Hollyqui
SN1-195: Fixing issue with reward calculation
ded44b5
@Hollyqui
Merge remote-tracking branch 'origin/main' into SN1-195-add-inference…
15ae88c 
…-task
@Hollyqui
SN1-195: Removing tokenizer from stream processing
55a7eed
@Hollyqui
SN1-195: Fixing miner issues introduced by merge
f918b13
@Hollyqui
SN1-195: Making sure task prbabilities add up to 1
ef0bd12
@Hollyqui
SN1-195: Ensuring to round to avoid floating point issues when checki…
008a40b 
…ng probability sum
@Hollyqui @dbobrenko
SN1-195: Timer to use perf_counter
15949d7 
Co-authored-by: Dmytro Bobrenko <17252809+dbobrenko@users.noreply.github.com>
@Hollyqui @dbobrenko
SN1-195: Moving to perf_counter
e5e8e9e 
Co-authored-by: Dmytro Bobrenko <17252809+dbobrenko@users.noreply.github.com>
@Hollyqui
SN1-195: Addressing various comments
dd4d8cd
@Hollyqui
SN1-195: Minor fixes/improvements
4e38c11
@Hollyqui
SN1-195: Moving loops into __name__ == __main__
4d944da
@Hollyqui
SN1-195: Setting ram based on .env file
bdd5230
@bkb2135
Add Signature of Hotkey to WANDB run (#360)
e69fc1d 
Add hotkey signature to the wandb run for multi-choice verification
@Hollyqui
SN1-224: Adding random website dataset (#359)
1f061fc 
- Adding dataset to retrieve random website, which feeds the inference
task
@Hollyqui
Merge remote-tracking branch 'origin/staging' into SN1-195-add-infere…
6496fc5 
…nce-task
@Hollyqui
SN1-212: Fixing readme
117a688
@dbobrenko
v2.7.2 (#362)
4a5cd1a 
Changes:
- Bump v2.7.2.
- Raise multi-choice probability from 0.05 to 0.2.
@Hollyqui
Merge branch 'staging' into SN1-195-add-inference-task
df9c5fb
@Hollyqui Hollyqui marked this pull request as ready for review September 4, 2024 09:46
dbobrenko
dbobrenko approved these changes Sep 4, 2024
View reviewed changes
Copy link
Collaborator

@dbobrenko dbobrenko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Hollyqui Hollyqui merged commit 36cd277 into pre-staging Sep 4, 2024
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dbobrenko dbobrenko dbobrenko approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Hollyqui @dbobrenko @bkb2135