Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Linfa integration #244

Open
wants to merge 136 commits into
base: master
Choose a base branch
from
Open

Linfa integration #244

wants to merge 136 commits into from

Conversation

kbamponsem
Copy link
Contributor

This PR integrates the machine learning library linfa into BastionLab.

  • It also improves the ArrayStore by adding more macros and making it cleaner.
  • It also adds a tutorial notebook containing how to approach popular ML algos with BastionLab.

kbamponsem and others added 30 commits December 2, 2022 14:55
@kbamponsem
Inintial linfa integration to BastionLab
93cb03c
@kbamponsem
Merge remote-tracking branch 'origin/dev' into linfa-integration
3838591
@kbamponsem
Adds simple test against sklearn LinearRegression
02cb612
@kbamponsem
Fixed df_transformation to linfa Datasets discrepancy
0b02fce
@kbamponsem
Adds more comments and combine some methods
55bee8f
@kbamponsem
Adds directory in tests for linfa
2372f9a
@kbamponsem
Fixes LogisticRegression error and tests with sklearn
0dc1cca
@kbamponsem
Merge branch 'dev' into linfa-integration
8498bc1
@kbamponsem
Re-formats project
b6f7e58
@kbamponsem
Adds probability prediction to linfa
01921ed
@kbamponsem
Adds cross-validation and improves client API
69e0714
@kbamponsem
Merge branch 'master' of github.com:mithril-security/bastionlab into …
8b46ee2 
…linfa-integration
@kbamponsem
Adds conversion from DF to RemDataset
be5867d
@kbamponsem
Black formatting
f5361eb
@lyie28
ML data prep
ff59aa8
@kbamponsem
Redesigns conversion and as Dataset->DF conversion
6f8fa4a
@kbamponsem
Adds 🤗 tokenizer to BastionLab conversion.
0e02b5a 
Adds conversion functions for strings to tokens
@kbamponsem
Adds setup for tokenizer conversion
dadb4bb
@kbamponsem
Fixes bugs with tokenizer inclusion
99ccc6a 
- Conversion of string columns into [Tensor, Tensor]
@kbamponsem
Adds convert method to transform cols in dfs in row-wise manner
083a61d
@kbamponsem
Improves integration and set up for distilbert
267eab2
@kbamponsem
uses convert to transform RemoteDataFrames
751c3cb
@kbamponsem
Improves tensor addition in conversion
c001c12
@kbamponsem
Fixed with expand set to False
8524663
@kbamponsem
Adds train_test_split method to the API
f4b99a6
@kbamponsem
Reformatted for black
105d5c2
@kbamponsem
Sets RemoteLearner.expand to False by default
69ab58f
@kbamponsem
Merge branch 'master' into data-conversion
71e2288
@kbamponsem
Impl for new data-conversion policy
cd0dd74
@kbamponsem
Merge branch 'master' into linfa-integration
ef18839
kbamponsem and others added 13 commits February 23, 2023 16:47
@kbamponsem
Merge branch 'linfa-integration' of github.com:mithril-security/basti…
c4227db 
…onlab into linfa-integration
@kbamponsem
Merge branch 'master' into linfa-integration
13ab0b5
@kbamponsem
[Update][Notebook] Fix typos with loading data.
7a643f9
@kbamponsem
[Update] Removes unnessary commented code in linfa/utils.rs
2423ba3
@kbamponsem
[Update][API] Improves ArrayStore and algorithms
a41cd93 
This commit is a bit involved because it introduces a new method on the ArrayStore `cast`

`cast` is used to cast ArrayStores into different types.

It also introduces a new type `ArrayStoreType` which is a representation of the primitive types
stored by ArrayBase.
@kbamponsem
[Update][Notebook] Adds tutorial for logistic (binomial, multinomial)…
c47e105 
… logistic regression to the notebook.
@kbamponsem
[Update][server] Improves ndarray_to_df conversion with a macro.
2f7cf8e
@kbamponsem
[Update][Notebook] Adds a tutorial section for Decision Trees and imp…
168efd2 
…roves the Python API
@kbamponsem
[Update][Protocol] Replaces validation metrics string matching with P…
442ae5b 
…rotobuf types
@kbamponsem
Delete data_owner
f998b05
@kbamponsem
Delete data_owner.pub
8a03c93
@kbamponsem
[Update][Server] Remove PredicitonTypes and replaces with ArrayStore …
0e164f2 
…directly
@kbamponsem
Merge branch 'master' into linfa-integration
9b78079
@kbamponsem kbamponsem self-assigned this Feb 28, 2023
@github-actions
Copy link

github-actions bot commented Feb 28, 2023 •
edited
Loading

☂️ Python Cov

current status: ✅

Overall Coverage

Lines Covered Coverage Threshold Status
549 530 97% 0% 🟢

New Files

File Coverage Status
tests/test_remote_linfa.py 96% 🟢
TOTAL 96% 🟢

Modified Files

No covered modified files...

updated for commit: 90a7025 by action🐍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dhalf dhalf Awaiting requested review from dhalf

At least 1 approving review is required to merge this pull request.

Assignees

@kbamponsem kbamponsem

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@kbamponsem @lyie28 @Knulpinette