Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add sentencepiece preset #1384

Merged
merged 13 commits into from
Jul 25, 2023
Merged

Add sentencepiece preset #1384

merged 13 commits into from
Jul 25, 2023

Commits on Jul 8, 2023

  1. Add sentencepiece preset

    @sbrunk
    sbrunk committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    d1efcf5 View commit details
    Browse the repository at this point in the history

  2. Use zip instead of tar to avoid issues with symlinks on Windows

    @sbrunk
    sbrunk committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    aaa9448 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2023

  1. Build sentencepiece via cmake instead of make for better portability 

    Link against sentencepiece_train
    @sbrunk
    sbrunk committed Jul 9, 2023
    Configuration menu
    Copy the full SHA
    d39f47b View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2023

  1. Run Linux CI directly on Ubuntu runner instead of CentOS in Docker

    @sbrunk
    sbrunk committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    5ed915e View commit details
    Browse the repository at this point in the history

  2. Try to properly cross-compile on arm64

    @sbrunk
    sbrunk committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    e1b6ef2 View commit details
    Browse the repository at this point in the history

  3. Try to get decode working through String casting

    @sbrunk
    sbrunk committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    abc3457 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. Add missing cross-compilation for macosx-arm64

    @sbrunk
    sbrunk committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    9667a88 View commit details
    Browse the repository at this point in the history

  2. Map std::string valueTypes to String

    @sbrunk
    sbrunk committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    6bd72b9 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2023

  1. Add decoding to example; add README

    @sbrunk
    sbrunk committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    eebb35d View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2023

  1. Re-enable training and more decoding methods

    @sbrunk
    sbrunk committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    cf9a09d View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2023

  1. Fix nits

    @saudet
    saudet committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    7927acc View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. Merge remote-tracking branch 'upstream/master' into sentencepiece

    @saudet
    saudet committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    5be5107 View commit details
    Browse the repository at this point in the history

  2. Update CHANGELOG.md and revert unnecessary changes

    @saudet
    saudet committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    ec8bb21 View commit details
    Browse the repository at this point in the history