Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Macos in ci #342

Open
wants to merge 20 commits into
base: shm_apis
Choose a base branch
from
Open

Macos in ci #342

wants to merge 20 commits into from

Commits on Dec 12, 2022

  1. Initial module import from piker.data._sharemem 

    More or less a verbatim copy-paste minus some edgy variable naming and
internal `piker` module imports. There is a bunch of OHLC related
defaults that need to be dropped and we need to adjust to an optional
dependence on `numpy` by supporting shared lists as per the mp docs.
    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    901353c View commit details
    Browse the repository at this point in the history

  2. Add ShmList wrapping the stdlib's ShareableList 

    First attempt at getting `multiprocessing.shared_memory.ShareableList`
working; we wrap the stdlib type with a readonly attr and a `.key` for
cross-actor lookup. Also, rename all `numpy` specific routines to have
a `ndarray` suffix in the func names.
    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    0e4b37d View commit details
    Browse the repository at this point in the history

  3. Add initial readers-writer shm list tests

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    c01c227 View commit details
    Browse the repository at this point in the history

  4. Add repetitive attach to existing segment test

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    971ac50 View commit details
    Browse the repository at this point in the history

  5. Don't require runtime (for now), type annot fixing

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    ecea1e1 View commit details
    Browse the repository at this point in the history

  6. Fix uid2nursery lookup table type annot

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    6d4d428 View commit details
    Browse the repository at this point in the history

  7. Rename token type to NDToken in the style of nptyping

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    60f8f11 View commit details
    Browse the repository at this point in the history

  8. Add ShmList slice support in .__getitem__()

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    2ac19b2 View commit details
    Browse the repository at this point in the history

  9. Parametrize rw test with variable frame sizes 

    Demonstrates fixed size frame-oriented reads by the child where the
parent only transmits a "read" stream msg on "frame fill events" such
that the child incrementally reads the shm list data (much like in
a real-time-buffered streaming system).
    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    3bdd04e View commit details
    Browse the repository at this point in the history

  10. Mod define _USE_POSIX, add a of of todos

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    1be3f41 View commit details
    Browse the repository at this point in the history

  11. Allocate size-specced "empty" sequence from default values by type

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    54322f2 View commit details
    Browse the repository at this point in the history

  12. Pass str dtype for use_str case

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    6453195 View commit details
    Browse the repository at this point in the history

  13. Add numpy for testing optional integrated shm API layer

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    9c336ec View commit details
    Browse the repository at this point in the history

  14. Add back pytest full trace flag to debug CI hangs

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    7c42d25 View commit details
    Browse the repository at this point in the history

  15. Add macos run using only the trio spawner

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    a5e3cf4 View commit details
    Browse the repository at this point in the history

  16. Skip debugger tests on OS X for now

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    64819b2 View commit details
    Browse the repository at this point in the history

  17. Always print any std streams to console in docs examples tests

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    e12def5 View commit details
    Browse the repository at this point in the history

  18. Add logging and teardown prints to full-fledged-streaming example

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    b624ebb View commit details
    Browse the repository at this point in the history

  19. Always set the parent_exit: trio.Event on exit

    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    45a9aaf View commit details
    Browse the repository at this point in the history

  20. Handle broken mem chan on Actor._push_result() 

    When backpressure is used and a feeder mem chan breaks during msg
delivery (usually because the IPC allocating task already terminated)
instead of raising we simply warn as we do for the non-backpressure
case.

Also, add a proper `Actor.is_arbiter` test inside `._invoke()` to avoid
doing an arbiter-registry lookup if the current actor **is** the
registrar.
    @goodboy
    goodboy committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    a89799b View commit details
    Browse the repository at this point in the history