Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Async get_events, handle_event, handle_readables, handle_writables #769

Merged
merged 61 commits into from
Nov 23, 2021
Merged

Async get_events, handle_event, handle_readables, handle_writables #769

merged 61 commits into from
Nov 23, 2021

Commits on Nov 20, 2021

  1. Asynchronous handle_event and LocalExecutor thread

    @abhinavsingh
    abhinavsingh committed Nov 20, 2021
    Configuration menu
    Copy the full SHA
    8d87f7e View commit details
    Browse the repository at this point in the history

  2. Bail out on first task completion

    @abhinavsingh
    abhinavsingh committed Nov 20, 2021
    Configuration menu
    Copy the full SHA
    dbaf18a View commit details
    Browse the repository at this point in the history

  3. mypy

    @abhinavsingh
    abhinavsingh committed Nov 20, 2021
    Configuration menu
    Copy the full SHA
    40e38cb View commit details
    Browse the repository at this point in the history

  4. Add helper/benchmark.sh and fix threaded which must now use asyncio… 

    … (reduced performance of threaded)
    @abhinavsingh
    abhinavsingh committed Nov 20, 2021
    Configuration menu
    Copy the full SHA
    e0fd4de View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2021

  1. Print open file diff from benchmark.sh

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    f5998dd View commit details
    Browse the repository at this point in the history

  2. Add --local-executor flag, disabled by default for now until tests … 

    …are updated
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    d5ef5fd View commit details
    Browse the repository at this point in the history

  3. Async handle_readables and handle_writables for `HttpProtocolHand… 

    …lerPlugin` interface (doesnt impact proxy/web plugins for now)
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    aad066b View commit details
    Browse the repository at this point in the history

  4. Async get_events

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    b25b041 View commit details
    Browse the repository at this point in the history

  5. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    f0042de View commit details
    Browse the repository at this point in the history

  6. Address tests after async changes

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    2d311a6 View commit details
    Browse the repository at this point in the history

  7. mypy and flake8

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    416d852 View commit details
    Browse the repository at this point in the history

  8. spelldoc

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    c71f91f View commit details
    Browse the repository at this point in the history

  9. check.py and trailing comma

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    94f9ef8 View commit details
    Browse the repository at this point in the history

  10. Rename to _assertions.py

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    ae089f4 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'async-handle-events' of github.com:abhinavsingh/proxy.p… 

    …y into async-handle-events
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    b3fb2bd View commit details
    Browse the repository at this point in the history

  12. Add missing pytest-mock and pytest-asyncio deps

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    2a727c8 View commit details
    Browse the repository at this point in the history

  13. Add pytest-mock to pylint deps

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    c03c817 View commit details
    Browse the repository at this point in the history

  14. Correct use of parameterize and add PT007 to flake8 ignores

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    78b59aa View commit details
    Browse the repository at this point in the history

  15. Fix mypy hints broken for < Python3.9

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    55d3a29 View commit details
    Browse the repository at this point in the history

  16. Remove usage of asynccontextmanager which is not available for all … 

    …Python versions that `proxy.py` supports
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    87ff921 View commit details
    Browse the repository at this point in the history

  17. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    9436e99 View commit details
    Browse the repository at this point in the history

  18. Fix for pre-python-3.9 versions

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    39eebc4 View commit details
    Browse the repository at this point in the history

  19. Merge branch 'async-handle-events' of github.com:abhinavsingh/proxy.p… 

    …y into async-handle-events
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    f0d4357 View commit details
    Browse the repository at this point in the history

  20. AsyncTask apis set_name and get_name are not available on all s… 

    …upported versions
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    d89160c View commit details
    Browse the repository at this point in the history

  21. Install setuptools via lib-dep until we recommend editable install

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    0543b54 View commit details
    Browse the repository at this point in the history

  22. Deprecate support for Python 3.6

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    cbd2be2 View commit details
    Browse the repository at this point in the history

  23. Use recommendation suggested here https://github.com/abhinavsingh/pro… 

    …xy.py/pull/769\#discussion_r753840929
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    0c30899 View commit details
    Browse the repository at this point in the history

  24. Address recommendation here https://github.com/abhinavsingh/proxy.py/… 

    …pull/769\#discussion_r753841906
    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    5348b0a View commit details
    Browse the repository at this point in the history

  25. Make Threadless agnostic of multiprocessing.Process

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    5dd0926 View commit details
    Browse the repository at this point in the history

  26. Acceptors must dispatch to local executor in non-blocking fashion

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    3b8019d View commit details
    Browse the repository at this point in the history

  27. No daemon for executor processes and fix shutdown logic

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    3e7ddec View commit details
    Browse the repository at this point in the history

  28. Only return fds from _selected_events not all events data

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    1c746e6 View commit details
    Browse the repository at this point in the history

  29. Refactor logic

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    1f4c176 View commit details
    Browse the repository at this point in the history

  30. Prefix private methods with _

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    91741a7 View commit details
    Browse the repository at this point in the history

  31. work_queue and not client_queue

    @abhinavsingh
    abhinavsingh committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    3044758 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2021

  1. Turn Threadless into an abstract executor. Introduce RemoteExecutor

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    5b04f42 View commit details
    Browse the repository at this point in the history

  2. Make LocalExecutor agnostic of threading.Thread

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    36dcbc1 View commit details
    Browse the repository at this point in the history

  3. LocalExecutor now implements Threadless

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    271652c View commit details
    Browse the repository at this point in the history

  4. get_events and get_descriptors now must return int and not sock. … 

    …`Threadless` now avoids repeated register/unregister and instead make use of `selectors.modify`
    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    194ce58 View commit details
    Browse the repository at this point in the history

  5. Fix main tests

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    01d5121 View commit details
    Browse the repository at this point in the history

  6. Apply suggestions from code review 

    Co-authored-by: Sviatoslav Sydorenko <wk@sydorenko.org.ua>
    @abhinavsingh @webknjaz
    abhinavsingh and webknjaz authored Nov 22, 2021
    Configuration menu
    Copy the full SHA
    473fe8c View commit details
    Browse the repository at this point in the history

  7. Merge branch 'async-handle-events' of github.com:abhinavsingh/proxy.p… 

    …y into async-handle-events
    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    466530c View commit details
    Browse the repository at this point in the history

  8. Apply code review recommendations manually

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    baff0b9 View commit details
    Browse the repository at this point in the history

  9. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    c5ed3e3 View commit details
    Browse the repository at this point in the history

  10. Revert back Any and use addr or None

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    15966ac View commit details
    Browse the repository at this point in the history

  11. Merge branch 'async-handle-events' of github.com:abhinavsingh/proxy.p… 

    …y into async-handle-events
    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    b870038 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'develop' into async-handle-events

    @abhinavsingh
    abhinavsingh authored Nov 22, 2021
    Configuration menu
    Copy the full SHA
    292ea7a View commit details
    Browse the repository at this point in the history

  13. Address flake8

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    cedf02d View commit details
    Browse the repository at this point in the history

  14. Update tests to use fileno

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    d96d5c2 View commit details
    Browse the repository at this point in the history

  15. Fix doc build

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    2 Configuration menu
    Copy the full SHA
    2805841 View commit details
    Browse the repository at this point in the history

  16. Fix doc spell, use tear down and not teardown

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    7d5e955 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'develop' into async-handle-events

    @abhinavsingh
    abhinavsingh authored Nov 22, 2021
    Configuration menu
    Copy the full SHA
    71a595e View commit details
    Browse the repository at this point in the history

  18. Doc updates

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    f36ab2d View commit details
    Browse the repository at this point in the history

  19. Add back support for Python 3.6

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    f78fe5e View commit details
    Browse the repository at this point in the history

  20. Merge branch 'async-handle-events' of github.com:abhinavsingh/proxy.p… 

    …y into async-handle-events
    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    d158d67 View commit details
    Browse the repository at this point in the history

  21. Acceptors dont need loop initialization

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    265380d View commit details
    Browse the repository at this point in the history

  22. On Python 3.6 asyncio.new_event_loop() is necessary

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    5684b8c View commit details
    Browse the repository at this point in the history

  23. Make doc happy

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    8686093 View commit details
    Browse the repository at this point in the history

  24. --threaded needs a new event loop for 3.7 too

    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    d84d3b4 View commit details
    Browse the repository at this point in the history

  25. Always use asyncio.new_event_loop() for threaded mode 

    Added e2e integration tests (subprocess & curl) for all modes.
    @abhinavsingh
    abhinavsingh committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    7090764 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2021

  1. Lint fixes

    @abhinavsingh
    abhinavsingh committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    bb0ae7c View commit details
    Browse the repository at this point in the history