Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rename experimental JSON tests. #15568

Merged

Conversation

bdice
Copy link
Contributor

@bdice bdice commented Apr 18, 2024

Description

This PR renames the "experimental" JSON reader tests. These are now production grade and not experimental.

This task is tracked in #15537.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@bdice bdice requested a review from a team as a code owner April 18, 2024 21:29
@github-actions github-actions bot added the libcudf Affects libcudf (C++/CUDA) code. label Apr 18, 2024
@bdice
Copy link
Contributor Author

bdice commented Apr 18, 2024

@karthikeyann / @vuule: Could one of you help me understand this line?

INSTANTIATE_TEST_SUITE_P(Experimental, JsonParserTest, testing::Bool());

This boolean parameter labeled "Experimental" appears to control whether we call device_parse_nested_json or host_parse_nested_json. Do we still need both of those code paths (with tests)? Should we rename this flag from Experimental to DeviceParse?

@bdice bdice added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Apr 18, 2024
@vuule
Copy link
Contributor

vuule commented Apr 18, 2024

@karthikeyann / @vuule: Could one of you help me understand this line?

INSTANTIATE_TEST_SUITE_P(Experimental, JsonParserTest, testing::Bool());

This boolean parameter labeled "Experimental" appears to control whether we call device_parse_nested_json or host_parse_nested_json. Do we still need both of those code paths (with tests)? Should we rename this flag from Experimental to DeviceParse?

IMO we can remove the host path, and thus this test. We now have a lot of tests of the new reader, I think we don't have to test this part of the implementation against the reference any more. If not, yes, renaming to DeviceParse sounds good to me
We do definitely need @karthikeyann's blessing to remove the test :)

@bdice
Copy link
Contributor Author

bdice commented Apr 18, 2024

Great. I renamed to IsFullGPU because that's how the variables are named in the tests. If @karthikeyann thinks we can remove the host parsing logic, I'll do that (and remove the tests) in a follow-up PR.

@bdice bdice mentioned this pull request Apr 18, 2024
7 tasks
@bdice
Copy link
Contributor Author

bdice commented Apr 19, 2024

/merge

@rapids-bot rapids-bot bot merged commit 088be5a into rapidsai:branch-24.06 Apr 19, 2024
71 checks passed
@karthikeyann
Copy link
Contributor

Yes. We could remove the host parsing logic. It may not be in sync with device code with a lot of recent changes in JSON tokenizer, and tree algorithms. @elstehle shall we remove host parsing code and their tests?

@davidwendt
Copy link
Contributor

Did you merge this with only one cpp review approval?

@bdice
Copy link
Contributor Author

bdice commented Apr 19, 2024

Did you merge this with only one cpp review approval?

Oops. @davidwendt I thought you were the second approver. My apologies.

@bdice
Copy link
Contributor Author

bdice commented Apr 19, 2024

@vuule and/or @karthikeyann feel free to take a look over this. I thought Vukasin had approved first and David was second, but I now see that I imagined the first ✅ where there was none. I hope we don’t need to revert but I’ll be happy to apply any follow-ups in another PR if needed.

@vuule
Copy link
Contributor

vuule commented Apr 19, 2024

How could you do this @bdice ?!
Well, no harm done, I would approve as-is. Just nobody tell Greg.

@bdice bdice mentioned this pull request May 6, 2024
3 tasks
rapids-bot bot pushed a commit that referenced this pull request May 6, 2024
This PR addresses a task from #15537 to remove the `host_parse_nested_json` code path and corresponding tests. See discussion in #15568 (comment).

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - David Wendt (https://github.com/davidwendt)
  - Mark Harris (https://github.com/harrism)

URL: #15674
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement / enhancement to an existing function libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

4 participants