Add a bonsai guide page to the SLEAP website #1785
Conversation
WalkthroughThe recent changes introduce a new branch trigger for the GitHub workflow and add comprehensive documentation for using Bonsai with SLEAP. The updates include a new guide on exporting SLEAP models, installing Bonsai, and employing Bonsai SLEAP modules for prediction and analysis, along with a new section in the documentation index. Changes
Poem
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (invoked as PR comments)
Additionally, you can add CodeRabbit Configration File (
|
![coderabbitai[bot]](https://github.com/avatars/in/347564?s=60&v=4){kind=small}
There was a problem hiding this comment.
Actionable comments posted: 4
Review details
Configuration used: CodeRabbit UI
Review profile: CHILL
Files ignored due to path filters (1)
docs/_static/bonsai-workflow.jpgis excluded by!**/*.jpg
Files selected for processing (3)
- .github/workflows/website.yml (1 hunks)
- docs/guides/bonsai.md (1 hunks)
- docs/guides/index.md (2 hunks)
Files skipped from review due to trivial changes (1)
- .github/workflows/website.yml
Additional context used
LanguageTool
docs/guides/index.md
[uncategorized] ~19-~19: Use a comma before ‘and’ if it connects two independent clauses (unless they are closely connected and short). (COMMA_COMPOUND_SENTENCE)
Context: ...e project as your original training data and you want to correct some of the predict...
[uncategorized] ~21-~21: Use a comma before ‘but’ if it connects two independent clauses (unless they are closely connected and short). (COMMA_COMPOUND_SENTENCE)
Context: ...ough with the frame-by-frame predictions but you need to correct the identities trac...
[uncategorized] ~25-~25: Use a comma before ‘and’ if it connects two independent clauses (unless they are closely connected and short). (COMMA_COMPOUND_SENTENCE)
Context: ...ave a project with labeled training data and you'd like to run training or inference...
[uncategorized] ~27-~27: Use a comma before ‘and’ if it connects two independent clauses (unless they are closely connected and short). (COMMA_COMPOUND_SENTENCE)
Context: ...en you have a project with training data and you want to train on a different machin...
[uncategorized] ~31-~31: Use a comma before ‘and’ if it connects two independent clauses (unless they are closely connected and short). (COMMA_COMPOUND_SENTENCE)
Context: ...emote-inference` when you trained models and you want to run inference on a differen...
[style] ~31-~31: You have already used this phrasing in nearby sentences. Consider replacing it to add variety to your writing. (REP_WANT_TO_VB)
Context: ...erence` when you trained models and you want to run inference on a different machine us...
[style] ~35-~35: You have already used this phrasing in nearby sentences. Consider replacing it to add variety to your writing. (REP_WANT_TO_VB)
Context: ...EAP with Bonsai {ref}bonsaiwhen you want to analyze the trained SLEAP model to visu...docs/guides/bonsai.md
[style] ~12-~12: Consider a shorter alternative to avoid wordiness. (IN_ORDER_TO_PREMIUM)
Context: ...down and top-down-id SLEAP models. ::: In order to import the trained model into Bonsai, w...
[typographical] ~19-~19: Consider adding a comma here. (PLEASE_COMMA)
Context: ...exported_model ``` (for further details please refer {ref}sleap-exportdocs for more...
[uncategorized] ~27-~27: Possible missing comma found. (AI_HYDRA_LEO_MISSING_COMMA)
Context: ...stallation.html). - Add the necessary packages including theBonsai.SLEAPand `Bonsa...
[misspelling] ~33-~33: Use “a” instead of ‘an’ if the following word doesn’t start with a vowel sound, e.g. ‘a sentence’, ‘a university’. (EN_A_VS_AN)
Context: ...application. - The workflow must have an source moduleFileCapturewhich can b...
Markdownlint
docs/guides/bonsai.md
36-36: Expected: 2; Actual: 4 (MD007, ul-indent)
Unordered list indentation
37-37: Expected: 2; Actual: 4 (MD007, ul-indent)
Unordered list indentation
25-25: Expected: 0 or 2; Actual: 1 (MD009, no-trailing-spaces)
Trailing spaces
31-31: Expected: 0 or 2; Actual: 1 (MD009, no-trailing-spaces)
Trailing spaces
15-15: null (MD040, fenced-code-language)
Fenced code blocks should have a language specified
49-49: null (MD047, single-trailing-newline)
Files should end with a single newline character
Additional comments not posted (2)
docs/guides/index.md (1)
33-36: The addition of the "SLEAP with Bonsai" section is clear and well-integrated into the existing structure.Tools
LanguageTool
[style] ~35-~35: You have already used this phrasing in nearby sentences. Consider replacing it to add variety to your writing. (REP_WANT_TO_VB)
Context: ...EAP with Bonsai {ref}bonsaiwhen you want to analyze the trained SLEAP model to visu...docs/guides/bonsai.md (1)
43-47: The description and visualization of the Bonsai workflow are effectively presented.
docs/guides/bonsai.md
Outdated
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | ||
| ::: | ||
|
|
||
| In order to import the trained model into Bonsai, we need to export the model using the {code}`sleap-export` cli command to convert the trained model to a Protocol buffer(.pb) format. For example, for the top-down-id model, the command is as follows: |
There was a problem hiding this comment.
Consider using a more concise phrase to improve readability.
- In order to import the trained model into Bonsai, we need to export the model using the {code}`sleap-export` cli command to convert the trained model to a Protocol buffer(.pb) format.
+ To import the trained model into Bonsai, export it using the {code}`sleap-export` cli command to convert it to a Protocol buffer (.pb) format.Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| In order to import the trained model into Bonsai, we need to export the model using the {code}`sleap-export` cli command to convert the trained model to a Protocol buffer(.pb) format. For example, for the top-down-id model, the command is as follows: | |
| To import the trained model into Bonsai, export it using the {code}`sleap-export` cli command to convert it to a Protocol buffer (.pb) format. For example, for the top-down-id model, the command is as follows: |
docs/guides/bonsai.md
Outdated
| - Install bonsai by following the instructions provided in their [installation page](https://bonsai-rx.org/docs/articles/installation.html). | ||
|
|
||
| - Add the necessary packages including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules. For more information on other dependency installations, please refer to the official [bonsai sleap documentation](https://github.com/bonsai-rx/sleap?tab=readme-ov-file#bonsai---sleap). |
There was a problem hiding this comment.
Correct typographical issues for better readability.
- Install bonsai by following the instructions provided in their [installation page](https://bonsai-rx.org/docs/articles/installation.html).
+ Install bonsai by following the instructions provided on their [installation page](https://bonsai-rx.org/docs/articles/installation.html).
- Add the necessary packages including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules.
+ Add the necessary packages, including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages, for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules.Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| - Install bonsai by following the instructions provided in their [installation page](https://bonsai-rx.org/docs/articles/installation.html). | |
| - Add the necessary packages including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules. For more information on other dependency installations, please refer to the official [bonsai sleap documentation](https://github.com/bonsai-rx/sleap?tab=readme-ov-file#bonsai---sleap). | |
| - Install bonsai by following the instructions provided on their [installation page](https://bonsai-rx.org/docs/articles/installation.html). | |
| - Add the necessary packages, including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages, for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules. For more information on other dependency installations, please refer to the official [bonsai sleap documentation](https://github.com/bonsai-rx/sleap?tab=readme-ov-file#bonsai---sleap). |
Tools
LanguageTool
[uncategorized] ~27-~27: Possible missing comma found. (AI_HYDRA_LEO_MISSING_COMMA)
Context: ...stallation.html). - Add the necessary packages including theBonsai.SLEAPand `Bonsa...
Markdownlint
25-25: Expected: 0 or 2; Actual: 1 (MD009, no-trailing-spaces)
Trailing spaces
docs/guides/bonsai.md
Outdated
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. | ||
|
|
||
| - For the top-down model, | ||
| - To predict the centroids, add the `PredictCentroid` module and provide the path to the training config JSON file for the centroid model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | ||
| - To predict the instances, add the `PredictPoses` module and provide the path to the training config JSON file for the centered instance model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | ||
|
|
||
| - For the top-down-id model, to predict the instances with identities, add `PredictPoseIdentities` module and provide the path to the training config JSON file for the top-down-id model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. |
There was a problem hiding this comment.
Correct markdown formatting issues to adhere to standards.
- - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor.
+ - The workflow must have a source module `FileCapture` which can be found in the toolbox search in the workflow editor.
- - To predict the centroids, add the `PredictCentroid` module and provide the path to the training config JSON file for the centroid model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module.
+ - To predict the centroids, add the `PredictCentroid` module and provide the path to the training config JSON file for the centroid model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module.Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. | |
| - For the top-down model, | |
| - To predict the centroids, add the `PredictCentroid` module and provide the path to the training config JSON file for the centroid model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | |
| - To predict the instances, add the `PredictPoses` module and provide the path to the training config JSON file for the centered instance model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | |
| - For the top-down-id model, to predict the instances with identities, add `PredictPoseIdentities` module and provide the path to the training config JSON file for the top-down-id model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | |
| - The workflow must have a source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. | |
| - For the top-down model, | |
| - To predict the centroids, add the `PredictCentroid` module and provide the path to the training config JSON file for the centroid model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | |
| - To predict the instances, add the `PredictPoses` module and provide the path to the training config JSON file for the centered instance model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | |
| - For the top-down-id model, to predict the instances with identities, add `PredictPoseIdentities` module and provide the path to the training config JSON file for the top-down-id model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. |
Tools
LanguageTool
[misspelling] ~33-~33: Use “a” instead of ‘an’ if the following word doesn’t start with a vowel sound, e.g. ‘a sentence’, ‘a university’. (EN_A_VS_AN)
Context: ...application. - The workflow must have an source moduleFileCapturewhich can b...
Markdownlint
36-36: Expected: 2; Actual: 4 (MD007, ul-indent)
Unordered list indentation
37-37: Expected: 2; Actual: 4 (MD007, ul-indent)
Unordered list indentation
docs/guides/bonsai.md
Outdated
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | ||
| ::: | ||
|
|
||
| In order to import the trained model into Bonsai, we need to export the model using the {code}`sleap-export` cli command to convert the trained model to a Protocol buffer(.pb) format. For example, for the top-down-id model, the command is as follows: |
There was a problem hiding this comment.
| In order to import the trained model into Bonsai, we need to export the model using the {code}`sleap-export` cli command to convert the trained model to a Protocol buffer(.pb) format. For example, for the top-down-id model, the command is as follows: | |
| Before we can import a trained model into Bonsai, we need to use the {code}`sleap-export` command to convert the model to a format supported by Bonsai. For example, for the top-down-id model, the command is as follows: |
docs/guides/bonsai.md
Outdated
| **Exporting a SLEAP trained model:** | ||
|
|
||
| :::{note} | ||
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | ||
| ::: |
There was a problem hiding this comment.
Flip flop
| **Exporting a SLEAP trained model:** | |
| :::{note} | |
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | |
| ::: | |
| :::{note} | |
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | |
| ::: | |
| **Exporting a SLEAP trained model:** |
docs/guides/bonsai.md
Outdated
| sleap-export -m centroid_model_folder_path -m top_down_id_model_folder_path exported_model | ||
| ``` | ||
|
|
||
| (for further details please refer {ref}`sleap-export` docs for more details.) |
There was a problem hiding this comment.
| (for further details please refer {ref}`sleap-export` docs for more details.) | |
| . Please refer to the {ref}`sleap-export` docs for more details on using the command. |
docs/guides/bonsai.md
Outdated
|
|
||
| (for further details please refer {ref}`sleap-export` docs for more details.) | ||
|
|
||
| This will generate the necessary `.pb` file and other information files to be used in Bonsai in the `exported_model` folder. |
There was a problem hiding this comment.
| This will generate the necessary `.pb` file and other information files to be used in Bonsai in the `exported_model` folder. | |
| This will generate the necessary `.pb` file and other information files required by Bonsai. In this example, these files were saved to the specified `exported_model` folder. |
docs/guides/bonsai.md
Outdated
| - Install bonsai by following the instructions provided in their [installation page](https://bonsai-rx.org/docs/articles/installation.html). | ||
|
|
||
| - Add the necessary packages including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules. For more information on other dependency installations, please refer to the official [bonsai sleap documentation](https://github.com/bonsai-rx/sleap?tab=readme-ov-file#bonsai---sleap). |
There was a problem hiding this comment.
| - Install bonsai by following the instructions provided in their [installation page](https://bonsai-rx.org/docs/articles/installation.html). | |
| - Add the necessary packages including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules. For more information on other dependency installations, please refer to the official [bonsai sleap documentation](https://github.com/bonsai-rx/sleap?tab=readme-ov-file#bonsai---sleap). | |
| 1. Install Bonsai. See the [Bonsai installation instructions](https://bonsai-rx.org/docs/articles/installation.html). | |
| 2. Download the necessary packages for Bonsai to run with SLEAP. See the official [Bonsai SLEAP documentation](https://github.com/bonsai-rx/sleap?tab=readme-ov-file#bonsai---sleap) for more information. |
docs/guides/bonsai.md
Outdated
|
|
||
| Bonsai is a visual language for reactive programming and currently supports SLEAP models. | ||
|
|
||
| **Exporting a SLEAP trained model:** |
There was a problem hiding this comment.
| **Exporting a SLEAP trained model:** | |
| ### Exporting a SLEAP trained model |
docs/guides/bonsai.md
Outdated
|
|
||
| This will generate the necessary `.pb` file and other information files to be used in Bonsai in the `exported_model` folder. | ||
|
|
||
| **Installing Bonsai and necessary packages:** |
There was a problem hiding this comment.
| **Installing Bonsai and necessary packages:** | |
| ### Installing Bonsai and necessary packages |
docs/guides/bonsai.md
Outdated
|
|
||
| - Add the necessary packages including the `Bonsai.SLEAP` and `Bonsai.SLEAP.Design` packages for SLEAP to run with Bonsai and to access the SLEAP-Bonsai modules. For more information on other dependency installations, please refer to the official [bonsai sleap documentation](https://github.com/bonsai-rx/sleap?tab=readme-ov-file#bonsai---sleap). | ||
|
|
||
| **Using Bonsai SLEAP modules:** |
There was a problem hiding this comment.
| **Using Bonsai SLEAP modules:** | |
| ### Using Bonsai SLEAP modules |
docs/guides/bonsai.md
Outdated
|
|
||
| **Using Bonsai SLEAP modules:** | ||
|
|
||
| Once you have Bonsai installed with the required packages, you should be able to open the bonsai application. |
There was a problem hiding this comment.
| Once you have Bonsai installed with the required packages, you should be able to open the bonsai application. | |
| Once you have Bonsai installed with the required packages, you should be able to open the Bonsai application. |
docs/guides/bonsai.md
Outdated
| - For the top-down model, | ||
| - To predict the centroids, add the `PredictCentroid` module and provide the path to the training config JSON file for the centroid model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | ||
| - To predict the instances, add the `PredictPoses` module and provide the path to the training config JSON file for the centered instance model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. |
There was a problem hiding this comment.
Instead of bullets, lets make each of these sections. Also maybe we can split up the long bullets into multiple sentences.
| - For the top-down model, | |
| - To predict the centroids, add the `PredictCentroid` module and provide the path to the training config JSON file for the centroid model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | |
| - To predict the instances, add the `PredictPoses` module and provide the path to the training config JSON file for the centered instance model in the `ModelFileName` field and the path to the `exported_model` folder containing the `.pb` file in the `TrainingConfig` field of the module. | |
| #### Top-down model | |
| The top-down model requires both the `PredictCentroid` and the `PredictPoses` modules. | |
| The `PredictCentroid` module will predict the centroids of detections. There are two fields inside the `PredictCentroid` module: the `ModelFileName` field and the `TrainingConfig` field. The `ModelFileName` field expects the path to the training config JSON file for the centroid model. The `TrainingConfig` field expects the path to the `exported_model` folder (which contains the exported `.pb` file). | |
| The `PredictPoses` module will predict the instances of detections. Similar to the `PredictCentroid` module, there are two fields inside the `PredictPoses` module: the `ModelFileName` field and the `TrainingConfig` field. The `ModelFileName` field expects the path to the training config JSON file for the centered instance model. The `TrainingConfig` field expects the path to the `exported_model` folder (which contains the exported `.pb` file). |
There was a problem hiding this comment.
Actionable comments posted: 7
Review details
Configuration used: CodeRabbit UI
Review profile: CHILL
Files selected for processing (1)
- docs/guides/bonsai.md (1 hunks)
Additional context used
LanguageTool
docs/guides/bonsai.md
[misspelling] ~33-~33: Use “a” instead of ‘an’ if the following word doesn’t start with a vowel sound, e.g. ‘a sentence’, ‘a university’. (EN_A_VS_AN)
Context: ...pplication. - The workflow must have an source moduleFileCapturewhich can b...
Markdownlint
docs/guides/bonsai.md
11-11: Expected: h2; Actual: h3 (MD001, heading-increment)
Heading levels should only increment by one level at a time
25-25: Expected: 0 or 2; Actual: 1 (MD009, no-trailing-spaces)
Trailing spaces
48-48: Expected: 1; Actual: 2 (MD012, no-multiple-blanks)
Multiple consecutive blank lines
35-35: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
42-42: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
45-45: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
15-15: null (MD040, fenced-code-language)
Fenced code blocks should have a language specified
55-55: null (MD047, single-trailing-newline)
Files should end with a single newline character
docs/guides/bonsai.md
Outdated
|
|
||
| Before we can import a trained model into Bonsai, we need to use the {code}`sleap-export` command to convert the model to a format supported by Bonsai. For example, for the top-down-id model, the command is as follows: | ||
|
|
||
| ``` |
There was a problem hiding this comment.
Specify the language for fenced code blocks.
- ```
+ ```bashTools
Markdownlint
15-15: null (MD040, fenced-code-language)
Fenced code blocks should have a language specified
| #### Single instance model: | ||
| The `PredictSinglePose` module will predict the poses for single instance models. This module also has two fields: the `ModelFileName` field and the `TrainingConfig` field. The `TrainingConfig` field expects the path to the training config JSON file for the single instance model. The `ModelFileName` field expects the path to the `exported_model` folder (which contains the exported `.pb` file). | ||
|
|
||
|
|
There was a problem hiding this comment.
Avoid multiple consecutive blank lines.
-Committable suggestion was skipped due to low confidence.
Tools
Markdownlint
48-48: Expected: 1; Actual: 2 (MD012, no-multiple-blanks)
Multiple consecutive blank lines
docs/guides/bonsai.md
Outdated
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | ||
| ::: | ||
|
|
||
| ### Exporting a SLEAP trained model: |
There was a problem hiding this comment.
Ensure heading levels increment by one level at a time.
- ### Exporting a SLEAP trained model:
+ ## Exporting a SLEAP trained model:Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| ### Exporting a SLEAP trained model: | |
| ## Exporting a SLEAP trained model: |
Tools
Markdownlint
11-11: Expected: h2; Actual: h3 (MD001, heading-increment)
Heading levels should only increment by one level at a time
docs/guides/bonsai.md
Outdated
|
|
||
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. | ||
|
|
||
| #### Top-down model: |
There was a problem hiding this comment.
Ensure headings are surrounded by blank lines.
- The top-down model requires both the `PredictCentroid` and the `PredictPoses` modules.
+
+ The top-down model requires both the `PredictCentroid` and the `PredictPoses` modules.
+
- The `PredictPoseIdentities` module will predict the instances with identities.
+
+ The `PredictPoseIdentities` module will predict the instances with identities.
+
- The `PredictSinglePose` module will predict the poses for single instance models.
+
+ The `PredictSinglePose` module will predict the poses for single instance models.
+ Also applies to: 42-42, 45-45
Committable suggestion was skipped due to low confidence.
Tools
Markdownlint
35-35: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
docs/guides/bonsai.md
Outdated
|
|
||
| Once you have Bonsai installed with the required packages, you should be able to open the Bonsai application. | ||
|
|
||
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. |
There was a problem hiding this comment.
Correct grammatical error in the article usage.
- The workflow must have an source module `FileCapture`
+ The workflow must have a source module `FileCapture`Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. | |
| - The workflow must have a source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. |
Tools
LanguageTool
[misspelling] ~33-~33: Use “a” instead of ‘an’ if the following word doesn’t start with a vowel sound, e.g. ‘a sentence’, ‘a university’. (EN_A_VS_AN)
Context: ...pplication. - The workflow must have an source moduleFileCapturewhich can b...
docs/guides/bonsai.md
Outdated
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | ||
| ::: | ||
|
|
||
| ### Exporting a SLEAP trained model: |
There was a problem hiding this comment.
Remove the ":"
| ### Exporting a SLEAP trained model: | |
| ### Exporting a SLEAP trained model |
docs/guides/bonsai.md
Outdated
|
|
||
| ### Exporting a SLEAP trained model: | ||
|
|
||
| Before we can import a trained model into Bonsai, we need to use the {code}`sleap-export` command to convert the model to a format supported by Bonsai. For example, for the top-down-id model, the command is as follows: |
There was a problem hiding this comment.
"For example, for the top-down-id model" is a bit weird sounding
docs/guides/bonsai.md
Outdated
|
|
||
| Before we can import a trained model into Bonsai, we need to use the {code}`sleap-export` command to convert the model to a format supported by Bonsai. For example, for the top-down-id model, the command is as follows: | ||
|
|
||
| ``` |
There was a problem hiding this comment.
| ``` | |
| ```bash |
docs/guides/bonsai.md
Outdated
| Before we can import a trained model into Bonsai, we need to use the {code}`sleap-export` command to convert the model to a format supported by Bonsai. For example, for the top-down-id model, the command is as follows: | ||
|
|
||
| ``` | ||
| sleap-export -m centroid_model_folder_path -m top_down_id_model_folder_path exported_model |
There was a problem hiding this comment.
emulate the path for paths:
| sleap-export -m centroid_model_folder_path -m top_down_id_model_folder_path exported_model | |
| sleap-export -m centroid/model/folder/path -m top_down_id/model/folder/path exported_model |
docs/guides/bonsai.md
Outdated
|
|
||
| Once you have Bonsai installed with the required packages, you should be able to open the Bonsai application. | ||
|
|
||
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. |
docs/guides/bonsai.md
Outdated
|
|
||
| Once you have Bonsai installed with the required packages, you should be able to open the Bonsai application. | ||
|
|
||
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. |
There was a problem hiding this comment.
Add screenshots of what FileCapture is and how to add it
docs/guides/bonsai.md
Outdated
| #### Top-down model: | ||
| The top-down model requires both the `PredictCentroid` and the `PredictPoses` modules. | ||
|
|
||
| The `PredictCentroid` module will predict the centroids of detections. There are two fields inside the `PredictCentroid` module: the `ModelFileName` field and the `TrainingConfig` field. The `TrainingConfig` field expects the path to the training config JSON file for the centroid model. The `ModelFileName` field expects the path to the `exported_model` folder (which contains the exported `.pb` file). |
There was a problem hiding this comment.
Add screenshots of what PredictCentroid is and how to add it
docs/guides/bonsai.md
Outdated
|
|
||
| The `PredictCentroid` module will predict the centroids of detections. There are two fields inside the `PredictCentroid` module: the `ModelFileName` field and the `TrainingConfig` field. The `TrainingConfig` field expects the path to the training config JSON file for the centroid model. The `ModelFileName` field expects the path to the `exported_model` folder (which contains the exported `.pb` file). | ||
|
|
||
| The `PredictPoses` module will predict the instances of detections. Similar to the `PredictCentroid` module, there are two fields inside the `PredictPoses` module: the `ModelFileName` field and the `TrainingConfig` field. The `TrainingConfig` field expects the path to the training config JSON file for the centered instance model. The `ModelFileName` field expects the path to the `exported_model` folder (which contains the exported `.pb` file). |
There was a problem hiding this comment.
Add screenshots of what PredictPoses is and how to add it
docs/guides/bonsai.md
Outdated
|
|
||
|  | ||
|
|
||
| - Once you have the basic workflow for Bonsai.SLEAP created and running successfully, you can add more modules to analyze and visualize the results in Bonsai. |
docs/guides/bonsai.md
Outdated
|
|
||
| - The workflow must have an source module `FileCapture` which can be found in the toolbox search in the workflow editor. Provide the path to the video that was used to train the SLEAP model in the `FileName` field of the module. | ||
|
|
||
| #### Top-down model: |
There was a problem hiding this comment.
Remove the ":"
| #### Top-down model: | |
| #### Top-down model |
There was a problem hiding this comment.
Actionable comments posted: 7
Review details
Configuration used: CodeRabbit UI
Review profile: CHILL
Files ignored due to path filters (5)
docs/_static/bonsai-connection.jpgis excluded by!**/*.jpgdocs/_static/bonsai-filecapture.jpgis excluded by!**/*.jpgdocs/_static/bonsai-predictcentroids.jpgis excluded by!**/*.jpgdocs/_static/bonsai-predictposeidentities.jpgis excluded by!**/*.jpgdocs/_static/bonsai-predictposes.jpgis excluded by!**/*.jpg
Files selected for processing (1)
- docs/guides/bonsai.md (1 hunks)
Additional context used
LanguageTool
docs/guides/bonsai.md
[grammar] ~66-~66: The verb “Right-click” is spelled with a hyphen. (CLICK_HYPHEN)
Context: ...thfolder. ### Connecting the modules Right click on theFileCapture` module and select ...
[uncategorized] ~75-~75: Use a comma before ‘and’ if it connects two independent clauses (unless they are closely connected and short). (COMMA_COMPOUND_SENTENCE)
Context: ...e green start button to run the workflow and you can add more modules to analyze and...
Markdownlint
docs/guides/bonsai.md
11-11: Expected: h2; Actual: h3 (MD001, heading-increment)
Heading levels should only increment by one level at a time
35-35: Expected: 0 or 2; Actual: 1 (MD009, no-trailing-spaces)
Trailing spaces
67-67: Expected: 0 or 2; Actual: 1 (MD009, no-trailing-spaces)
Trailing spaces
47-47: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
58-58: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
63-63: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
66-66: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
25-25: null (MD040, fenced-code-language)
Fenced code blocks should have a language specified
77-77: null (MD047, single-trailing-newline)
Files should end with a single newline character
|
|
||
| The `exported/model/path` folder will have a structure like the following: | ||
|
|
||
| ``` |
There was a problem hiding this comment.
Specify the language for fenced code blocks.
- ```
+ ```plaintextTools
Markdownlint
25-25: null (MD040, fenced-code-language)
Fenced code blocks should have a language specified
| Currently Bonsai supports only single instance, top-down and top-down-id SLEAP models. | ||
| ::: | ||
|
|
||
| ### Exporting a SLEAP trained model |
There was a problem hiding this comment.
Ensure heading levels increment by one level at a time.
- ### Exporting a SLEAP trained model
+ ## Exporting a SLEAP trained modelCommittable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| ### Exporting a SLEAP trained model | |
| ## Exporting a SLEAP trained model |
Tools
Markdownlint
11-11: Expected: h2; Actual: h3 (MD001, heading-increment)
Heading levels should only increment by one level at a time
|
|
||
|  | ||
|
|
||
| #### Top-down model |
There was a problem hiding this comment.
Ensure headings are surrounded by blank lines.
- The top-down model requires both the `PredictCentroids` and the `PredictPoses` modules.
+
+ The top-down model requires both the `PredictCentroids` and the `PredictPoses` modules.
+
- The `PredictPoseIdentities` module will predict the instances with identities.
+
+ The `PredictPoseIdentities` module will predict the instances with identities.
+
- The `PredictSinglePose` module will predict the poses for single instance models.
+
+ The `PredictSinglePose` module will predict the poses for single instance models.
+
- Right click on the `FileCapture` module and select **Create Connection**. Now click on the required SLEAP module to complete the connection.
+
+ Right click on the `FileCapture` module and select **Create Connection**. Now click on the required SLEAP module to complete the connection.
+ Also applies to: 58-58, 63-63, 66-66
Committable suggestion was skipped due to low confidence.
Tools
Markdownlint
47-47: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
|
|
||
|  | ||
|
|
||
| Now you can click the green start button to run the workflow and you can add more modules to analyze and visualize the results in Bonsai. |
There was a problem hiding this comment.
Use a comma before 'and' in a compound sentence.
- Now you can click the green start button to run the workflow and you can add more modules to analyze and visualize the results in Bonsai.
+ Now you can click the green start button to run the workflow, and you can add more modules to analyze and visualize the results in Bonsai.Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| Now you can click the green start button to run the workflow and you can add more modules to analyze and visualize the results in Bonsai. | |
| Now you can click the green start button to run the workflow, and you can add more modules to analyze and visualize the results in Bonsai. |
Tools
LanguageTool
[uncategorized] ~75-~75: Use a comma before ‘and’ if it connects two independent clauses (unless they are closely connected and short). (COMMA_COMPOUND_SENTENCE)
Context: ...e green start button to run the workflow and you can add more modules to analyze and...
| #### Single instance model | ||
| The `PredictSinglePose` module will predict the poses for single instance models. This module also has two fields: the `ModelFileName` field and the `TrainingConfig` field. The `TrainingConfig` field expects the path to the training config JSON file for the single instance model. The `ModelFileName` field expects the path to the `frozen_graph.pb` file in the `exported/model/path` folder. | ||
|
|
||
| ### Connecting the modules |
There was a problem hiding this comment.
Correct the spelling of "Right-click".
- Right click on the `FileCapture` module and select **Create Connection**.
+ Right-click on the `FileCapture` module and select **Create Connection**.Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| ### Connecting the modules | |
| ### Connecting the modules | |
| Right-click on the `FileCapture` module and select **Create Connection**. |
Tools
LanguageTool
[grammar] ~66-~66: The verb “Right-click” is spelled with a hyphen. (CLICK_HYPHEN)
Context: ...thfolder. ### Connecting the modules Right click on theFileCapture` module and select ...
Markdownlint
66-66: Expected: 1; Actual: 0; Below (MD022, blanks-around-headings)
Headings should be surrounded by blank lines
|
|
||
| Now you can click the green start button to run the workflow and you can add more modules to analyze and visualize the results in Bonsai. | ||
|
|
||
| For more documentation on various modules and workflows, please refer to the [official Bonsai docs](https://bonsai-rx.org/docs/articles/editor.html). |
There was a problem hiding this comment.
Ensure the file ends with a single newline character.
+ Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation.
| For more documentation on various modules and workflows, please refer to the [official Bonsai docs](https://bonsai-rx.org/docs/articles/editor.html). | |
| For more documentation on various modules and workflows, please refer to the [official Bonsai docs](https://bonsai-rx.org/docs/articles/editor.html). | |
Tools
Markdownlint
77-77: null (MD047, single-trailing-newline)
Files should end with a single newline character
|
|
||
| ### Installing Bonsai and necessary packages | ||
|
|
||
| 1. Install Bonsai. See the [Bonsai installation instructions](https://bonsai-rx.org/docs/articles/installation.html). |
There was a problem hiding this comment.
Remove trailing spaces.
- 1. Install Bonsai. See the [Bonsai installation instructions](https://bonsai-rx.org/docs/articles/installation.html).
+ 1. Install Bonsai. See the [Bonsai installation instructions](https://bonsai-rx.org/docs/articles/installation.html).
- Right click on the `FileCapture` module and select **Create Connection**. Now click on the required SLEAP module to complete the connection.
+ Right click on the `FileCapture` module and select **Create Connection**. Now click on the required SLEAP module to complete the connection.Also applies to: 67-67
Committable suggestion was skipped due to low confidence.
Tools
Markdownlint
35-35: Expected: 0 or 2; Actual: 1 (MD009, no-trailing-spaces)
Trailing spaces
.github/workflows/website.yml
Outdated
| @@ -9,6 +9,7 @@ on: | |||
| - main | |||
| - develop | |||
| - fakebranch | |||
| - shrivaths/bonsai-guide | |||
There was a problem hiding this comment.
| - shrivaths/bonsai-guide |
Description
Currently we do not have a page that helps in understanding on how to use Bonsai and SLEAP together for analysis. So, adding a Bonsai guide page to the website for a guidance on using SLEAP models in Bonsai.
Types of changes
Does this address any currently open issues?
Outside contributors checklist
Thank you for contributing to SLEAP!
❤️
Summary by CodeRabbit
New Features
Documentation