Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tsdb editing and mgmt toolz #312

Open
6 tasks
goodboy opened this issue May 11, 2022 · 0 comments
Open
6 tasks

tsdb editing and mgmt toolz #312

goodboy opened this issue May 11, 2022 · 0 comments
Labels
data-layer real-time and historical data processing and storage integration external stack and/or lib augmentations tsdb time series db stuff UI

Comments

@goodboy
Copy link
Contributor

goodboy commented May 11, 2022

with #308 landing shortly we'll have daemon support for storing large time series as part of a trader's normal toolset. one of the main utilities i'm sure most would expect is the ability to edit data sets in a way that's both intuitive and simple.

UX ideas

  • allow user selection of datums on a chart and export to a repl (likely ipython shell) which has all the user's computational tools as well as a standard set of tsdb mgmt APIs for "fixing" data that was either written wrong or for overlaying data sets on a whim
  • the mgmt APIs will likely want to include:
    • timeseries diffing and duplication detection (the latter for when bad writes happen due to bugs or mistakes)
    • tsdb write/delete ability and "reload" functionality, possibly by context-menu style right click
    • export to a format suitable for network transport?
    • gap detection for attempting to find missing history frame segments
  • a repl (prolly ipython) which wraps all this in a suitable env (with some extensions?) for doing all the above easily from cli (so likely we'll need IPython integration 😎  goodboy/tractor#306)

main holdups

Probably more to come as this gets researched more.

@goodboy goodboy added integration external stack and/or lib augmentations data-layer real-time and historical data processing and storage UI tsdb time series db stuff labels May 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data-layer real-time and historical data processing and storage integration external stack and/or lib augmentations tsdb time series db stuff UI
Projects
None yet
Development

No branches or pull requests

1 participant