Skip to content

Sofisticate library for back testing AI strategies on historical data from major stock exchanges

Notifications You must be signed in to change notification settings

Evgeny7777/ML_for_trading

Repository files navigation

Work in progress. This documentation being improved

Index

Main idea

This is a software that handles the next scenarios

  • Download and preprocess historical data for stock markets
  • Create Machine learning model for prediction future price movement
  • Tune hyperparameters of the model and data preprocessing
  • Use UI to manage training/tuning jobs
  • Save results of every execution for future analysis
  • Pick best runs and deploy for productive trading

All together this solution covers end-to-end process.

Installation

So far there is no pip package published so the only way now is to clone this repo

In order to launch optimization jobs you would need to

Prepare data

  • download orderlog files for needed tickers from here
  • convert it from qsh to bin format via this tool

Store data

Either local filesystem (fast, not scalable) or S3 storage

Place to store experiments and results

Create a Mongo instance and to add credentials to ./py/config.py. Some hosting options with free tiers

Structure of the repo

  • ./py folder has python scripts with main logic
  • ./flask_ui scripts that do start a server with UI for scheduling experiments and tracking their results
  • ./docker has Dockerfiles for lua tests (bot) and for running tuning jobs

Start using

The easiest way is to add experiments via UI on locally hosted Flask server and locally launch a Docker container that will start worker. And worker will pick the next job that is ready for processing

Useful links

Data

Useful libraries

Parameters tuning

Trade history

Bot creation

LUA

Engineering and infrastructure

DB

Flask admin

VPS

Deployment

About

Sofisticate library for back testing AI strategies on historical data from major stock exchanges

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published