Skip to content

QualiChain/analyzer

Repository files navigation

AnalEyeZer

AnalEyeZer is a component used in Qualichain H2020

Supported Data Sources

  • RDBMS
    • PostgreSQL
  • NoSQL
    • MongoDB
  • Files
    • CSV
    • TSV

Setup ElasticSearch and Kibana

  • cd config
  • docker-compose up -d es01 kibana

Run AnalEyeZer locally

  • pip install -r requirements.txt
  • flask run

Run AnalEyEZer using Docker

In order to run AnalEyeZer using Docker you should run the following command

docker-compose up -d analeyzer --build

Run Analyezer Stack

In order to run all Analyezer Components at once you should run the following

docker-compose up -d --build

This command creates the following

  • one ElasticSearch node is accessible in port 9200
  • Kibana is accessible in port 5601
  • AnalEyeZer is accessible in port 5000

Examples

Submit a new data source

POST /receive/source HTTP/1.1
Host: 127.0.0.1:5000
Content-Type: application/json

{
	"uri": "postgresql://admin:admin@qualichain.epu.ntua.gr:5432/api_db",
	"type": "POSTGRES",
	"part": "job_post",
	"index": "my_index"
}

Submit Query to ElasticSearch

POST /ask/storage HTTP/1.1
Host: 127.0.0.1:5000
Content-Type: application/json

{
	"query":"bool_query",
	"index": "my_index",
	"min_score": 4,
	"_source": ["id"],
	"should": [
    {"multi_match": {
        "query": "backend engineer",
        "fields": ["title", "requirements"],
        "type": "phrase",
        "slop": 2}
    },
    {"multi_match": {
        "query": "backend developer",
        "fields": ["title", "requirements"],
        "type": "phrase",
        "slop": 2}
    }
]
}

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published