[System Logging] Feature Branch

[dbogunowicz]

The Main Feature Branch for the System Logging Functionality

Major highlights

Support for three types of System Logging Groups

The user now has the ability to enable/disable system logging functionality. This PR introduces three system logging groups (each of them can be turned on/off at will):

• request_details group - logs information pertaining to the request sent to the server
• resource_utilization group - logs information pertaining to the amountof resources being utilized by the server
• prediction_latency group - logs information pertaining to the latency of different stages of the pipeline (this information was being logged before this commit, but now it has been refactored and included as a system logging group)

User interface that enables changing the system logging settings

We can now pass the extended ServerConfig.

system_logging:
      enable: True # enables/disables system logging globally
      resource_utilization:
          enable: True # enables/disables system logging on the group level
          target_loggers: ["python"] # allows the user to specify the particular set of loggers to handle the relevant logs
     prediction_latency:
          enable: False 
endpoints:
      route: /unpruned/predict
      model: zoo:nlp/question_answering/bert-base/pytorch/huggingface/squad/base-none

That will enable data and/or system logging and enable the user to have granular control over the logging functionality.

Other notable changes:

• refactored the identifier structure and the matching logic in the FunctionLogger ( between the target identifier and the incoming identifier)
• added the infrastructure that hopefully further enables seamless scaling of the system logging functionality. Either in terms of the number of items that are to be logged within the existing system logging groups or in terms of increasing the set of system logging groups available.
• added unit- and E2E- tests for new functionalities.

[corey-nm]

🎉 nice work!!!