Error while execution generate_user_intent: 'NoneType' object has no attribute 'agenerate_prompt'

[DrmedAllel]

Tried to connect NeMo with Microsoft Azure like in this issue explained.

My config.yml is like this:

type: main engine: azure model: gpt-4 parameters: azure_endpoint: https://*******/ api_version: 2023-07-01-preview deployment_name: gpt-4-0613-preview api_key: ************************

The Python Code I use is looking like this:

`import os
from nemoguardrails import LLMRails, RailsConfig

os.environ["OPENAI_API_KEY"] = "****"

def read_file(path):
with open(path, "r") as f:
return f.read()

colang_content = read_file("T2000/config/topics.co")

yaml_content = read_file("T2000/config/config.yml")

initialize rails config

config = RailsConfig.from_content(
yaml_content=yaml_content,
colang_content=colang_content
)

create rails

rails = LLMRails(config)

options = {
"output_vars": ["triggered_input_rail"],
"log": {
"activated_rails": True
}
}

def generate(prompt):
return rails.generate(prompt, options=options)

print("\033c")
while True:
prompt = input("Input: ")
print(generate(prompt))
print("\n")
`

Can someone help me?
The script keeps running but I get the following error printed as a string to the console:

Input: hallo Parameter temperature does not exist for NoneType Error while execution generate_user_intent: 'NoneType' object has no attribute 'agenerate_prompt' response="I'm sorry, an internal error has occurred." llm_output=None output_data={'triggered_input_rail': None} log=GenerationLog(activated_rails=[ActivatedRail(type='dialog', name='generate user intent', decisions=['execute generate_user_intent'], executed_actions=[ExecutedAction(action_name='generate_user_intent', action_params={}, return_value=None, llm_calls=[], started_at=1718713098.935654, finished_at=1718713098.947871, duration=0.012217044830322266)], stop=False, additional_info=None, started_at=1718713098.9356449, finished_at=1718713098.947905, duration=0.012260198593139648)], stats=GenerationStats(input_rails_duration=None, dialog_rails_duration=0.012260198593139648, generation_rails_duration=None, output_rails_duration=None, total_duration=0.014315128326416016, llm_calls_duration=0, llm_calls_count=0, llm_calls_total_prompt_tokens=0, llm_calls_total_completion_tokens=0, llm_calls_total_tokens=0), llm_calls=None, internal_events=None, colang_history=None) state=None

[Pouyanpi]

Hi @DrmedAllel, are you still facing this issue? This might help in resolving it.