Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

generator list is slow #624

Closed
leondz opened this issue Apr 24, 2024 · 0 comments · Fixed by #768
Closed

generator list is slow #624

leondz opened this issue Apr 24, 2024 · 0 comments · Fixed by #768
Labels
quality-speed This affects the speed of program use

Comments

@leondz
Copy link
Owner

leondz commented Apr 24, 2024

python3 -m garak --list_generators should return almost instantly - instead it takes a few seconds.

LiteLLM complaint is dumped out top, maybe this module is being instantiated?

garak LLM security probe v0.9.0.12.post1 ( https://github.com/leondz/garak ) at 2024-04-24T14:36:38.356597
14:36:40 - LiteLLM:DEBUG: utils.py:100 - Exception import enterprise features No module named 'litellm.proxy.enterprise'
generators: cohere 🌟
generators: cohere.CohereGenerator
generators: function 🌟
generators: function.Single
generators: ggml 🌟
generators: ggml.GgmlGenerator
generators: guardrails 🌟
generators: guardrails.NeMoGuardrails
generators: langchain 🌟
generators: langchain.LangChainLLMGenerator
generators: litellm 🌟
generators: litellm.LiteLLMGenerator
generators: nemo 🌟
generators: nemo.NeMoGenerator
generators: nvcf 🌟
generators: nvcf.NvcfGenerator
generators: octo 🌟
generators: octo.OctoGenerator
generators: openai 🌟
generators: openai.OpenAIGenerator
generators: rasa 🌟
generators: rasa.RestGenerator
generators: replicate 🌟
generators: replicate.ReplicateGenerator
generators: rest 🌟
generators: rest.RestGenerator
generators: test 🌟
generators: test.Blank
generators: test.Repeat

Would be nice to, in the longer term, have a consistent pattern for differentiating plugin list from load

@leondz leondz added enhancement Architectural upgrades ux Interface & interaction improvements quality-speed This affects the speed of program use and removed enhancement Architectural upgrades ux Interface & interaction improvements labels Apr 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
quality-speed This affects the speed of program use
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant