How to manage prompts


Challenges:

  • Non-software devs should be able to edit and test
  • Prompts must be versioned
  • Prompts are often heavily tightly coupled to code for parsing, chaining, etc.
  • There should be an easy way to run evals and regression tests on prompts

Options:

  • FlowiseAI – for Low-code UI
  • Mirascope
  • LangSmith – for versioning and evals