Helper module/class for LLM-based apps

[keighrim]

New Feature Summary

Now that we have more than a couple of LLM-based apps, and they share a lot of internal logic, I think we should consider refactor some of the LLM_based implementation to the SDK level. For example;

• model loading (via litellm)
• prompt sending and collecting responses
• common LLM configuration (temp, prompt levels - system/user, ...)
• common implementation of "long" configuration passing (much longer than usual runtime params that are passable via query string)

Related

all of these issues can be in part of SDK-level implementation
clamsproject/app-smolvlm2-captioner#2
clamsproject/app-smolvlm2-captioner#4

Alternatives

No response

Additional context

No response

[keighrim]

@kelleyl Please add more details from our conversation if there's anything missing.