Option to read Redis URL from AWS Secret#526

seanshi-scale merged 9 commits intomainscaleapi/llm-engine:mainfrom

seanshi/20240524-redis-url-from-aws-secretscaleapi/llm-engine:seanshi/20240524-redis-url-from-aws-secretCopy head branch name to clipboard