Skip to content

Conversation

omaryashraf5
Copy link
Contributor

What does this PR do?

Adds a guide for launching multiple LlamaStack servers using the starter distribution.

Test Plan

Tested all commands in this guide on my dev-server.

@omaryashraf5 omaryashraf5 self-assigned this Oct 2, 2025
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Oct 2, 2025
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: can you please use lowercase in the file name?

Copy link
Collaborator

@leseb leseb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm failing to understand the rationale here? Why would someone do that in production? Nobody is going to use nohup or multiple terminals. Production will use container images (via systemd unit) or run the distro server with a systemd unit.

If the argument is around developers, I don't think this needs to be documented either. We have a getting started guide that offers multiple options, too. If people are looking at running multiple instances for whatever reason, they should be able to figure that out without needing explicit instructions from us.

@omaryashraf5
Copy link
Contributor Author

@leseb I understand your point, would it be helpful to create documentation for spinning up multiple LS servers for production container deployments?

@omaryashraf5 omaryashraf5 marked this pull request as draft October 2, 2025 17:39
@leseb
Copy link
Collaborator

leseb commented Oct 3, 2025

@leseb I understand your point, would it be helpful to create documentation for spinning up multiple LS servers for production container deployments?

Yes I see value in that. Not necessarily multiple instances but at least containers running through a systemd unit. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants