feat(BA-1607): Add runtime_variant parameter to Service creation SDK function

[fregataa]

resolves #4748 (BA-1607)

Checklist: (if applicable)

• Milestone metadata specifying the target backport version
• Mention to the original issue
• Installer updates including:
  • Fixtures for db schema changes
  • New mandatory config options
• Update of end-to-end CLI integration tests in ai.backend.test
• API server-client counterparts (e.g., manager API -> client SDK)
• Test case(s) to:
  • Demonstrate the difference of before/after
  • Demonstrate the flow of abstract/conceptual models with a concrete implementation
• Documentation
  • Contents in the docs directory
  • docstrings in public interfaces and type annotations

[Copilot]

Pull Request Overview

Add a new runtime_variant option to the Service creation functions in both the SDK and CLI, allowing callers to specify which runtime environment should back their inference service.

• Introduce runtime_variant parameter in the async client SDK create method (type, docstring, and request payload)
• Add a --runtime-variant click option to the CLI create command and include it in the request body

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File	Description
src/ai/backend/client/func/service.py	Added optional runtime_variant param, docstring entry, and payload field
src/ai/backend/client/cli/service.py	Imported RuntimeVariant, added --runtime-variant CLI option, and passed it in the request body

Comments suppressed due to low confidence (2)

src/ai/backend/client/func/service.py:116

• There are no tests covering the new runtime_variant parameter. Add unit or integration tests to verify behavior when it is provided or omitted.

        runtime_variant: Optional[str] = None,

src/ai/backend/client/func/service.py:1

• Missing import for RuntimeVariant, which is referenced in the type annotation suggestion and should also be used in the payload for consistency. Add:

from ai.backend.common.types import RuntimeVariant

from collections.abc import Mapping, Sequence

[Copilot]

Consider using the RuntimeVariant enum for the runtime_variant parameter instead of a plain string. For example:

from ai.backend.common.types import RuntimeVariant
...
runtime_variant: Optional[RuntimeVariant] = None,

Suggested change

	runtime_variant: Optional[str] = None,
	runtime_variant: Optional[RuntimeVariant] = None,

[Copilot]

The click.Choice invocation is passing the enum class directly. It should pass the enum values, e.g.:

type=click.Choice([rv.value for rv in RuntimeVariant], case_sensitive=False)

Suggested change

	type=click.Choice([*RuntimeVariant], case_sensitive=False),
	type=click.Choice([rv.value for rv in RuntimeVariant], case_sensitive=False),