Launch a Komodo Service.

Usage

komo service launch [OPTIONS] CONFIG_FILE

Options

OptionRequiredDescriptionType
‑‑nameNoService name. If not provided, a name will be generated.str
‑c, ‑‑cloudNoName of the cloud to use. If not provided, Komodo will select a cloud for you based on GPU prices and availability.str
‑g, ‑‑gpusNoWhich gpus to use, in the format <GPU type>:<Num GPUs> (eg. A100:4)str
‑d, ‑‑detachNoExit after the service is started instead of following the logsflag
‑e, ‑‑envNoSpecify an environment variable in the form --env key=value or --env key (value will come from the value of $key in your shell). You can use this flag multiple times to specify multiple environment variables.str

Examples

Launch a simple HTTP service on AWS using a config file.

service:
  readiness_probe:
    path: /
    initial_delay_seconds: 30

  replica_policy:
    min_replicas: 1
    max_replicas: 5
    target_qps_per_replica: 10
    upscale_delay_seconds: 60
    downscale_delay_seconds: 60

resources:
  cloud: aws
  ports: [8989]

workdir: .

envs:
  test_var: "test_value"

setup: |
  echo "Running setup operations"

run: |
  echo 'Running!'
  python -m http.server 8989

And then run

komo service launch --name simple-http service-simple-aws.yaml