Kubeflow Charmers Tf Serving

  • By Kubeflow Charmers
  • Ai Ml
Channel Revision Published Runs on
latest/stable 12 19 Mar 2021
Ubuntu 20.04
latest/candidate 12 19 Mar 2021
Ubuntu 20.04
latest/beta 12 19 Mar 2021
Ubuntu 20.04
latest/edge 12 19 Mar 2021
Ubuntu 20.04
juju deploy kubeflow-charmers-tf-serving
Show information

Platform:

Learn about configurations >

  • aws-access-key-id | string

    AWS Access Key ID. Only necessary when serving models from S3

  • aws-region | string

    AWS Region. Only necessary when serving models from S3

  • aws-secret-access-key | string

    AWS Secret Access Key. Only necessary when serving models from S3

  • env-vars | string

    Set extra environment variables for the workload. Expects the format of a multiline-string where every line is in the form `FOO=bar` (without the backticks).

  • grpc-port | int

    Default: 9000

    The port to serve the GRPC API on

  • model-base-path | string

    Path to single model to serve. Can either be an absolute path to a local file, starting with `/models` (as that's where storage is mounted), or an S3 URL such as s3://bucket/file

  • model-conf | string

    Configuration file containing models to serve

  • model-name | string

    Name of single model to serve

  • rest-port | int

    Default: 9001

    The port to serve the REST API on

  • s3-endpoint | string

    S3 Endpoint. Only necessary when serving models from S3

  • s3-use-https | string

    Default: 1

    If `1`, HTTPS will be used when talking to the S3 endpoint. If `0`, HTTP will be used.

  • s3-verify-ssl | string

    Default: 1

    If `1`, SSL certificates will be verified. If `0`, SSL certificates will not be verified.

  • tf-logging-level | string

    Default: 0

    Sets TF_CPP_MIN_LOG_LEVEL. Valid values are 0 through 3, inclusive