Skip to content
This repository was archived by the owner on Sep 13, 2023. It is now read-only.
This repository was archived by the owner on Sep 13, 2023. It is now read-only.

Pin flyctl version to <0.1.0 in MLEM #677

Description

@mchugh80

MLEM requires a flyctl version of <0.1.0, but the most recent version are > 0.1.0

The following error is observed when following the steps in https://iterative.ai/blog/mlem-nanogpt-modal-flyio/

mlem deploy run flyio app -m mlem_char \
        --app_name mlem-test-nanogpt --scale_memory 1024 \
        --server streamlit  --server.ui_port 8080 \
        --server.server_port 8081 --server.template app.py
⏳️ Loading deployment from app.mlem
:floppy_disk: Saving deployment to app.mlem
⏳️ Loading model from mlem_char.mlem
automatically selected personal organization: MyName
:x: Unexpected error: 'Key "services" does not exist.'
Use the --tb or --traceback option to include the traceback in the output
Please report it here: <https://github.com/iterative/mlem/issues> 

Printing the fly.toml from meta.py when running the original deploy command:

mlem deploy run flyio app -m mlem_char \
        --app_name mlem-test-nanogpt --scale_memory 1024 \
        --server streamlit  --server.ui_port 8080 \
        --server.server_port 8081 --server.template app.py

gives the following format, which is different from the fly.toml expected by MLEM
{'app': 'mlem-test-nanogpt', 'primary_region': 'lax', 'http_service': {'internal_port': 8080, 'force_https': True, 'auto_stop_machines': True, 'auto_start_machines': True, 'min_machines_running': 0}}

Pinning the flyctl version to v0.0.559 should resolve this.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingdeployRelated to model deploymentpluginsPlugins and extensions for MLEM!

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions