Skip to content

ERROR running playbook on QA2 #321

@martindemko

Description

@martindemko

Playbook failed on nginx:

fatal: [galaxy-qa2.galaxy.cloud.e-infra.cz]: FAILED! => changed=false 
  msg: The new nginx configuration failed to install or validate, so the previous configuration has been restored. Please investigate the errors above for more information.

However, I was only able to find out this error in the log. Anyway, gravity was restarted, and Galaxy is running. Not sure if it's somehow connected.

fatal: [galaxy-qa2.galaxy.cloud.e-infra.cz]: FAILED! => changed=true 
  cmd:
  - /srv/galaxy/venv/bin/galaxyctl
  - -c
  - /srv/galaxy/config/galaxy.yml
  - graceful
  delta: '0:00:01.286209'
  end: '2026-05-13 22:38:39.588545'
  invocation:
    module_args:
      _raw_params: /srv/galaxy/venv/bin/galaxyctl -c /srv/galaxy/config/galaxy.yml graceful
      _uses_shell: false
      argv: null
      chdir: null
      creates: null
      executable: null
      removes: null
      stdin: null
      stdin_add_newline: true
      strip_empty_ends: true
      warn: false
  msg: non-zero return code
  rc: 1
  start: '2026-05-13 22:38:38.302336'
  stderr: |-
    Traceback (most recent call last):
      File "/srv/galaxy/venv/bin/galaxyctl", line 6, in <module>
        sys.exit(galaxyctl())
                 ^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1485, in __call__
        return self.main(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1406, in main
        rv = self.invoke(ctx)
             ^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1873, in invoke
        return _process_result(sub_ctx.command.invoke(sub_ctx))
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 1269, in invoke
        return ctx.invoke(self.callback, **ctx.params)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/core.py", line 824, in invoke
        return callback(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/click/decorators.py", line 34, in new_func
        return f(get_current_context(), *args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/commands/cmd_graceful.py", line 19, in cli
        pm.graceful(instance_names=instances_services)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/process_manager/__init__.py", line 75, in decorator
        routed_func(*args, **kwargs)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/process_manager/systemd.py", line 382, in graceful
        self.__graceful_service(config, service, service_names)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/process_manager/systemd.py", line 370, in __graceful_service
        service.rolling_restart(restart_callbacks)
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/state.py", line 275, in rolling_restart
        if not service_instance.is_ready(quiet=False):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/srv/galaxy/venv/lib/python3.11/site-packages/gravity/state.py", line 247, in is_ready
        raise NotImplementedError("is_ready not implemented for base Service class")
    NotImplementedError: is_ready not implemented for base Service class
  stderr_lines: <omitted>
  stdout: |-
    Restarted: galaxy-gunicorn.service
    Restarted: galaxy-celery.service
    Restarted: galaxy-celery-beat.service
    Performing rolling restart on service: handler
  stdout_lines: <omitted>

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions