Skip to content

CI not starting any jobs - out of space #2453

Closed

Description

@AshCripps

trying to start https://ci.nodejs.org/job/node-test-commit-aix-ashcripps/ and I just get page refreshes and according to grafana looks like the CI system is out of space
image

@nodejs/build-infra

Activity

  1. rvagg commented on Oct 2, 2020

    @rvagg
    Member

    I think the backup server has filled up which has stopped the automatic cleanup:

    zones/6dbfb615-b1ac-4f9a-8006-2cb45b87e4cb  3.0T  3.0T     0 100% /
    

    @jbergstroem halp!

    I'm running the cleanup scripts manually and will restart ci afterward.

    FYI on the backup server, the cleanup script is called from /var/spool/cron/crontabs/root, I'm running:

    /root/backup_scripts/remove_old.sh ci.nodejs.org
    /root/backup_scripts/remove_old.sh ci-release.nodejs.org
  2. rvagg commented on Oct 2, 2020

    @rvagg
    Member

    done and restarted, and I've updated Jenkins plugins while I was in there:

    WMI Windows Agents
    Trilead API
    Git client
    Git
    Pipeline: Nodes and Processes
    Bitbucket Branch Source
    JUnit
    Pipeline: Basic Steps
    Groovy
    SCM API
    Git client
    Lockable Resources
    Matrix Project
    Role-based Authorization Strategy

    This will mean a second restart which I'll get sorted out when this current queue is emptied.

  3. AshCripps commented on Oct 2, 2020

    @AshCripps
    MemberAuthor

    Thanks a lot @rvagg sorry to disturb your evening!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions