Skip to content

AIX timing out when building V8 updates #4496

Description

@joyeecheung

At first it timed out when the timeout is 60 minutes https://ci.nodejs.org/job/node-test-commit-aix/65790/nodes=aix73-power9/console

Then @richardlau bumped it to 120minutes but it is still timing out https://ci.nodejs.org/job/node-test-commit-aix/65790/nodes=aix73-power9/console

From @sxa on slack:

OK that's while building the tq-csa files so it's the point at which the system is pushed to the limit in terms of system use. It's possible we're over the limit now when JOBS=10 on a 16GB system (which is how that machine is configured). I've dropped it to JOBS=9 so hopefully that will resolve it.

Opening an issue to track this since it appears more complicated than we thought

Activity

  1. sxa commented on Oct 1, 2026

    @sxa
    Member

    From the logs I expect it's hitting an out of memory condition on that system which has 16GB RAM and is set to run with JOBS=10. I ran some tests in #4230 (comment) which suggested that JOBS=10 was ok but it's possible that it was close to the limit, particularly when building the tq-csa files which are very resource intensive to compile. It's also possible that the V8 update is resulting in it using more memory than it did during those compiles with 14.6.

    What I'll try and do is run a couple of tests clearing the ccache and building the 14.6 and 15.2 builds

    In the interim I've dropped that machine to JOBS=9 so that if we are just close to the limit that will hopefully help.

  2. self-assigned this
    on Oct 1, 2026
  3. sxa commented on Oct 1, 2026

    @sxa
    Member

    https://ci.nodejs.org/job/node-test-commit-aix/nodes=aix73-power9/65841 is running on the same machine and has just been chewing through the tq-csa files on the V8 15.2 branch and looks to have got through that phase without problems.

  4. sxa commented on Oct 8, 2026

    @sxa
    Member

    Hmmm seen again today with JOBS=9 durignt he test build of V5 15.6 on ibm-aix73-3. I don't see it always happening though (I've done some builds with an unpopulated ccache in the last week and haven't hit it).

  5. sxa commented on Oct 8, 2026

    @sxa
    Member

    Ran through with JOBS=8 at https://ci.nodejs.org/job/node-test-commit-aix/nodes=aix73-power9/65966/console

    Hard to say if this is purely down to increased RAM requirements of the later V8s or if there's another thing we need to address, but I never hit an issue on these machines when building from scratch without a populated ccache in the past when it would have needed to rebuild everything

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions