Repository navigation

v4: dequeue performance improvements (split concurrency from dequeue) - #2127

Merged

ericallam merged 25 commits into

mainfrom

v4-queue-dispatcher

Jun 4, 2025

Merged

v4: dequeue performance improvements (split concurrency from dequeue)#2127
ericallam merged 25 commits into
mainfrom
v4-queue-dispatcher

Commits on Jun 4, 2025
- WIP
  ericallam
  committed
  d8352f9
- Run queue now works with the worker queue / master queue split
  ericallam
  committed
  9cec702
- Acking should also cause the master queue to be processed
  ericallam
  committed
  9204ba0
- Convert run engine tests and run engine to use runQueue changes
  ericallam
  committed
  0ca8b0a
- Include the util files in the test tsconfig
  ericallam
  committed
  9193e53
- coordinator target should be es2020 as well
  ericallam
  committed
  a38f8e5
- providers target 2020
  ericallam
  committed
  6d5c8d2
- Fix the triggerTask tests in the webapp
  ericallam
  committed
  a25bae2
- v4 now working with the new worker queues, and added the legacy master queue migration stuff
  ericallam
  committed
  f5d54b0
- report worker queue lengths via opentelemetry metrics
  ericallam
  committed
  a2aa2c8
- Adding lock metrics
  ericallam
  committed
  e2d7c13
- Release concurrency bucket metrics
  ericallam
  committed
  ff2768c
- • Updated RunQueue.removeEnvironmentQueuesFromMasterQueue() method signature to take runtimeEnvironmentId instead of masterQueue parameter
  ericallam
  committed
  57ee381
- metrics now working, configure the run queue settings, additional metrics for run engine and redis-worker
  ericallam
  committed
  2e0ead9
- Fix CodeRabbit suggestions
  ericallam
  committed
  5fd0efd
- return undefined from dequeueFromWorkerQueue, not null
  ericallam
  committed
  5b78b5d
- Remove message from worker queue in certain circumstances when acking
  ericallam
  committed
  01f62df
- Update log
  ericallam
  committed
  95a522b
- Ensure master queue consumers cannot stop from a processing error, and make the consumer interval configurable via an env var
  ericallam
  committed
  be82a67
- Change how the run queue master queue consumers are disabled internally
  ericallam
  committed
  4b073b2
- Fixed tests
  ericallam
  committed
  d5cfa24
- process the queue on nack
  ericallam
  committed
  9037d3c
- Fix more tests
  ericallam
  committed
  79e7a15
- Fix priority tests
  ericallam
  committed
  7387c0e
- Fixed dequeueing test
  ericallam
  committed
  54f06f5

Commits

Commits on Jun 4, 2025