Run promises with a concurrency limit

Javascript

Keeps a fixed number of jobs in flight rather than firing a thousand requests at once.

async function pool(items, limit, worker) {
  const results = [];
  const running = new Set();
  for (const item of items) {
    const p = Promise.resolve().then(() => worker(item));
    results.push(p);
    running.add(p);
    p.finally(() => running.delete(p));
    if (running.size >= limit) await Promise.race(running);
  }
  return Promise.all(results);
}

Download

JavaScript promises concurrency chris

More in JavaScript

Deep clone a value JavaScript structuredClone handles Dates, Maps, Sets and cycles, which JSON round-tripping quietly destroys. Retry a fetch with exponential backoff JavaScript Backs off on each failure and adds jitter, so a recovering service is not hit by every client at the same moment. Copy text to the clipboard JavaScript The modern API needs a secure context and a real user gesture, so the failure path matters as much as the success one. Debounce without pulling in a library JavaScript Twelve lines covering the case most projects add a dependency for, including cancelling a call that has not fired yet. Fetch with a timeout JavaScript fetch has no timeout of its own. AbortSignal.timeout is the short way to give it one. Relative time without a date library JavaScript Turns a timestamp into 'three days ago' using the built-in formatter. Throttle with a trailing call JavaScript Runs at most once per interval but still fires once more after the last event, so the final state is never dropped. Group an array by a key JavaScript Object.groupBy is available in current runtimes; the reduce version is the fallback for older ones.

Random picks

Pin a dependency to an exact version Build & CI Caret ranges are how a build that passed last week fails today. Exact versions plus a lockfile remove the surprise. Security headers for an Express app Security The handful worth setting even when you are not using a framework that sets them for you. A starting Content-Security-Policy Security Blocks inline script and restricts everything to the origin. Tighten from here rather than loosening from nothing. Add a column without locking the table Databases On Postgres 11 and later a nullable column with a default is a metadata-only change. Adding NOT NULL afterwards is the part that needs care. Which indexes is nobody using? Databases Lists indexes that have never been scanned, which are pure write cost. Check against a long uptime before dropping any. A GitHub Actions workflow for a Node project Build & CI Caches the dependency install, runs on a matrix of versions, and fails the build on a lint error. Prepared statement with PDO PHP Placeholders rather than interpolation. This is the whole of SQL injection defence in PHP. Merge dictionaries Python The | operator returns a new dict; |= updates in place. Later keys win in both.