Re: Popcount optimization using AVX512

Nathan Bossart <nathandbossart@gmail.com>

From: Nathan Bossart <nathandbossart@gmail.com>

To: "Amonson, Paul D" <paul.d.amonson@intel.com>

Cc: Tom Lane <tgl@sss.pgh.pa.us>, David Rowley <dgrowleyml@gmail.com>, Andres Freund <andres@anarazel.de>, Alvaro Herrera <alvherre@alvh.no-ip.org>, "Shankaran, Akash" <akash.shankaran@intel.com>, Noah Misch <noah@leadboat.com>, Matthias van de Meent <boekewurm+postgres@gmail.com>, "pgsql-hackers@lists.postgresql.org" <pgsql-hackers@lists.postgresql.org>

Date: 2024-03-28T21:38:54Z

Lists: pgsql-hackers

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →

Fix __attribute__((target(...))) usage.
- 41b98ddb77bf 18.0 landed
Use __attribute__((target(...))) for AVX-512 support.
- f78667bd910e 18.0 landed
Fix code for probing availability of AVX-512.
- 598e0114a3b1 17.0 landed
Optimize visibilitymap_count() with AVX-512 instructions.
- 41c51f0c68b2 17.0 landed
Optimize pg_popcount() with AVX-512 instructions.
- 792752af4eb5 17.0 landed
Inline pg_popcount() for small buffers.
- deb1486c7d36 17.0 landed
Avoid function call overhead of pg_popcount() in syslogger.c.
- 4133c1f45c54 17.0 landed
Refactor code for setting pg_popcount* function pointers.
- 6687430c98f3 17.0 landed
Inline pg_popcount{32,64} into pg_popcount().
- cc4826dd5e52 17.0 landed
Remove MSVC scripts
- 1301c80b2167 17.0 cited
Use ARMv8 CRC instructions where available.
- f044d71e331d 11.0 cited
Use Intel SSE 4.2 CRC instructions where available.
- 3dc2d62d0486 9.5.0 cited

Attachments

v14-0001-AVX512-popcount-support.patch (text/x-diff)

Here is a v14 of the patch that I think is beginning to approach something
committable.  Besides general review and testing, there are two things that
I'd like to bring up:

* The latest patch set from Paul Amonson appeared to support MSVC in the
  meson build, but not the autoconf one.  I don't have much expertise here,
  so the v14 patch doesn't have any autoconf/meson support for MSVC, which
  I thought might be okay for now.  IIUC we assume that 64-bit/MSVC builds
  can always compile the x86_64 popcount code, but I don't know whether
  that's safe for AVX512.

* I think we need to verify there isn't a huge performance regression for
  smaller arrays.  IIUC those will still require an AVX512 instruction or
  two as well as a function call, which might add some noticeable overhead.

-- 
Nathan Bossart
Amazon Web Services: https://aws.amazon.com