Re: [WIP]Vertical Clustered Index (columnar store extension) - take2

Alvaro Herrera <alvherre@alvh.no-ip.org>

From: Alvaro Herrera <alvherre@alvh.no-ip.org>
To: "Aya Iwata (Fujitsu)" <iwata.aya@fujitsu.com>
Cc: "pgsql-hackers@lists.postgresql.org" <pgsql-hackers@lists.postgresql.org>
Date: 2025-01-14T12:00:22Z
Lists: pgsql-hackers

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →
  1. Mark ItemPointer arguments as const throughout

  2. Reorganize GUC structs

  3. Eliminate XLOG_HEAP2_VISIBLE from vacuum phase III

  4. Update various forward declarations to use typedef

  5. Pathify RHS unique-ification for semijoin planning

  6. Revert "Don't lock partitions pruned by initial pruning"

  7. For inplace update, send nontransactional invalidations.

  8. Remove nearly-unused SizeOfIptrData macro.

Hello,

I came across this email by chance while looking for something else.

On 2024-Oct-07, Aya Iwata (Fujitsu) wrote:

> Therefore, we propose Vertical Clustered Indexing (VCI), an in-memory
> column store function that holds data in a state suitable for business
> analysis and is also expected to improve analysis performance.

> With VCI, you can also expect to run analysis 7.8 times faster. This
> is achieved by the analytics engine, which optimizes parallel
> processing of column-oriented data, in addition to the fact that VCI
> stores data in a columnar format, enabling efficient retrieval of the
> columns needed for analysis.

Wow.

> Request matter
> ===========
> 
> Are members of the PostgreSQL hackers interested in VCI features?
> We welcome your comments and suggestions on this feature.
> In particular, if you have any questions, required features, or implementations, please let me know.

I think this is definitely an important and welcome development.
I look forward to your patches in this area.

Thank you,

-- 
Álvaro Herrera        Breisgau, Deutschland  —  https://www.EnterpriseDB.com/
Essentially, you're proposing Kevlar shoes as a solution for the problem
that you want to walk around carrying a loaded gun aimed at your foot.
(Tom Lane)