Re: [HACKERS] path toward faster partition pruning

Amit Langote <langote_amit_f8@lab.ntt.co.jp>

From: Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>

To: Robert Haas <robertmhaas@gmail.com>

Cc: Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>, Jesper Pedersen <jesper.pedersen@redhat.com>, David Rowley <david.rowley@2ndquadrant.com>, Amit Langote <amitlangote09@gmail.com>, Rajkumar Raghuwanshi <rajkumar.raghuwanshi@enterprisedb.com>, Dilip Kumar <dilipbalaut@gmail.com>, Beena Emerson <memissemerson@gmail.com>, "pgsql-hackers@postgresql.org" <pgsql-hackers@postgresql.org>

Date: 2018-02-13T11:08:59Z

Lists: pgsql-hackers

Attachments

v26-0001-Modify-bound-comparision-functions-to-accept-mem.patch (text/plain) patch v26-0001
v26-0002-Refactor-partition-bound-search-functions.patch (text/plain) patch v26-0002
v26-0003-Add-parttypid-partcollation-partsupfunc-to-Parti.patch (text/plain) patch v26-0003
v26-0004-Faster-partition-pruning.patch (text/plain) patch v26-0004
v26-0005-Add-only-unpruned-partitioned-child-rels-to-part.patch (text/plain) patch v26-0005

On 2018/02/09 21:36, Amit Langote wrote:
> 0004-Faster-partition-pruning.patch
> 
> The main patch that adds src/backend/optimizer/util/partprune.c, a module
> to provide the functionality that will replace the current approach of
> calling relation_excluded_by_constraints() for each partition.
> 
> Sorry, but there is still this big TODO here, which I'll try to fix early
> next week.
> 
> + * partprune.c
> + *      Provides functions to prune partitions of a partitioned table by
> + *      comparing provided set of clauses with the table's partitions'
> + *      boundaries
> + *
> + * TODO: write a longer description of things in this file

And I tried to fix that to some degree in the attached updated version.

Thanks,
Amit

Commits

Fix assorted partition pruning bugs
- d758d9702e2f 11.0 landed
Make gen_partprune_steps static
- d1e2cac5ff7e 11.0 landed
Remove useless 'default' clause
- c775fb9e18ac 11.0 landed
Reorganize partitioning code
- da6f3e45ddb6 11.0 landed
Use custom hash opclass for hash partition pruning
- fafec4cce814 11.0 landed
Blindly attempt to fix sepgsql tests broken due to 9fdb675fc5.
- 4f813c7203e0 11.0 landed
Attempt to fix endianess issues in new hash partition test.
- 40e42e1024c5 11.0 landed
Faster partition pruning
- 9fdb675fc5d2 11.0 landed
For partitionwise join, match on partcollation, not parttypcoll.
- 2af28e603319 11.0 landed
Revise API for partition bound search functions.
- f724022d0ae0 11.0 landed
Revise API for partition_rbound_cmp/partition_rbound_datum_cmp.
- b0229235564f 11.0 landed
Fix possible crash in partition-wise join.
- f069c91a5793 11.0 cited
Refactor code for partition bound searching
- 9aef173163ae 11.0 landed
New C function: bms_add_range
- 84940644de93 11.0 landed
Add extensive tests for partition pruning.
- 8d4e70a63bf8 11.0 landed
Add null test to partition constraint for default range partitions.
- 7b88d63a9122 11.0 cited
Remove BufFile's isTemp flag.
- 11e264517dff 11.0 cited
Make OWNER TO subcommand mention consistent
- bf54c0f05c0a 11.0 cited
Fix index matching for operators with mixed collatable/noncollatable inputs.
- cb37c291060d 9.2.0 cited