Re: partition routing layering in nodeModifyTable.c
Heikki Linnakangas <hlinnaka@iki.fi>
From: Heikki Linnakangas <hlinnaka@iki.fi>
To: Amit Langote <amitlangote09@gmail.com>
Cc: Daniel Gustafsson <daniel@yesql.se>, Tom Lane <tgl@sss.pgh.pa.us>,
Etsuro Fujita <etsuro.fujita@gmail.com>, Andres Freund <andres@anarazel.de>,
Thomas Munro <thomas.munro@gmail.com>,
David Rowley <david.rowley@2ndquadrant.com>,
Robert Haas <robertmhaas@gmail.com>,
Alvaro Herrera <alvherre@2ndquadrant.com>,
Etsuro Fujita <fujita.etsuro@lab.ntt.co.jp>,
PostgreSQL-development <pgsql-hackers@postgresql.org>, amitdkhan.pg@gmail.com
Date: 2020-10-07T12:07:20Z
Lists: pgsql-hackers
On 07/10/2020 12:50, Amit Langote wrote: > On Tue, Oct 6, 2020 at 12:45 AM Heikki Linnakangas <hlinnaka@iki.fi> wrote: >> It would be better to set it in make_modifytable(), just >> after calling PlanDirectModify(). > > Actually, that's how it was done in earlier iterations but I think I > decided to move that into the FDW's functions due to some concern of > one of the other patches that depended on this patch. Maybe it makes > sense to bring that back into make_modifytable() and worry about the > other patch later. On second thoughts, I take back my earlier comment. Setting it in make_modifytable() relies on the assumption that the subplan is a single ForeignScan node, on the target relation. The documentation for PlanDirectModify says: > To execute the direct modification on the remote server, this > function must rewrite the target subplan with a ForeignScan plan node > that executes the direct modification on the remote server. So I guess that assumption is safe. But I'd like to have some wiggle room here. Wouldn't it be OK to have a Result node on top of the ForeignScan, for example? If it really must be a simple ForeignScan node, the PlanDirectModify API seems pretty strange. I'm not entirely sure what I would like to do with this now. I could live with either version, but I'm not totally happy with either. (I like your suggestion below) Looking at this block in postgresBeginDirectModify: > /* > * Identify which user to do the remote access as. This should match what > * ExecCheckRTEPerms() does. > */ > Assert(fsplan->resultRelIndex >= 0); > dmstate->resultRelIndex = fsplan->resultRelIndex; > rtindex = list_nth_int(resultRelations, fsplan->resultRelIndex); > rte = exec_rt_fetch(rtindex, estate); > userid = rte->checkAsUser ? rte->checkAsUser : GetUserId(); That's a complicated way of finding out the target table's RTI. We should probably store the result RTI in the ForeignScan in the first place. >> Another idea is to merge "resultRelIndex" and a "range table index" into >> one value. Range table entries that are updated would have a >> ResultRelInfo, others would not. I'm not sure if that would end up being >> cleaner or messier than what we have now, but might be worth trying. > > I have thought about something like this before. An idea I had is to > make es_result_relations array indexable by plain RT indexes, then we > don't need to maintain separate indexes that we do today for result > relations. That sounds like a good idea. es_result_relations is currently an array of ResultRelInfos, so that would leave a lot of unfilled structs in the array. But in on of your other threads, you proposed turning es_result_relations into an array of pointers anyway (https://www.postgresql.org/message-id/CA+HiwqE4k1Q2TLmCAvekw+8_NXepbnfUOamOeX=KpHRDTfSKxA@mail.gmail.com). - Heikki
Commits
-
Fix initialization of es_result_relations in EvalPlanQualStart().
- 22b73d3cb0b5 14.0 landed
-
Remove PartitionRoutingInfo struct.
- fb5883da8615 14.0 landed
-
Revise child-to-root tuple conversion map management.
- 6973533650c0 14.0 landed
-
Clean up code to resolve the "root target relation" in nodeModifyTable.c
- f49b85d783f6 14.0 landed
-
Refactor code for cross-partition updates to a separate function.
- c5b097f8fa69 14.0 landed
-
Remove es_result_relation_info from EState.
- a04daa97a433 14.0 landed
-
Include result relation info in direct modify ForeignScan nodes.
- 178f2d560dde 14.0 landed
-
Create ResultRelInfos later in InitPlan, index them by RT index.
- 1375422c7826 14.0 landed