Thread

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →
  1. doc: Mention validation attempt during ALTER INDEX .. ATTACH PARTITION

  2. Allow ALTER INDEX .. ATTACH PARTITION to validate a parent index

  1. [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Mohamed ALi <moali.pg@gmail.com> — 2026-04-09T06:16:48Z

    Hi hackers,
    
    A partitioned (parent) index in PostgreSQL can become permanently
    stuck with `indisvalid = false` even after all of its child partition
    indexes have been repaired and are valid. There is no built-in
    mechanism to re-validate the parent index after a child is fixed via
    `REINDEX`. This affects all currently supported PostgreSQL versions
    (13 through 18)
    The root cause is that `validatePartitionedIndex()` — the only
    function that can mark a partitioned index as valid is never called
    after `REINDEX` operations, and is skipped when re-running `ALTER
    INDEX ATTACH PARTITION` on an already-attached index.
    
    How the Bug Manifests
    
    Typical Scenario :
    1. A partitioned table has multiple partitions.
    2. The user creates indexes on partitions concurrently. One fails (due
    to deadlock, cancellation, timeout, etc.), leaving an invalid
    partition index.
    3. A parent index is created (or the invalid index is attached to an
    existing parent). The parent is correctly marked `indisvalid = false`
    because at least one child is invalid.
    4. The user fixes the broken child index with `REINDEX INDEX CONCURRENTLY`.
    5. The child index becomes valid (`indisvalid = true`).
    6. The parent index remains `indisvalid = false` permanently. No SQL
    command can fix it.
    
    Reproduction steps:
    
    ```sql
    -- ============================================================
    -- SETUP: Partitioned table with two partitions and sample data
    -- ============================================================
    DROP TABLE IF EXISTS orders;
    CREATE TABLE orders (
        id serial,
        order_date date NOT NULL,
        amount numeric
    ) PARTITION BY RANGE (order_date);
    CREATE TABLE orders_2023 PARTITION OF orders
        FOR VALUES FROM ('2023-01-01') TO ('2024-01-01');
    CREATE TABLE orders_2024 PARTITION OF orders
        FOR VALUES FROM ('2024-01-01') TO ('2025-01-01');
    INSERT INTO orders (order_date, amount)
    SELECT d, random() * 1000
    FROM generate_series('2023-01-01'::date, '2023-12-31'::date, '1 day') d;
    INSERT INTO orders (order_date, amount)
    SELECT d, random() * 1000
    FROM generate_series('2024-01-01'::date, '2024-12-31'::date, '1 day') d;
    -- ============================================================
    -- STEP 1: Create parent index with ONLY (starts as invalid)
    -- ============================================================
    CREATE INDEX orders_amount_idx ON ONLY orders (amount);
    -- Verify: parent index is invalid (no children attached yet)
    SELECT c.relname, i.indisvalid
    FROM pg_class c
    JOIN pg_index i ON c.oid = i.indexrelid
    WHERE c.relname LIKE 'orders%idx%'
    ORDER BY c.relname;
    -- Expected:
    --  orders_amount_idx | f
    -- ============================================================
    -- STEP 2: Create valid index on first partition
    -- ============================================================
    CREATE INDEX CONCURRENTLY orders_2023_amount_idx ON orders_2023 (amount);
    -- ============================================================
    -- STEP 3: Create an INVALID index on second partition
    -- ============================================================
    -- In a separate session, hold a lock:
    BEGIN; LOCK TABLE orders_2024 IN SHARE MODE;
    -- Then in the main session:
    SET statement_timeout = '1ms';
    CREATE INDEX CONCURRENTLY orders_2024_amount_idx ON orders_2024 (amount);
    RESET statement_timeout;
    -- it will fail/timeout, leaving an invalid index.
    -- Verify state:
    SELECT c.relname, i.indisvalid
    FROM pg_class c
    JOIN pg_index i ON c.oid = i.indexrelid
    WHERE c.relname LIKE 'orders%idx%'
    ORDER BY c.relname;
    -- Expected:
    --  orders_2023_amount_idx | t   (valid)
    --  orders_2024_amount_idx | f   (invalid)
    --  orders_amount_idx      | f   (invalid, created with ONLY)
    -- ============================================================
    -- STEP 4: Attach both partition indexes to the parent
    -- ============================================================
    -- Attach the invalid one first
    ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2024_amount_idx;
    -- Succeeds. Parent stays invalid (correct — child is invalid).
    -- Attach the valid one
    ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2023_amount_idx;
    -- Succeeds. Parent still invalid (correct — one child still invalid).
    -- Verify attachment and validity:
    SELECT c.relname, i.indisvalid,
           pg_get_indexdef(i.indexrelid) AS indexdef
    FROM pg_class c
    JOIN pg_index i ON c.oid = i.indexrelid
    WHERE c.relname LIKE 'orders%amount%'
    ORDER BY c.relname;
    -- Expected:
    --  orders_2023_amount_idx | t
    --  orders_2024_amount_idx | f
    --  orders_amount_idx      | f
    -- ============================================================
    -- STEP 5: Fix the invalid child index via REINDEX
    -- ============================================================
    REINDEX INDEX CONCURRENTLY orders_2024_amount_idx;
    -- Verify: child is now valid
    SELECT c.relname, i.indisvalid
    FROM pg_class c
    JOIN pg_index i ON c.oid = i.indexrelid
    WHERE c.relname LIKE 'orders%amount%'
    ORDER BY c.relname;
    -- ACTUAL (buggy) result:
    --  orders_2023_amount_idx | t   (valid)
    --  orders_2024_amount_idx | t   (valid — fixed by REINDEX)
    --  orders_amount_idx      | f   (STILL INVALID — this is the bug!)
    --
    -- EXPECTED result (if bug were fixed):
    --  orders_2023_amount_idx | t
    --  orders_2024_amount_idx | t
    --  orders_amount_idx      | t   (should be valid now)
    -- ============================================================
    -- STEP 6: Demonstrate that re-running ATTACH does not help
    -- ============================================================
    ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2024_amount_idx;
    -- Returns "ALTER INDEX" (succeeds silently, does nothing)
    SELECT c.relname, i.indisvalid
    FROM pg_class c
    JOIN pg_index i ON c.oid = i.indexrelid
    WHERE c.relname LIKE 'orders%amount%'
    ORDER BY c.relname;
    -- Parent is STILL invalid. The "silently do nothing" path
    -- skips validatePartitionedIndex() entirely.
    -- ============================================================
    -- CLEANUP
    -- ============================================================
    DROP TABLE orders;
    ```
    
    
    Root Cause Analysis:
    
    Where `validatePartitionedIndex()` Is Called
    
    The function is called in exactly these code paths:
    1. During `ALTER INDEX ... ATTACH PARTITION` — inside
    `ATExecAttachPartitionIdx()`
    2. During `ALTER TABLE ... ATTACH PARTITION` — via
    `AttachPartitionEnsureIndexes()`
    3. During `CREATE INDEX` on partitioned tables — via `DefineIndex()`
    It is NOT called:
    - After `REINDEX` of a partitioned index
    - During any maintenance operation
    - As any periodic validation check
    
    Bug 1: REINDEX Does Not Validate Parent
    
    
    When `reindex_index()` in `src/backend/catalog/index.c` marks a
    partition index as valid (setting `indisvalid = true`), it does not
    check whether the parent partitioned index should also become valid.
    The function simply updates the child's `pg_index` entry and returns.
    
    Bug 2: Re-running ATTACH Skips Validation
    
    
    In `ATExecAttachPartitionIdx()` (tablecmds.c, around line 21923 in PG
    16 / line ~22900 in HEAD):
    https://github.com/postgres/postgres/blob/master/src/backend/commands/tablecmds.c#L21923
    
    ```c
    /* Silently do nothing if already in the right state */
    currParent = partIdx->rd_rel->relispartition ?
        get_partition_parent(partIdxId, false) : InvalidOid;
    if (currParent != RelationGetRelid(parentIdx))
    {
        // ... all validation checks and attachment logic ...
        validatePartitionedIndex(parentIdx, parentTbl);  // ONLY called here
    }
    // If already attached, entire block is skipped — no validation!
    ```
    
    When the child is already attached (`currParent == parentIdx`), the
    condition is false, the entire if-block is skipped, and
    `validatePartitionedIndex()` is never called. The comment "Silently do
    nothing if already in the right state" is misleading  "already
    attached" does not mean "parent validity is correct."
    
    Proposed Fixes:
    
    Fix 1 : Always Validate Parent Index in ALTER INDEX ATTACH PARTITION
    
    Patch File : 0001-Always-validate-parent-index-in-ALTER-INDEX-ATTACH.patch
    
    Move the validatePartitionedIndex() call outside the if-block so it runs
    unconditionally — both when a new attachment is made and when the partition is
    already attached. This provides a user-accessible recovery path: after fixing a
    child index with REINDEX, re-running ALTER INDEX ATTACH PARTITION triggers
    parent validation.
    
    When the partition is already attached, a NOTICE is emitted:
    
    NOTICE:  partition index "child_idx" is already attached to
    "parent_idx", validating parent index
    
    
    This follows PostgreSQL's existing convention of using NOTICE for
    informational messages about no-op or reduced-scope operations (e.g.,
    DROP TABLE IF EXISTS, CREATE INDEX IF NOT EXISTS). It tells the user:
    
    1- Nothing went wrong
    2- The index was already attached (so they know the state)
    3-  Validation still happened (so they know the fix path works)
    
    
    Fix 2: Validate Parent Partitioned Index After REINDEX of Child
    
    Patch File : 0001-Validate-parent-partitioned-index-after-REINDEX.patch
    
    Same underlying bug but this patch addresses it from the
    REINDEX side. When a partition index is repaired via REINDEX or
    REINDEX CONCURRENTLY, the parent partitioned index remains permanently
    stuck with indisvalid = false even though all children are now valid.
    
    This is because validatePartitionedIndex() — the only function that can
    mark a partitioned index as valid is never called from any REINDEX code
    path.
    
    
    validatePartitionedIndex() is only called during:
    
    1- ALTER INDEX ... ATTACH PARTITION (tablecmds.c)
    2- ALTER TABLE ... ATTACH PARTITION (tablecmds.c)
    3- CREATE INDEX on partitioned tables (indexcmds.c)
    
    It is NOT called after:
    
    1- REINDEX INDEX (regular) — handled by reindex_index() in index.c
    2- REINDEX INDEX CONCURRENTLY — handled by ReindexRelationConcurrently()
    
    in indexcmds.c, which uses index_concurrently_swap() in index.c
    
    Three changes are made:
    
    1. Make validatePartitionedIndex() public
    The function was static in tablecmds.c. It is now exported via
    tablecmds.h so it can be called from index.c and indexcmds.c.
    
    Files changed:
    
    src/backend/commands/tablecmds.c — remove static, update comment
    src/include/commands/tablecmds.h — add extern declaration
    
    2. Call from reindex_index() (regular REINDEX)
    After reindex_index() marks a partition index as valid (indisvalid = true),
    check if the index is a partition (iRel->rd_rel->relispartition) and if so,
    look up the parent and call validatePartitionedIndex().
    
    A CommandCounterIncrement() is required before the call so that the child's
    updated indisvalid is visible to the syscache lookup that
    validatePartitionedIndex() performs internally.
    
    File changed: src/backend/catalog/index.c
    
    3. Call from ReindexRelationConcurrently() (REINDEX CONCURRENTLY)
    REINDEX CONCURRENTLY uses a completely different code path: it creates a new
    index, builds it concurrently, then swaps it with the old one via
    index_concurrently_swap(). The new index inherits the old index's partition
    status during the swap.
    
    After the swap and the existing CommandCounterIncrement() (which makes the
    swap visible), check if the new index is a partition and call
    validatePartitionedIndex() on the parent.
    
    File changed: src/backend/commands/indexcmds.c
    
    Multi-level Hierarchy Support
    validatePartitionedIndex() already handles multi-level partition hierarchies.
    When it marks a mid-level parent valid, it checks if that parent is itself a
    partition and recursively validates the grandparent. No additional recursion
    logic is needed in the REINDEX patches.
    
    
    Thanks,
    Mohamed Ali
    Senior DBE
    AWS RDS
    
  2. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Haibo Yan <tristan.yim@gmail.com> — 2026-04-11T00:55:29Z

    On Wed, Apr 8, 2026 at 11:17 PM Mohamed ALi <moali.pg@gmail.com> wrote:
    
    > Hi hackers,
    >
    > A partitioned (parent) index in PostgreSQL can become permanently
    > stuck with `indisvalid = false` even after all of its child partition
    > indexes have been repaired and are valid. There is no built-in
    > mechanism to re-validate the parent index after a child is fixed via
    > `REINDEX`. This affects all currently supported PostgreSQL versions
    > (13 through 18)
    > The root cause is that `validatePartitionedIndex()` — the only
    > function that can mark a partitioned index as valid is never called
    > after `REINDEX` operations, and is skipped when re-running `ALTER
    > INDEX ATTACH PARTITION` on an already-attached index.
    >
    > How the Bug Manifests
    >
    > Typical Scenario :
    > 1. A partitioned table has multiple partitions.
    > 2. The user creates indexes on partitions concurrently. One fails (due
    > to deadlock, cancellation, timeout, etc.), leaving an invalid
    > partition index.
    > 3. A parent index is created (or the invalid index is attached to an
    > existing parent). The parent is correctly marked `indisvalid = false`
    > because at least one child is invalid.
    > 4. The user fixes the broken child index with `REINDEX INDEX CONCURRENTLY`.
    > 5. The child index becomes valid (`indisvalid = true`).
    > 6. The parent index remains `indisvalid = false` permanently. No SQL
    > command can fix it.
    >
    > Reproduction steps:
    >
    > ```sql
    > -- ============================================================
    > -- SETUP: Partitioned table with two partitions and sample data
    > -- ============================================================
    > DROP TABLE IF EXISTS orders;
    > CREATE TABLE orders (
    >     id serial,
    >     order_date date NOT NULL,
    >     amount numeric
    > ) PARTITION BY RANGE (order_date);
    > CREATE TABLE orders_2023 PARTITION OF orders
    >     FOR VALUES FROM ('2023-01-01') TO ('2024-01-01');
    > CREATE TABLE orders_2024 PARTITION OF orders
    >     FOR VALUES FROM ('2024-01-01') TO ('2025-01-01');
    > INSERT INTO orders (order_date, amount)
    > SELECT d, random() * 1000
    > FROM generate_series('2023-01-01'::date, '2023-12-31'::date, '1 day') d;
    > INSERT INTO orders (order_date, amount)
    > SELECT d, random() * 1000
    > FROM generate_series('2024-01-01'::date, '2024-12-31'::date, '1 day') d;
    > -- ============================================================
    > -- STEP 1: Create parent index with ONLY (starts as invalid)
    > -- ============================================================
    > CREATE INDEX orders_amount_idx ON ONLY orders (amount);
    > -- Verify: parent index is invalid (no children attached yet)
    > SELECT c.relname, i.indisvalid
    > FROM pg_class c
    > JOIN pg_index i ON c.oid = i.indexrelid
    > WHERE c.relname LIKE 'orders%idx%'
    > ORDER BY c.relname;
    > -- Expected:
    > --  orders_amount_idx | f
    > -- ============================================================
    > -- STEP 2: Create valid index on first partition
    > -- ============================================================
    > CREATE INDEX CONCURRENTLY orders_2023_amount_idx ON orders_2023 (amount);
    > -- ============================================================
    > -- STEP 3: Create an INVALID index on second partition
    > -- ============================================================
    > -- In a separate session, hold a lock:
    > BEGIN; LOCK TABLE orders_2024 IN SHARE MODE;
    > -- Then in the main session:
    > SET statement_timeout = '1ms';
    > CREATE INDEX CONCURRENTLY orders_2024_amount_idx ON orders_2024 (amount);
    > RESET statement_timeout;
    > -- it will fail/timeout, leaving an invalid index.
    > -- Verify state:
    > SELECT c.relname, i.indisvalid
    > FROM pg_class c
    > JOIN pg_index i ON c.oid = i.indexrelid
    > WHERE c.relname LIKE 'orders%idx%'
    > ORDER BY c.relname;
    > -- Expected:
    > --  orders_2023_amount_idx | t   (valid)
    > --  orders_2024_amount_idx | f   (invalid)
    > --  orders_amount_idx      | f   (invalid, created with ONLY)
    > -- ============================================================
    > -- STEP 4: Attach both partition indexes to the parent
    > -- ============================================================
    > -- Attach the invalid one first
    > ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2024_amount_idx;
    > -- Succeeds. Parent stays invalid (correct — child is invalid).
    > -- Attach the valid one
    > ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2023_amount_idx;
    > -- Succeeds. Parent still invalid (correct — one child still invalid).
    > -- Verify attachment and validity:
    > SELECT c.relname, i.indisvalid,
    >        pg_get_indexdef(i.indexrelid) AS indexdef
    > FROM pg_class c
    > JOIN pg_index i ON c.oid = i.indexrelid
    > WHERE c.relname LIKE 'orders%amount%'
    > ORDER BY c.relname;
    > -- Expected:
    > --  orders_2023_amount_idx | t
    > --  orders_2024_amount_idx | f
    > --  orders_amount_idx      | f
    > -- ============================================================
    > -- STEP 5: Fix the invalid child index via REINDEX
    > -- ============================================================
    > REINDEX INDEX CONCURRENTLY orders_2024_amount_idx;
    > -- Verify: child is now valid
    > SELECT c.relname, i.indisvalid
    > FROM pg_class c
    > JOIN pg_index i ON c.oid = i.indexrelid
    > WHERE c.relname LIKE 'orders%amount%'
    > ORDER BY c.relname;
    > -- ACTUAL (buggy) result:
    > --  orders_2023_amount_idx | t   (valid)
    > --  orders_2024_amount_idx | t   (valid — fixed by REINDEX)
    > --  orders_amount_idx      | f   (STILL INVALID — this is the bug!)
    > --
    > -- EXPECTED result (if bug were fixed):
    > --  orders_2023_amount_idx | t
    > --  orders_2024_amount_idx | t
    > --  orders_amount_idx      | t   (should be valid now)
    > -- ============================================================
    > -- STEP 6: Demonstrate that re-running ATTACH does not help
    > -- ============================================================
    > ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2024_amount_idx;
    > -- Returns "ALTER INDEX" (succeeds silently, does nothing)
    > SELECT c.relname, i.indisvalid
    > FROM pg_class c
    > JOIN pg_index i ON c.oid = i.indexrelid
    > WHERE c.relname LIKE 'orders%amount%'
    > ORDER BY c.relname;
    > -- Parent is STILL invalid. The "silently do nothing" path
    > -- skips validatePartitionedIndex() entirely.
    > -- ============================================================
    > -- CLEANUP
    > -- ============================================================
    > DROP TABLE orders;
    > ```
    >
    >
    > Root Cause Analysis:
    >
    > Where `validatePartitionedIndex()` Is Called
    >
    > The function is called in exactly these code paths:
    > 1. During `ALTER INDEX ... ATTACH PARTITION` — inside
    > `ATExecAttachPartitionIdx()`
    > 2. During `ALTER TABLE ... ATTACH PARTITION` — via
    > `AttachPartitionEnsureIndexes()`
    > 3. During `CREATE INDEX` on partitioned tables — via `DefineIndex()`
    > It is NOT called:
    > - After `REINDEX` of a partitioned index
    > - During any maintenance operation
    > - As any periodic validation check
    >
    > Bug 1: REINDEX Does Not Validate Parent
    >
    >
    > When `reindex_index()` in `src/backend/catalog/index.c` marks a
    > partition index as valid (setting `indisvalid = true`), it does not
    > check whether the parent partitioned index should also become valid.
    > The function simply updates the child's `pg_index` entry and returns.
    >
    > Bug 2: Re-running ATTACH Skips Validation
    >
    >
    > In `ATExecAttachPartitionIdx()` (tablecmds.c, around line 21923 in PG
    > 16 / line ~22900 in HEAD):
    >
    > https://github.com/postgres/postgres/blob/master/src/backend/commands/tablecmds.c#L21923
    >
    > ```c
    > /* Silently do nothing if already in the right state */
    > currParent = partIdx->rd_rel->relispartition ?
    >     get_partition_parent(partIdxId, false) : InvalidOid;
    > if (currParent != RelationGetRelid(parentIdx))
    > {
    >     // ... all validation checks and attachment logic ...
    >     validatePartitionedIndex(parentIdx, parentTbl);  // ONLY called here
    > }
    > // If already attached, entire block is skipped — no validation!
    > ```
    >
    > When the child is already attached (`currParent == parentIdx`), the
    > condition is false, the entire if-block is skipped, and
    > `validatePartitionedIndex()` is never called. The comment "Silently do
    > nothing if already in the right state" is misleading  "already
    > attached" does not mean "parent validity is correct."
    >
    > Proposed Fixes:
    >
    > Fix 1 : Always Validate Parent Index in ALTER INDEX ATTACH PARTITION
    >
    > Patch File : 0001-Always-validate-parent-index-in-ALTER-INDEX-ATTACH.patch
    >
    > Move the validatePartitionedIndex() call outside the if-block so it runs
    > unconditionally — both when a new attachment is made and when the
    > partition is
    > already attached. This provides a user-accessible recovery path: after
    > fixing a
    > child index with REINDEX, re-running ALTER INDEX ATTACH PARTITION triggers
    > parent validation.
    >
    > When the partition is already attached, a NOTICE is emitted:
    >
    > NOTICE:  partition index "child_idx" is already attached to
    > "parent_idx", validating parent index
    >
    >
    > This follows PostgreSQL's existing convention of using NOTICE for
    > informational messages about no-op or reduced-scope operations (e.g.,
    > DROP TABLE IF EXISTS, CREATE INDEX IF NOT EXISTS). It tells the user:
    >
    > 1- Nothing went wrong
    > 2- The index was already attached (so they know the state)
    > 3-  Validation still happened (so they know the fix path works)
    >
    >
    > Fix 2: Validate Parent Partitioned Index After REINDEX of Child
    >
    > Patch File : 0001-Validate-parent-partitioned-index-after-REINDEX.patch
    >
    > Same underlying bug but this patch addresses it from the
    > REINDEX side. When a partition index is repaired via REINDEX or
    > REINDEX CONCURRENTLY, the parent partitioned index remains permanently
    > stuck with indisvalid = false even though all children are now valid.
    >
    > This is because validatePartitionedIndex() — the only function that can
    > mark a partitioned index as valid is never called from any REINDEX code
    > path.
    >
    >
    > validatePartitionedIndex() is only called during:
    >
    > 1- ALTER INDEX ... ATTACH PARTITION (tablecmds.c)
    > 2- ALTER TABLE ... ATTACH PARTITION (tablecmds.c)
    > 3- CREATE INDEX on partitioned tables (indexcmds.c)
    >
    > It is NOT called after:
    >
    > 1- REINDEX INDEX (regular) — handled by reindex_index() in index.c
    > 2- REINDEX INDEX CONCURRENTLY — handled by ReindexRelationConcurrently()
    >
    > in indexcmds.c, which uses index_concurrently_swap() in index.c
    >
    > Three changes are made:
    >
    > 1. Make validatePartitionedIndex() public
    > The function was static in tablecmds.c. It is now exported via
    > tablecmds.h so it can be called from index.c and indexcmds.c.
    >
    > Files changed:
    >
    > src/backend/commands/tablecmds.c — remove static, update comment
    > src/include/commands/tablecmds.h — add extern declaration
    >
    > 2. Call from reindex_index() (regular REINDEX)
    > After reindex_index() marks a partition index as valid (indisvalid = true),
    > check if the index is a partition (iRel->rd_rel->relispartition) and if so,
    > look up the parent and call validatePartitionedIndex().
    >
    > A CommandCounterIncrement() is required before the call so that the child's
    > updated indisvalid is visible to the syscache lookup that
    > validatePartitionedIndex() performs internally.
    >
    > File changed: src/backend/catalog/index.c
    >
    > 3. Call from ReindexRelationConcurrently() (REINDEX CONCURRENTLY)
    > REINDEX CONCURRENTLY uses a completely different code path: it creates a
    > new
    > index, builds it concurrently, then swaps it with the old one via
    > index_concurrently_swap(). The new index inherits the old index's partition
    > status during the swap.
    >
    > After the swap and the existing CommandCounterIncrement() (which makes the
    > swap visible), check if the new index is a partition and call
    > validatePartitionedIndex() on the parent.
    >
    > File changed: src/backend/commands/indexcmds.c
    >
    > Multi-level Hierarchy Support
    > validatePartitionedIndex() already handles multi-level partition
    > hierarchies.
    > When it marks a mid-level parent valid, it checks if that parent is itself
    > a
    > partition and recursively validates the grandparent. No additional
    > recursion
    > logic is needed in the REINDEX patches.
    >
    >
    > Thanks,
    > Mohamed Ali
    > Senior DBE
    > AWS RDS
    >
    
    Hi, Mohamed
    
    Thanks for working on this. I went through the problem statement and the
    two proposed fixes. I agree that the underlying issue looks real: after
    repairing an invalid child index with REINDEX, the parent partitioned index
    can remain stuck in an invalid state because validatePartitionedIndex() is
    not reached from the relevant REINDEX paths. The analysis around
    ATExecAttachPartitionIdx() also looks correct: when the child index is
    already attached, the current code takes the no-op path and skips the
    validation call entirely.
    
    Overall, I think this is worth fixing, but I do not view the two patches
    equally.
    
    I think patch 2 is the real fix. The state transition that matters here is
    that a child index goes from invalid to valid, and the natural place to
    trigger parent revalidation is where that transition actually happens,
    namely in REINDEX. By contrast, patch 1 feels more like a secondary
    hardening/workaround path: it makes ALTER INDEX ... ATTACH PARTITION retry
    parent validation even in the already-attached case, but that is not really
    where the underlying state change happens.
    
    My main comments are below.
    
    1. Patch 2 should be treated as the primary fix
    
    This seems like the correct place to repair the catalog state. If REINDEX
    repairs a partition index that was previously invalid, and that index is
    attached to a partitioned parent index, then rechecking the parent with
    validatePartitionedIndex() is a reasonable and direct solution.
    
    I also think it is good that the patch covers both the regular REINDEX path
    and the REINDEX CONCURRENTLY path. Those are distinct enough that both need
    explicit attention, and the extra CommandCounterIncrement() before
    revalidation also seems necessary.
    
    So at a high level, this patch makes sense to me.
    
    2. I am less convinced by patch 1 in its current form
    
    The main issue here is not correctness, but design and placement.
    
    Once the child is already attached, ALTER INDEX ... ATTACH PARTITION is
    conceptually supposed to be a no-op. With this patch, it becomes a generic
    “retry parent validation” hook. That means users can run an attach command
    that does not change attachment state at all, yet still triggers a full
    parent validation attempt.
    
    That is especially questionable if there are still other invalid child
    indexes elsewhere under the same parent. In that case, each
    already-attached ATTACH command will do the validation work again, but it
    is already known in advance that the parent still cannot become valid. So
    this is not “reinvalidating” anything, but it is repeated checking with no
    state change, which feels misplaced on a no-op path.
    
    Because of that, I do not think patch 1 should be the main bug fix. At
    most, I would see it as an optional hardening patch.
    
    3. The NOTICE added by patch 1 does not seem like a good fit
    
    The existing code explicitly says “Silently do nothing if already in the
    right state”. Changing that into a NOTICE every time we hit the
    already-attached case seems noisy to me.
    
    If the community decides that the validation call should stay in this path,
    I would still suggest dropping the NOTICE. The command is syntactically an
    ATTACH command, not a repair command, and emitting a message for an
    otherwise no-op case does not feel very PostgreSQL-like.
    
    4. Please double-check coverage of all REINDEX entry points
    
    I agree with the direction in patch 2, but I think reviewers will want
    confidence that all relevant REINDEX flows are covered consistently.
    
    For example, it would be good to confirm that the fix behaves correctly not
    just for REINDEX INDEX, but also for the broader forms that eventually
    reach the same logic, such as REINDEX TABLE, and that there is no alternate
    path where a repaired child index can still leave the parent stale.
    
    5. Multi-level partition trees need explicit testing
    
    One especially important point here is recursion. If a repaired child index
    causes its immediate parent partitioned index to become valid, and that
    parent is itself a child of another partitioned index, we need to be sure
    that validity propagates all the way up as intended.
    
    The current reasoning suggests that validatePartitionedIndex() already
    handles that, but this is important enough that it should be demonstrated
    with a regression test, not just assumed.
    
    Minor comments:
    
    
       -
    
       In patch 1, I would avoid turning the already-attached path into a
       behavioral special case unless there is a strong reason to keep it. It
       would be cleaner if the fix relied primarily on the actual state-changing
       paths.
       -
    
       If patch 1 remains, I would remove the NOTICE.
       -
    
       The commit message for patch 2 should clearly explain why REINDEX is the
       right place to do this, rather than making ATTACH PARTITION the repair
       mechanism.
       -
    
       It may also help to mention explicitly whether the extra validation call
       is only intended for indexes that were previously invalid and have just
       been repaired, since that is an important part of why the patch is
       reasonably narrow.
    
    I do not think the current patches are complete without regression
    coverage. At minimum, I think the following tests should be added:
    
    
       1.
    
       Regular REINDEX case
    
       Create a partitioned table with a parent index left invalid initially,
       then attach child indexes such that one child index is invalid. Repair that
       child with plain REINDEX INDEX, and verify that the child becomes valid
       and the parent also becomes valid.
       2.
    
       REINDEX CONCURRENTLY case
    
       Same setup, but use REINDEX INDEX CONCURRENTLY. This should be tested
       separately because the code path is different.
       3.
    
       Multi-level partition hierarchy
    
       Use at least a three-level hierarchy and verify that repairing a
       leaf-level invalid child index can cause validity to propagate upward
       through intermediate partitioned indexes.
       4.
    
       Negative case
    
       Repair one child index while another child index under the same parent
       remains invalid, and verify that the parent remains invalid.
       5.
    
       Already-attached ATTACH PARTITION case
    
       Only if patch 1 is kept: exercise ALTER INDEX ... ATTACH PARTITION on a
       child index that is already attached, and verify both behaviors:
    
    
       -
    
       parent becomes valid if all children are now valid
       -
    
       parent stays invalid if some other child is still invalid
    
    My overall view is:
    
    
       - The bug itself looks real.
       - The diagnosis looks sound.
       - Patch 2 is the right direction and should be the primary fix.
       - Patch 1 is much less compelling as written, and I would not take it as
       the main solution.
       - The series needs regression tests before it is ready.
    
    Regards,
    Haibo
    
  3. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Haibo Yan <tristan.yim@gmail.com> — 2026-04-11T02:18:07Z

    On Fri, Apr 10, 2026 at 5:55 PM Haibo Yan <tristan.yim@gmail.com> wrote:
    
    > On Wed, Apr 8, 2026 at 11:17 PM Mohamed ALi <moali.pg@gmail.com> wrote:
    >
    >> Hi hackers,
    >>
    >> A partitioned (parent) index in PostgreSQL can become permanently
    >> stuck with `indisvalid = false` even after all of its child partition
    >> indexes have been repaired and are valid. There is no built-in
    >> mechanism to re-validate the parent index after a child is fixed via
    >> `REINDEX`. This affects all currently supported PostgreSQL versions
    >> (13 through 18)
    >> The root cause is that `validatePartitionedIndex()` — the only
    >> function that can mark a partitioned index as valid is never called
    >> after `REINDEX` operations, and is skipped when re-running `ALTER
    >> INDEX ATTACH PARTITION` on an already-attached index.
    >>
    >> How the Bug Manifests
    >>
    >> Typical Scenario :
    >> 1. A partitioned table has multiple partitions.
    >> 2. The user creates indexes on partitions concurrently. One fails (due
    >> to deadlock, cancellation, timeout, etc.), leaving an invalid
    >> partition index.
    >> 3. A parent index is created (or the invalid index is attached to an
    >> existing parent). The parent is correctly marked `indisvalid = false`
    >> because at least one child is invalid.
    >> 4. The user fixes the broken child index with `REINDEX INDEX
    >> CONCURRENTLY`.
    >> 5. The child index becomes valid (`indisvalid = true`).
    >> 6. The parent index remains `indisvalid = false` permanently. No SQL
    >> command can fix it.
    >>
    >> Reproduction steps:
    >>
    >> ```sql
    >> -- ============================================================
    >> -- SETUP: Partitioned table with two partitions and sample data
    >> -- ============================================================
    >> DROP TABLE IF EXISTS orders;
    >> CREATE TABLE orders (
    >>     id serial,
    >>     order_date date NOT NULL,
    >>     amount numeric
    >> ) PARTITION BY RANGE (order_date);
    >> CREATE TABLE orders_2023 PARTITION OF orders
    >>     FOR VALUES FROM ('2023-01-01') TO ('2024-01-01');
    >> CREATE TABLE orders_2024 PARTITION OF orders
    >>     FOR VALUES FROM ('2024-01-01') TO ('2025-01-01');
    >> INSERT INTO orders (order_date, amount)
    >> SELECT d, random() * 1000
    >> FROM generate_series('2023-01-01'::date, '2023-12-31'::date, '1 day') d;
    >> INSERT INTO orders (order_date, amount)
    >> SELECT d, random() * 1000
    >> FROM generate_series('2024-01-01'::date, '2024-12-31'::date, '1 day') d;
    >> -- ============================================================
    >> -- STEP 1: Create parent index with ONLY (starts as invalid)
    >> -- ============================================================
    >> CREATE INDEX orders_amount_idx ON ONLY orders (amount);
    >> -- Verify: parent index is invalid (no children attached yet)
    >> SELECT c.relname, i.indisvalid
    >> FROM pg_class c
    >> JOIN pg_index i ON c.oid = i.indexrelid
    >> WHERE c.relname LIKE 'orders%idx%'
    >> ORDER BY c.relname;
    >> -- Expected:
    >> --  orders_amount_idx | f
    >> -- ============================================================
    >> -- STEP 2: Create valid index on first partition
    >> -- ============================================================
    >> CREATE INDEX CONCURRENTLY orders_2023_amount_idx ON orders_2023 (amount);
    >> -- ============================================================
    >> -- STEP 3: Create an INVALID index on second partition
    >> -- ============================================================
    >> -- In a separate session, hold a lock:
    >> BEGIN; LOCK TABLE orders_2024 IN SHARE MODE;
    >> -- Then in the main session:
    >> SET statement_timeout = '1ms';
    >> CREATE INDEX CONCURRENTLY orders_2024_amount_idx ON orders_2024 (amount);
    >> RESET statement_timeout;
    >> -- it will fail/timeout, leaving an invalid index.
    >> -- Verify state:
    >> SELECT c.relname, i.indisvalid
    >> FROM pg_class c
    >> JOIN pg_index i ON c.oid = i.indexrelid
    >> WHERE c.relname LIKE 'orders%idx%'
    >> ORDER BY c.relname;
    >> -- Expected:
    >> --  orders_2023_amount_idx | t   (valid)
    >> --  orders_2024_amount_idx | f   (invalid)
    >> --  orders_amount_idx      | f   (invalid, created with ONLY)
    >> -- ============================================================
    >> -- STEP 4: Attach both partition indexes to the parent
    >> -- ============================================================
    >> -- Attach the invalid one first
    >> ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2024_amount_idx;
    >> -- Succeeds. Parent stays invalid (correct — child is invalid).
    >> -- Attach the valid one
    >> ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2023_amount_idx;
    >> -- Succeeds. Parent still invalid (correct — one child still invalid).
    >> -- Verify attachment and validity:
    >> SELECT c.relname, i.indisvalid,
    >>        pg_get_indexdef(i.indexrelid) AS indexdef
    >> FROM pg_class c
    >> JOIN pg_index i ON c.oid = i.indexrelid
    >> WHERE c.relname LIKE 'orders%amount%'
    >> ORDER BY c.relname;
    >> -- Expected:
    >> --  orders_2023_amount_idx | t
    >> --  orders_2024_amount_idx | f
    >> --  orders_amount_idx      | f
    >> -- ============================================================
    >> -- STEP 5: Fix the invalid child index via REINDEX
    >> -- ============================================================
    >> REINDEX INDEX CONCURRENTLY orders_2024_amount_idx;
    >> -- Verify: child is now valid
    >> SELECT c.relname, i.indisvalid
    >> FROM pg_class c
    >> JOIN pg_index i ON c.oid = i.indexrelid
    >> WHERE c.relname LIKE 'orders%amount%'
    >> ORDER BY c.relname;
    >> -- ACTUAL (buggy) result:
    >> --  orders_2023_amount_idx | t   (valid)
    >> --  orders_2024_amount_idx | t   (valid — fixed by REINDEX)
    >> --  orders_amount_idx      | f   (STILL INVALID — this is the bug!)
    >> --
    >> -- EXPECTED result (if bug were fixed):
    >> --  orders_2023_amount_idx | t
    >> --  orders_2024_amount_idx | t
    >> --  orders_amount_idx      | t   (should be valid now)
    >> -- ============================================================
    >> -- STEP 6: Demonstrate that re-running ATTACH does not help
    >> -- ============================================================
    >> ALTER INDEX orders_amount_idx ATTACH PARTITION orders_2024_amount_idx;
    >> -- Returns "ALTER INDEX" (succeeds silently, does nothing)
    >> SELECT c.relname, i.indisvalid
    >> FROM pg_class c
    >> JOIN pg_index i ON c.oid = i.indexrelid
    >> WHERE c.relname LIKE 'orders%amount%'
    >> ORDER BY c.relname;
    >> -- Parent is STILL invalid. The "silently do nothing" path
    >> -- skips validatePartitionedIndex() entirely.
    >> -- ============================================================
    >> -- CLEANUP
    >> -- ============================================================
    >> DROP TABLE orders;
    >> ```
    >>
    >>
    >> Root Cause Analysis:
    >>
    >> Where `validatePartitionedIndex()` Is Called
    >>
    >> The function is called in exactly these code paths:
    >> 1. During `ALTER INDEX ... ATTACH PARTITION` — inside
    >> `ATExecAttachPartitionIdx()`
    >> 2. During `ALTER TABLE ... ATTACH PARTITION` — via
    >> `AttachPartitionEnsureIndexes()`
    >> 3. During `CREATE INDEX` on partitioned tables — via `DefineIndex()`
    >> It is NOT called:
    >> - After `REINDEX` of a partitioned index
    >> - During any maintenance operation
    >> - As any periodic validation check
    >>
    >> Bug 1: REINDEX Does Not Validate Parent
    >>
    >>
    >> When `reindex_index()` in `src/backend/catalog/index.c` marks a
    >> partition index as valid (setting `indisvalid = true`), it does not
    >> check whether the parent partitioned index should also become valid.
    >> The function simply updates the child's `pg_index` entry and returns.
    >>
    >> Bug 2: Re-running ATTACH Skips Validation
    >>
    >>
    >> In `ATExecAttachPartitionIdx()` (tablecmds.c, around line 21923 in PG
    >> 16 / line ~22900 in HEAD):
    >>
    >> https://github.com/postgres/postgres/blob/master/src/backend/commands/tablecmds.c#L21923
    >>
    >> ```c
    >> /* Silently do nothing if already in the right state */
    >> currParent = partIdx->rd_rel->relispartition ?
    >>     get_partition_parent(partIdxId, false) : InvalidOid;
    >> if (currParent != RelationGetRelid(parentIdx))
    >> {
    >>     // ... all validation checks and attachment logic ...
    >>     validatePartitionedIndex(parentIdx, parentTbl);  // ONLY called here
    >> }
    >> // If already attached, entire block is skipped — no validation!
    >> ```
    >>
    >> When the child is already attached (`currParent == parentIdx`), the
    >> condition is false, the entire if-block is skipped, and
    >> `validatePartitionedIndex()` is never called. The comment "Silently do
    >> nothing if already in the right state" is misleading  "already
    >> attached" does not mean "parent validity is correct."
    >>
    >> Proposed Fixes:
    >>
    >> Fix 1 : Always Validate Parent Index in ALTER INDEX ATTACH PARTITION
    >>
    >> Patch File : 0001-Always-validate-parent-index-in-ALTER-INDEX-ATTACH.patch
    >>
    >> Move the validatePartitionedIndex() call outside the if-block so it runs
    >> unconditionally — both when a new attachment is made and when the
    >> partition is
    >> already attached. This provides a user-accessible recovery path: after
    >> fixing a
    >> child index with REINDEX, re-running ALTER INDEX ATTACH PARTITION triggers
    >> parent validation.
    >>
    >> When the partition is already attached, a NOTICE is emitted:
    >>
    >> NOTICE:  partition index "child_idx" is already attached to
    >> "parent_idx", validating parent index
    >>
    >>
    >> This follows PostgreSQL's existing convention of using NOTICE for
    >> informational messages about no-op or reduced-scope operations (e.g.,
    >> DROP TABLE IF EXISTS, CREATE INDEX IF NOT EXISTS). It tells the user:
    >>
    >> 1- Nothing went wrong
    >> 2- The index was already attached (so they know the state)
    >> 3-  Validation still happened (so they know the fix path works)
    >>
    >>
    >> Fix 2: Validate Parent Partitioned Index After REINDEX of Child
    >>
    >> Patch File : 0001-Validate-parent-partitioned-index-after-REINDEX.patch
    >>
    >> Same underlying bug but this patch addresses it from the
    >> REINDEX side. When a partition index is repaired via REINDEX or
    >> REINDEX CONCURRENTLY, the parent partitioned index remains permanently
    >> stuck with indisvalid = false even though all children are now valid.
    >>
    >> This is because validatePartitionedIndex() — the only function that can
    >> mark a partitioned index as valid is never called from any REINDEX code
    >> path.
    >>
    >>
    >> validatePartitionedIndex() is only called during:
    >>
    >> 1- ALTER INDEX ... ATTACH PARTITION (tablecmds.c)
    >> 2- ALTER TABLE ... ATTACH PARTITION (tablecmds.c)
    >> 3- CREATE INDEX on partitioned tables (indexcmds.c)
    >>
    >> It is NOT called after:
    >>
    >> 1- REINDEX INDEX (regular) — handled by reindex_index() in index.c
    >> 2- REINDEX INDEX CONCURRENTLY — handled by ReindexRelationConcurrently()
    >>
    >> in indexcmds.c, which uses index_concurrently_swap() in index.c
    >>
    >> Three changes are made:
    >>
    >> 1. Make validatePartitionedIndex() public
    >> The function was static in tablecmds.c. It is now exported via
    >> tablecmds.h so it can be called from index.c and indexcmds.c.
    >>
    >> Files changed:
    >>
    >> src/backend/commands/tablecmds.c — remove static, update comment
    >> src/include/commands/tablecmds.h — add extern declaration
    >>
    >> 2. Call from reindex_index() (regular REINDEX)
    >> After reindex_index() marks a partition index as valid (indisvalid =
    >> true),
    >> check if the index is a partition (iRel->rd_rel->relispartition) and if
    >> so,
    >> look up the parent and call validatePartitionedIndex().
    >>
    >> A CommandCounterIncrement() is required before the call so that the
    >> child's
    >> updated indisvalid is visible to the syscache lookup that
    >> validatePartitionedIndex() performs internally.
    >>
    >> File changed: src/backend/catalog/index.c
    >>
    >> 3. Call from ReindexRelationConcurrently() (REINDEX CONCURRENTLY)
    >> REINDEX CONCURRENTLY uses a completely different code path: it creates a
    >> new
    >> index, builds it concurrently, then swaps it with the old one via
    >> index_concurrently_swap(). The new index inherits the old index's
    >> partition
    >> status during the swap.
    >>
    >> After the swap and the existing CommandCounterIncrement() (which makes the
    >> swap visible), check if the new index is a partition and call
    >> validatePartitionedIndex() on the parent.
    >>
    >> File changed: src/backend/commands/indexcmds.c
    >>
    >> Multi-level Hierarchy Support
    >> validatePartitionedIndex() already handles multi-level partition
    >> hierarchies.
    >> When it marks a mid-level parent valid, it checks if that parent is
    >> itself a
    >> partition and recursively validates the grandparent. No additional
    >> recursion
    >> logic is needed in the REINDEX patches.
    >>
    >>
    >> Thanks,
    >> Mohamed Ali
    >> Senior DBE
    >> AWS RDS
    >>
    >
    > Hi, Mohamed
    >
    > Thanks for working on this. I went through the problem statement and the
    > two proposed fixes. I agree that the underlying issue looks real: after
    > repairing an invalid child index with REINDEX, the parent partitioned index
    > can remain stuck in an invalid state because validatePartitionedIndex()
    > is not reached from the relevant REINDEX paths. The analysis around
    > ATExecAttachPartitionIdx() also looks correct: when the child index is
    > already attached, the current code takes the no-op path and skips the
    > validation call entirely.
    >
    > Overall, I think this is worth fixing, but I do not view the two patches
    > equally.
    >
    > I think patch 2 is the real fix. The state transition that matters here is
    > that a child index goes from invalid to valid, and the natural place to
    > trigger parent revalidation is where that transition actually happens,
    > namely in REINDEX. By contrast, patch 1 feels more like a secondary
    > hardening/workaround path: it makes ALTER INDEX ... ATTACH PARTITION
    > retry parent validation even in the already-attached case, but that is not
    > really where the underlying state change happens.
    >
    > My main comments are below.
    >
    > 1. Patch 2 should be treated as the primary fix
    >
    > This seems like the correct place to repair the catalog state. If REINDEX
    > repairs a partition index that was previously invalid, and that index is
    > attached to a partitioned parent index, then rechecking the parent with
    > validatePartitionedIndex() is a reasonable and direct solution.
    >
    > I also think it is good that the patch covers both the regular REINDEX
    > path and the REINDEX CONCURRENTLY path. Those are distinct enough that
    > both need explicit attention, and the extra CommandCounterIncrement()
    > before revalidation also seems necessary.
    >
    > So at a high level, this patch makes sense to me.
    >
    > 2. I am less convinced by patch 1 in its current form
    >
    > The main issue here is not correctness, but design and placement.
    >
    > Once the child is already attached, ALTER INDEX ... ATTACH PARTITION is
    > conceptually supposed to be a no-op. With this patch, it becomes a generic
    > “retry parent validation” hook. That means users can run an attach command
    > that does not change attachment state at all, yet still triggers a full
    > parent validation attempt.
    >
    > That is especially questionable if there are still other invalid child
    > indexes elsewhere under the same parent. In that case, each
    > already-attached ATTACH command will do the validation work again, but it
    > is already known in advance that the parent still cannot become valid. So
    > this is not “reinvalidating” anything, but it is repeated checking with no
    > state change, which feels misplaced on a no-op path.
    >
    > Because of that, I do not think patch 1 should be the main bug fix. At
    > most, I would see it as an optional hardening patch.
    >
    > 3. The NOTICE added by patch 1 does not seem like a good fit
    >
    > The existing code explicitly says “Silently do nothing if already in the
    > right state”. Changing that into a NOTICE every time we hit the
    > already-attached case seems noisy to me.
    >
    > If the community decides that the validation call should stay in this
    > path, I would still suggest dropping the NOTICE. The command is
    > syntactically an ATTACH command, not a repair command, and emitting a
    > message for an otherwise no-op case does not feel very PostgreSQL-like.
    >
    > 4. Please double-check coverage of all REINDEX entry points
    >
    > I agree with the direction in patch 2, but I think reviewers will want
    > confidence that all relevant REINDEX flows are covered consistently.
    >
    > For example, it would be good to confirm that the fix behaves correctly
    > not just for REINDEX INDEX, but also for the broader forms that
    > eventually reach the same logic, such as REINDEX TABLE, and that there is
    > no alternate path where a repaired child index can still leave the parent
    > stale.
    >
    > 5. Multi-level partition trees need explicit testing
    >
    > One especially important point here is recursion. If a repaired child
    > index causes its immediate parent partitioned index to become valid, and
    > that parent is itself a child of another partitioned index, we need to be
    > sure that validity propagates all the way up as intended.
    >
    > The current reasoning suggests that validatePartitionedIndex() already
    > handles that, but this is important enough that it should be demonstrated
    > with a regression test, not just assumed.
    >
    > Minor comments:
    >
    >
    >    -
    >
    >    In patch 1, I would avoid turning the already-attached path into a
    >    behavioral special case unless there is a strong reason to keep it. It
    >    would be cleaner if the fix relied primarily on the actual state-changing
    >    paths.
    >    -
    >
    >    If patch 1 remains, I would remove the NOTICE.
    >    -
    >
    >    The commit message for patch 2 should clearly explain why REINDEX is
    >    the right place to do this, rather than making ATTACH PARTITION the repair
    >    mechanism.
    >    -
    >
    >    It may also help to mention explicitly whether the extra validation
    >    call is only intended for indexes that were previously invalid and have
    >    just been repaired, since that is an important part of why the patch is
    >    reasonably narrow.
    >
    > I do not think the current patches are complete without regression
    > coverage. At minimum, I think the following tests should be added:
    >
    >
    >    1.
    >
    >    Regular REINDEX case
    >
    >    Create a partitioned table with a parent index left invalid initially,
    >    then attach child indexes such that one child index is invalid. Repair that
    >    child with plain REINDEX INDEX, and verify that the child becomes
    >    valid and the parent also becomes valid.
    >    2.
    >
    >    REINDEX CONCURRENTLY case
    >
    >    Same setup, but use REINDEX INDEX CONCURRENTLY. This should be tested
    >    separately because the code path is different.
    >    3.
    >
    >    Multi-level partition hierarchy
    >
    >    Use at least a three-level hierarchy and verify that repairing a
    >    leaf-level invalid child index can cause validity to propagate upward
    >    through intermediate partitioned indexes.
    >    4.
    >
    >    Negative case
    >
    >    Repair one child index while another child index under the same parent
    >    remains invalid, and verify that the parent remains invalid.
    >    5.
    >
    >    Already-attached ATTACH PARTITION case
    >
    >    Only if patch 1 is kept: exercise ALTER INDEX ... ATTACH PARTITION on
    >    a child index that is already attached, and verify both behaviors:
    >
    >
    >    -
    >
    >    parent becomes valid if all children are now valid
    >    -
    >
    >    parent stays invalid if some other child is still invalid
    >
    > My overall view is:
    >
    >
    >    - The bug itself looks real.
    >    - The diagnosis looks sound.
    >    - Patch 2 is the right direction and should be the primary fix.
    >    - Patch 1 is much less compelling as written, and I would not take it
    >    as the main solution.
    >    - The series needs regression tests before it is ready.
    >
    > Regards,
    > Haibo
    >
    
    Hi, Mohamed
    I took a look at this patch and added some regression coverage for it.
    While doing that, I found that the current concurrent-path fix is not quite
    complete. The new tests exposed crashes in existing REINDEX CONCURRENTLY
    regression coverage, and the root cause appears to be that in the
    concurrent path, validatePartitionedIndex() can eventually reach catalog
    update code at a point where there is no active/registered snapshot. That
    leads to the HaveRegisteredOrActiveSnapshot() assertion failure.
    So the overall bug diagnosis still looks correct to me, and the plain
    REINDEX direction also looks right, but the REINDEX CONCURRENTLY path needs
    an additional fix around the call site/context.
    Based on that, I prepared a v2 on top of your patch. It includes:
    
       - a fix for the concurrent-path snapshot issue
       - narrower handling for the concurrent path so it only does parent
       revalidation for the actual repair case
       - regression tests covering:
       - plain REINDEX INDEX
       - a negative case where another invalid sibling keeps the parent invalid
       - multi-level partition hierarchies
       - REINDEX TABLE
    
    If my understanding above looks right to you, I think this v2 is a better
    base for further review.
    Thanks,
    Haibo
    
  4. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Sami Imseih <samimseih@gmail.com> — 2026-04-11T16:10:54Z

    Hi,
    
    Thanks the report
    
    > 6. The parent index remains `indisvalid = false` permanently. No SQL
    > command can fix it.
    
    Yes, that seems confusing. the indisvalid on a parent partition should reflect
    the state of all index partitions; true if all index partitions are
    valid, and false
    if any index partition is invalid.
    
    I think this can only become an issue in practice with the combination
    of CREATING
    a parent index ONLY ( because the parent indisvalid is marked as false
    initially),
    then one of the partition indexes becoming invalid, then the expectation would
    be that if we REINEX/re-create the child index, a re-attach of this
    index will set
    the parent index indisvalid to true.
    
    The state of an invalid parent index ( with all children being valid )
    breaks the ON CONFLICT case:
    ```
    DROP TABLE IF EXISTS pt;
    CREATE TABLE pt (a int, b int) PARTITION BY RANGE (a);
    CREATE TABLE pt_1 PARTITION OF pt FOR VALUES FROM (1) TO (100);
    CREATE TABLE pt_2 PARTITION OF pt FOR VALUES FROM (100) TO (200);
    CREATE UNIQUE INDEX pt_a_idx ON pt (a);
    -- ON CONFLICT works fine here
    INSERT INTO pt VALUES (1, 1);
    INSERT INTO pt VALUES (1, 1) ON CONFLICT (a) DO UPDATE SET b = EXCLUDED.b + 1;
    -- Manually invalidate the parent index
    EXPLAIN ANALYZE UPDATE pg_index SET indisvalid = false WHERE
    indexrelid = 'pt_a_idx'::regclass;
    SELECT c.relname, i.indisvalid, i.indisready FROM pg_class c JOIN
    pg_index i ON c.oid = i.indexrelid WHERE c.relname LIKE 'pt_%' ORDER
    BY c.relname;
    -- Now ON CONFLICT fails now
    EXPLAIN ANALYZE INSERT INTO pt VALUES (1, 1) ON CONFLICT (a) DO UPDATE
    SET b = EXCLUDED.b + 1;
    -- ERROR: there is no unique or exclusion constraint matching the ON
    CONFLICT specification
    ```
    because of:
    ```
    /* We require at least one indisvalid index */
    if (results == NIL || !foundValid)
    ereport(ERROR,
    (errcode(ERRCODE_INVALID_COLUMN_REFERENCE),
    errmsg("there is no unique or exclusion constraint matching the ON
    CONFLICT specification")));
    ``` in infer_arbiter_indexes() in plancat.c
    
    > Bug 1: REINDEX Does Not Validate Parent
    
    I don't think that a REINDEX should attempt to set the parent index indisvalid.
    It seems the responsibility for this falls squarely on the ATTACH
    PARTITION command,
    as it currently does.
    
    Would the right solution here be to try to have the ATTACH PARTITION  check if
    the parent index is not valid, then validatePartitionedIndex() ?
    
    ````
    diff --git a/src/backend/commands/tablecmds.c b/src/backend/commands/tablecmds.c
    index eec09ba1ded..a46af023689 100644
    --- a/src/backend/commands/tablecmds.c
    +++ b/src/backend/commands/tablecmds.c
    @@ -22029,6 +22029,14 @@ ATExecAttachPartitionIdx(List **wqueue,
    Relation parentIdx, RangeVar *name)
                    free_attrmap(attmap);
    
                    validatePartitionedIndex(parentIdx, parentTbl);
    +       } else if (!parentIdx->rd_index->indisvalid)
    +       {
    +               /*
    +                * The index is already attached but the parent isn't valid yet.
    +                * Check if all partitions now have valid indexes, and if so,
    +                * mark the parent index as valid.
    +                */
    +               validatePartitionedIndex(parentIdx, parentTbl);
            }
    ````
    We can add some additional documentation about this in the
    "ATTACH PARTITION index_name" documentation [1]
    so users have a way out of this condition ?
    
    
    [1] [https://www.postgresql.org/docs/current/sql-alterindex.html]
    
     --
    Sami Imseih
    Amazon Web Services (AWS)
    
    
    
    
  5. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Michael Paquier <michael@paquier.xyz> — 2026-04-13T22:18:33Z

    On Sat, Apr 11, 2026 at 11:10:54AM -0500, Sami Imseih wrote:
    > I don't think that a REINDEX should attempt to set the parent index indisvalid.
    > It seems the responsibility for this falls squarely on the ATTACH
    > PARTITION command,
    > as it currently does.
    
    Relying on REINDEX is not optimal, as it would mean that all the
    partitioned indexes would need to be updated before flipping the flag.
    If the indisvalid flags of the partitions are already true, this would
    be a huge waste of resources.
    
    > Would the right solution here be to try to have the ATTACH PARTITION  check if
    > the parent index is not valid, then validatePartitionedIndex() ?
    
    This may be a backpatchable thing, even if it requires one to detach
    one partition before attaching it again, or attach a fake partition to
    force a flip of the flag, before detaching this fake partition.
    
    One better alternative that I could think of is a new flavor of ALTER
    TABLE, like a ALTER TABLE foo VALIDATE PARTITION (no partition name
    here) focused on flipping the indisvalid flags?  This would not be
    backpatchable, but it would make the whole flow lighter by not
    requiring a redefinition of one partition.
    --
    Michael
    
  6. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Michael Paquier <michael@paquier.xyz> — 2026-04-14T16:05:38Z

    On Tue, Apr 14, 2026 at 07:18:33AM +0900, Michael Paquier wrote:
    > On Sat, Apr 11, 2026 at 11:10:54AM -0500, Sami Imseih wrote:
    >> Would the right solution here be to try to have the ATTACH PARTITION  check if
    >> the parent index is not valid, then validatePartitionedIndex() ?
    > 
    > This may be a backpatchable thing, even if it requires one to detach
    > one partition before attaching it again, or attach a fake partition to
    > force a flip of the flag, before detaching this fake partition.
    
    Actually no.  Yesterday I was looking at that from the angle of using
    ALTER TABLE for the job, that requires a partition bound.  Sami has
    mentioned me that a repeated ALTER INDEX .. ATTACH PARTITION does not
    fail when repeated, so we could just rely on that and enforce a
    round of indisvalid across the partitioned index we are working on.
    
    Could you write a patch?  It would be better to have tests with
    multiple levels, at least, with a partitioned table being a leaf of
    another partitioned table.  I am sure you get the picture, the point
    being to recurse across multiple levels.
    --
    Michael
    
  7. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Sami Imseih <samimseih@gmail.com> — 2026-04-18T14:37:48Z

    Hi,
    
    > Could you write a patch?  It would be better to have tests with
    > multiple levels, at least, with a partitioned table being a leaf of
    > another partitioned table.  I am sure you get the picture, the point
    > being to recurse across multiple levels.
    
    Here is the patch with tests. It adds a test for this case using
    multi-level partitions and ensures that the parent indexes are
    validated once a child index is set to valid. Also, I added the
    negative case where only one child index is validated to ensure
    that the parent indexes remain invalid.
    
    --
    Sami Imseih
    Amazon Web Services (AWS)
    
  8. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Michael Paquier <michael@paquier.xyz> — 2026-04-19T22:07:59Z

    On Sat, Apr 18, 2026 at 09:37:48AM -0500, Sami Imseih wrote:
    > Here is the patch with tests. It adds a test for this case using
    > multi-level partitions and ensures that the parent indexes are
    > validated once a child index is set to valid. Also, I added the
    > negative case where only one child index is validated to ensure
    > that the parent indexes remain invalid.
    
    That looks sensible here, including the test coverage.  Thanks for the
    patch!
    
    One thing that I'm tempted to add is more scans to check indisvalid
    across these commands, particularly after the individual ATTACH
    PARTITION bits on each individual index.
    
    A second thing.  Do you think that it would be worth adding a
    partitioned table that has no leaves in some portion of the test?  I
    was thinking about a partitioned table called idxpart2 attached to
    idxpart in the first part of the test.  I've found this pattern 
    usually useful for this area of the code when recursing with
    validatePartitionedIndex() from a parent.  I was also thinking about
    a partitioned table idxpart3 in the last test block, but as you want
    to check that indisvalid is not flipped to true for the parent if a
    child is !indisvalid, it would not be adapted.
    --
    Michael
    
  9. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Michael Paquier <michael@paquier.xyz> — 2026-04-22T01:47:56Z

    On Mon, Apr 20, 2026 at 07:07:59AM +0900, Michael Paquier wrote:
    > One thing that I'm tempted to add is more scans to check indisvalid
    > across these commands, particularly after the individual ATTACH
    > PARTITION bits on each individual index.
    > 
    > A second thing.  Do you think that it would be worth adding a
    > partitioned table that has no leaves in some portion of the test?  I
    > was thinking about a partitioned table called idxpart2 attached to
    > idxpart in the first part of the test.  I've found this pattern 
    > usually useful for this area of the code when recursing with
    > validatePartitionedIndex() from a parent.  I was also thinking about
    > a partitioned table idxpart3 in the last test block, but as you want
    > to check that indisvalid is not flipped to true for the parent if a
    > child is !indisvalid, it would not be adapted.
    
    Both things have been added to the tests, and applied the result down
    to v14.  The patch was able to apply cleanly across the board, without
    conflicts.  That's rare, these days..
    --
    Michael
    
  10. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Sami Imseih <samimseih@gmail.com> — 2026-04-22T10:33:09Z

    > > One thing that I'm tempted to add is more scans to check indisvalid
    > > across these commands, particularly after the individual ATTACH
    > > PARTITION bits on each individual index.
    
    That works.
    
    > > A second thing.  Do you think that it would be worth adding a
    > > partitioned table that has no leaves in some portion of the test?  I
    > > was thinking about a partitioned table called idxpart2 attached to
    > > idxpart in the first part of the test.  I've found this pattern
    > > usually useful for this area of the code when recursing with
    > > validatePartitionedIndex() from a parent.
    
    Good idea.
    
    > Both things have been added to the tests, and applied the result down
    > to v14.  The patch was able to apply cleanly across the board, without
    > conflicts.  That's rare, these days..
    
    Sorry for the late reply, and thanks for getting this committed!
    
    --
    Sami Imseih
    Amazon Web Services (AWS)
    
    
    
    
  11. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Mohamed ALi <moali.pg@gmail.com> — 2026-04-29T21:36:09Z

    Hi Michael, Sami, Haibo,
    
    Thank you all for the reviews and for committing the fix (9d3e094f12).
    I'm glad to see this backpatched through PostgreSQL 14.
    
    Sami's targeted approach — only calling validatePartitionedIndex()
    when the index is already attached AND the parent is currently
    invalid — is clean and avoids the concerns Haibo raised about
    turning the no-op path into a generic validation hook. Good call.
    
    
    I noticed that the commit did not include a documentation update
    for ALTER INDEX ATTACH PARTITION.
    
    There is no mention that re-running the command on an already-attached
    index will attempt to validate the parent. Users who hit this bug
    would have no way to discover the recovery path from the docs alone —
    they would need to find the mailing list thread or read the commit
    message.
    
    I have attached a small doc-only patch that adds a paragraph to the
    ALTER INDEX documentation:
    
    "If the named index is already attached to the altered index, the
    command will attempt to validate the parent index if the parent
    is currently invalid."
    
    This applies on top of current HEAD (which includes 9d3e094f12).
    Since the code change was backpatched to 14, the doc update should
    probably be backpatched to the same branches.
    
    Thanks,
    Mohamed Ali
    AWS RDS
    
    
    On Wed, Apr 22, 2026 at 3:33 AM Sami Imseih <samimseih@gmail.com> wrote:
    >
    > > > One thing that I'm tempted to add is more scans to check indisvalid
    > > > across these commands, particularly after the individual ATTACH
    > > > PARTITION bits on each individual index.
    >
    > That works.
    >
    > > > A second thing.  Do you think that it would be worth adding a
    > > > partitioned table that has no leaves in some portion of the test?  I
    > > > was thinking about a partitioned table called idxpart2 attached to
    > > > idxpart in the first part of the test.  I've found this pattern
    > > > usually useful for this area of the code when recursing with
    > > > validatePartitionedIndex() from a parent.
    >
    > Good idea.
    >
    > > Both things have been added to the tests, and applied the result down
    > > to v14.  The patch was able to apply cleanly across the board, without
    > > conflicts.  That's rare, these days..
    >
    > Sorry for the late reply, and thanks for getting this committed!
    >
    > --
    > Sami Imseih
    > Amazon Web Services (AWS)
    
  12. Re: [PATCH] Fix: Partitioned parent index remains invalid after child indexes are repaired

    Michael Paquier <michael@paquier.xyz> — 2026-04-30T23:28:06Z

    On Wed, Apr 29, 2026 at 02:36:09PM -0700, Mohamed ALi wrote:
    > I have attached a small doc-only patch that adds a paragraph to the
    > ALTER INDEX documentation:
    > 
    > "If the named index is already attached to the altered index, the
    > command will attempt to validate the parent index if the parent
    > is currently invalid."
    
    That sounds like a good idea to me to mention this behavior in the
    docs, as you are suggesting.  That's less guesses a user would need to
    do, just more reading and something we can directly point at.
    --
    Michael