**Info**

My question relates to a moderately big table (~40GB data space) that is a heap  
*(Unfortunately, I am not allowed to add a clustered index to the table by the application owners)*

An auto created statistic on an Identity column (`ID`) was created, but is empty. 

 - Auto create stats & auto update stats are on
 - Modifications have happened in the table
 - There are other (auto created) statistics that are getting updated
 - There is another statistic on the same column created by an index (duplicate)
 - Build: 12.0.5546


The duplicate statistic is getting updated:
[![enter image description here][1]][1]

**The actual question**

To my understanding, all stats could be used and modifications are tracked, even if there are two statistics on exactly the same columns (duplicates), so why does this statistic remain empty?



**Stats Info**

[![enter image description here][2]][2]

**DB stat info**

[![enter image description here][3]][3]

**Table Size**

[![enter image description here][4]][4]

**Column Information where the statistic is created on**

[![enter image description here][5]][5]

    [ID] [int] IDENTITY(1,1) NOT NULL
*Identity column*

    select * from sys.stats  
    where name like '%_WA_Sys_0000000A_6B7099F3%';
[![enter image description here][6]][6]
*Auto created*


**Getting some info on another statistic**

    select * From sys.dm_db_stats_properties (1802541555, 3)  

[![enter image description here][7]][7]

In comparison with my empty stat:

[![enter image description here][8]][8]

Stats + Histogram from "generate scripts":

    /****** Object:  Statistic [_WA_Sys_0000000A_6B7099F3]    Script Date: 2/1/2019 10:18:19 AM ******/
    
        CREATE STATISTICS [_WA_Sys_0000000A_6B7099F3] ON [dbo].[table]([ID]) WITH STATS_STREAM = 0x01000000010000000000000000000000EC03686B0000000040000000000000000000000000000000380348063800000004000A00000000000000000000000000


**When creating a copy of the stats, no data is inside**

    CREATE STATISTICS [_WA_Sys_0000000A_6B7099F3_TEST] ON [dbo].[table]([ID]) WITH STATS_STREAM = 0x01000000010000000000000000000000EC03686B0000000040000000000000000000000000000000380348063800000004000A00000000000000000000000000



[![enter image description here][9]][9]

**When manually updating the stat they do get updated.** 

    UPDATE STATISTICS [dbo].[Table]([_WA_Sys_0000000A_6B7099F3_TEST])

[![enter image description here][10]][10]


  [1]: https://i.stack.imgur.com/HTEDK.png
  [2]: https://i.stack.imgur.com/qNvrU.png
  [3]: https://i.stack.imgur.com/VSCrc.png
  [4]: https://i.stack.imgur.com/Ae4NZ.png
  [5]: https://i.stack.imgur.com/jvofZ.png
  [6]: https://i.stack.imgur.com/KCfa7.png
  [7]: https://i.stack.imgur.com/EdQki.png
  [8]: https://i.stack.imgur.com/A7scr.png
  [9]: https://i.stack.imgur.com/k9Z8Y.png
  [10]: https://i.stack.imgur.com/qAfFn.png
Top Answer
Paul White (imported from SE)
I was able to reproduce this, both with an empty statistic, and a populated statistic. I arranged for an automatic statistic to be created on an empty table, and the index was created later:

```
IF OBJECT_ID(N'dbo.Heap', N'U') IS NOT NULL
BEGIN
    DROP TABLE dbo.Heap;
END;
GO
CREATE TABLE dbo.Heap 
(
    id integer NOT NULL IDENTITY,
    val integer NOT NULL,
);
GO
-- Add 1000 rows
INSERT dbo.Heap
    WITH (TABLOCKX)
    (val)
SELECT
    SV.number
FROM master.dbo.spt_values AS SV
WHERE
    SV.[type] = N'P'
    AND SV.number BETWEEN 1 AND 1000;
GO
SELECT COUNT_BIG(*) 
FROM dbo.Heap AS H
JOIN dbo.Heap AS H2
    ON H2.id = H.id
WHERE H.id > 0
AND H2.id > 0;
GO
-- Empty table
TRUNCATE TABLE dbo.Heap;
GO
-- Repeat exact same query (RT = 500 + 0.2 * 1000 = 700)
GO
SELECT COUNT_BIG(*) 
FROM dbo.Heap AS H
JOIN dbo.Heap AS H2
    ON H2.id = H.id
WHERE H.id > 0
AND H2.id > 0;
GO
-- Add 1000 rows
INSERT dbo.Heap
    WITH (TABLOCKX)
    (val)
SELECT
    SV.number
FROM master.dbo.spt_values AS SV
WHERE
    SV.[type] = N'P'
    AND SV.number BETWEEN 1 AND 1000;
GO
-- Add index
ALTER TABLE dbo.Heap ADD 
    CONSTRAINT [PK dbo.Heap id]
    PRIMARY KEY NONCLUSTERED (id);
GO
SELECT
    S.[name],
    S.auto_created,
    DDSP.stats_id,
    DDSP.last_updated,
    DDSP.[rows],
    DDSP.rows_sampled,
    DDSP.steps,
    DDSP.unfiltered_rows,
    DDSP.modification_counter
FROM sys.stats AS S
CROSS APPLY sys.dm_db_stats_properties(S.[object_id], S.stats_id) AS DDSP
WHERE 
    S.[object_id] = OBJECT_ID(N'dbo.Heap', N'U');
```

[![Output][1]][1]

I found that modifications continue to be tracked accurately on all non-empty duplicates, but only one statistic is updated automatically (regardless of the asynchronous setting).

Automatic statistics updates only occur when the query optimizer needs a particular statistic, and finds that it is out of date (an optimality-related recompile).

The optimizer chooses from duplicate statistics as mentioned in the [Plan Caching and Recompilations in SQL Server 2012][2] paper:

> An issue not directly related to the topic of this document is: given multiple statistics on the same set of columns in the same order, how does the query optimizer decide which ones to load during query optimization? The answer is not simple, but the query optimizer uses such guidelines as: Give preference to recent statistics over older statistics; Give preference to statistics computed using `FULLSCAN` option to those computed using sampling; and so on.

The point being that the optimizer chooses **one** of the available duplicate statistics (the "best one), and that one is automatically updated if found to be stale.

I believe this is a change in behaviour from older releases - or at least the documentation suggests that all out-of-date statistics for an object would be updated as part of this process, but I have no idea when this changed. It was certainly after August 2013 when Matt Bowler posted [Duplicate Statistics][3], which contains a handy AdventureWorks-based repo. That script now results in only one of the statistics objects being updated, while at the time both were.

The above explanation matches all the behaviours I observed while attempting to reproduce your scenario, but I doubt it is explicitly documented anywhere. It does seem like a sensible optimization, since there is little value in keeping duplicates fully updated.

This is probably all at a level of detail below that which Microsoft are willing to support. This also means it could change without notice.


  [1]: https://i.stack.imgur.com/H9iip.png
  [2]: https://docs.microsoft.com/en-us/previous-versions/sql/sql-server-2012/dn148262(v=msdn.10)
  [3]: https://mattsql.wordpress.com/2013/08/28/duplicate-statistics/

This room is for discussion about this question.

Once logged in you can direct comments to any contributor here.

Enter question or answer id or url (and optionally further answer ids/urls from the same question) from

Separate each id/url with a space. No need to list your own answers; they will be imported automatically.