system.aggregated_zookeeper_log

System table containing aggregated statistics of ZooKeeper operations grouped by session, path, operation type, component, and subrequest flag.

Description

This table contains aggregated statistics of ZooKeeper operations (e.g. number of operations, average latency, errors) grouped by (session_id, parent_path, operation, component, is_subrequest) and periodically flushed to disk.

Unlike system.zookeeper_log which logs every individual request and response, this table aggregates operations into groups, making it much more lightweight and therefore more suitable for production workloads.

Operations that are part of a Multi or MultiRead batch are tracked separately via the is_subrequest column. Subrequests have zero latency because the total latency is attributed to the enclosing Multi/MultiRead operation.

Columns

• hostname (LowCardinality(String)) — Hostname of the server.
• event_date (Date) — Date the group was flushed.
• event_time (DateTime) — Time the group was flushed.
• session_id (Int64) — Session id.
• parent_path (String) — Prefix of the path.
• operation (Enum16(‘Close’ = -11, ‘Error’ = -1, ‘Watch’ = 0, ‘Create’ = 1, ‘Remove’ = 2, ‘Exists’ = 3, ‘Get’ = 4, ‘Set’ = 5, ‘GetACL’ = 6, ‘SetACL’ = 7, ‘SimpleList’ = 8, ‘Sync’ = 9, ‘Heartbeat’ = 11, ‘List’ = 12, ‘Check’ = 13, ‘Multi’ = 14, ‘Create2’ = 15, ‘Reconfig’ = 16, ‘CheckWatch’ = 17, ‘RemoveWatch’ = 18, ‘MultiRead’ = 22, ‘Auth’ = 100, ‘SetWatch’ = 101, ‘SetWatch2’ = 105, ‘AddWatch’ = 106, ‘FilteredList’ = 500, ‘CheckNotExists’ = 501, ‘CreateIfNotExists’ = 502, ‘RemoveRecursive’ = 503, ‘CheckStat’ = 504, ‘TryRemove’ = 505, ‘FilteredListWithStatsAndData’ = 506, ‘ListRecursive’ = 507, ‘SessionID’ = 997)) — Type of ZooKeeper operation.
• is_subrequest (UInt8) — Whether this operation was a subrequest inside a Multi or MultiRead operation.
• count (UInt32) — Number of operations in the (session_id, parent_path, operation, component, is_subrequest) group.
• errors (Map(Enum8(‘ZNOWATCHER’ = -121, ‘ZNOTREADONLY’ = -119, ‘ZSESSIONMOVED’ = -118, ‘ZNOTHING’ = -117, ‘ZCLOSING’ = -116, ‘ZAUTHFAILED’ = -115, ‘ZINVALIDACL’ = -114, ‘ZINVALIDCALLBACK’ = -113, ‘ZSESSIONEXPIRED’ = -112, ‘ZNOTEMPTY’ = -111, ‘ZNODEEXISTS’ = -110, ‘ZNOCHILDRENFOREPHEMERALS’ = -108, ‘ZBADVERSION’ = -103, ‘ZNOAUTH’ = -102, ‘ZNONODE’ = -101, ‘ZAPIERROR’ = -100, ‘ZOUTOFMEMORY’ = -10, ‘ZINVALIDSTATE’ = -9, ‘ZBADARGUMENTS’ = -8, ‘ZOPERATIONTIMEOUT’ = -7, ‘ZUNIMPLEMENTED’ = -6, ‘ZMARSHALLINGERROR’ = -5, ‘ZCONNECTIONLOSS’ = -4, ‘ZDATAINCONSISTENCY’ = -3, ‘ZRUNTIMEINCONSISTENCY’ = -2, ‘ZSYSTEMERROR’ = -1, ‘ZOK’ = 0), UInt32)) — Errors in the (session_id, parent_path, operation, component, is_subrequest) group.
• average_latency (Float64) — Average latency across all operations in (session_id, parent_path, operation, component, is_subrequest) group, in microseconds. Subrequests have zero latency because the latency is attributed to the enclosing Multi or MultiRead operation.
• component (LowCardinality(String)) — Component that caused the event.

See also

• system.zookeeper_log — Detailed per-request ZooKeeper log.
• ZooKeeper