增强MySQL8.0-INFORMATION_SCHEMA

来源:这里教程网 时间:2026-03-01 15:56:39 作者:
Coinciding with the new native data dictionary in MySQL 8.0, we have made a number of useful enhancements to our   INFORMATION_SCHEMA  subsystem design in MySQL 8.0. In this post I will first go through our legacy implementation as it has stood since MySQL 5.1, and then cover what’s changed.
与MySQL 8.0原生数据字典一致,在MySQL 8.0的  INFORMATION_SCHEMA 子系统设计中,我们做了一些很有用的增强。在这篇文章中,我将会介绍自MySQL 5.1以来的旧的实现方式,然后介绍我们做了什么改变。
Background
INFORMATION_SCHEMA  was first introduced into MySQL 5.0, as a standards compliant way of retrieving meta data from a running MySQL server. When we look at the history of   INFORMATION_SCHEMA  there have been a number of complaints about the performance of certain queries, particularly in the case that there are many database objects (schemas, tables etc).
INFORMATION_SCHEMA 首次引入MySQL 5.0,作为一种从正在运行的MySQL服务器检索元数据的标准兼容方式。当我们回顾  INFORMATION_SCHEMA 的历史时,对于某些特定查询性能总是有很多的抱怨,特别是在有许多数据库对象(schema,表等)的情况下。
In an effort to address these reported issues, since MySQL 5.1 we have made a number of performance optimizations to speed up the execution of   INFORMATION_SCHEMA  queries. The optimizations are described in the MySQL manual, and apply when the user provides an explicit schema name or table name in the query.
为了解决这些上报的问题,从MySQL 5.1开始,我们进行了许多性能优化来加快  INFORMATION_SCHEMA 查询的执行速度。MySQL手册 <链接1> 中描述了这些优化,当用户在查询中提供显式schema名称或表名时,将会应用这些。
Alas, despite these improvements   INFORMATION_SCHEMA  performance is still a major pain point for many of our users. The key reason behind these performance issues in the current   INFORMATION_SCHEMA  implementation is that   INFORMATION_SCHEMA  tables are implemented as temporary tables that are created on-the-fly during query execution. These temporary tables are populated via:

  1. Meta data from files, e.g. table definitions from .FRM files.
  2. Details from storage engines, e.g. dynamic table statistics.
  3. Data from global data structures in the MySQL server.

尽管有这些改进,  INFORMATION_SCHEMA的 性能仍然是我们许多用户的主要痛点。在当前  INFORMATION_SCHEMA 实现方式下产生的性能问题背后的关键原因是,  INFORMATION_SCHEMA 表的查询实现方式是在查询执行期间创建临时表。这些临时表通过以下方式填充:

  1. 元数据来自文件,例如:表定义来自FRM文件
  2. 细节来自于存储引擎,例如:动态表的统计信息
  3. 来自MySQL server层中全局数据结构的数据

For a MySQL server having hundreds of database, each with hundreds of tables within them, the   INFORMATION_SCHEMA query would end-up doing lot of I/O reading each individual FRM files from the file system. And it would also end-up using more CPU cycles in effort to open the table and prepare related in-memory data structures. It does attempt to use the MySQL server table cache (the system variable ‘  table_definition_cache ‘), however in large server instances it’s very rare to have a table cache that is large enough to accommodate all of these tables.
对于一个MySQL实例来说可能有上百个库,每个库又有上百张表,  INFORMATION_SCHEMA 查询最终会从文件系统中读取每个单独的FRM文件,造成很多I/O读取。 并且最终还会消耗更多的CPU来打开表并准备相关的内存数据结构。 它确实尝试使用MySQL server层的表缓存(系统变量  table_definition_cache  ),但是在大型实例中,很少有一个足够大的表缓存来容纳所有的表。
One can easily face the above mentioned performance issue if the optimization is not used by the   INFORMATION_SCHEMA query. For example, let us consider the two queries below
如果  INFORMATION_SCHEMA 查询未使用优化,则可以很容易碰到上面的性能问题。 例如,让我们考虑下面的两个查询


mysql  > EXPLAIN  SELECT TABLE_NAME  FROM  INFORMATION_SCHEMATABLES  WHERE -> TABLE_SCHEMA  =  'test '  AND TABLE_NAME  =  't1 '\G ***************************  1. row  *************************** id:  1 select_type: SIMPLE table: TABLES partitions:  NULL type: ALL possible_keys:  NULL key: TABLE_SCHEMA,TABLE_NAME key_len:  NULL ref:  NULL rows:  NULL filtered:  NULL Extra: Using  where; Skip_open_table; Scanned  0 databases 1 row  in  set1 warning (  000 sec) mysql  > EXPLAIN  SELECT TABLE_NAME  FROM  INFORMATION_SCHEMATABLES  WHERE -> TABLE_SCHEMA  like  'test% '  AND TABLE_NAME  like  't% '\G ***************************  1. row  *************************** id:  1 select_type: SIMPLE table: TABLES partitions:  NULL type: ALL possible_keys:  NULL key:  NULL key_len:  NULL ref:  NULL rows:  NULL filtered:  NULL Extra: Using  where; Skip_open_table; Scanned all databases 1 row  in  set1 warning (  000 sec)

As we can see from the   EXPLAIN  output, we see that the former query would use the values provided in   WHERE  clause for the   TABLE_SCHEMA  and   TABLE_NAME  field as a key to read the desired   FRM  files from the file system. However, the latter query would end up reading all the   FRM  in the entire data directory, which is very costly and does not scale.
从  EXPLAIN 的输出可以看到。 我们看到前一个查询将使用  WHERE 子句中为  TABLE_SCHEMA 和  TABLE_NAME 字段提供的值作为键,从文件系统读取所需  FRM 文件。 但是,后一个查询最终将读取整个数据目录中的所有  FRM ,这非常昂贵且无法扩展。
Changes in MySQL 8.0
One of the major changes in 8.0 is the introduction of a native data dictionary based on InnoDB. This change has enabled us to get rid of file-based metadata store (  FRM  files) and also help MySQL to move towards supporting transactional DDL. For more details on introduction of data dictionary feature in 8.0 and its benefits, please look at Staale’s post here.
8.0中的一个主要变化是引入了基于InnoDB的数据字典。这一变化使我们能够摆脱基于文件的元数据存储(  FRM 文件),并帮助MySQL转向支持事务DDL。有关在8.0中引入数据字典功能及其优点的更多详细信息,请在此处查看Staale的文章 <链接2> 。
Now that the metadata of all database tables is stored in transactional data dictionary tables, it enables us to design an   INFORMATION_SCHEMA  table as a database VIEW over the data dictionary tables. This eliminates costs such as the creation of temporary tables for each   INFORMATION_SCHEMA  query during execution on-the-fly, and also scanning file-system directories to find FRM files. It is also now possible to utilize the full power of the MySQL optimizer to prepare better query execution plans using indexes on data dictionary tables.
既然所有数据库表的元数据都存储在事务数据字典表中,它使我们能够将INFORMATION_SCHEMA表设计为数据字典表上的数据库视图 。 这消除了成本,例如在执行期间为每个  INFORMATION_SCHEMA 查询创建临时表,以及扫描文件系统目录以查找FRM文件。 现在还可以利用MySQL优化器的全部功能,使用数据字典表上的索引来获得更好的执行计划。
The following diagram explains the difference in design in MySQL 5.7 and 8.0.

相关推荐