Page MenuHomePhabricator
Create Task
Maniphest T407582

[d5ea073c-a68c-4f3a-9cea-dc371b1517fe] 2025-10-16 21:41:08: Fatal exception of type "Wikimedia\Rdbms\DBQueryTimeoutError"
Closed, DuplicatePublicPRODUCTION ERROR
Actions

Description

Steps to replicate the issue (include links if applicable):

What happens?:
Error.

What should have happened instead?:
The log should be shown

2025-10-16 21:41:08.232681 [d5ea073c-a68c-4f3a-9cea-dc371b1517fe] mw-web.eqiad.main-d976f4d78-dt5rl ruwiki 1.45.0-wmf.23 exception ERROR: [d5ea073c-a68c-4f3a-9cea-dc371b1517fe] /wiki/%D0%A1%D0%BB%D1%83%D0%B6%D0%B5%D0%B1%D0%BD%D0%B0%D1%8F:%D0%96%D1%83%D1%80%D0%BD%D0%B0%D0%BB%D1%8B/QBA-bot?uselang=en   Wikimedia\Rdbms\DBQueryTimeoutError: A database query timeout has occurred.
Query: SET STATEMENT max_statement_time=30 FOR SELECT  /*! STRAIGHT_JOIN */ log_id,log_type,log_action,log_timestamp,log_namespace,log_title,log_params,log_deleted,user_id,user_name,log_actor,logging_actor.actor_user AS `log_user`,logging_actor.actor_name AS `log_user_text`,comment_log_comment.comment_text AS `log_comment_text`,comment_log_comment.comment_data AS `log_comment_data`,comment_log_comment.comment_id AS `log_comment_cid`,(SELECT  GROUP_CONCAT(ctd_name SEPARATOR ',')  FROM `change_tag` JOIN `change_tag_def` ON ((ct_tag_id=ctd_id))   WHERE (ct_log_id=log_id)  ) AS `ts_tags`  FROM `logging` FORCE INDEX (log_actor_type_time) JOIN `actor` `logging_actor` ON ((actor_id=log_actor)) LEFT JOIN `user` ON ((user_id=logging_actor.actor_user)) JOIN `comment` `comment_log_comment` ON ((comment_log_comment.comment_id = log_comment_id))   WHERE (log_type NOT IN ('spamblacklist','titleblacklist','urlshortener','abusefilter','abusefilterprivatedetails','abusefilterblockeddomainhit','abusefilter-protected-vars','oath','checkuser-temporary-account','checkuser-private-event','ipinfo','suppress')) AND (log_type NOT IN ('review','thanks','patrol','tag')) AND log_actor = 1 AND ((log_deleted & 4) = 0)  ORDER BY log_timestamp DESC,log_id DESC LIMIT 101
Function: MediaWiki\Pager\IndexPager::buildQueryInfo (MediaWiki\Pager\LogPager)
Error: 1969 Query execution was interrupted (max_statement_time exceeded)
 {"exception_url":"/wiki/%D0%A1%D0%BB%D1%83%D0%B6%D0%B5%D0%B1%D0%BD%D0%B0%D1%8F:%D0%96%D1%83%D1%80%D0%BD%D0%B0%D0%BB%D1%8B/QBA-bot?uselang=en","reqId":"d5ea073c-a68c-4f3a-9cea-dc371b1517fe","caught_by":"entrypoint"}
[Exception Wikimedia\Rdbms\DBQueryTimeoutError] (/srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/database/Database.php:1221) A database query timeout has occurred.
Query: SET STATEMENT max_statement_time=30 FOR SELECT  /*! STRAIGHT_JOIN */ log_id,log_type,log_action,log_timestamp,log_namespace,log_title,log_params,log_deleted,user_id,user_name,log_actor,logging_actor.actor_user AS `log_user`,logging_actor.actor_name AS `log_user_text`,comment_log_comment.comment_text AS `log_comment_text`,comment_log_comment.comment_data AS `log_comment_data`,comment_log_comment.comment_id AS `log_comment_cid`,(SELECT  GROUP_CONCAT(ctd_name SEPARATOR ',')  FROM `change_tag` JOIN `change_tag_def` ON ((ct_tag_id=ctd_id))   WHERE (ct_log_id=log_id)  ) AS `ts_tags`  FROM `logging` FORCE INDEX (log_actor_type_time) JOIN `actor` `logging_actor` ON ((actor_id=log_actor)) LEFT JOIN `user` ON ((user_id=logging_actor.actor_user)) JOIN `comment` `comment_log_comment` ON ((comment_log_comment.comment_id = log_comment_id))   WHERE (log_type NOT IN ('spamblacklist','titleblacklist','urlshortener','abusefilter','abusefilterprivatedetails','abusefilterblockeddomainhit','abusefilter-protected-vars','oath','checkuser-temporary-account','checkuser-private-event','ipinfo','suppress')) AND (log_type NOT IN ('review','thanks','patrol','tag')) AND log_actor = 1 AND ((log_deleted & 4) = 0)  ORDER BY log_timestamp DESC,log_id DESC LIMIT 101
Function: MediaWiki\Pager\IndexPager::buildQueryInfo (MediaWiki\Pager\LogPager)
Error: 1969 Query execution was interrupted (max_statement_time exceeded)

  #0 /srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/database/Database.php(1209): Wikimedia\Rdbms\Database->getQueryException(string, int, string, string)
  #1 /srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/database/Database.php(1183): Wikimedia\Rdbms\Database->getQueryExceptionAndLog(string, int, string, string)
  #2 /srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/database/Database.php(640): Wikimedia\Rdbms\Database->reportQueryError(string, int, string, string, bool)
  #3 /srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/database/Database.php(1363): Wikimedia\Rdbms\Database->query(Wikimedia\Rdbms\Query, string)
  #4 /srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/database/DBConnRef.php(127): Wikimedia\Rdbms\Database->select(array, array, array, string, array, array)
  #5 /srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/database/DBConnRef.php(384): Wikimedia\Rdbms\DBConnRef->__call(string, array)
  #6 /srv/mediawiki/php-1.45.0-wmf.23/includes/libs/rdbms/querybuilder/SelectQueryBuilder.php(762): Wikimedia\Rdbms\DBConnRef->select(array, array, array, string, array, array)
  #7 /srv/mediawiki/php-1.45.0-wmf.23/includes/pager/IndexPager.php(460): Wikimedia\Rdbms\SelectQueryBuilder->fetchResultSet()
  #8 /srv/mediawiki/php-1.45.0-wmf.23/includes/pager/IndexPager.php(275): MediaWiki\Pager\IndexPager->reallyDoQuery(string, int, bool)
  #9 /srv/mediawiki/php-1.45.0-wmf.23/includes/pager/IndexPager.php(564): MediaWiki\Pager\IndexPager->doQuery()
  #10 /srv/mediawiki/php-1.45.0-wmf.23/includes/specials/SpecialLog.php(390): MediaWiki\Pager\IndexPager->getBody()
  #11 /srv/mediawiki/php-1.45.0-wmf.23/includes/specials/SpecialLog.php(207): MediaWiki\Specials\SpecialLog->show(MediaWiki\Html\FormOptions, array)
  #12 /srv/mediawiki/php-1.45.0-wmf.23/includes/specialpage/SpecialPage.php(711): MediaWiki\Specials\SpecialLog->execute(string)
  #13 /srv/mediawiki/php-1.45.0-wmf.23/includes/specialpage/SpecialPageFactory.php(1730): MediaWiki\SpecialPage\SpecialPage->run(string)
  #14 /srv/mediawiki/php-1.45.0-wmf.23/includes/actions/ActionEntryPoint.php(499): MediaWiki\SpecialPage\SpecialPageFactory->executePath(string, MediaWiki\Context\RequestContext)
  #15 /srv/mediawiki/php-1.45.0-wmf.23/includes/actions/ActionEntryPoint.php(143): MediaWiki\Actions\ActionEntryPoint->performRequest()
  #16 /srv/mediawiki/php-1.45.0-wmf.23/includes/MediaWikiEntryPoint.php(184): MediaWiki\Actions\ActionEntryPoint->execute()
  #17 /srv/mediawiki/php-1.45.0-wmf.23/index.php(44): MediaWiki\MediaWikiEntryPoint->run()
  #18 /srv/mediawiki/w/index.php(3): require(string)
  #19 {main}

Event Timeline

Iniquity created this task.Oct 16 2025, 9:42 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 16 2025, 9:42 PM
Reedy added projects: Wikimedia-production-error, Wikimedia-Slow-DB-Query.Oct 16 2025, 9:57 PM
Restricted Application changed the subtype of this task from "Bug Report" to "Production Error". · View Herald TranscriptOct 16 2025, 9:57 PM
Reedy updated the task description. (Show Details)Oct 16 2025, 9:59 PM
Reedy added a project: MediaWiki-Logevents.
Marostegui subscribed.Oct 17 2025, 5:26 AM

This is a very slow query and the query killer kicks in:

cumin2024@db2151.codfw.wmnet[ruwiki]> show explain for 615197095;
+------+--------------------+---------------------+--------+----------------------------+---------------------+---------+---------------------------------+----------+----------------------------------------------------+
| id   | select_type        | table               | type   | possible_keys              | key                 | key_len | ref                             | rows     | Extra                                              |
+------+--------------------+---------------------+--------+----------------------------+---------------------+---------+---------------------------------+----------+----------------------------------------------------+
|    1 | PRIMARY            | logging             | range  | log_actor_type_time        | log_actor_type_time | 42      | NULL                            | 20892215 | Using index condition; Using where; Using filesort |
|    1 | PRIMARY            | logging_actor       | const  | PRIMARY                    | PRIMARY             | 8       | const                           |        1 |                                                    |
|    1 | PRIMARY            | user                | eq_ref | PRIMARY                    | PRIMARY             | 4       | ruwiki.logging_actor.actor_user |        1 | Using where                                        |
|    1 | PRIMARY            | comment_log_comment | eq_ref | PRIMARY                    | PRIMARY             | 8       | ruwiki.logging.log_comment_id   |        1 |                                                    |
|    2 | DEPENDENT SUBQUERY | change_tag          | ref    | ct_log_tag_id,ct_tag_id_id | ct_log_tag_id       | 5       | ruwiki.logging.log_id           |        7 | Using index                                        |
|    2 | DEPENDENT SUBQUERY | change_tag_def      | eq_ref | PRIMARY                    | PRIMARY             | 4       | ruwiki.change_tag.ct_tag_id     |        1 |                                                    |
+------+--------------------+---------------------+--------+----------------------------+---------------------+---------+---------------------------------+----------+----------------------------------------------------+
6 rows in set, 1 warning (0.035 sec)

The query takes

101 rows in set (1 min 47.008 sec)
Ladsgroup subscribed.Oct 17 2025, 11:19 AM

This seems very similar to {T400711}

Marostegui added a comment.Oct 21 2025, 11:35 AM

What do we want to do with this task then?

Marostegui moved this task from Triage to Refine on the DBA board.Oct 21 2025, 11:36 AM
Ladsgroup added a comment.Oct 21 2025, 12:04 PM
In T407582#11293335, @Marostegui wrote:

What do we want to do with this task then?

This could be an optimizer issue see T400711#11158762 and onwards. Maybe we are missing something obvious.

Marostegui closed this task as a duplicate of Restricted Task.Nov 6 2025, 8:47 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits