Production error => use https://phabricator.wikimedia.org/maniphest/task/edit/form/46/

This is still happening as of now. In case it helps to have a second log entry, here you go: [345c9f98-01ab-4ba9-b82b-21e2bd831c42] 2024-06-14 23:35:14: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".

i noticed that out of the 7 million in Category:Files with no machine-readable author, 3.8 are DPLA uploads.

Thank you @Zabe

Mentioned in SAL (#wikimedia-operations) [2024-06-12T10:07:44Z] <zabe> zabe@mwmaint1002:~$ foreachwikiindblist 'all - s4' refreshImageMetadata.php --mime image/webp # T364680

Mentioned in SAL (#wikimedia-operations) [2024-06-12T08:42:14Z] <zabe> zabe@mwmaint1002:~$ mwscript refreshImageMetadata.php commonswiki --mime image/webp # T364680

I am not sure if it is a regression caused by the new Parsoid media structure.

https://commons.wikimedia.org/wiki/MediaWiki_talk:Common.css#Special:Search_thumbnail_sizing

The last 3 version of https://commons.wikimedia.org/wiki/File:Oxygen480-mimetypes-image-vnd.dwg.svg already contains a workaround so that the last version renders at the preview-size of 120px.

@Prototyperspective: Could you please answer the last comment? Thanks in advance!

Thin lines are now rendering in the test cases given

In edit https://commons.wikimedia.org/w/index.php?title=File:Queen_Victoria_by_Bassano.jpg&diff=prev&oldid=804669319 Cessy3 vandalistically added en caption "welcome". In edit https://commons.wikimedia.org/w/index.php?title=File:Queen_Victoria_by_Bassano.jpg&diff=prev&oldid=841293383 Haansn08 removed that caption, but earned abuse filter log entries https://commons.wikimedia.org/wiki/Special:AbuseLog/10343284 and https://commons.wikimedia.org/wiki/Special:AbuseLog/10343285 in the process because "New page wikitext, after the edit ($1) (new_wikitext)" is completely wrong (it is not wikitext at all, but a bastardized text representation of the change in wikibase-mediainfo) and triggered Commons Abuse Filter 58. Perhaps we can exclude changes where "New content model ($1) (new_content_model)" is 'wikibase-mediainfo' to remove such false positives?

@Davey2010: Do you still face this issue? Asking as some related/similar issues have been resolved in the meantime.

So first of all, categorylinks in commons is a beast that no other wiki can compare:

root@clouddb1021:/srv# ls -Ssh sqldata.s*/*/categorylinks.ibd | head
 171G sqldata.s4/commonswiki/categorylinks.ibd
  45G sqldata.s1/enwiki/categorylinks.ibd
  27G sqldata.s3/ruwikinews/categorylinks.ibd
  24G sqldata.s7/arwiki/categorylinks.ibd
  17G sqldata.s6/frwiki/categorylinks.ibd
  14G sqldata.s3/arzwiki/categorylinks.ibd
 9.3G sqldata.s5/cebwiki/categorylinks.ibd
 9.2G sqldata.s2/enwiktionary/categorylinks.ibd
 9.2G sqldata.s7/fawiki/categorylinks.ibd
 9.1G sqldata.s6/ruwiki/categorylinks.ibd

I'd be curious to hear more about why it's impossible. I realize that Commons is much bigger in some respects than all other wikis, but that should just mean that the update to recalculate categories will take much longer (maybe weeks instead of days), not that it will be impossible. Someone has to monitor the update script during this time and maybe restart it if the server it's running on gets shut down or something, which is inconvenient, but again not impossible. The wiki should otherwise continue functioning normally while this happens.

Sorry about the trouble it has made, it's great that you are adding a comment to the section so changes in the future can be done more carefully, just to note in future if you can design someway to change this, please go for numeric instead of uca-default-u-kn as it was on the initial versions of the reverted patch (weird that it has changed last minute, probably even my own fault 😞). Maybe uca-default-u-kn can be desirable sometime but perhaps another community discussion is needed for that I think as some may don't like that T32996#2342009 and the request was only to enable numeric sorting. (and quick question from @Jdforrester-WMF, is a change from uppercase to numeric also this costly?)

I remember https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)/Archive_149#Sorting_in_categories_unreliable_for_a_few_days on enwiki, which didn't involve making the database read-only. But I guess Commons is much bigger than enwiki so it would take even longer.

In T362494#9868389, @Pppery wrote:

What makes it impossible (rather than simply difficult) exactly?

What makes it impossible (rather than simply difficult) exactly?

In practice, I think this is effectively Declined as impossible?

This appears fixed

There may be some pages that are wrong, but this should sort itself out as they're re-parsed.

Pagination appears to be working correctly now.

Mentioned in SAL (#wikimedia-operations) [2024-06-06T15:23:02Z] <jforrester@deploy1002> Finished scap: Backport for [[gerrit:1039746|Revert "commonswiki: Enable numeric wgCategoryCollation" (T366809)]] (duration: 13m 58s)

Change #1039767 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/mediawiki-config@master] Add a note that you cannot change wgCategoryCollation easily

https://gerrit.wikimedia.org/r/1039767

Change #1039767 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/mediawiki-config@master] Add a note that you cannot change wgCategoryCollation easily

https://gerrit.wikimedia.org/r/1039767

Mentioned in SAL (#wikimedia-operations) [2024-06-06T15:11:34Z] <jforrester@deploy1002> jforrester: Backport for [[gerrit:1039746|Revert "commonswiki: Enable numeric wgCategoryCollation" (T366809)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-06-06T15:09:03Z] <jforrester@deploy1002> Started scap: Backport for [[gerrit:1039746|Revert "commonswiki: Enable numeric wgCategoryCollation" (T366809)]]