User Details
- User Since
- Nov 13 2016, 3:31 PM (452 w, 4 d)
- Availability
- Available
- IRC Nick
- AntiComposite
- LDAP User
- AntiCompositeNumber
- MediaWiki User
- AntiCompositeNumber [ Global Accounts ]
Yesterday
To eliminate any traffic filtering problems, I grabbed the HTML for this task and threw it in a Toolforge tool, and it works (with the previously-noted image issue):
I tried the Slack tool mentioned earlier in this thread, and it apparently 429s:
Mon, Jul 14
Thu, Jun 26
An IPv6 /64 is likely too small for most mobile providers -- they tend to be significantly more dynamic than that.
Wed, Jun 18
Hm, are you on a blocked IP that you know of?
May 10 2025
Got a report via Discord of vandalism appearing in the preview for https://en.wikipedia.org/wiki/Formula_One_cars, which is a redirect. I tried purging the redirect page, and it didn't work. Then I purged the redirect target, which also did nothing. Then I purged the redirect page again and it worked.
May 5 2025
Local test container:
thumbor-1 | 2025-05-05 00:41:33 thumbor:DEBUG Loading extension wikimedia_thumbor.handler.images
thumbor-1 | 2025-05-05 00:41:33 thumbor:DEBUG Loading extension wikimedia_thumbor.handler.core
thumbor-1 | 2025-05-05 00:41:33 thumbor:DEBUG Loading extension wikimedia_thumbor.handler.healthcheck
thumbor-1 | 2025-05-05 00:41:33 thumbor:DEBUG Monkey patching ContextHandler.initialize
thumbor-1 | 2025-05-05 00:41:33 root:DEBUG thumbor starting at 0.0.0.0:8800
thumbor-1 | 2025-05-05 00:41:33 asyncio:DEBUG Using selector: EpollSelector
thumbor-1 | 2025-05-05 00:41:41 thumbor:DEBUG METRICS: inc: response.count:1
thumbor-1 | 2025-05-05 00:41:41 thumbor:DEBUG METRICS: inc: response.none_smart:1
thumbor-1 | 2025-05-05 00:41:41 thumbor:DEBUG METRICS: timing: response.none_smart:1
thumbor-1 | 2025-05-05 00:41:41 thumbor:DEBUG METRICS: inc: storage.miss:1
thumbor-1 | 2025-05-05 00:41:41 thumbor:DEBUG [HTTPS] load_sync: https%3A//upload.wikimedia.org/wikipedia/commons/e/e9/Hospitalkirche_20241221_HOF9117-HDR_RAW-Export.tif
thumbor-1 | 2025-05-05 00:41:41 thumbor:DEBUG [HTTPS] Loading normalized URL: https://upload.wikimedia.org/wikipedia/commons/e/e9/Hospitalkirche_20241221_HOF9117-HDR_RAW-Export.tif
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [HTTPS] return_contents: /tmp/tmp6wbkyp7i
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG METRICS: inc: original_image.status.200:1
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG METRICS: inc: original_image.status.200.upload_wikimedia_org:1
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG METRICS: inc: original_image.response_bytes:4096
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [Proxy] load: '.tiff'
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [Proxy] Looking for a tiff engine
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [ExiftoolRunner] command: ['/usr/bin/exiftool', '-ImageSize', '-j', '-m', '-q', '-q', '/tmp/tmp6wbkyp7i']
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [ShellRunner] Command: ['/usr/bin/timeout', '--foreground', '60', '/usr/bin/exiftool', '-ImageSize', '-j', '-m', '-q', '-q', '/tmp/tmp6wbkyp7i']
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [ShellRunner] Stdout: b'[{\n "SourceFile": "/tmp/tmp6wbkyp7i",\n "ImageSize": "9490x6327"\n}]\n'
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [ShellRunner] Stderr: b''
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [ShellRunner] Return code: 0
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [ShellRunner] Duration: 138.535
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [VIPS] Shrinking with command
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [BWE] Found source file in context
thumbor-1 | 2025-05-05 00:41:59 thumbor:DEBUG [ShellRunner] Command: ['/usr/bin/timeout', '--foreground', '60', '/usr/bin/vips', 'shrink', '/tmp/tmp6wbkyp7i', '/tmp/tmpoex4nzru/vips_result.png', '5', '5']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stdout: b''
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stderr: b"\n(vips:20): VIPS-WARNING **: 00:41:59.854: profile 'icc': 0h: PCS illuminant is not D50\n\n(vips:20): VIPS-WARNING **: 00:41:59.854: bad ICC profile not saved\n"
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Return code: 0
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Duration: 2284.042
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] Dumping buffer into temp file
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ExiftoolRunner] command: ['/usr/bin/exiftool', '-j', '-ImageSize', '-ProfileDescription', '-ColorType', '-FileType', '-Transparency', '-Artist', '-Copyright', '-ImageDescription', '-m', '-q', '-q', '/tmp/tmphaga8uw_']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Command: ['/usr/bin/timeout', '--foreground', '60', '/usr/bin/exiftool', '-j', '-ImageSize', '-ProfileDescription', '-ColorType', '-FileType', '-Transparency', '-Artist', '-Copyright', '-ImageDescription', '-m', '-q', '-q', '/tmp/tmphaga8uw_']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stdout: b'[{\n "SourceFile": "/tmp/tmphaga8uw_",\n "ImageSize": "1898x1265",\n "ColorType": "RGB",\n "FileType": "PNG"\n}]\n'
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stderr: b''
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Return code: 0
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Duration: 146.671
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] EXIF: {'SourceFile': '/tmp/tmphaga8uw_', 'ImageSize': '1898x1265', 'ColorType': 'RGB', 'FileType': 'PNG'}
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] File has no ICC profile
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] reorientate
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] resize: 800.0 533.0
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] Queued operators: ['-resize', '800x533^', '-gravity', 'center', '-extent', '800x533']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG No image format specified. Retrieving from the image extension: .tiff.
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG Content Type of image/tiff detected.
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [BWE] Defaulting to .jpg
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] read: .jpg 79
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] Chroma subsampling: '4:2:0'
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] Generating image with quality 79
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] Queued operators: ['-resize', '800x533^', '-gravity', 'center', '-extent', '800x533', '-quality', '79', '-sampling-factor', '4:2:0', '-interlace', 'Plane']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Command: ['/usr/bin/timeout', '--foreground', '60', '/usr/bin/convert', '-define', 'tiff:exif-properties=no', '-resize', '800x533^', '-gravity', 'center', '-extent', '800x533', '-quality', '79', '-sampling-factor', '4:2:0', '-interlace', 'Plane', '/tmp/tmphaga8uw_[0]', 'jpg:-']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stdout: <too long to display (3075 bytes)>
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stderr: b''
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Return code: 0
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Duration: 90.521
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [IM] Processing EXIF
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ExiftoolRunner] command: ['/usr/bin/exiftool', '-all=', '-m', '-q', '-q', '/tmp/tmpwv2qffjd', '-o', '-']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Command: ['/usr/bin/timeout', '--foreground', '60', '/usr/bin/exiftool', '-all=', '-m', '-q', '-q', '/tmp/tmpwv2qffjd', '-o', '-']
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stdout: <too long to display (3057 bytes)>
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Stderr: b''
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Return code: 0
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG [ShellRunner] Duration: 137.89100000000002
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: timing: engine.processing_time.wikimedia_thumbor.engine.vips:3021
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: timing: engine.processing_utime.wikimedia_thumbor.engine.vips:2875
thumbor-1 | 2025-05-05 00:42:02 tornado.access:INFO 200 GET /thumbor/unsafe/800x/https://upload.wikimedia.org/wikipedia/commons/e/e9/Hospitalkirche_20241221_HOF9117-HDR_RAW-Export.tif (172.18.0.1) 21210.97ms
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: timing: response.time:21210
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: timing: response.time.200:21210
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: inc: response.status.200:1
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: inc: response.not_smart.count:1
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: timing: response.not_smart.latency:21210
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: inc: response.format.jpg:1
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: timing: response.time.jpg:21210
thumbor-1 | 2025-05-05 00:42:02 thumbor:DEBUG METRICS: inc: response.bytes.jpg:3057
thumbor-1 | 2025-05-05 00:42:03 tornado.access:WARNING 404 GET /favicon.ico (172.18.0.1) 1.33ms
thumbor-1 | 2025-05-05 00:42:19 thumbor:DEBUG [HTTPS] cleanup_temp_file: /tmp/tmp6wbkyp7iMay 4 2025
Firefox crashed again (I have too many tabs) and now enwiki is doing it again.
May 3 2025
I got centrally logged out, I logged back in on enwiki, and am now being inconsistently locally logged out on local wikis (the central session remained logged-in after logging in the first time). JS autologin sometimes works, but sometimes it doesn't and I have to click login again.
I logged out of the iOS app to test something yesterday, and am now not remaining logged in on my laptop.
May 2 2025
Apr 29 2025
Apr 28 2025
acl*security_steward removals are managed by the https://gitlab.wikimedia.org/repos/stewards/onboarding-system script now, and activity is checked through the yearly reconfirmation process. However, the bot does not have access to verify 2FA on Phabricator.
Apr 24 2025
Hm.... Trying to load the original https://upload.wikimedia.org/wikipedia/commons/c/c5/Himalaya%2C_Indian_Atlas%2C_sheet_66_%2815219000%29.jpg in Firefox ends up with an Image corrupt or truncated. error in the console. Trying to load the URL with my test Thumbor HTTP loader gives errors about HTTP Content-Length. identify -verbose takes a fairly long time to complete but does so without errors.
$ identify -verbose Himalaya,_Indian_Atlas,_sheet_66_\(15219000\).jpg Image: Filename: Himalaya,_Indian_Atlas,_sheet_66_(15219000).jpg Permissions: rw-r--r-- Format: JPEG (Joint Photographic Experts Group JFIF format) Mime type: image/jpeg Class: DirectClass Geometry: 28674x20246+0+0 Resolution: 72x72 Print size: 398.25x281.194 Units: PixelsPerInch Colorspace: sRGB Type: TrueColor Base type: Undefined Endianness: Undefined Depth: 8-bit Channels: 3.0 Channel depth: Red: 8-bit Green: 8-bit Blue: 8-bit Channel statistics: Pixels: 580533804 Red: min: 0 (0) max: 255 (1) mean: 183.913 (0.721227) median: 205 (0.803922) standard deviation: 59.024 (0.231467) kurtosis: -1.02395 skewness: -0.58938 entropy: 0.883561 Green: min: 0 (0) max: 255 (1) mean: 179.205 (0.702765) median: 201 (0.788235) standard deviation: 57.341 (0.224867) kurtosis: -0.975416 skewness: -0.615138 entropy: 0.884332 Blue: min: 0 (0) max: 255 (1) mean: 165.105 (0.647472) median: 186 (0.729412) standard deviation: 52.5198 (0.20596) kurtosis: -0.795282 skewness: -0.686176 entropy: 0.879595 Image statistics: Overall: min: 0 (0) max: 255 (1) mean: 176.074 (0.690488) median: 197.333 (0.773856) standard deviation: 56.2949 (0.220764) kurtosis: -0.931548 skewness: -0.630231 entropy: 0.882496 Rendering intent: Perceptual Gamma: 0.454545 Chromaticity: red primary: (0.64,0.33,0.03) green primary: (0.3,0.6,0.1) blue primary: (0.15,0.06,0.79) white point: (0.3127,0.329,0.3583) Matte color: grey74 Background color: white Border color: srgb(223,223,223) Transparent color: black Interlace: JPEG Intensity: Undefined Compose: Over Page geometry: 28674x20246+0+0 Dispose: Undefined Iterations: 0 Compression: JPEG Quality: 98 Orientation: Undefined Profiles: Profile-icc: 672 bytes Properties: date:create: 2025-04-24T10:45:42+00:00 date:modify: 2023-08-07T21:28:26+00:00 date:timestamp: 2025-04-24T11:22:37+00:00 icc:copyright: Public Domain icc:description: GIMP built-in sRGB icc:manufacturer: GIMP icc:model: sRGB jpeg:colorspace: 2 jpeg:sampling-factor: 1x1,1x1,1x1 signature: a5b27e9b6f10edbd54b2a08e17e2f8a5dfc7c4f6998883fa723df749029f9781 Artifacts: verbose: true Tainted: False Filesize: 267.593MiB Number pixels: 580.534M Pixel cache type: Memory Pixels per second: 42.8261MP User time: 13.450u Elapsed time: 0:14.555 Version: ImageMagick 7.1.1-47 Q16-HDRI x86_64 22763 https://imagemagick.org
I was able to get my test Thumbor instance to thumbnail the file by downloading it with wget and using the file loader. I'm not sure if the original is corrupt in some way or if this is a SRE-swift-storage issue.
Apr 22 2025
This file likely exceeds the Debian-provided resource limits for ImageMagick. It seems like it's failing fast, so it's likely exceeding them on load rather than while attempting to render the thumbnail. T220171: Generate thumbnails of large JPGs with VIPS is the solution.
Apr 21 2025
To summarize a bit for those who may not have been following developments: The Graph extension, as it previously existed, will not be re-deployed to Wikimedia sites as it is not possible to do so securely. It is being replaced for some uses with the Chart extension. As a pilot, an initial version of the Chart extension has been deployed to mediawiki.org, Commons, the test wikis, and the Hebrew, Italian, and Swedish Wikipedias. You can see some example charts at https://www.mediawiki.org/wiki/Extension:Chart#Types_of_chart. While testing on those wikis, some problems were identified that have delayed the rollout to further wikis, which was previously expected for this month. You can read the plans for the continuing development of this system at https://www.mediawiki.org/wiki/Extension:Chart/Project and follow updates at https://www.mediawiki.org/wiki/Extension:Chart/Project/Updates.
Apr 12 2025
Not represented in those tasks is the community perception that the MediaWiki 2FA implementation is fragile and prone to locking people out of their accounts because they lost their authentication device and their scratch codes don't work. Whether this was ever true is unknown, but I certainly know of multiple people who say it happened to them years ago. Those stories seem to be less prevalent now, but the perception (and the way we talk about 2FA) has not really changed.
Apr 11 2025
Apr 8 2025
Mar 31 2025
From a license compliance point of view, this isn't a complex, nuanced, or even interesting issue. It's just a shocking lack of willingness to comply with the terms of the free licenses of software we use in our free software.
Technically, this has been fixed. But the block information is now shown in a manner that is entirely unusable. It is impossible to actually scroll the block messages to read them, and the "see more" link opens a blank tray.
Appears, at least from a single test, to be working as expected now.
@Jacobolus Please don't leave comments about new problems on old tasks. The task for the current incident is T390512.
Mar 30 2025
I would describe a lot of these tools, even some of the ones I placed in the "multiple active maintainers" section, as undermaintained even if they are not totally unmaintained. We can probably find someone to turn them off and back on again if they get stuck, but if something goes more seriously wrong (like a breaking API change) I'm not confident that there's anyone with enough knowledge of the tools to repair them.
https://commons.wikimedia.org/w/index.php?title=User_talk:Steinsplitter&curid=19802717&diff=1014580276&oldid=1013854652 @Ahecht now has access to the globalusagecount tool.
Mar 28 2025
This spread to CVNBot14 (commons) a while ago, and this month is now affecting CVNBot5 (meta) and CVNBot6 (swmt, includes meta).
Mar 27 2025
Mar 26 2025
<AntiComposite> I have a lot of pages on Commons that were added to my watchlist because I made a single category change
<AntiComposite> so "all my edits to the page are tagged with HotCat" would be useful
Mar 25 2025
@Ahecht https://toolsadmin.wikimedia.org/tools/id/globalusagecount lists Steinsplitter as the only maintainer, so if he's not around then adoption is the next step. Looks like you're about to meet the times set in https://wikitech.wikimedia.org/wiki/Help:Toolforge/Abandoned_tool_policy#Adoption (Steinsplitter's last edit was 27 days ago, https://commons.wikimedia.org/wiki/User_talk:Steinsplitter#c-Ahecht-20250312234700-GlobalUsageCount was 12 days ago). I don't see the required Wikitech notification though.
Mar 24 2025
$ display NYTMapNeuveChapelle1915.png display: IDAT: invalid distance too far back `NYTMapNeuveChapelle1915.png' @ error/png.c/MagickPNGError/1305.
This is T285875: Thumbor fails to render PNG with "Failed to convert image convert: IDAT: invalid distance too far back", returns 429 "Too Many Requests". Fixed with pngfix.
Mar 23 2025
Mar 22 2025
That provision was introduced in May 2023, and we know that FNDE logged in to Toolforge in Jan 2024 (T320003#9474901). That should be sufficient for the default license to apply, but I don't know how much TSC has decided to rely on it.
Mar 21 2025
I first noticed this on hewiki only early on the 14th. I remember seeing a connection to auth.wm.o in the devtools, but didn't look further because I was having multiple issues while making a series of complex oversight actions. Then it started on enwiki on the 17th/18th. I haven't had the issue in the last 48 hours.
acl*sre-team != acl*security_sre. acl*sre-team does not appear on https://phabricator.wikimedia.org/project/subprojects/30/ as a subproject of acl*security (aren't phab ACLs fun?)
Mar 19 2025
You mean it doesn't change enwiki and loginwiki having the same token, but the token itself does change when you log out and back in, right? If it didn't (and still worked) that would be quite bad.
On enwiki, without having logged in/out, page loaded logged-in:
and on loginwiki:
The centralauth_Token matches between enwiki and loginwiki. I first noticed this 14 March on hewiki without having recently logged in or out. I tried logging out and back in then (with keep me logged in, as always) to see if that changed anything and it did not.
Mar 18 2025
It's been a while since I looked at Znuny/OTRS ticket numbers, but if I remember correctly they were composed of YYYYMMDD and then an 8-digit counter of tickets received that day, resetting at 00:00Z.
Mar 16 2025
currently also affecting MusikBot AbuseFilterIRC (cc @MusikAnimal )
Mar 13 2025
Mar 12 2025
Mar 11 2025
2025-03-11T00:58:38Z SULWatcher EventsteamsThread INFO: Replayed change detected, restarting EventStream: 2025-03-03T18:52:22Z, None 2025-03-11T01:36:17Z SULWatcher EventsteamsThread INFO: Replayed change detected, restarting EventStream: 2025-03-03T18:52:22Z, None 2025-03-11T01:39:51Z SULWatcher EventsteamsThread INFO: Replayed change detected, restarting EventStream: 2025-03-03T18:52:22Z, None 2025-03-11T02:23:22Z SULWatcher EventsteamsThread INFO: Replayed change detected, restarting EventStream: 2025-03-03T18:52:22Z, None 2025-03-11T02:56:52Z SULWatcher EventsteamsThread INFO: Replayed change detected, restarting EventStream: 2025-03-03T18:52:22Z, None
log entries don't have a notify_url. Oh well. The actual mitigation is working, so this task is resolved for now.
Mar 10 2025
Mar 9 2025
Mar 8 2025
I temporarily added some logging to StewardBot to confirm that EventStreams is sending the correct timestamps when replaying old events, and it is.
Mar 5 2025
Feb 28 2025
wpTargets does work.
Feb 27 2025
As far as I can tell, the site is still loading cross-site resources.