ARCHIVED - use Instrument-ClientError instead!
Work related to the client error instrument that reports runtime errors from MediaWiki and other platforms.
Details
Details
Description
Nov 24 2022
Nov 24 2022
Aklapper renamed DoNotUse---Instrument-ClientError from Instrument-ClientError to DoNotUse---Instrument-ClientError.
Nov 21 2022
Nov 21 2022
Aklapper removed a project from T256173: Allow filtering of errors from logged in users: Patch-For-Review.
Nov 8 2022
Nov 8 2022
Maintenance_bot removed a project from T266504: Include canonical special page name for JS error reports: Patch-For-Review.
gerritbot added a comment to T266504: Include canonical special page name for JS error reports.
Change 700241 abandoned by Gergő Tisza:
[mediawiki/extensions/WikimediaEvents@master] clientError: Use dedicated field for canonical special page name
Reason:
This was done in If8d5732cd2e973df7096b88bdbc824e69bb58961
Oct 26 2022
Oct 26 2022
Oct 17 2022
Oct 17 2022
Oct 10 2022
Oct 10 2022
Oct 4 2022
Oct 4 2022
Krinkle triaged T279120: Make index.php?action=raw CDN cacheable for both logged-in and logged-out for import script use case as Medium priority.
Krinkle renamed T279120: Make index.php?action=raw CDN cacheable for both logged-in and logged-out for import script use case from Misc changes to index.php?action=raw for perf and error logging to Make index.php?action=raw CDN cacheable for both logged-in and logged-out for import script use case.
brennen placed T319261: Significant and unexpected drop in JavaScript error logging up for grabs.
Jdlrobson added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Thanks for the quick response here!
Resolving per discussion here and normal-looking graphs.
Ottomata added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Thank you all! Yes, only the 'analytics' eventgate clusters use dynamic schema lookup. All others rely on schemas baked into their local docker image, so they don't have to be runtime coupled to a remote schema service.
elukey lowered the priority of T319261: Significant and unexpected drop in JavaScript error logging from Unbreak Now! to Medium.
phuedx added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
elukey added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Both logstash and grafana look really good, I think that the task can be closed!
BTullis added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
I have deployed eventgate-logging-external and the new schema appears to be in place.
BTullis added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
I have merged @elukey's change to eventgate-wikimedia (https://gerrit.wikimedia.org/r/c/eventgate-wikimedia/+/838067) which built a new production eventgate image.
gerritbot added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Change 838107 merged by jenkins-bot:
[operations/deployment-charts@master] Bump version of eventgate image that is in use
gerritbot added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Change 838107 had a related patch set uploaded (by Btullis; author: Btullis):
[operations/deployment-charts@master] Bump version of eventgate image that is in use
gerritbot added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Change 838067 merged by Btullis:
[eventgate-wikimedia@master] blubber: update primary schema registry's git sha
gerritbot added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Change 838067 had a related patch set uploaded (by Elukey; author: Elukey):
[eventgate-wikimedia@master] blubber: update primary schema registry's git sha
elukey added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
It seems that the Docker image needs to be rebuilt with a new version of the schema registry, see this prev commit: https://gerrit.wikimedia.org/r/c/eventgate-wikimedia/+/625966/1/.pipeline/blubber.yaml
elukey added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
Tried a roll restart of codfw pods, not successful.
elukey added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
I think that the issue is related to how eventgate-logging-external reads the schemas, namely from local disk only:
Tgr added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
(On an aside, the schema version is hardcoded in puppet here, maybe that should be updated. But that's for the beta cluster.)
Tgr added a project to T319261: Significant and unexpected drop in JavaScript error logging: Event-Platform.
Failed loading schema at /mediawiki/client/error/2.0.0 with ENOENT (meaning the schema file was not found).
Jdlrobson updated the task description for T319261: Significant and unexpected drop in JavaScript error logging.
Jdlrobson added a comment to T319261: Significant and unexpected drop in JavaScript error logging.
@Tgr @phuedx pinging you given the activity in WikimediaEvents last week (https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaEvents/+/700242)
I am marking this as a train blocker for now, as it could potentially mean errors leak into production that we don't know about. Feel free to adapt once you've assessed! Thanks in advance!
Jdlrobson triaged T319261: Significant and unexpected drop in JavaScript error logging as Unbreak Now! priority.
Sep 26 2022
Sep 26 2022
Maintenance_bot removed a project from T265096: Tag errors where a banner is being displayed: Patch-For-Review.
Maintenance_bot removed a project from T314948: Make channel(topic) a filterable field in logstash: Patch-For-Review.
gerritbot added a comment to T265096: Tag errors where a banner is being displayed.
Change 829300 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Tag errors when a banner is displayed
gerritbot added a comment to T314948: Make channel(topic) a filterable field in logstash.
Change 700242 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] clientError: Log everything sent from mw.errorLogger.logError()
gerritbot added a comment to T256173: Allow filtering of errors from logged in users.
Change 829299 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] clientError: Add more information to log events
Sep 21 2022
Sep 21 2022
colewhite moved T248884: Documentation of client side error logging capabilities on mediawiki from Inbox to Radar on the Observability-Logging board.
colewhite moved T316992: ClientError fieldname 'tags' is conflicting from Inbox to Radar on the Observability-Logging board.
Sep 20 2022
Sep 20 2022
Maintenance_bot removed a project from T316992: ClientError fieldname 'tags' is conflicting: Patch-For-Review.
gerritbot added a comment to T316992: ClientError fieldname 'tags' is conflicting.
Change 829295 merged by Ottomata:
[schemas/event/primary@master] mediawiki/client/error: rename 'tags' to 'error_context'