Page MenuHomePhabricator

Consider compressing types in orchestrator -> evaluator requests
Closed, ResolvedPublic

Description

Description

Type specifications are highly redundant. We should consider moving type specifications out of the ZObjects themselves and into separate data structures to which ZObjects can refer. The most obvious and urgent place to do this will be in the evaluator request, where large type specifications have already caused problems.

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

  • consider whether to do this
  • do it?

Completion checklist

Details

TitleReferenceAuthorSource BranchDest Branch
Update to Avro schema version 2.0.0.repos/abstract-wiki/wikifunctions/function-orchestrator!375apineapine-smoltypemain
Update function-schemata sub-module to HEAD (e27d97f)repos/abstract-wiki/wikifunctions/function-orchestrator!374jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (e27d97f)repos/abstract-wiki/wikifunctions/function-evaluator!349jforrestersync-function-schematamain
Update function-schemata sub-module to HEAD (e27d97f)repos/abstract-wiki/wikifunctions/wikilambda-cli!74jforrestersync-function-schematamain
Add Avro schema version 2.0.0 with support for type compression.repos/abstract-wiki/wikifunctions/function-schemata!228apineapine-smoltypemain
Customize query in GitLab

Event Timeline

Change #1151782 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (e27d97f)

https://gerrit.wikimedia.org/r/1151782

Change #1151782 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Update function-schemata sub-module to HEAD (4680f99)

https://gerrit.wikimedia.org/r/1151782

Change #1153616 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Update evaluators from 2025-05-21-192515 to 2025-06-03-205630

https://gerrit.wikimedia.org/r/1153616

Change #1153617 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Update orchestrator from 2025-05-21-192453 to 2025-06-03-231524

https://gerrit.wikimedia.org/r/1153617

Change #1153616 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Update evaluators from 2025-05-21-192515 to 2025-06-03-205630

https://gerrit.wikimedia.org/r/1153616

Change #1153617 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Update orchestrator from 2025-05-21-192453 to 2025-06-04-185118

https://gerrit.wikimedia.org/r/1153617