Page MenuHomePhabricator

function-evaluatorComponent
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

Tasks related to the Wikifunctions function-evaluator service, as managed by the Abstract Wikipedia team. See also the function-orchestrator and function-schemata.

Recent Activity

Today

vaughnwalters closed T394558: Make catalyst build / selenium tests blocking in orchestrator gitlab pipeline as Resolved.

Tested this in the orchestrator pipeline and env is created, tests run and then env was successfully deleted. NICE! marking this as resolved

Fri, Jul 18, 12:41 AM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Catalyst (Kulupu Olin), Essential-Work, function-evaluator

Yesterday

Jdforrester-WMF moved T394558: Make catalyst build / selenium tests blocking in orchestrator gitlab pipeline from Ready to Needs Sign-off on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.

@vaughnwalters, leaving to you to sign-off as complete.

Thu, Jul 17, 6:00 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Catalyst (Kulupu Olin), Essential-Work, function-evaluator
Maintenance_bot removed a project from T394558: Make catalyst build / selenium tests blocking in orchestrator gitlab pipeline: Patch-For-Review.
Thu, Jul 17, 4:31 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Catalyst (Kulupu Olin), Essential-Work, function-evaluator
CodeReviewBot added a comment to T394558: Make catalyst build / selenium tests blocking in orchestrator gitlab pipeline.

Add selenium tests

Thu, Jul 17, 3:49 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Catalyst (Kulupu Olin), Essential-Work, function-evaluator
Jelto added a comment to T399348: gitlab CI mem issue .

@ecarg can you link to the jobs which got killed on WMCS runners? I can't find any job which had memory issues. I just see a lot of error: failed to solve: failed to compute cache key: failed to calculate checksum of ref ...: .js": not found where I'm not sure if this is a side effect of memory issues.

Thu, Jul 17, 6:51 AM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator
ecarg added a comment to T399348: gitlab CI mem issue .

Thank you, everyone~
@Jelto I tried using wmcs and unfortunately it wasn't enough 🥲

Thu, Jul 17, 3:40 AM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator

Wed, Jul 16

Dzahn added a comment to T399348: gitlab CI mem issue .

Well, we also had (different) CI failures in the other direction. That were not an issue on wmcs runners but were on DO runners. And the default was previously changed at some point leading to surprises when users were not aware of that.

Wed, Jul 16, 10:08 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator
bd808 added a comment to T399348: gitlab CI mem issue .

We could possibly discuss with releng if Digital Ocean runners should still be default or maybe the other way around, default to wmcs and people can opt-in to Digital Ocean runners if they want. (Given that we had a few reports where the suggested solution ended up being to switch to our own infra.)

Wed, Jul 16, 8:58 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator
CodeReviewBot added a project to T394558: Make catalyst build / selenium tests blocking in orchestrator gitlab pipeline: Patch-For-Review.

jhuneidi opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/411

Wed, Jul 16, 7:44 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Catalyst (Kulupu Olin), Essential-Work, function-evaluator
Jdforrester-WMF triaged T399341: add logs to trace utility wrapper and fix clock skew as High priority.
Wed, Jul 16, 3:42 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), Patch-For-Review, function-orchestrator, function-evaluator
Jdforrester-WMF changed the status of T399341: add logs to trace utility wrapper and fix clock skew from Open to In Progress.
Wed, Jul 16, 3:42 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), Patch-For-Review, function-orchestrator, function-evaluator
Jdforrester-WMF edited projects for T399341: add logs to trace utility wrapper and fix clock skew , added: Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work; removed Abstract Wikipedia team.
Wed, Jul 16, 3:41 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), Patch-For-Review, function-orchestrator, function-evaluator
Jdforrester-WMF changed the status of T399348: gitlab CI mem issue from Open to In Progress.
Wed, Jul 16, 3:35 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator
Jdforrester-WMF moved T399348: gitlab CI mem issue from Incoming to In Engineering on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 3:35 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator
Jdforrester-WMF edited projects for T399348: gitlab CI mem issue , added: Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
Wed, Jul 16, 3:35 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator
Dzahn added a comment to T399348: gitlab CI mem issue .

We could possibly discuss with releng if Digital Ocean runners should still be default or maybe the other way around, default to wmcs and people can opt-in to DO if they want. (Given that we had a few reports where the suggested solution ended up being to switch to our own infra.)

Wed, Jul 16, 3:30 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, collaboration-services, Release-Engineering-Team, Patch-For-Review, function-orchestrator, function-evaluator
DSantamaria moved T399316: Spike: build a prototype of new type converter/evaluator request to measure effects from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:20 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), function-schemata, function-evaluator, function-orchestrator
DSantamaria triaged T399316: Spike: build a prototype of new type converter/evaluator request to measure effects as High priority.
Wed, Jul 16, 2:20 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), function-schemata, function-evaluator, function-orchestrator
DSantamaria moved T399317: Learn what "capacity planning" means at WMF from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:18 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), WikiLambda, function-schemata, function-evaluator, function-orchestrator
DSantamaria triaged T399317: Learn what "capacity planning" means at WMF as Medium priority.
Wed, Jul 16, 2:18 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), WikiLambda, function-schemata, function-evaluator, function-orchestrator
DSantamaria moved T399318: Write an architectural plan for capacity planning work in a subsequent quarter from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:18 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), WikiLambda, function-schemata, function-evaluator, function-orchestrator
DSantamaria triaged T399318: Write an architectural plan for capacity planning work in a subsequent quarter as Medium priority.
Wed, Jul 16, 2:18 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), WikiLambda, function-schemata, function-evaluator, function-orchestrator
DSantamaria triaged T394917: If we understand capacity planning, we can create an architectural plan how to prevent service outage/throttling, to be executed in subsequent quarters as Medium priority.
Wed, Jul 16, 2:17 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Epic, Essential-Work, function-schemata, function-evaluator, function-orchestrator
DSantamaria moved T399322: Rust-based evaluator service should maintain a pool of ready executors from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:16 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-schemata, function-evaluator
DSantamaria triaged T399322: Rust-based evaluator service should maintain a pool of ready executors as Medium priority.
Wed, Jul 16, 2:15 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-schemata, function-evaluator
DSantamaria edited projects for T399322: Rust-based evaluator service should maintain a pool of ready executors, added: Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work; removed Abstract Wikipedia team.
Wed, Jul 16, 2:15 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-schemata, function-evaluator
DSantamaria moved T399344: Rust-based evaluator is at feature parity with the current Node-based one from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:15 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), WikiLambda, function-schemata, function-evaluator, function-orchestrator
DSantamaria added a project to T399344: Rust-based evaluator is at feature parity with the current Node-based one: Essential-Work.
Wed, Jul 16, 2:15 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), WikiLambda, function-schemata, function-evaluator, function-orchestrator
DSantamaria triaged T399344: Rust-based evaluator is at feature parity with the current Node-based one as Medium priority.
Wed, Jul 16, 2:15 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), WikiLambda, function-schemata, function-evaluator, function-orchestrator
DSantamaria moved T388981: In our Rust POC of the function-evaluator, upgrade wasmtime to 21.0.2+ (or replace) from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:14 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-evaluator
DSantamaria edited projects for T388981: In our Rust POC of the function-evaluator, upgrade wasmtime to 21.0.2+ (or replace), added: Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team, Abstract Wikipedia Fix-It tasks.
Wed, Jul 16, 2:14 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-evaluator
DSantamaria moved T391723: Fix broken JS executor tests for Rust from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:14 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-evaluator
DSantamaria edited projects for T391723: Fix broken JS executor tests for Rust, added: Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
Wed, Jul 16, 2:13 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-evaluator
DSantamaria moved T391722: Add fuzz testing to the Rust evaluator from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:13 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-evaluator
DSantamaria edited projects for T391722: Add fuzz testing to the Rust evaluator, added: Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
Wed, Jul 16, 2:13 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-evaluator
DSantamaria moved T391716: Remove remaining lint errors in Rust from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:13 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-schemata, function-evaluator
DSantamaria edited projects for T391716: Remove remaining lint errors in Rust , added: Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
Wed, Jul 16, 2:12 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-schemata, function-evaluator
DSantamaria moved T391721: Run cargo clippy/fix in CI from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:12 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-schemata, function-evaluator
DSantamaria edited projects for T391721: Run cargo clippy/fix in CI, added: Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
Wed, Jul 16, 2:11 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-schemata, function-evaluator
DSantamaria moved T391720: Address Rust security review findings from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:11 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-schemata, function-evaluator
DSantamaria edited projects for T391720: Address Rust security review findings, added: Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
Wed, Jul 16, 2:11 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-schemata, function-evaluator
DSantamaria moved T382045: [RUST STUFF]: Make executor_classes a non-public module from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:11 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), Patch-For-Review, function-evaluator
DSantamaria edited projects for T382045: [RUST STUFF]: Make executor_classes a non-public module, added: Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work; removed Abstract Wikipedia Fix-It tasks, Abstract Wikipedia team.
Wed, Jul 16, 2:10 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), Patch-For-Review, function-evaluator
DSantamaria moved T380808: Clean up error handling in Rust executor from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:10 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-evaluator
DSantamaria edited projects for T380808: Clean up error handling in Rust executor, added: Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work; removed Abstract Wikipedia team.
Wed, Jul 16, 2:10 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-evaluator
DSantamaria moved T380941: Reduce Rust binary sizes from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:09 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-evaluator
DSantamaria edited projects for T380941: Reduce Rust binary sizes, added: Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work; removed Abstract Wikipedia team.
Wed, Jul 16, 2:09 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-evaluator
DSantamaria moved T378558: Write Rust Functions to Recognize Evaluator-Specific Regexes from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:09 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-evaluator
DSantamaria moved T378782: [spike] install-rust && wasmedge build inconsistent and fails depending on env from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
Wed, Jul 16, 2:09 PM · Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work, function-evaluator
DSantamaria edited projects for T378558: Write Rust Functions to Recognize Evaluator-Specific Regexes, added: Abstract Wikipedia team (26Q1 (Jul–Sep)), Essential-Work; removed Abstract Wikipedia team.
Wed, Jul 16, 2:08 PM · Essential-Work, Abstract Wikipedia team (26Q1 (Jul–Sep)), function-evaluator