Repository navigation
Anze 5915 federated spe define implement the orchestrator tre agent task api with file based dataset access - #194
Closed
Closed
Conversation
- Manage S3 users via the Ceph RGW Admin Ops API (/admin/user, /admin/metadata/user), AWS4-signed; drop the mc CLI helpers and AttachPolicyToUserAsync. - Replace canned policy + attach with Principal-scoped statements merged into each bucket policy, tagged by policy-name Sids so they can be stripped on revoke. CreateProjectS3AccessPolicyAsync now takes the access key; RemovePolicyAsync takes the submission/output buckets. - Create the user before granting access, and delete it if the grant fails. - Pass vaultPath to DeleteCredentialHandlerBase.DeleteUserAsync so DeleteS3UserHandler can read the buckets back from Vault; CreateS3SecretHandler now stores them. - CreateBucketPolicy is a no-op; BucketPolicySetPublic delegates to SetPublicPolicy. - Point S3BucketPath at the Ceph Dashboard bucket view; RustFS comments updated to Ceph. Not changed: ControllerHelpers.AddUserToMinioBucket (Keycloak claim -> canned policy) has no Ceph equivalent and needs STS AssumeRoleWithWebIdentity + IAM roles.
Add FederatedTaskSettings (DatasetBucket, DatasetPrefix) to Agent.Api and
create the dataset bucket at startup via IMinioTreHelper. Datasets are
CSVs under {DatasetPrefix}{name}/ in that bucket. The bucket is separate
from project buckets, so expired-project cleanup never deletes it.
Startup logs an error rather than failing if storage is unreachable.
This reverts commit 20c09ad. The TRE storage stays on RustFS, whose console provides the Keycloak-backed upload UI that Ceph RGW lacks.
…lt/GetTask endpoints
RitaPeixoto
deleted the
ANZE-5915-federated-spe-define-implement-the-orchestrator-tre-agent-task-api-with-file-based-dataset-access
branch
October 29, 2026 12:25
RitaPeixoto
restored the
ANZE-5915-federated-spe-define-implement-the-orchestrator-tre-agent-task-api-with-file-based-dataset-access
branch
October 29, 2026 12:31
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.