Armakuni Contact us
← All case studies

Its value was in combining data with partners.
Every partnership started from scratch.

A U.S. data intelligence company needed to analyze its data together with partners' data without either side exposing raw records, and each new collaboration meant building the staging, permissions and masking again. Over four to six weeks, in four phases, we designed and deployed a working AWS Clean Rooms prototype: a governed path from Redshift into the collaboration, two patterns for machine learning inside its boundary, and the runbooks and templates to repeat it for every partner.

Before

Partner deals needed data that couldn't leave its owner.

After
Workingclean-room prototype, with every security boundary tested
  • A security and governance blueprint covering IAM, KMS, masking, hashing and logging.

Partner deals needed data that couldn't leave its owner

The company's commercial opportunity depended on combining its data with partners' datasets. Its Redshift environment supported internal analysis well. But each external collaboration needed a fresh approach to staging the data, setting permissions and protecting sensitive fields, done by hand and from nothing. Without defined patterns for masking, hashing and access control, every partnership carried regulatory and reputational risk.

Machine learning couldn't use partner data at all

Machine learning raised a harder question. Which computations could run inside the collaboration boundary, and which results had to be prepared beforehand? Either approach could work in theory, but nobody had designed or tested one, so the products built on the company's models couldn't use partner data at all.

A pattern the company could repeat for every partner

We built a pattern the company could repeat for every partner: a governed pipeline from Redshift into a clean room, security designed in before deployment, and documentation good enough that the company's own team could onboard the next partner without us.

How we built it

5 decisions, in the order we made them. Each one says what we did and why, with what it did drawn beside it.

  1. Discover before designing
  2. A governed path from Redshift to the clean room
  3. Two ways to bring machine learning in
  4. A time-boxed sprint, with the security boundaries tested too
  5. Hand over something the team can run

Discover before designing

Built withIAM
Before any design Account readiness1IAM2Governance3Schemas4 a candidate design
The engineering

The engagement began by checking that the foundations were actually ready, rather than assuming they were:

  • A kickoff workshop set success criteria and agreed what the engagement would and wouldn't deliver.
  • Discovery reviewed AWS account readiness, IAM, governance, source schema metadata and the datasets needed for the first collaboration.
  • The output was a discovery summary, a landing-zone readiness assessment and a candidate data-mapping strategy, the evidence to approve the build.

A governed path from Redshift to the clean room

Built withRedshiftGlueS3AthenaClean RoomsIAM
RedshiftGlue reshapes it into S3Clean Rooms schemasMasked, hashed, logged
The engineering

The design covered the whole flow, from Redshift through staging to the collaboration and back out to partners:

  • Glue job templates extract Redshift data and reshape it into compatible structures in S3, with Athena as the query layer.
  • Collaboration schemas define how staged data takes part in AWS Clean Rooms analysis.
  • IAM permissions, KMS encryption, masking, hashing and logging were specified against the collaboration's requirements and its sensitive fields, in a security and governance blueprint written before anything was deployed.
  • The reusable implementation assets, infrastructure-as-code templates included, mean the next collaboration doesn't start from zero.

Partners join a data collaboration because their data stays private, so the privacy controls were designed before any data moved.

Two ways to bring machine learning in

Built withClean Rooms
The clean room Answers brought inWork done inside
The engineering

The architecture sets out two patterns: precompute model outputs or embeddings before the collaboration, or run a supported workload inside the Clean Rooms environment. Which path fits depends on the use case, the partner's requirements and the compute the clean room allows. Having both designed means each new use case is a choice between known options rather than a research project.

A time-boxed sprint, with the security boundaries tested too

Acceptance testsThe data pathThe security boundaries written before the sprint
The engineering

In a time-boxed implementation sprint, run from an execution runbook, test scripts and acceptance criteria written in advance, the teams deployed the staging pipelines, the collaboration configuration and representative analytic or ML flows against sample datasets. Acceptance tests exercised the data path and the security boundaries, and every deviation became an explicit remediation item.

The company's own engineers worked beside ours throughout the sprint, so the knowledge transferred through doing the work.

Hand over something the team can run

Built withGlue
Our teamTheir team Templates and IaCThe runbookOnboarding patternsA roadmap
The engineering

The last phase turned the prototype into the company's own capability:

  • Reusable infrastructure definitions and Glue templates.
  • An operational runbook updated with what the deployed prototype actually showed.
  • Patterns for onboarding datasets and partners.
  • Joint implementation sessions and knowledge transfer covering the runbooks, infrastructure patterns, governance and machine-learning design.
  • A prioritized roadmap from prototype to production workloads.

What we'd tell another CTO

1Design the privacy controls before you deploy anything. Masking, hashing and key management are the product in a clean room, and the acceptance tests should exercise what it prevents as hard as what it does.
2Make the second partner cheaper than the first. The templates and playbooks are the deliverable that lasts, and so is a decision already made about where models run for each use case, precomputed outside or run inside. Building it with the company's own engineers meant the team that ran the sprint can run the next one.

What else changed

  • A working AWS Clean Rooms prototype, with data flows deployed and security boundaries tested.
  • A governed, repeatable path from Redshift through Glue, S3 and Athena into the collaboration.
  • Two designed patterns for machine learning inside the clean-room boundary.
  • Templates, runbooks, onboarding patterns and a trained team, plus a roadmap to production, from a four-to-six-week engagement.

What comes next

Onboarding partners at production scale, following the delivered roadmap.

How we'd do it today

This project came before our current offers. Here's how we'd approach the same work now.

Axiom would keep one catalogue on Amazon DataZone, so every staged dataset, and every AI agent that uses it, reads each field the same way, with row-level access through AWS Lake Formation. Before any data moved, we'd approve a data-flow map covering prompts, retrieval, embeddings, caches and logs, and check the real flows against it.

The rule a clean room enforces for people would apply to AI agents too: none would hold private data, read untrusted text and be able to send data out at once, and each would get its own identity, with Cedar policies checked outside the model on every call.

Have a problem like this one?

A free workshop: a few hours with the architects who'd do the work, on your own systems. No cost.

Book a free workshop