Armakuni Contact us
← All case studies

2,500 species in the library.
Not one of them was searchable.

A wildlife footage marketplace held 5,000 hours from more than 750 filmmakers, but a clip only existed for buyers once someone had typed in what was in it. We proved that AI can identify species, behavior and scene, with tagging accuracy above 95%, and rebuilt the platform around search by meaning, event-driven transcoding of professional camera files and a new kind of product: five-second behavior datasets. A proof of concept became six pieces of work in five months.

Before

Buyers were looking for one particular moment.

Search by keyword only, across 2,500 species.

After
95%+tagging accuracy across species and behavior, as reported
10 TBsingle-file uploads, 50+ formats
  • Search by meaning and by technical need, plus batch processing for research buyers.

Buyers were looking for one particular moment

A footage buyer rarely wants every clip of a lion. They're after one behavior, in one kind of setting and shot one way, for the sequence they're cutting: "slow-motion footage of a lion stalking prey at dusk".

The marketplace serves filmmakers, broadcasters and global brands, but finding that moment depended on someone having described it first. Contributors annotated every clip by hand against a detailed schema, covering species, behavior, habitat, location and technical attributes, before it could go on sale. So the filmmakers held far more footage than they could ever submit, and the library could only be as big as the annotation allowed.

Search by keyword only, across 2,500 species

Search was keyword-only. A library spanning 2,500 species couldn't be searched by species, behavior or habitat, so buyers scrolled through clips looking for what they needed.

The machinery underneath was fragile too. The transcoding service checked a database on a timer and failed with no signal to anyone. Professional camera formats such as RED R3D needed a different decoding path from ordinary web video. And on the live site, bot traffic with no WAF in front of it was overloading the database.

Models describe every clip, including the untagged ones

The idea was to stop depending on people's descriptions. If models can see what's in a clip, every clip can be described, searched and sold, including the ones nobody ever had time to tag.

How we built it

6 decisions, in the order we made them. Each one says what we did and why, with what it did drawn beside it.

  1. Test three approaches on the same footage
  2. An AI agent turns a visual brief into a precise search
  3. Behavior in five-second sequences, a new product to sell
  4. Transcoding that tells you when it fails
  5. Four platforms, designed before the build
  6. Keep the live site standing while the new one is built

Test three approaches on the same footage

Built withBedrockOpenSearchStreamlit
The same footage Amazon NovaTwelve Labs
The engineering

We didn't pick a model and hope. The first proof of concept (POC) processed 10,000 minutes of wildlife video. It sampled key frames from each clip and used Amazon Nova models on Bedrock to identify species, behavior, habitat and technical attributes:

  • The pipeline generated up to ten metadata fields per clip, linked to its video ID in Amazon OpenSearch.
  • Video and query representations supported semantic retrieval alongside the structured metadata.
  • A Streamlit interface let users describe a request, retrieve candidate clips and inspect the results.
  • Candidate approaches, including Nova and Twelve Labs, ran against the same footage, so the model decision was made on comparative results.

Why: we ran the models side by side on the library itself, because benchmarks on general images say little about wildlife footage.

A later AWS Experience-Based Acceleration tested species identification on a bounded set of 20 species, at production quality, and set out the work needed to extend coverage to the full catalog. It also tested containerized transcoding against real RED and ProRes files, and delivered deployment runbooks and reusable implementation patterns.

An AI agent turns a visual brief into a precise search

Built withBedrock
SpeciesBehaviourContextTechnical One search

“What sets them apart is their ability to move between technical execution and business-context problem-solving.”

CTO, a wildlife footage library
The engineering

A buyer's brief mixes the creative with the technical: what's happening, where, and at what frame rate and format. The AI-agent search design handles both:

  • Bedrock parses the request into species, behavior, context and technical requirements.
  • Semantic retrieval finds relevant content, while structured filters apply requirements such as frame rate and format, and results are ranked for visual and behavioral relevance.
  • A batch processor accepts spreadsheets or task lists from research buyers, runs every requested search and assembles the matching material into organized collections for review.
  • Metadata generation describes interactions, setting and cinematic attributes as searchable tags and editorial summaries, reaching tagging accuracy above 95% across species, behavior, habitat and technical attributes, as the company reports.

Behavior in five-second sequences, a new product to sell

Built withEventBridgeStep Functions
A long clip 5-second piecesLabelled
The engineering

Temporal analysis opened a new way to sell the footage. It divides behavior into sequences of roughly five seconds, each with a behavior label, a confidence score and context. Scientific institutions and AI companies want behavioral data at that grain, not whole clips, so the library gained a dataset-licensing business alongside conventional clip sales.

EventBridge and Step Functions connect the private media archive to the licensing workflow, coordinating quality assessment, enrichment, licensing readiness and publication, so moving a clip from the archive to the marketplace no longer waits for a person to trigger it.

Transcoding that tells you when it fails

Built withS3FFmpegStep FunctionsCloudWatch
UploadsTranscodesA failed job Team
The engineering

Better search is worthless if footage can't get onto the platform in a usable form. We replaced polling with event-driven processing:

  • S3 multipart upload, Transfer Acceleration and presigned ingestion support resumable submission of large professional files, through a cross-platform command-line upload tool, with single files up to 10 TB across more than 50 video formats.
  • Input-format detection selects the transcoding path, with REDline and FFmpeg for decoding and conversion and g4dn and g4ad GPU instances for acceleration.
  • Step Functions tracks each job. Recoverable failures retry with exponential backoff, and unrecoverable jobs move to a dead-letter queue to be investigated.
  • Each upload produces seven preview assets, meaning five video-quality previews, a still image and a proxy for AI processing and editorial review.
  • CloudWatch shows job progress and failures. Spot capacity and autoscaling hold down compute cost, with GPU autoscaling responding in under three minutes, and S3 Intelligent-Tiering follows changing storage access.

When a step fails, the pipeline retries it and then parks the job where someone will see it, so no footage is lost.

Four platforms, designed before the build

Built withECSAuroraMySQLDynamoDBOpenSearchS3
Four platforms, one plan Asset management1Stock licensing2AI datasets3Transcoding4 then the build
The engineering

The architecture assessment mapped the whole existing stack, a legacy PHP CodeIgniter backend and a WordPress frontend, and defined the target for four platforms: private media asset management, stock-footage licensing, AI-dataset licensing and video transcoding. The target combines containerized services on ECS, Aurora MySQL for relational data, DynamoDB for workflow state, OpenSearch for retrieval and AWS Batch with CPU/GPU workers, with a JavaScript frontend on S3 and CloudFront replacing the PHP and WordPress pattern.

AWS Marketplace readiness was designed in from the start, with metering, entitlement and billing integration for subscriptions and private offers, rather than added later. The security stack (AWS WAF, Shield, CloudTrail and KMS) is aimed at SOC 2 Type II and GDPR readiness for enterprise buyers.

Keep the live site standing while the new one is built

Built withWAF
Bots turned away at the edgeThe live site kept up
The engineering

A dedicated DevOps pod looked after the live service in parallel. It investigated abnormal traffic, tuned WAF rules to block bot and malicious requests, fixed the database load they caused, and improved logs and alerts so the team sees a problem before users do.

What we'd tell another CTO

1Run the candidate models on your own content, side by side; Nova and Twelve Labs on the same footage ended the model debate with evidence.
2Look for the product hidden in the data. Once the footage could describe itself, five-second behavior segments became something new to sell, to buyers the library hadn't served before.
3Keep the live site stable while the new one is built, so customers don't pay for the modernization.

What else changed

  • 5,000+ hours of footage within reach of AI metadata, where contributor tagging used to be the only path to publication.
  • A dataset-licensing product built on five-second behavior segments.
  • Marketplace metering, entitlement and billing designed in.
  • A stable live site, with WAF tuned against automated bot traffic and the database load fixed.

What comes next

Rollout across the full species catalog, the AWS Marketplace listing, and the agentic workflows scaled across the complete video library.

How we'd do it today

This project came before our current offers. Here's how we'd approach the same work now.

At 5,000 hours and growing, tagging is a cost line, so AI Inference Engineering would move the routine clips to a model the company owns, on Amazon SageMaker AI at about a tenth of the price; for a business that licenses AI training data, a model it owns is also an asset. AK AI Factory would prove the 95% on a golden set tagged by expert annotators plus a sealed set, with rare species as critical cases, because an average hides the species buyers search for. AK Evolve would pin the CodeIgniter backend's behavior with characterization tests, so the old site keeps selling until the new one has taken over. After launch, AK Run's AI agents would take the first look at every alert and draft the fix, for a named engineer to confirm and ship with a test through the platform's own pipeline.

Have a problem like this one?

A free workshop: a few hours with the architects who'd do the work, on your own systems. No cost.

Book a free workshop