Live challenge · Round 1 · hidden questions

Kitchen CCTV monitor$300 bounty · Round 1 is live: turn kitchen CCTV into answers about hygiene, handoff flow, and bottlenecks under $0.30 per hour. Ends Sep 9 · How scoring works. Two useful views: the challenge (the rules, the prize, the board) or the build guide (strategies, tools, and code). One of 3 live challenges →

The challengeBuild guide

Kitchen CCTV monitor - Round 1 - Jul 12-Sep 9

Answer real ops questions from kitchen CCTV.

This is for restaurants and cloud kitchens that already have CCTV but no time to review it: was staff wearing caps, did food sit too long at handoff, was a container sealed, where did the bottleneck start? Your agent must answer in JSON, show evidence, and stay under $0.30 per 60 minutes of video.

Prize
$300
top valid score
Window
60 days
Jul 12-Sep 9, 2026
Budget
$0.30 / hr
plus 25 minutes wall-clock
Scored on
Hidden ops QA
answers, evidence, cost log
Enter the challenge →

Start here: read the build guide · check the sample videos · skim the sample questions · download the challenge spec. A strong entry is a public portfolio piece: messy CCTV in, audited kitchen-ops answers out, under a real cost cap.

What you build

Submit one reproducible program. It receives CCTV-style kitchen videos and a JSON file of questions, then writes answers and a run log. No manual video inspection during scoring.

python answer.py --videos ./videos --questions questions.json --out answers.json --log run_log.json

The useful skill is not captioning every frame. It is finding the few moments that answer the question, using OCR only where it helps, and saying not_visible when the footage does not show enough.

Sample videos and references

Start with the long fixed-view kitchen clips below. Scoring uses hidden questions and an answer key on the stated video set; if any held-back clips are added later, that will be stated before they are used.

Long public CCTV
60-minute fixed kitchen CCTV-style service clip

One-hour fixed kitchen view with timestamp, staff movement, prep, and service flow. Strong public sample/reference; verify rights before rehosting.

Open video ->
Long public CCTV
Cctv dapur keteter pesanan mulai jam 2 sampai jam 8 pagi

About 28 minutes of busy kitchen order flow from a fixed CCTV-style angle. Useful for hidden-question design and cost-control testing.

Open video ->
Long public CCTV
CCTV DAPUR

About 22 minutes of fixed kitchen cooking footage. Good for long-window sampling and timestamp questions.

Open video ->
Long public CCTV
cctv dapur seafood jos gandos

About 19 minutes of restaurant-kitchen work from a fixed view. Useful as a public long-form reference.

Open video ->
More references and datasets
Supplemental sample
Chinese Commercial Kitchen - overhead task clips

Fixed-view real commercial-kitchen work. Useful supplemental sample and baseline development source.

Open source ->
Supplemental sample
Kaggle - Kitchen Video in Restaurants

Restaurant-kitchen workflow footage. License/access must be checked before rehosting cuts.

Open source ->
Messy reference
Chinese restaurant hygiene-problem footage

Messier public restaurant footage. Useful for realism and question design, not the only scored source.

Open video ->
Style reference
IP Bullet CCTV Camera (Kitchen View) - Revlight Security

Short true fixed kitchen CCTV. Good visual target, too short to carry the round alone.

Open video ->
Reference only
COM Kitchens

Unedited fixed-view cooking videos. Useful benchmark reference; restricted academic access.

Open source ->
Reference only
EPFL Smart Kitchen

Long multi-view kitchen actions. Lab setting, but useful for scoring and action-question design.

Open source ->

Sample questions

These are examples so builders understand the job. Final scoring uses hidden questions on the same public videos, with an answer key.

Q1At what timestamp was the first sealed bag placed on the handoff shelf?
Q2Was the cook at the stove wearing a cap or hairnet at 00:45?
Q3How many people were active at the prep counter at 00:45?
Q4Did the worker close the container before moving it away from the station?
Q5Which happened last: garnish added, lid closed, bag moved, or tray wiped?
Q6Is the order number visible? Answer not_visible if it is not readable.

Model policy

Open-source or local models are recommended, because this should be cheap enough for a small kitchen to run often. They are not mandatory.

Cloud models are allowed if every call is logged and the normalized cost stays under the cap. Local runs count as $0 model/API cost, but still have to fit the same runtime and frame limits.

What the hidden questions test

Objective answers

Yes/no, multiple choice, counts, timestamps, durations, and not-visible answers. Freeform scene descriptions do not decide the winner.

Operational facts

Cap or hairnet visible? Container sealed before handoff? Tray unattended too long? Which station was active? When did a bottleneck start?

No guessing credit

If the order number, face, label, or action is not visible, the right answer is not visible. Guessing should lose points.

Temporal reasoning

Many questions need the order of events, not just a single frame: first sealed bag, last item added, duration unattended, or step before serving.

Benchmark to beat

The baseline is a simple coarse-to-fine video agent: sample the whole clip cheaply, identify likely time windows, inspect only those windows with a vision model and OCR where useful, then answer in JSON with evidence.

It must be cheap

A valid run stays under $0.30 estimated model/API cost per 60 minutes of source video. Full-video brute force may fit some cheap APIs, but repeated full-clip calls should not win.

It must be precise

The answer key checks timestamps, counts, event order, and not-visible cases. A broad caption or summary is not enough.

It must show evidence

Every useful answer should point to the video span or frame that supports it, with a run log showing frames, calls, cost, and runtime.

Scoring

Total score is 100 points. A run is valid only if it stays under the hard cost and runtime caps. If it goes over, it does not rank.

  • 80 points - answer accuracy: hidden yes/no, counts, event order, timestamp, duration, and not-visible questions.
  • 15 points - cost efficiency: lower model/API cost helps only after the answer is valid and useful.
  • 5 points - reproducibility: one command, useful evidence, frame/model call log, and repeatable outputs.

Cost cap

Hard cap: $0.30 estimated model/API cost per 60 minutes of source video, 25 minutes wall-clock, and about 1,500 sampled frames per 60 minutes unless the evaluator states an equivalent frame budget.

If the scored set is longer or shorter, the dollar and frame caps scale with video minutes. The cap is deliberate: a useful restaurant tool has to find the right windows cheaply, not send every frame to the biggest model.

Why this maps to a real business

A restaurant or cloud-kitchen operator does not need a general video captioner. They need cheap, repeatable checks from footage they already collect: whether cooks wore caps or hairnets, whether food sat too long at handoff, whether a container was sealed, where orders backed up, and what the camera could not show.

The cost cap matters. A system that spends heavily on every frame is less useful to a small kitchen than one that samples intelligently, answers the actual operations question, and admits when the video does not show enough.

Why this shape

Public video-QA benchmarks usually separate examples from the held-out scoring answers. This round follows that idea, but makes it practical for kitchens: fixed-camera footage, objective questions, a cost cap, and logs that show what the agent actually looked at.

Sample questions are public so builders understand the job. Hidden questions prevent agents from hard-coding answers to the visible examples.

Submit / enterRead scoring rulesDownload challenge spec