Skip to content Dr Martin Peniak Innovation · Robotics · Project Tao

Spatial calibration · service v1

Spatial intelligence.

Two cameras can see the same person and disagree about where they are. I invented the first version of the spatial calibration service to bring those views into one shared frame of reference.

Six camera views on the left, with coloured overlays and a combined 3D point cloud on the right Open still image
Six-view R&D during the invention of spatial service v1. Still image.

The question

Where is it, beyond the image?

A person appears in a different position in each camera’s image. I wanted those observations to refer to the same place. That meant moving from image pixels to shared geometry and, ultimately, coordinates in the site.

My contribution

Bringing the views together

My contribution was the first service implementation connecting camera images to a common spatial reference. During its development, the six-view experiment let me inspect the original images alongside their combined 3D representation.

The experiment

Six views, one shared representation

The research still shows the camera images beside a fused point cloud, a set of points describing the scene in three dimensions. Coloured camera markers and positions make the relationship between the views and the reconstruction visible.

That was the useful shift: I could inspect the observations together in space, alongside the images they came from.

How it fits together

From camera images to site coordinates.

1 · Inputs

Camera images

Start with views of a place. Each image describes the scene from its own viewpoint.

2 · Shared geometry

Relate the views

Bring the views into a common geometric frame so they can describe the same space.

3 · Site coordinates

Place the observations

Connect an observation in an image to a position in that shared space.

Generator v1.0 public synthetic-world video Watch Generator
Generator v1.0 · published 19 January 2024

Related work · Oosto era

Generator: a world where the cameras are known.

In Generator, I explored the complementary problem: creating controlled synthetic scenes with known camera geometry and scene information. That gives perception experiments a reference to test against.

I shared the v1.0 demonstration in January 2024. Synthetic scenes and spatial calibration approach the same question from two directions: building a known world, and relating camera observations to a physical one.

Watch Generator v1.0 on YouTube

What this work established

A spatial reference for camera observations.

The research image and public Generator film show two sides of the work: relating real camera views, and creating a world whose geometry is known. Together they show why a shared picture is only part of the problem; checking it against an independent reference matters just as much.

Evidence scope: research imagery from v1 development, not a field benchmark.