Skip to content

[Epic] Markerless image tracking #48

Description

@kalwalt

Goal

Develop markerless image tracking for WebARKit — tracking natural images / planar surfaces without a pre-registered marker — building on the marker-based planar tracker.

Context

The marker-based Teblid / AKAZE / ORB / FREAK planar tracker is being made correct and robust (pose, projection, tracking-loss, examples) under the Marker-based tracking foundation milestone. That pipeline (feature detection → matching → homography → solvePnP → pose) is the stepping stone toward markerless tracking. This epic seeds the Markerless tracking milestone and will be broken into sub-issues as the approach is decided.

Scope / open questions (to refine)

  • Define the "markerless" target: on-the-fly reference acquisition (use the first frame / a captured keyframe as the reference), matching against a database of natural images, or instant tracking of an arbitrary planar surface.
  • Reference/keyframe management without a pre-supplied marker image.
  • Extend the existing OCVT pipeline (TrackingPointSelector, homography, optical flow) to a markerless workflow.
  • Evaluate approaches (instant tracking, plane detection, SLAM-lite).
  • New example(s) in webarkit-testing demonstrating markerless tracking.
  • WASM performance budget (detection cost per frame — cf. Restore downsampled feature detection + single-marker detection guard for performance (reconcile with ArtoolkitX OCVT) #44).

Foundation it builds on

Status

Planning / north-star epic. Sub-issues to follow.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status
    To do

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions