Link Search Menu Expand Document

VOXL 2 Camera Configurations

Table of contents

  1. Overview
  2. Available Configurations
    1. SDK 1.0
      1. 1.6.2 Supported Sensor Hardware IDs
      2. 1.6.2 Supported Sensor Settings
    2. Platform Release 0.9.5
      1. Changes
      2. 1.5.5 Supported Sensor Hardware IDs
      3. 1.5.5 Supported Sensor Settings
    3. Platform Release 0.9
      1. 1.4.1 Supported Sensor Hardware IDs
      2. 1.4.1 Supported Sensor Settings
  3. Quickstart Video
  4. Image Sensor Configurations - SDK 1.0
    1. C-01: Front Stereo and Tracking
    2. C-02: Tracking Only
    3. C-03: Front Stereo, Hires, and Tracking
    4. C-04: Hires and Tracking
    5. C-05: ToF and Tracking
    6. C-06: ToF, Hires, and Tracking (D0005 Starling)
    7. C-08: Hires Only
    8. C-09: ToF Only
    9. C-10: Front Stereo Only (ov7251)
    10. C-11: Front Stereo, Rear Stereo, Hires, and Tracking (D0006 Sentinel)
    11. C-12: Front Stereo Only (ov9782)
    12. C-13: Front Stereo (ov9782) and Hires
    13. C-14: ToF, Hires, and Tracking
    14. C-15: Stereo flip (ov9782)
    15. C-16: ToF, Hires, and 2 Trackings
    16. C-17: ToF, Tracking, Stereo(0v9782), and Hires(imx412)
  5. Image Sensor Configurations - SDK 0.9.5
    1. C3 - Front Stereo, Hires, and Tracking
    2. C4 - Tracking and Hires Only
    3. C6 - Hires + ToF + Tracking
    4. C10 - Front Stereo Only
    5. C11 - Front Stereo, Rear Stereo, Hires, and Tracking
    6. C8 - Hires Only
    7. C9 - Time of Flight (ToF) Only
    8. CX - Two Time of Flights (ToF)
  6. Current Limitations

Overview

VOXL 2 has 3 camera groups (shown below), where each group has:

  • QTY-2 full 4 lane MIPI CSI ports
  • CCI and camera control signals
  • 8 power rails (from 1.05V up to 5V) for cameras and other sensors
  • Dedicated I/O bus (one of UART, SPI, i2c hard-coded depending on group)

m0054-image-sensors-groups

Available Configurations

The camera configurations are purpose built via a combination of hardware and software to support more flexible options. Each configuration needs to be developed as its own effort, and then supported as a part of the system image and voxl-camera-server. The software needs to be configured using voxl-configure-cameras, and the image sensors must be connected to the port that matches the configurations documented on this page.

The configurations are not mix and match. One may have luck with different combinations, but that does not mean it will work in the future.

SDK 1.0

  • SDK 1.0.0
  • System Image 1.6.2

Please see a new voxl2-image-sensors page if you are on SDK 1.0+ and looking for additional setup information.

1.6.2 Supported Sensor Hardware IDs

HW Sensor IDSensor TypeDescriptionInterposer
0OV7251 M0015StereoM0010 + M0076
0OV9782 M0113StereoM0010 + M0076
0PMD TOF M0040ToFM0040 + M0076
HW Sensor IDSensor TypeDescriptionInterposer
1OV7251 M0015StereoM0010 + M0076
1OV9782 M0113StereoM0010 + M0076
1PMD TOF M0040ToFM0040 + M0076
HW Sensor IDSensor TypeDescriptionInterposer
2OV7251 M0014TrackingM0076, M0084 JL
2ov9782TrackingM0076, M0084 JL
2PMD TOF M0040DepthM0076, M0084 JL
2IMX678 M0061-2Hi-resM0076, M0084 JL
2IMX412 M0107Hi-resM0076, M0084 JL
2IMX214 M0025-2Hi-resM0076, M0084 JL
HW Sensor IDSensor TypeDescriptionInterposer
3IMX678 M0061-2Hi-resM0084 JU
3IMX412 M0107Hi-resM0084 JU
3IMX214 M0025-2Hi-resM0084 JU
3PMD TOF M0040ToFM0084 JU
HW Sensor IDSensor TypeDescriptionInterposer
4OV7251 M0015StereoM0010 + M0076
4OV9782 M0113StereoM0010 + M0076
4PMD TOF M0040ToFM0040 + M0076
4IMX678 M0061-2Hi-resM0076, M0084 JL
4IMX412 M0107Hi-resM0076, M0084 JL
4IMX214 M0025-2Hi-resM0076, M0084 JL
HW Sensor IDSensor TypeDescriptionInterposer
5OV7251 M0015StereoM0010 + M0076
5OV9782 M0113StereoM0010 + M0076
5PMD TOF M0040ToFNA
5IMX678 M0061-2Hi-res(alt address 0x20)M0076, M0084 JL

1.6.2 Supported Sensor Settings

SensorSensor TypeResolution @ FPS
IMX678 M0061-2Hi-res3840x2160 @ 30
1920x1080 @ 30
IMX412 M0107Hi-res1920x1080 @ 30
IMX214 M0025-2Hi-res4096 x 2160 @ 30
3840x2160 @ 30
2048x1536 @ 30
1920 x 1080 @ 30
1280 x 720 @ 30
1024 x 768 @ 30
640 x 480 @ 30
PMD TOF M0040ToF224 x 1557 @ 5
224x172 @ 5
OV7251 M0014Tracking Config640x480 @ 30
OV7251 M0015Stereo Config Left640x480 @ 30
OV7251 M0015Stereo Config Right640x480 @ 30
ov9782Tracking Config1280x800 @ 30
OV9782 M0113Stereo Config Left1280x800 @ 30
OV9782 M0113Stereo Config Right1280x800 @ 30

Platform Release 0.9.5

  • SDK 0.9.5
  • System Image 1.5.5

Changes

  • Added IMX678 support 1920x1080@30, 3840x2160@30
  • Enabled more sensor options (see table below)

1.5.5 Supported Sensor Hardware IDs

HW Sensor IDSensor TypeDescriptionInterposer
0OV7251 M0015StereoM0010 + M0076
0OV9782 M0113StereoM0010 + M0076
0PMD TOF M0040ToFM0040 + M0076
HW Sensor IDSensor TypeDescriptionInterposer
1OV7251 M0015StereoM0010 + M0076
1OV9782 M0113StereoM0010 + M0076
1PMD TOF M0040ToFNA
HW Sensor IDSensor TypeDescriptionInterposer
2OV7251 M0014TrackingM0076, M0084 JL
2ov9782TrackingM0076, M0084 JL
2PMD TOF M0040DepthM0076, M0084 JL
2IMX678 M0061-2Hi-resM0076, M0084 JL
2IMX412 M0107Hi-resM0076, M0084 JL
2IMX214 M0025-2Hi-resM0076, M0084 JL
HW Sensor IDSensor TypeDescriptionInterposer
3IMX678 M0061-2Hi-resM0084 JU
3IMX412 M0107Hi-resM0084 JU
3IMX214 M0025-2Hi-resM0084 JU
3PMD TOF M0040ToFM0084 JU
HW Sensor IDSensor TypeDescriptionInterposer
4OV7251 M0015StereoM0010 + M0076
4OV9782 M0113StereoM0010 + M0076
4PMD TOF M0040ToFM0040 + M0076
4IMX678 M0061-2Hi-resM0076, M0084 JL
4IMX412 M0107Hi-resM0076, M0084 JL
4IMX214 M0025-2Hi-resM0076, M0084 JL
HW Sensor IDSensor TypeDescriptionInterposer
5OV7251 M0015StereoM0010 + M0076
5OV9782 M0113StereoM0010 + M0076
5PMD TOF M0040ToFNA
5IMX678 M0061-2Hi-res(alt address 0x20)M0076, M0084 JL

1.5.5 Supported Sensor Settings

Some sensors may list additional capabilities when probed from software. Below are what we’ve tested against, other settings may have unexpected results.

SensorSensor TypeResolution @ FPS
IMX678 M0061-2Hi-res3840x2160 @ 30
1920x1080 @ 30
IMX412/577 M0107Hi-res1920x1080 @ 30
IMX214 M0025-2Hi-res4096 x 2160 @ 30
3840x2160 @ 30
2048x1536 @ 30
1920 x 1080 @ 30
1280 x 720 @ 30
1024 x 768 @ 30
640 x 480 @ 30
PMD TOF M0040ToF224 x 1557 @ 5
OV7251 M0014Tracking Config640x480 @ 30
OV7251 M0015Stereo Config Left640x480 @ 30
OV7251 M0015Stereo Config Right640x480 @ 30
ov9782Tracking Config1280x800 @ 30
OV9782 M0113Stereo Config Left1280x800 @ 30
OV9782 M0113Stereo Config Right1280x800 @ 30

Platform Release 0.9

  • SDK 0.9
  • System Image 1.4.1

1.4.1 Supported Sensor Hardware IDs

HW Sensor IDSensor TypeDescription
0OV7251 M0015Stereo
0OV9782 M0113Stereo
0PMD TOF M0040ToF
HW Sensor IDSensor TypeDescription
1OV7251 M0015Stereo
1OV9782 M0113Stereo
1PMD TOF M0040ToF
HW Sensor IDSensor TypeDescription
2OV7251 M0014Tracking
2ov9782Stereo
2PMD TOF M0040ToF
HW Sensor IDSensor TypeDescription
3IMX214 M0025-2Hi-res
3IMX412 M0107Hi-res
3PMD TOF M0040ToF
HW Sensor IDSensor TypeDescription
4OV7251 M0015CV,BW,
4OV9782 M0113Stereo
4PMD TOF M0040ToF
HW Sensor IDSensor TypeDescription
5OV7251 M0015Stereo
5OV9782 M0113Stereo
5PMD TOF M0040ToF

1.4.1 Supported Sensor Settings

SensorSensor TypeResolution @ FPS
IMX214 M0025-2Hi-res4096 x 2160 @ 30
3840x2160 @ 30
2048x1536 @ 30
1920 x 1080 @ 30
1280 x 720 @ 30
1024 x 768 @ 30
640 x 480 @ 30
IMX412/577 M0107Hi-resConfig1920x1080 @ 30
PMD TOF M0040ToF224 x 1557 @ 5
OV7251 M0014Tracking Config640x480 @ 30
OV7251 M0015Stereo Config Left640x480 @ 30
OV7251 M0015Stereo Config Right640x480 @ 30
ov9782Tracking Config1280x800 @ 30
OV9782 M0113Stereo Config Left1280x800 @ 30
OV9782 M0113Stereo Config Right1280x800 @ 30

Quickstart Video

The following video demonstrates setting up the image sensors for the “C11” VOXL 2 development kit:

Image Sensor Configurations - SDK 1.0

Please see a new voxl2-image-sensors page if you are on SDK 1.0+ and looking for additional setup information.

C-01: Front Stereo and Tracking

M0054-tracking-stereo

Sensor IDSensor TypeNotesUsage
0 (J6L)OV7251 M0015Fsync in0Front stereo
1 (J6L)OV7251 M0015Fsync out0Front stereo
2 (J7L)OV7251 M0014 Tracking

C-02: Tracking Only

M0054-tracking

Sensor IDSensor TypeNotesUsage
2 (J7L)OV7251 M0014 Tracking

C-03: Front Stereo, Hires, and Tracking

M0054-imx214-tracking-stereo

Sensor IDSensor TypeNotesUsage
0 (J6L)OV7251 M0015Fsync in0Front stereo
1 (J6L)OV7251 M0015Fsync out0Front stereo
2 (J7L)OV7251 M0014 Tracking
3 (J7U)imx214, imx412 Hi-res

C-04: Hires and Tracking

M0054-imx214-tracking

Sensor IDSensor TypeNotesUsage
2 (J7L)OV7251 M0014 Tracking
3 (J7U)imx214, imx412 Hi-res

C-05: ToF and Tracking

M0054-pmdtof-tracking

Sensor IDSensor TypeNotesUsage
0 (J6L)PMD ToF M0040 ToF
2 (J7L)OV7251 M0014 Tracking

C-06: ToF, Hires, and Tracking (D0005 Starling)

M0054-pmdtof-imx214-tracking

Sensor IDSensor TypeNotesUsage
0 (J6L)PMD ToF M0040 ToF
2 (J7L)imx214, imx412 Hi-res
3 (J7U)OV7251 M0014 Tracking

C-08: Hires Only

M0054-imx214

Sensor IDSensor TypeNotesUsage
3 (J7U)imx214, imx412 Hi-res

C-09: ToF Only

M0054-pmdtof

Sensor IDSensor TypeNotesUsage
0 (J6L)PMD ToF M0040 ToF

C-10: Front Stereo Only (ov7251)

M0054-stereo

Sensor IDSensor TypeNotesUsage
0 (J6L)OV7251 M0015Fsync in0Front stereo
1 (J6L)OV7251 M0015Fsync out0Front stereo

C-11: Front Stereo, Rear Stereo, Hires, and Tracking (D0006 Sentinel)

M0054-D0006-sentinel

Sensor IDSensor TypeNotesUsage
0 (J6L)OV7251 M0015Fsync in0Front stereo
1 (J6L)OV7251 M0015Fsync out0Front stereo
2 (J7L)OV7251 M0014 Tracking
3 (J7U)imx214, imx412 Hi-res
4 (J8L)OV7251 M0015Fsync in1Rear Stereo
5 (J8L)OV7251 M0015Fsync out1Rear Stereo

C-12: Front Stereo Only (ov9782)

M0054-ov9782-stereo

Sensor IDSensor TypeNotesUsage
0 (J6L)OV9782, M0113Fsync in0Front stereo
1 (J6L)OV9782, M0113Fsync out0Front stereo

C-13: Front Stereo (ov9782) and Hires

M0054-imx412-ov9782-stereo

Sensor IDSensor TypeNotesUsage
0 (J6L)OV9782, M0113Fsync in0Front stereo
1 (J6L)OV9782, M0113Fsync out0Front stereo
3 (J7U)imx214, imx412 Hi-res

C-14: ToF, Hires, and Tracking

M0054-pmdtof-imx214-tracking

Sensor IDSensor TypeNotesUsage
0 (J6L)PMD ToF M0040 ToF
2 (J7L)imx214, imx412 Hi-res
3 (J7U)OV7251 M0014 Tracking

C-15: Stereo flip (ov9782)

M0054-ov9782-stereo

Sensor IDSensor TypeNotesUsage
0 (J6L)OV9782, M0113 Stereo
1 (J6L)OV9782, M0113 Stereo

C-16: ToF, Hires, and 2 Trackings

M0054-imx214-tracking-pmdtof

Sensor IDSensor TypeNotesUsage
0 (J6L)PMD ToF M0040 ToF
2 (J7L)imx214, imx412 Hi-res
3 (J7U)OV7251 M0014 Tracking
3 (J8L)OV7251 M0014 Tracking 2

C-17: ToF, Tracking, Stereo(0v9782), and Hires(imx412)

M0054-pmdtof-imx412,tracking-tracking2

Sensor IDSensor TypeNotesUsage
0 (J6L)PMD ToF M0040 ToF
2 (J7L)imx412 M0061 Hi-res
3 (J7U)OV7251 M0014 Tracking
4 (J8L)OV9782, M0113 Stereo
5 (J8L)OV9782, M0113 Stereo

Image Sensor Configurations - SDK 0.9.5

C3 - Front Stereo, Hires, and Tracking

m0054-front-stereo-hires-tracking

Sensor IDSensor TypeNotesUsage
0 (J6L)OV7251 M0015Fsync in0Front stereo
1 (J6L)OV7251 M0015Fsync out0Front stereo
2 (J7L)ov7251 Tracking
3 (J7U)imx214, imx412 Hi-res

C4 - Tracking and Hires Only

m0054-hires-tracking

Sensor IDSensor TypeNotesUsage
2 (J7L)ov7251 Tracking
3 (J7U)imx214, imx412 Hi-res

C6 - Hires + ToF + Tracking

Available starting with Platform Release 0.9, sys img 1.4.1.

HW Setup

M0054-pmdtof-imx214-tracking

Sensor IDSensor TypeNotesUsage
0 (J6L)PMD TOF M0040 Depth 0
2 (J7L)imx214, imx412 Hi-res
3 (J7U)ov7251 Tracking

C10 - Front Stereo Only

m0054-front-stereo

Sensor IDSensor TypeNotesUsage
0 (J6L)OV7251 M0015Fsync in0Front stereo
1 (J6L)OV7251 M0015Fsync out0Front stereo

C11 - Front Stereo, Rear Stereo, Hires, and Tracking

m0054-dual-stereo-hires-tracking

Sensor IDSensor TypeNotesUsage
0 (J6L)OV7251 M0015Fsync in0Front stereo
1 (J6L)OV7251 M0015Fsync out0Front stereo
2 (J7L)ov7251 Tracking
3 (J7U)imx214, imx412 Hi-res
4 (J8L)OV7251 M0015Fsync in1Rear stereo
5 (J8L)OV7251 M0015Fsync out1Rear stereo

C8 - Hires Only

Available starting with Platform Release 0.9.5, sys img 1.5.3.

M0061-2 based IMX678, on M0054 J8 (no other camera location for IMX678 is supported in 1.5.3, must be J8).

Shown here, the M0076 interposer plugs into M0054 J8. The M0074 flex then connects to the M0061-2 backpack for the IMX678 module.

m0054-imx678-m0061-2

M0025-2 based IMX214, on M0054 J8.

m0054-imx214-m0025-2

SW Setup

voxl2:/$ voxl-configure-cameras 8

C9 - Time of Flight (ToF) Only

Available starting with Platform Release 0.9, sys img 1.4.1.

HW Setup

m0054-single-tof-m0076

Sensor IDSensor TypeNotesUsage
0PMD TOF M0040 Depth 0

SW Setup

voxl2:/$ voxl-configure-cameras 9

CX - Two Time of Flights (ToF)

Available starting with Platform Release 0.9, sys img 1.4.1.

HW Setup

Using the M0076-1 interposers on J6 and J8 as examples:

m0054-dual-tof-m0076

Using the M0084-1 dual camera adapter (“y-flex”) on J8 as example:

m0054-dual-tof-m0084

Sensor IDSensor TypeNotesUsage
0PMD TOF M0040 Depth 0
1PMD TOF M0040 Depth 1

SW Setup

NA

Current Limitations

  • As a means to allow coexistence of OV7251 sensors on CCI3, we are not resetting sensors when they normally should per Qualcomm, to prevent the sensors losing a runtime address swap. This modification is in the kernel, dmesg shows MODALAI HACK where it’s happening.
  • Sensor ID 1 and Sensor ID 5 share a reset line (gpio100), no specific known defects but an area to watch out.
  • Sensor indices assume all six sensors are in place and will shift when not fully populated.
  • All camera AVDD rails in this configuration are left on always (2P8VDC) as they’re shared

m0054-camera