FSM-IMX570D Development Kit for Jetson AGX Orin and Xavier – High-Resolution iToF Imaging Solution fsm-imx570-development-kit-for-jetson-agx-orin-xavier

Description

The FSM-IMX570D Devkit delivers compact and high-resolution Indirect Time-Of-Flight (iTOF) technology integrating the Sony IMX570PLR-C sensor. This “off-the-shelf” Devkit reduces your time-to-market by providing a complete and calibrated assembly; a sensor board, lens, illumination board, power board, adapters, and drivers. Prototype quickly and capture fast moving 3D data in low lighting conditions. Experience high-precision object depth mapping with onboard Sony DepthSense™ and compile results as a reference point to take advantage of our fully customizable solutions.

The FSM-IMX570D Devkit delivers compact and high-resolution Indirect Time-Of-Flight (iTOF) technology integrating the Sony IMX570PLR-C sensor. This “off-the-shelf” Devkit reduces your time-to-market by providing a complete and calibrated assembly; a sensor board, lens, illumination board, power board, adapters, and drivers. Prototype quickly and capture fast moving 3D data in low lighting conditions. Experience high-precision object depth mapping with onboard Sony DepthSense™ and compile results as a reference point to take advantage of our fully customizable solutions.

Features

Back-illuminated Sony IMX570PLR-C iToF 640 x 480 sensor.
Drivers and demo application for NVIDIA® Jetson AGX Orin™ and AGX Xavier™.
PixelMate™ MIPI CSI-2 Interface for robust connectivity.
Onboard Sony DepthSense™ Sensor Edge Processor (SEP) performing depth calculation and correction.
Support for Multi-Sensor Synchronization (ToF, RGB).
Application

Operate iToF technology and IMX570 in your environment and evaluate the technological applicability and performance.
Benefit from the open platform by driving down to the component level, and gauge your own implementation of depth processing against Sony’s reference.
Make educated “build vs buy” decisions and benefit from FRAMOS’s long-term camera development experience for your tailored productization.
SPECIFICATIONS

Image Sensor

Type: Sony IMX570PLR-C
Technology: Sony DepthSense™
Shutter: CMOS Global
Resolution: 640 x 480
Pixel Size: 5 µm x 5 µm
Optical Format: 1/4.5″
Sensor Framerate (RAW): 56 fps (4-phases)
Optical Attributes

Field of View (HxV): 60° x 45°
Operating Wavelength: 940nm
Lens Type: 2.88 mm, F#1.2, 930-980 nm(FPL-307610)
Mount Type: M12
Assembly: Focused and Fixed (Calibrated, not adjustable / interchangeable)
Illumination

4x VCSEL Laser Diode @ 940nm (Osram V105Q121A-940)
4x Laser Driver (Sony CXA4026)
Depth Processor (On-Board)

Type: Sony CXD5639
Modes: 20 MHz, 120 MHz (Single Mode)
Output Resolution: 640 x 480
Supported Framerate(s)

30 fps (continuous operation)
Up to 56 fps (limited duration)
Synchronization
External: Yes (XVS used for Frame Trigger)
Multi-ToF: Yes (maximum 4 units, TDMA method)
RGB Sensor: Yes (XVS)
RGB sensor is not supplied with this kit.
Calibration (per device, full scope)

Calibration Methods: Thermal, Cyclic, Global/Lens/Gradient
Calibration Storage: On device EEPROM (binary)
DRIVER PACKAGE CONTENT AND IMPLEMENTED FUNCTIONS:

Scope of the Package

Platform and device drivers for Linux for Tegra
NVIDIA® Jetpack 5.1 / L4T 35.2.1 and later
V4L2 based subdevice drivers (low-level C API)
Streamlined V4L2 library (LibSV) providing C/C++ API
Displaying example
Supported Platforms
NVIDIA® Jetson AGX Orin™ Developer Kit
NVIDIA® Jetson AGX Xavier™ Developer Kit
Parameter Access

Exposure Time Control: 15 - 1000µs
Sensor Operation Mode: (Master, Slave)
Frame Rate Control: Yes (Results Pending)
Depth Operating Modes (Single Frequency)
Single Frequency:
Short Range (120 MHz): 0.4 - 1.25 m
Long Range (20 MHz): 0.4 - 7.5 m
Dual Mode (20/120 MHz): 0.4 -7.5 m
Bypass Mode (RAW)*
*Unprocessed sensor/phase data.
Data Formats

Depth: RAW8 (XYZC, 12 bytes per pixel) 7680 x 480 (640 * 12 x 480)
RAW: RAW12 (2 Taps * 4 phases per pixel) 1280 x 1920 (640 * 2 x 480 x 4)