Sony just issued the following press text for the release of their new SPAD sensor. Not sure this sensor tech might be used on future APS-C and FF designs too. But surely this innovation sounds exciting:
Sony Semiconductor Solutions to Release SPAD Depth Sensor for Smartphones with
High-Accuracy, Low-Power Distance Measurement Performance, Powered
by the Industry’s Highest*1 Photon Detection Efficiency
Atsugi, Japan — Sony Semiconductor Solutions Corporation (SSS) today announced the upcoming release of the IMX611, a direct time-of-flight (dToF) SPAD depth sensor for smartphones that delivers the industry’s highest*1 photon detection efficiency.
The IMX611 has a photon detection efficiency of 28%, the highest in the industry,*1 thanks to its proprietary single-photon avalanche diode (SPAD) pixel structure.*2 This reduces the power consumption of the entire system while enabling high-accuracy measurement of the distance of an object.
This new sensor will generate opportunities to create new value in smartphones, including functions and applications that utilize distance information.
*1 Among SPAD depth sensors for smartphones. As of this announcement on March 6, 2023.
*2 A pixel structure that uses avalanche multiplication to amplify electrons from a single incident photon, causing a cascade like an avalanche.
IMX611 SPAD ToF depth sensor for smartphones
| Model name | Sample shipment date (planned) |
Sample price (including tax) |
|---|---|---|
| IMX611 1/8.1 type (2.2 mm diagonal) approx. 23,000 effective-pixel*3 SPAD ToF depth sensor |
March 2023 | 1,000 yen |
*3 Based on image sensor effective pixel specification method.
In general, SPAD pixels are used as a type of detector in a dToF sensor, which acquire distance information by detecting the time of flight of light emitted from a source until it returns to the sensor after being reflected off an object.
The IMX611 uses a proprietary SPAD pixel structure that gives the sensor the industry’s highest*1 photon detection efficiency, at 28%, which makes it possible to detect even very weak photons that have been emitted from the light source and reflected off the object. This allows for highly accurate measurement of object distance. It also means the sensor can offer high distance-measurement performance even with lower light source laser output, thereby helping to reduce the power consumption of the whole smartphone system.
This sensor can accurately measure the distance to an object, making it possible to improve autofocus performance in low-light environments with poor visibility, to apply a bokeh effect to the subject’s background, and to seamlessly switch between wide-angle and telephoto cameras. All of these capabilities will improve the user experience of smartphone cameras. This sensor also enables 3D spatial recognition, AR occlusion,*4 motion capture/gesture recognition, and other such functions. With the spread of the metaverse in the future, this sensor will contribute to the functional evolution of VR head mounted displays and AR glasses, which are expected to see increasing demand.
*4 The ability to hide virtual AR objects with objects physically located in the foreground.
Application examples of a SPAD ToF depth sensor
-
Hand Tracking
-
AR Occlusion*4 -
AR Map
Main Features
■ Highly accurate distance measurement and low-power consumption made possible by the industry’s highest*1 photon detection efficiency
The IMX611 employs a stacked configuration, where a Cu-Cu connection is used to achieve conduction for each pixel between the back-illuminated SPAD pixel chip (top) and the logic chip equipped with a distance measuring processing circuit (bottom). By arranging the circuit under the pixel chip, SSS has achieved a pixel size of 10 μm square, which is quite small for an SPAD, while still securing a high aperture ratio.*5 SSS has also made the following improvements to the pixels:
These proprietary pixel structures combine to deliver the industry’s highest*1 photon detection efficiency, at 28%, when using a wavelength of 940 nm, which is commonly used in laser light sources for smartphones. This enables highly accurate recognition and reduces the power consumption of the overall system.
*5 Ratio of aperture section (section other than light-blocking sections) as viewed from the light incident side per pixel. The larger the aperture, the higher the detection efficiency becomes.
■Proprietary signal processing function simplifies overall system development
By incorporating a proprietary signal processing function into the logic chip inside the sensor, the RAW information acquired from the SPAD pixels is converted into distance information to output, and all this is done within the sensor. This approach makes it possible to reduce the load of post-processing, thereby simplifying overall system development.
Structure of SPAD ToF depth sensor
Related links
See the following website for more details about the applications utilizing ToF technology.
See the following website for more information on LYTIA mobile image sensors.
| Model name | IMX611 | |
|---|---|---|
| Effective pixels | 140 x 170, 23,000 pixels | |
| Image size | Diagonal 2.2 mm (1/8.1-type) | |
| SPAD unit cell size | 10.08 x 10.08 µm | |
| Recommended light source wavelength | 940 nm | |
| Photon detection efficiency | 28% | |
| Power consumption at 8m*6 (long-distance mode) |
110mW (sensor) 160mW (system*7) |
|
| Power consumption at 3m*6 (short-distance mode) |
40mW (sensor) 85mW (system*7) |
|
| Distance precision*6 | Less than 0.1% error | |
| Distance signal processing | Included in the sensor’s logic chip | |