Circuit device, display system, and electronic apparatus

Patent metadata

Field	Value
Publication number	US-12456400-B2
Application number	US-202418734228-A
Country	US
Kind code	B2
Filing date	Jun 5, 2024
Priority date	Jun 2, 2021
Publication date	Oct 28, 2025
Grant date	Oct 28, 2025

Abstract

A circuit device includes a storing section configured to store a rendering image and a warp processing section. The warp processing section includes a coordinate converting section, a coordinate-address converting section, and an output section. The coordinate converting section converts, with coordinate conversion based on warp parameters and rotation correction parameters, an output coordinate, which is a coordinate on a display image, into an input coordinate, which is a coordinate on the rendering image. The coordinate-address converting section converts the input coordinate into a read address of the storing section. The output section reads out pixel data of the rendering image from the read address of the storing section and outputs, based on the read-out pixel data, pixel data in the output coordinate of the display image.

First claim

What is claimed is:

1. A circuit device that performs display control for a head-up display of a moving object that displays, in a display region, a virtual object corresponding to a preceding moving object in a real space and a fixed image relating to the moving object, the circuit device comprising:
a memory configured to store a rendering image including the virtual object and the fixed object; and
a warp engine logic circuit configured to:
perform warp processing for the rendering image and generate a first display image and a pre-conversion fixed image;
convert, with coordinate conversion based on the post-correction warp parameter and the rotation correction parameter, a first output coordinate, which is a coordinate on the first display image, into a first input coordinate, which is a coordinate on the rendering image;
convert, with the coordinate conversion based on the warp parameter, a second output coordinate, which is a coordinate on the pre-conversion fixed image, into a second input coordinate, which is a coordinate on the rendering image;
convert the first input coordinate into a first read address of the memory;
convert the second input coordinate into a second read address of the memory;
read out pixel data of the rendering image from the first read address of the memory and output, based on the read-out pixel data, first pixel data in the first output coordinate of the first display image;
read out pixel data of the rendering image from the second read address of the memory and output, based on the read-out pixel data, second pixel data in the second output coordinate of the pre-conversion fixed image;
generate a second display image of the virtual object based on the output first pixel data;
generate the fixed image of the fixed object based on the output second pixel data;
display the second display image including the virtual object in the display region at a position directly adjacent to the object-view position corresponding to the preceding moving object in the real space based on the tracking result in a state in which the displayed virtual object is configured to be moved in the display region by following the preceding moving object; and
display the fixed image at a fixed position in the display region.

2. The circuit device according to claim 1 , further comprising:
a logic circuit configured to:
receive output signals from a sensor disposed in the moving object, the sensor being configured to detect a position, a posture, and a motion of the preceding moving object so as to track the preceding moving object;
continuously output a tracking result of the preceding moving object based on the continuously received output signals from the sensor;
render the virtual object based on the tracking result so as to obtain an object-view position in the display region through which the preceding moving object is seen and generate a rendering image including the virtual object;
render a fixed object corresponding to the fixed image to generate the rendering image including the fixed object;
calculate a rotation correction parameter that is a latency compensation parameter compensating for latency including rendering processing latency of the rendering image based on the tracking result; and
correct a warp parameter with the rotation correction parameter to provide a post-correction warp parameter, the warp parameter corresponding to a distortion of a video due to an optical system.

3. The circuit device according to claim 1 , wherein
the warp engine logic circuit is further configured to perform, as the coordinate conversion, first coordinate conversion for converting the first output coordinate according to the warp parameter and second coordinate conversion for subjecting a coordinate after the first coordinate conversion to rotation processing according to the rotation correction parameter.

4. The circuit device according to claim 1 , wherein
the warp parameter is a coefficient of a polynomial for correcting the distortion of the video.

5. The circuit device according to claim 1 , wherein
the warp engine logic circuit is further configured to calculate, in the warp processing performed in a second frame next to a first frame, the first input coordinate to which rotation processing is applied using the rotation correction parameter updated in the first frame.

6. The circuit device according to claim 1 , wherein
the warp engine logic circuit is further configured to:
generate a read address group based on a reference read address, which is the first read address;
read out a pixel data group corresponding to the read address group; and
perform interpolation processing for the pixel data group to generate the first pixel data of the first output coordinate.

7. The circuit device according to claim 1 , wherein
the memory is configured to store the rendering image including an image of a first display object, which is the virtual object, and an image of a second display object, which is the fixed object,
for the image of the first display object in the rendering image, the warp engine logic circuit is configured to calculate, with the coordinate conversion based on the warp parameter and the rotation correction parameter, the first input coordinate to which rotation processing is applied, and
for the image of the second display object in the rendering image, the warp engine logic circuit is configured to calculate, with the coordinate conversion based on the warp parameter, the second input coordinate to which the rotation processing is not applied.

8. The circuit device according to claim 7 , wherein
for the image of the first display object in the rendering image:
the post-correction warp parameter is selected; and
the warp engine logic circuit is configured to perform the coordinate conversion using the post-correction warp parameter, and

for the image of the second display object in the rendering image:
the warp parameter is selected; and
the warp engine logic circuit is configured to perform the coordinate conversion using the warp parameter.

9. The circuit device according to claim 7 , wherein
for the image of the first display object in the rendering image, the warp engine logic circuit is configured to perform, as the coordinate conversion, first coordinate conversion for converting the first output coordinate according to the warp parameter and second coordinate conversion for subjecting a coordinate after the first coordinate conversion to the rotation processing according to the rotation correction parameter, and
the warp engine logic circuit is configured to perform the first coordinate conversion for converting the second output coordinate according to the warp parameter as the coordinate conversion for the image of the second display object in the rendering image.

10. An electronic apparatus comprising the circuit device according to claim 1 .

11. A display system comprising:
a head-up display of a moving object, the head-up display being configured to display a virtual object corresponding to a preceding moving object in a real space and a fixed image relating to the moving object in a display region;
a memory configured to store the rendering image including the virtual object and the fixed object; and
a warp engine logic circuit configured to:
perform warp processing for the rendering image and generate a first display image and a pre-conversion fixed image;
convert, with coordinate conversion based on the post-correction warp parameter and the rotation correction parameter, a first output coordinate, which is a coordinate on the first display image, into a first input coordinate, which is a coordinate on

Assignees

• Seiko Epson Corp

Inventors

• Akiba Yasutoshi
• Eric jeffrey

Classifications

• B60K35/00

  Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles · CPC title

• B60K35/23

  Head-up displays [HUD] (optical aspects of head-up displays G02B27/01) · CPC title

• B60K2360/149

  Instrument input by detecting viewing direction not otherwise provided for · CPC title

• B60K35/235

  with means for detecting the driver's gaze direction or eye points · CPC title

• B60K35/50

  Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence) · CPC title