Mobile information terminal

Patent metadata

Field	Value
Publication number	US-12081352-B2
Application number	US-202318174966-A
Country	US
Kind code	B2
Filing date	Feb 27, 2023
Priority date	Jun 7, 2018
Publication date	Sep 3, 2024
Grant date	Sep 3, 2024

Abstract

When a first user makes a video call with a second user of the other side by using the video call function, a first state is set as a state in which the enclosure is flatly placed on a first surface of an object, and in which a face of the first user is included within a range of an angle of view AV 1 of the front camera C 1. In the first state, the mobile information terminal 1 detects a first region including the face of the first user from a wide angle image that is captured by the front camera C 1, trims a first image corresponding to the first region, creates a transmission image to be transmitted to a terminal of the other side on the basis of the first image, and transmits the transmission image to the terminal of the other side.

First claim

The invention claimed is:

1. A mobile information terminal having a video call function comprising:
a camera configured to generate an image signal from an image of subjects captured through a lens and mounted on a front surface of the mobile information terminal, on which a touch panel display is mounted;
an image signal processor configured to generate an image data based on the image signal and detect whether a face of a user is included in the image data as a part of the image of subjects;
a microphone configured to generate a vocal signal;
a speaker configured to output an audio;
a storage configured to store a registered image data;
a communication circuitry configured to communicate with another mobile terminal via the Internet; and
a control circuitry configured to:
execute the video call function; and
transmit at least a transmission image data to the other mobile terminal via the communication circuitry while the video call function is executed,
wherein the image signal processor is further configured to:
while the video call function is executed, check whether or not the face is included in the image data;
in case that the face is not included, generate the transmission image data based on the registered image data; and
in case that the face is included, generate the transmission image data based on the image data.

2. The mobile information terminal according to claim 1 ,
wherein the image signal processor is further configured to generate the transmission image data trimming the image data based on a region of the image data where the face is included, while the video call function is executed.

3. The mobile information terminal according to claim 1 ,
wherein the image signal processor is configured to generate the transmission image data by performing a distortion correcting process to the image data, while the video call function is executed.

4. The mobile information terminal according to claim 1 ,
wherein the image signal processor is configured to generate a monitor image data corresponding to the transmission image data, and
wherein the control circuitry is further configured to control to display the monitor image data on the touch panel display, while the video call function is executed.

5. The mobile information terminal according to claim 1 ,
wherein the image signal processor is configured to:
detect a feature of the face included in the image data; and
compare the feature of the face with a feature of a specific person's face stored into the storage, and
wherein the control circuitry is configured to transmit the transmission image data when the comparison result generated by the image signal processor indicates that the feature of the face matches the feature of the specific person's face.

6. The mobile information terminal according to claim 1 ,
wherein the image signal processor is further configured to:
detect a feature of the object included in the image data;
compare the feature of the object with a feature of a specific object; and
generate the transmission image data trimming the image data based on a region of the image data where the specific object is included.

7. The mobile information terminal according to claim 6 ,
wherein the region for the trimming is within a predetermined range from a portion of the image data where the face is included.

8. The mobile information terminal according to claim 1 ,
wherein in case that the face is not included, the image signal processor is further configured to generate the transmission image data replacing a portion of the image data with the registered image data.

9. The mobile information terminal according to claim 1 ,
wherein a view angle of the camera is at least from 30 degrees to 150 degrees.

10. The mobile information terminal according to claim 3 , further comprising
an acceleration sensor and/or a gyroscope sensor,
wherein the control circuitry is further configured to cause the image signal processor to perform the distortion correcting process based on a signal sensed by the acceleration sensor and/or the gyroscope sensor.

11. A method in a mobile information terminal having a video call function comprising the steps of:
generating, by a camera, an image signal from an image of subjects captured through a lens and mounted on a front surface of the mobile information terminal, on which a touch panel display is mounted;
generating, by an image signal processor, an image data based on the image signal and detect whether a face of a user is included in the image data as a part of the image of subjects;
generating, by a microphone, a vocal signal;
outputting, by a speaker, an audio;
storing, by a storage, a registered image data;
communicating, by a communication circuitry, with another mobile terminal via the Internet;
executing, by a control circuitry, the video call function;
transmitting at least a transmission image data to the other mobile terminal via the communication circuitry while the video call function is executed;
checking, by the image signal processor while the video call function is executed, whether or not the face is included in the image data;
generating, by the image signal processor in case that the face is not included, the transmission image data based on the registered image data; and
generating, by the image signal processor in case that the face is included, the transmission image data based on the image data.

12. The method according to claim 11 , further comprising the step of:
generating, by the image signal processor, the transmission image data trimming the image data based on a region of the image data where the face is included, while the video call function is executed.

13. The method according to claim 11 , further comprising the step of:
generating, by the image signal processor, the transmission image data by performing a distortion correcting process to the image data, while the video call function is executed.

14. The method according to claim 11 , further comprising the steps of:
generating, by the image signal processor, a monitor image data corresponding to the transmission image data; and
displaying the monitor image data on the touch panel display, while the video call function is executed.

15. The method according to claim 11 , further comprising the steps of:
detecting, by the image signal processor, a feature of the face included in the image data;
comparing, by the image signal processor, the feature of the face with a feature of a specific person's face stored into the storage; and
transmitting, by the control circuitry, the transmission image data when the comparison result generated by the image signal processor indicates that the feature of the face matches the feature of the specific person's face.

16. The method according to claim 11 , further comprising the steps of:
detecting, by the image signal processor, a feature of the object included in the image data;
comparing, by the image signal processor, the feature of the object with a feature of a specific object; and
generating the transmission image data trimming the image data based on a region of the image data where the specific object is included.

17. The method according to claim 16 ,
wherein the region for the trimming is within a predetermined range from a portion of the image data where the face is included.

18. The method according to claim 11 , further comprising the step of:
generating, by the image signal processor in case that the face is not included, the transmission

Assignees

• Maxell Ltd

Inventors

• Shimizu Hiroshi
• Ono Hiroaki
• Hashimoto Yasunobu
• Yoshizawa Kazuhiko
• TAKAMIZAWA Naohisa
• Masuoka Nobuo

Classifications

• G06T3/047

  Fisheye or wide-angle transformations · CPC title

• G06T5/80

  Geometric correction · CPC title

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title