Video conferencing apparatus and video conferencing method

Patent metadata

Field	Value
Publication number	US-10721440-B2
Application number	US-201916582144-A
Country	US
Kind code	B2
Filing date	Sep 25, 2019
Priority date	Sep 25, 2018
Publication date	Jul 21, 2020
Grant date	Jul 21, 2020

Abstract

A video conferencing apparatus includes an acquisition processing portion, a calculation processing portion, and a combining processing portion. The acquisition processing portion acquires site video data that represents site videos captured at a plurality of sites. The calculation processing portion calculates respective display priorities of the sites based on evaluation values for a plurality of predetermined evaluation items. The combining processing portion generates composite video data based on the site video data acquired by the acquisition processing portion, the composite video data representing a composite video which is a combination of a plurality of site videos having display sizes corresponding to the display priorities.

First claim

The invention claimed is:

1. A video conferencing apparatus comprising:
an acquisition processing portion configured to acquire site video data that represents site videos captured at a plurality of sites;
a calculation processing portion configured to calculate respective display priorities of the sites based on evaluation values for a plurality of predetermined evaluation items;
a combining processing portion configured to generate composite video data based on the site video data acquired by the acquisition processing portion, the composite video data representing a composite video which is a combination of a plurality of site videos having display sizes corresponding to the display priorities; and
an identification processing portion configured to identify a speaker based on a motion of a mouth of each participant included in the site videos, wherein
the combining processing portion cuts out, from a site video, a partial video of the speaker identified by the identification processing portion, and combines, as the site video, the cut-out partial video into the composite video.

2. The video conferencing apparatus according to claim 1 , wherein
the plurality of evaluation items include at least two evaluation items out of: an evaluation item related to an amount of speech of a participant(s) at each of the sites; an evaluation item related to the number of participants at each of the sites; an evaluation item related to whether a shared image is provided from a site to another site; and an evaluation item related to whether a specific person is present at a site.

3. The video conferencing apparatus according to claim 1 , wherein
the combining processing portion selects, based on the display priorities, one layout pattern from a plurality of predetermined layout patterns each showing a layout of the plurality of site videos in the composite video, and generates the composite video data based on the selected layout pattern.

4. The video conferencing apparatus according to claim 3 , wherein
the combining processing portion selects the layout pattern based on the number of sites that each have a display priority higher than a predetermined threshold.

5. The video conferencing apparatus according to claim 1 , wherein
when a name of a preliminarily registered participant is detected from site sounds collected at the sites, the combining processing portion enlarges display size of a site video of a site at which the preliminarily registered participant is present.

6. The video conferencing apparatus according to claim 1 , wherein
when an unmute operation has been performed at any site among the plurality of sites, the combining processing portion enlarges display size of a site video of the site.

7. The video conferencing apparatus according to claim 1 , wherein
when the identification processing portion identifies two or more speakers in a same site video, the combining processing portion combines, as the site video, a screen-split video that is composed of two or more partial videos of the speakers cut out from the site video, into the composite video.

8. A video conferencing method in which one or more processors execute:
an acquisition step of acquiring site video data that represents site videos captured at a plurality of sites;
a calculation step of calculating respective display priorities of the sites based on evaluation values for a plurality of predetermined evaluation items;
a combining step of generating composite video data based on the site video data acquired in the acquisition step, the composite video data representing a composite video which is a combination of a plurality of site videos having display sizes corresponding to the display priorities; and
an identification step of identifying a speaker based on a motion of a mouth of each participant included in the site videos, wherein
the combining step cuts out, from a site video, a partial video of the speaker identified by the identification step, and combines, as the site video, the cut-out partial video into the composite video.

Assignees

• Kyocera Document Solutions Inc

Inventors

• Sugihara Hiroshi

Classifications

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• H04L65/756

  adapting media to device capabilities · CPC title

• H04M3/567

  Multimedia conference systems · CPC title

• H04L65/403

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• H04L12/1831

  Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status · CPC title