Method and system for performing client-side zooming of a remote video feed

Patent metadata

Field	Value
Publication number	US-9354794-B2
Application number	US-201414510059-A
Country	US
Kind code	B2
Filing date	Oct 8, 2014
Priority date	Jul 7, 2014
Publication date	May 31, 2016
Grant date	May 31, 2016

Abstract

An electronic device with a display, processor(s), and memory detects a first user input to zoom in on a respective portion of a first video feed displayed on the display, and, in response, performs a software zoom function on the respective portion of the first video feed to display the respective portion at a first resolution. The electronic device determines a current zoom magnification and coordinates of the respective portion of the first video feed, and sends a command to the camera to perform a hardware zoom function on the coordinates of the respective portion according to the current zoom magnification. The electronic device receives a second video feed from the camera with a field of view corresponding to the respective portion, and displays, on the display, the second video feed in the video monitoring user interface with a second resolution that is higher than the first resolution.

First claim

What is claimed is:

1. A method of performing client-side zooming of a remote video feed, the method comprising:
receiving a first video feed from a camera located remotely from a client device, the first video feed having a first field of view;
displaying, on a display of the client device, the first video feed with the first field of view in a video monitoring user interface;
detecting a first user input to zoom in on a portion of the first video feed, the portion based on the first user input;
in response to detecting the first user input, performing a software zoom function on the first video feed to display the portion of the first video feed in a first resolution, such that subsequent to performing the software zoom function a second field of view corresponding to the portion is displayed;
determining a current zoom magnification of the software zoom function and coordinates of the portion of the first video feed;
generating a camera crop command based on the current zoom magnification and the coordinates of the portion of the first video feed;
sending the camera crop command to the camera to generate a cropped version of the first video feed at the camera according to the current zoom magnification and the coordinates of the portion of the first video feed;
in response to sending the camera crop command, receiving a second video feed from the camera, the second video feed corresponding to the cropped version of the first video feed and having a second resolution that is higher than the first resolution; and
displaying, on the display, the second video feed in the video monitoring user interface.

2. The method of claim 1 , wherein the display is a touch-screen display, and wherein the first user input is a pinch-in gesture performed on the first video feed within the video monitoring user interface.

3. The method of claim 1 , further comprising:
prior to the determining and the sending, detecting a second user input within the video monitoring user interface selecting a video enhancement affordance, wherein the determining and the sending are performed in response to detecting the second user input.

4. The method of claim 3 , further comprising:
in response to detecting the second user input and prior to sending the camera crop command, displaying a warning message indicating that a saved video will be limited to the portion.

5. The method of claim 1 , further comprising:
in response to detecting the first user input, displaying a perspective window within the video monitoring user interface indicating a location of the portion relative to the first video feed.

6. The method of claim 1 , wherein the video monitoring user interface includes an affordance for resetting the camera to display the first video feed after displaying the second video feed.

7. The method of claim 1 , wherein the first user input comprises a user gesture on a touch-sensitive surface of the client device, the user gesture detected at a location corresponding to the display of the first field of view in the video monitoring user interface; and
wherein the portion is based on one or more characteristics of the user gesture.

8. The method of claim 1 , wherein the camera crop command is sent in response to detecting the first user input.

9. An electronic device, comprising:
a display;
one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
receiving a first video feed from a camera located remotely from the electronic device, the first video feed having a first field of view;
displaying, on the display, the first video feed with the first field of view in a video monitoring user interface;
detecting a first user input to zoom in on a portion of the first video feed, the portion based on the first user input;
in response to detecting the first user input, performing a software zoom function on the first video feed to display the portion of the first video feed in a first resolution, such that subsequent to performing the software zoom function a second field of view corresponding to the portion is displayed;
determining a current zoom magnification of the software zoom function and coordinates of the portion of the first video feed;
generating a camera crop command based on the current zoom magnification and the coordinates of the respective portion of the first video feed;
sending the camera crop command to the camera to generate a cropped version of the first video feed at the camera according to the current zoom magnification and the coordinates of the portion of the first video feed;
in response to sending the camera crop command, receiving a second video feed from the camera, the second video feed corresponding to the cropped version of the first video feed and having a second resolution that is higher than the first resolution; and
displaying, on the display, the second video feed in the video monitoring user interface.

10. The electronic device of claim 9 , wherein the display is a touch-screen display, and wherein the first user input is a pinch-in gesture performed on the first video feed within the video monitoring user interface.

11. The electronic device of claim 9 , wherein the one or more programs further comprise instructions for:
prior to the determining and the sending, detecting a second user input within the video monitoring user interface selecting a video enhancement affordance, wherein the determining and the sending are performed in response to detecting the second user input.

12. The electronic device of claim 11 , wherein the one or more programs further comprise instructions for:
in response to detecting the second user input and prior to sending the camera crop command, displaying a warning message indicating that a saved video will be limited to the portion.

13. The electronic device of claim 9 , wherein the one or more programs further comprise instructions for:
in response to detecting the first user input, displaying a perspective window within the video monitoring user interface indicating a location of the portion relative to the first video feed.

14. The electronic device of claim 9 , wherein the video monitoring user interface includes an affordance for resetting the camera to display the first video feed after displaying the second video feed.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display and one or more processors, cause the electronic device to perform operations comprising:
receiving a first video feed from a camera located remotely from the electronic device, the first video feed having a first field of view;
displaying, on the display, the first video feed with the first field of view in a video monitoring user interface;
detecting a first user input to zoom in on a portion of the first video feed, the portion based on the first user input;
in response to detecting the first user input, performing a software zoom function on the first video feed to display the portion of the first video feed in a first resolution, such that subsequent to performing the software zoom function a second field of view corresponding to the portion is displayed;
determining a current zoom magnification of the software zoom function and coordinates of the portion of the first video feed;
generating a camera crop command based on the current zoom magnification and the coordinates of the portion of the first video feed;
sending the

Assignees

• Google Inc

Inventors

• Kirkby Ronald L
• Mitsuji Hiro
• Sherry Eden
• Neal Lawrence W
• Kifle Yohannes

Classifications

• G08B13/19608 Primary

  Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• G06F18/285

  Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title