Dynamic image analysis and cropping

Patent metadata

Field	Value
Publication number	US-11900675-B2
Application number	US-202217946720-A
Country	US
Kind code	B2
Filing date	Sep 16, 2022
Priority date	Jun 1, 2018
Publication date	Feb 13, 2024
Grant date	Feb 13, 2024

Abstract

The disclosed techniques generally relate to devices and methods for generating cropped images in which one or more features of interest are preserved or emphasized. In one implementation, such features of interest may include facial features. In accordance with certain implementations, location and extent of such features may be identified and used in conjunction with information regarding display characteristics so as to generate cropped images preserving or emphasizing the feature of interest when displayed on a given device.

First claim

What is claimed is:

1. A tangible, non-transitory machine-readable medium, comprising machine-readable instructions that, when executed by one or more processors, cause the one or more processors to:
receive a request from an electronic device, wherein the request is for media content associated with an image;
identify the image based upon the request;
identify a respective device crop code associated with the electronic device;
request a cropped image using an indication of the image and the respective device crop code;
receive the cropped image, wherein the cropped image comprises a version of the image that is cropped to preserve at least a portion of the image and is specifically cropped for display on the electronic device associated with the respective device crop code, wherein cropping regions of the cropped image are determined based upon:
a non-linear edge of a display of the electronic device that will display the cropped image, as indicated by a first parameter defined by the device crop code;
an obstructed display region of the display where the image will be at least partially obstructed, as indicated by a second parameter defined by the device crop code; or
a combination thereof; and

provide the cropped image to the electronic device.

2. The machine-readable medium of claim 1 , wherein the cropping regions of the cropped image are determined based upon the second parameter indicating the obstructed display region of the display comprising additional content displayed on the display that will at least partially obstruct the image, wherein the additional content comprises graphical elements that will be displayed concurrently with the cropped image.

3. The machine-readable medium of claim 1 , wherein the cropping regions of the cropped image are determined based upon a priority of a particular feature depicted in the image.

4. The machine-readable medium of claim 3 , wherein the cropping regions of the cropped image are determined based upon a shift of the image that facilitates the priority of the particular feature depicted in the image.

5. The machine-readable medium of claim 4 , wherein the shift of the image causes depiction of prioritized particular feature depicted in the image that would not be visible without with shift.

6. The machine-readable medium of claim 1 , wherein the cropping regions are determined based at least in part upon the crop code.

7. The machine-readable medium of claim 1 , wherein the request for media content comprises one or more of a request for music content, video content, e-book content or news content having content associated with the image.

8. A method of cropping images, comprising:
receiving a request from an electronic device, wherein the request is for media content associated with an image;
identifying the image based upon the request;
identifying a respective device crop code associated with the electronic device;
requesting a cropped image using an indication of the image and the respective device crop code, wherein the cropped image comprises a version of the image that is cropped to preserve at least a portion of the image and is specifically cropped for display on the electronic device associated with the respective device crop code; wherein cropping regions of the cropped image are determined based upon:
a non-linear edge of a display of the electronic device that will display the cropped image, as indicated by a first parameter defined by the device crop code;
an obstructed display region of the display where the image will be at least partially obstructed, as indicated by a second parameter defined by the device crop code; and

providing the cropped image to the electronic device.

9. The method of claim 8 , wherein the cropped image comprises a version of the image that is cropped to preserve at least a prioritized feature depicted in the image and is specifically cropped for display on the electronic device associated with a respective device crop code.

10. The method of claim 9 , wherein the cropping region is based upon:
a non-linear edge of a display of the electronic device that will display the cropped image.

11. The method of claim 9 , wherein the cropping region is based upon:
the second parameter indicating the obstructed display region of the display.

12. The method of claim 11 , wherein the obstructed display region of the display comprises a graphical user interface comprising additional content displayed on the display that will at least partially obstruct the image comprises graphical elements that will be displayed concurrently with the cropped image.

13. The method of claim 9 , wherein the cropping region of the cropped image is determined based upon a shift of the image that facilitates emphasis of the prioritized feature.

14. The method of claim 13 , wherein the shift of the image causes depiction of prioritized feature that would not be visible without with shift.

15. The method of claim 8 , wherein the cropping regions are determined based at least in part upon the crop code.

16. A computer for providing a cropped image to an electronic device, the computer comprising:
a memory; and
a processor, wherein the memory includes instructions executable by the processor to cause the computer to perform operations comprising:
receiving a request from the electronic device, wherein the request is for media content associated with an image;
identifying the image based upon the request;
identifying a respective device crop code associated with the electronic device;
requesting the cropped image using an indication of the image and the respective device crop code;
receiving the cropped image, wherein the cropped image comprises a version of the image that is cropped to preserve at least a portion of the image and is specifically cropped for display on electronic devices associated with the respective device crop code; wherein cropping regions of the cropped image are determined based upon:
a non-linear edge of a display of the electronic device that will display the cropped image, as indicated by a first parameter defined by the device crop code;
an obstructed display region of the display where the image will be at least partially obstructed, as indicated by a second parameter defined by the device crop code; or
a combination thereof; and

providing the cropped image to the electronic device.

17. The electronic device of claim 16 , wherein the request for media content comprises one or more of a request for music content, video content, e-book content, or news content having the content associated with the image.

18. The electronic device of claim 17 , wherein the cropping regions of the cropped image are determined based upon the second parameter indicating the obstructed display region of the display comprising additional content that will be displayed on the display that will at least partially obstruct the image, wherein the additional content comprises graphical elements that will be displayed concurrently with the cropped image.

19. The electronic device of claim 16 , wherein the cropping regions of the cropped image are determined based upon the non-linear edge of the display of the electronic device that will display the cropped image, as indicated by the crop code.

20. The electronic device of claim 16 , wherein the cropping regions of the cropped image are determined based upon a padding region indication associated with the crop code.

Assignees

• Apple Inc

Inventors

• Agarwal Ashish
• Peng Fei
• Zhang Wenyu
• Thorn Matthew H
• Harold Sean Michael
• Friedman Douglas Isaac
• Alarcón Leticia Marie

Classifications

• G06V20/20 Primary

  in augmented reality scenes · CPC title

• G06T7/11

  Region-based segmentation · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title

• G06V40/172

  Classification, e.g. identification · CPC title

• G06T2207/20132

  Image cropping · CPC title