Allocating edge services with large-scale processing framework clusters

Patent metadata

Field	Value
Publication number	US-10455028-B2
Application number	US-201615001735-A
Country	US
Kind code	B2
Filing date	Jan 20, 2016
Priority date	Jan 20, 2016
Publication date	Oct 22, 2019
Grant date	Oct 22, 2019

Abstract

Systems, methods, and software described herein enhance the generation of large-scale processing framework clusters and corresponding edge services. In one implementation, a method includes identifying a request for a large-scale processing cluster, and identifying one or more edge services based on the type and version of the large-scale processing cluster. The method further provides generating a user interface that indicates the one or more edge services available, receiving a selection of at least one edge service in the one or more edge services, and initiating execution of the large-scale processing framework cluster and the at least one edge service, wherein the at least one edge service is provided with configuration information for the large-scale processing framework cluster.

First claim

What is claimed is:

1. A method of operating a control node of a large-scale data processing environment, the method comprising:
identifying a request for a large-scale processing framework cluster;
determining a type and version of the large-scale processing framework cluster;
identifying one or more edge services capable of interacting with the large-scale processing framework cluster based on the type and version of the large-scale processing framework cluster;
generating a user interface that indicates the one or more edge services available for the large-scale processing framework cluster;
receiving a selection of at least one edge service in the one or more edge services; and
initiating execution of the large-scale processing framework cluster as one or more virtual nodes and the at least one edge service as one or more additional virtual nodes, wherein the at least one edge service comprises configuration functions that obtain configuration information for the large-scale processing framework cluster, wherein the configuration information comprises addressing information to communicate with the large-scale processing framework cluster, and wherein initiating the execution of the large-scale processing framework cluster and the at least one edge service comprises:
executing the configuration functions to obtain the configuration information for the large-scale processing framework cluster; and
allocating permissions to the at least one edge service to access the large-scale processing framework cluster.

2. The method of claim 1 wherein the large-scale processing framework cluster comprises one of an Apache Hadoop cluster or an Apache Spark cluster.

3. The method of claim 1 wherein the one or more edge services comprise at least one Splunk service.

4. The method of claim 1 wherein the one or more edge services comprise one or more edge service images.

5. The method of claim 1 wherein initiating execution of the large-scale processing framework cluster and the at least one edge service comprises:
generating a domain name system (DNS) for the large-scale processing cluster, wherein the DNS comprises addressing information for nodes in the large-scale processing cluster; and
providing credentials and addressing information for the DNS to the large-scale processing framework cluster and the at least one edge service.

6. The method of claim 1 further comprising:
identifying a plurality of available large-scale processing framework types and versions available to process data for a tenant of a computing environment; and
generating a first user interface that indicates the plurality of available large-scale processing framework types and versions,
wherein identifying the request for the large-scale processing framework cluster comprises receiving a selection of a large-scale processing framework type and version from the plurality of available large-scale processing framework types and versions.

7. The method of claim 1 wherein the one or more edge services comprise edge services associated with a tenant of the large-scale processing framework cluster.

8. The method of claim 1 wherein initiating execution of the large-scale processing framework cluster and the at least one edge service comprises generating a prompt for credentials associated with the at least one edge service.

9. An apparatus to allocate edge services with large-scale processing clusters, the apparatus comprising:
at least one non-transitory computer readable media; and
processing instructions stored on the at least one non-transitory computer readable media that, when executed by a processing system, direct the processing system to:
identify a request for a large-scale processing framework cluster;
determine a type and version of the large-scale processing framework cluster;
identify one or more edge services capable of interacting with the large-scale processing framework cluster based on the type and version of the large-scale processing framework cluster, wherein the one or more edge services provide visualization or management operations for data provided by the large-scale processing framework cluster;
generate a user interface that indicates the one or more edge services available for the large-scale processing framework cluster;
receive a selection of at least one edge service in the one or more edge services; and
initiate execution of the large-scale processing framework cluster as one or more virtual nodes and the at least one edge service as one or more additional virtual nodes, wherein the at least one edge service comprises configuration functions that obtain configuration information for the large-scale processing framework cluster, wherein the configuration information comprises addressing information to communicate with the large-scale processing framework cluster, and wherein initiating the execution of the large-scale processing framework cluster and the at least one edge service comprises:
executing the configuration functions to obtain the configuration information for the large-scale processing framework cluster; and
allocating permissions to the at least one edge service to access the large-scale processing framework cluster.

10. The apparatus of claim 9 wherein the large-scale processing framework cluster comprises one of an Apache Hadoop cluster or an Apache Spark cluster.

11. The apparatus of claim 9 wherein the one or more edge services comprise at least one Splunk service.

12. The apparatus of claim 9 wherein the one or more edge services comprise one or more edge service images.

13. The apparatus of claim 9 wherein the processing instructions to initiate execution of the large-scale processing framework cluster and the at least one edge service direct the processing system to:
generate a domain name system (DNS) for the large-scale processing cluster, wherein the DNS comprises addressing information for nodes in the large-scale processing cluster; and
provide credentials and addressing information for the DNS to the large-scale processing framework cluster and the at least one edge service.

14. The apparatus of claim 9 wherein the processing instructions further direct the processing system to:
identify a plurality of available large-scale processing framework types and versions available to process data for a tenant of a computing environment; and
generate a first user interface that indicates the plurality of available large-scale processing framework types and versions,
wherein the processing instructions to identify the request for the large-scale processing framework cluster direct the processing system to receive a selection of a large-scale processing framework type and version from the plurality of available large-scale processing framework types and versions.

15. The apparatus of claim 9 wherein the one or more edge services comprise edge services associated with a tenant of the large-scale processing framework cluster.

16. The apparatus of claim 9 wherein the processing instructions to initiate execution of the large-scale processing framework cluster and the at least one edge service direct the processing system to generate a prompt for credentials associated with the at least one edge service.

Assignees

• Hewlett Packard Entpr Dev Lp

Inventors

• Baxter Joel

Classifications

• H04L41/5051 Primary

  Service on demand, e.g. definition and deployment of services in real time · CPC title

• H04L41/5054

  Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components · CPC title

• H04L41/0806

  for initial configuration or provisioning, e.g. plug-and-play · CPC title

• H04L41/22

  comprising specially adapted graphical user interfaces [GUI] · CPC title

• H04L67/16 Primary

  Electricity · mapped topic