Integration of manufacturing control functions using a multi-functional vision system

Patent metadata

Field	Value
Publication number	US-9377778-B2
Application number	US-85992610-A
Country	US
Kind code	B2
Filing date	Aug 20, 2010
Priority date	Feb 17, 2010
Publication date	Jun 28, 2016
Grant date	Jun 28, 2016

Abstract

A manufacturing control system comprises a vision system for viewing operations within a manufacturing area and for producing vision data representing the viewed operations. A systems control analyzes the vision data, and controls at least two control functions related to the manufacturing operations based on the analyzed vision data.

First claim

What is claimed:

1. A manufacturing control system, comprising:
quality control, safety control, logistics, and automation control functions for controlling aircraft manufacturing operations within a manufacturing area, wherein the logistics function monitors a position and a status of aircraft components, to track the aircraft components against an expected location and time within the manufacturing area, wherein the safety function predicts a collision between vehicles within the manufacturing area, and wherein the aircraft components comprise components for assembly of aircraft;
a vision system for viewing the aircraft components within the manufacturing area and for producing images of the viewed aircraft components, wherein the vision system includes digital cameras each having pan, tilt and zoom functions, wherein the digital cameras are directed to view the aircraft components through use of one of the pan, tilt, and zoom functions to point and zoom the digital cameras at aircraft components that are subject of the logistics function not within a field of view of the digital cameras when used to perform the safety function; and
a systems control for extracting vision data from the images and for providing the extracted vision data to the quality control, safety control, logistics, and automation control functions.

2. The manufacturing control system of claim 1 , further comprising:
software for simulating, analyzing, and intervening with operations within the manufacturing area based on the extracted vision data.

3. The manufacturing control system of claim 1 , further comprising:
laser projection means for projecting nominal data onto the aircraft components within the manufacturing area that may be viewed by the vision system, and
wherein the systems control is operative to use the nominal data to locate features on the aircraft components within the manufacturing area using images of the aircraft components recorded by the vision system.

4. The manufacturing control system of claim 1 , wherein the automation control function is configured to control automated equipment within the manufacturing area, the logistic control function is configured to control logistics of the operations within the manufacturing area,
the safety control function is configured to control safety of the operations within the manufacturing area; and
the quality control function is configured to control the quality of the aircraft components manufactured in the manufacturing area.

5. The manufacturing control system of claim 4 , wherein each of the manufacturing control functions includes software for interrogating the vision system and for analyzing the extracted vision data.

6. The manufacturing control system of claim 1 , wherein the logistics function uses a live tracking model and a live 3-D simulation environment to track the aircraft components against the expected times and locations.

7. The manufacturing control system of claim 6 , wherein the aircraft components includes a part and the logistics function determines whether assembly of the part has been completed.

8. The manufacturing control system of claim 1 , wherein the aircraft components include at least one of, parts, tools, fixtures, or consumables.

9. The manufacturing control system of claim 1 , wherein the logistics function provides real time monitoring of work completion including detection of incomplete work or out of sequence work.

10. A manufacturing control system, comprising:
a vision system including a plurality of vision sensors for viewing aircraft components within a manufacturing area and for recording images of the viewed aircraft components, wherein the vision sensors comprise digital cameras each having pan, tilt and zoom functions, wherein the digital cameras are directed to view the aircraft components through use of one of the pan, tilt, and zoom functions to point and zoom the vision sensors at aircraft components that are subject of a logistic function not within a field of view of the vision sensors used to perform a safety function, wherein the logistics function monitors a position and a status of the aircraft components, to track the aircraft components against an expected location and time within the manufacturing area, wherein the safety function predicts a collision between vehicles within the manufacturing area, and wherein the aircraft components comprise components for assembly of aircraft;
a plurality of manufacturing control functions for controlling manufacturing operations within the manufacturing area, each of the manufacturing control functions including means for analyzing vision data and for controlling a manufacturing operation based on results of the analysis; and
a systems control for controlling the vision system and for providing the vision data to each of the manufacturing control functions at differing preselected times using the images recorded by the vision sensors.

11. The manufacturing control system of claim 10 , wherein the plurality of manufacturing control functions includes:
an automation control function configured to control automated equipment within the manufacturing area,
the logistic control function being configured to control logistics of the operations within the manufacturing area,
the safety control function being configured to control safety of the operations within the manufacturing area, and
a quality control function configured to control the quality of items manufactured in the manufacturing area.

12. The manufacturing control system of claim 10 , wherein:
means for analyzing vision data includes a software program for interrogating the vision system and for analyzing the vision data.

13. The manufacturing control system of claim 10 , further comprising:
software used by the systems control for simulating, analyzing, and intervening with operations within the manufacturing area based on the extracted vision data.

14. The manufacturing control system of claim 10 , further comprising:
laser projection means for projecting nominal data onto aircraft components within the manufacturing area that may be viewed by the vision system, and
wherein the systems control is operative to use the nominal data to locate and measure features on the aircraft components within the manufacturing area using images of the aircraft components recorded by the vision sensors.

15. A computer implemented method comprising:
concurrently controlling a combination of safety and logistics operations within a manufacturing area, comprising:
viewing the manufacturing area with a vision system, including using vision sensors to view aircraft components within the manufacturing area and record images of the viewed aircraft components, wherein the vision sensors comprise digital cameras each having pan, tilt and zoom functions to point and zoom the vision sensors at aircraft components that are subject of a logistics function that is not within a field of view of the vision sensors used to perform a safety control function, wherein the logistics function monitors a position and a status of the aircraft components to track the aircraft components against an expected location and time within the manufacturing area, and wherein the safety function predicts a collision between vehicles within the manufacturing area;
extracting vision data from the recorded images using a processor, creating extracted vision data;
sending the extracted vision data to manufacturing control functions at differing preselected times, wherein the manufacturing control functions include the safety control and logistics functions; and
usi

Assignees

• Crothers Phillip John
• Boeing Co

Inventors

• Crothers Phillip John

Classifications

• G05B19/4183 Primary

  characterised by data acquisition, e.g. workpiece identification · CPC title

• B64F5/0009

  Operations & Transport · mapped topic

• Y02P90/10

  Cross-Sectional Technologies · mapped topic

• B64F5/10

  Manufacturing or assembling aircraft, e.g. jigs therefor · CPC title

• B25J9/1697

  Vision controlled systems · CPC title