Amazon Web Services (AWS) has announced Amazon Monitron, Amazon Lookout for Equipment, the AWS Panorama Appliance, the AWS Panorama SDK, and Amazon Lookout for Vision. Together, these five new machine learning services will help industrial and manufacturing customers embed intelligence in their production processes in order to improve operational efficiency, quality control, security, and workplace safety. The services combine sophisticated machine learning, sensor analysis, and computer vision capabilities to address common technical challenges faced by industrial customers, and represent the most comprehensive suite of cloud-to-edge industrial machine learning services available.
Companies are increasingly looking to add machine learning capabilities to industrial environments, such as manufacturing facilities, fulfillment centers, and food processing plants. For these customers, data has become the connective tissue that holds their complex industrial systems together.
Industrial systems typically have numerous interdependent processes that operate with small tolerances for error, and even minor issues can have major ramifications. Being able to analyze data about the equipment operating in their facilities helps customers address this challenge, and many customers have embraced services like AWS IoT SiteWise as a way to collect data and generate real-time performance metrics from their industrial equipment.
As customers have begun to use the cloud to collect and analyze industrial data, they have also asked for new ways to incorporate machine learning to help make sense of the data and further drive operational efficiency. In some cases, customers want to use machine learning to help them realize the promise of predictive maintenance to reduce costs and improve operational efficiency. In other cases, customers running in disconnected or latency-sensitive environments want to use computer vision at the edge to spot product defects and improve workplace safety. With these evolving needs and opportunities, industrial companies have asked AWS to help them leverage the cloud, the industrial edge, and machine learning together to get even more value from the vast amounts of data being generated by their equipment.
‘Amazon Monitron’ and ‘Amazon Lookout’ Enables Equipment Predictive Maintenance
A major challenge facing industrial and manufacturing companies today is the ongoing maintenance of their equipment. Historically, most equipment maintenance is either reactive (after a machine breaks) or preventive (performed at regular intervals to ensure a machine doesn’t break). Reactive maintenance can result in significant costs and downtime, while preventive maintenance can be costly, result in over-maintenance, or fail to prevent breakdown if not performed often enough.
Predictive maintenance (the ability to foresee when equipment is likely to need maintenance) is a more promising solution. However, in order to make it work, companies have historically needed skilled technicians and data scientists to piece together a complex solution from scratch. This included identifying and procuring the right type of sensors for the use case and connecting them together with an IoT gateway (a device that aggregates and transmits data). Companies then had to test the monitoring system and transfer the data to on-premises infrastructure or the cloud for processing. Only then could the data scientists on staff build machine learning models to analyze the data for patterns and anomalies, or create an alerting system when an outlier was detected. Some companies have invested heavily in installing sensors across their equipment and the necessary infrastructure for data connectivity, storage, analytics, and alerting. But even these companies typically use rudimentary data analytics and simple modeling approaches that are expensive and often ineffective at detecting abnormal conditions compared to advanced machine learning models. Most companies lack the expertise and staff to build and refine the machine learning models that would enable highly accurate predictive maintenance. As a result, few companies have been able to successfully implement predictive maintenance, and those that have done it are looking for ways to further leverage their investment, while also easing the burden of maintaining their homegrown solutions.
Here’s how the new AWS machine learning services works:
- For customers who do not have an existing sensor network, Amazon Monitron offers an end-to-end machine monitoring system comprised of sensors, a gateway, and a machine learning service to detect anomalies and predict when industrial equipment will require maintenance. Amazon Monitron enables customers to remove cost and complexity from building a sophisticated, machine learning-driven predictive maintenance system from scratch, and it also allows them to focus on their core manufacturing, supply chain, and operations functions. Amazon Monitron detects when machines are not operating normally based on abnormal fluctuations in vibration or temperature, and notifies customers when to examine machinery in order to determine if preventative maintenance is needed. The end-to-end system includes IoT sensors to capture vibration and temperature data, a gateway to aggregate and transfer data to AWS, and a machine learning cloud service that can detect abnormal equipment patterns and deliver results in minutes with no machine learning or cloud experience required. With Amazon Monitron, maintenance technicians can start tracking machine health in a matter of hours, without any development work or specialized training. Amazon Monitron can be used on a variety of rotating equipment, such as bearings, motors, pumps, and conveyer belts in industrial and manufacturing settings. Use cases range from monitoring a few critical machines like the cooling fans or water pumps used in data centers, to large scale installations in manufacturing facilities with production and conveyance systems. Amazon Monitron also includes a mobile app for a customer’s onsite maintenance technicians to monitor equipment behavior in real time. With the mobile app, a technician can receive alerts of any abnormal equipment conditions across different machines, check up on the health of the machine, and decide if they need to schedule maintenance. To increase the accuracy of the system, technicians can enter feedback on the accuracy of the alerts in the mobile app, and Amazon Monitron learns from that feedback to continually improve over time. Amazon Monitron is now generally available.
- For customers that have existing sensors but don’t want to build machine learning models, Amazon Lookout for Equipment provides a way to send their sensor data to AWS to build models for them and return predictions to detect abnormal equipment behavior. To get started, customers upload their sensor data to Amazon Simple Storage Service (S3) and provide the S3 location to Amazon Lookout for Equipment. Amazon Lookout for Equipment can also pull data from AWS IoT SiteWise, and works seamlessly with other popular machine operations systems like OSIsoft. Amazon Lookout for Equipment analyzes the data, assesses normal or healthy patterns, and then uses the learnings from all of the data on which it is trained to build a model that is customized for the customer’s environment. Amazon Lookout for Equipment can then use the machine learning model to analyze incoming sensor data and identify early warning signs for machine failure. This allows customers to do predictive maintenance, saving them money and improving productivity by preventing the crash of an industrial system line. Amazon Lookout for Equipment allows customers to get more value from their existing sensors, and it helps customers make timely decisions that can materially improve the entire industrial process.
AWS Panorama Uses Computer Vision to Improve Industrial Operations
Many industrial and manufacturing customers want to be able to use computer vision on live video feeds of their facility and equipment to automate monitoring or visual inspection tasks and to make decisions in real time. For example, customers routinely need to inspect high-speed processes to determine if adjustments are needed, to monitor site and yard activity to ensure operating compliance, or to assess worker safety within their facilities. However, the typical monitoring methods used today are manual, error prone, and difficult to scale. Customers could build computer vision models in the cloud to monitor and analyze their live video feeds, but industrial processes typically need to be physically located in remote and isolated places, where connectivity can be slow, expensive, or completely non-existent. This problem is even more difficult for industrial processes that involve manual review like quality checks on manufactured parts. For example, if a quality issue emerges on a high throughput production line, customers want to know immediately because the costs of letting the problem persist is steep. This type of video feed could be automatically processed in the cloud using computer vision, but video feeds are high bandwidth and can be slow to upload. As a result, customers are required to monitor video feeds in real time, which is hard to do, error prone, and expensive. While there is a desire to use smart cameras that have enough processing power to run these models, getting low latency performance with good accuracy from these cameras can be challenging. Most customers end up running unsophisticated models that can’t be programmed to run custom code that integrates into the industrial machines.
Here’s how the new AWS computer vision services works:
- The AWS Panorama Appliance provides a new hardware appliance that allows organizations to add computer vision to existing on-premises cameras that customers may already have deployed. Customers start by connecting the AWS Panorama Appliance to their network, and the device automatically identifies camera streams and starts interacting with the existing industrial cameras. The AWS Panorama Appliance is integrated with AWS machine learning services and IoT services that can be used to build custom machine learning models or ingest video for more refined analysis. The AWS Panorama Appliance extends AWS machine learning to the edge to help customers make predictions locally in sites without connectivity. Each AWS Panorama Appliance can run computer vision models on multiple camera streams in parallel, making possible use cases like quality control, part identification, and workplace safety. The AWS Panorama Appliance works with AWS and third party pre-trained computer vision models. Also, customer-developed computer vision models developed in Amazon SageMaker can be deployed on the AWS Panorama Appliance.
- The AWS Panorama Software Development Kit (SDK) enables hardware vendors to build new cameras that can run meaningful computer vision models at the edge. Cameras that are built with the AWS Panorama SDK run computer vision models for use cases like detecting damaged parts on a fast-moving conveyor belt or spotting when machinery is outside of a designated work zone. These cameras can use chips designed for computer vision from NVIDIA and Ambarella. By using the AWS Panorama SDK, manufacturers can build cameras with computer vision models that can process higher quality video with better resolution for spotting issues. They can also build more sophisticated models on low-cost devices that can be powered over Ethernet and placed around a site. Customers can train their own models in Amazon SageMaker and deploy them on cameras built with the AWS Panorama SDK with a single click. Customers can also add Lambda functions to cameras built with the AWS Panorama SDK to be alerted to potential issues via text or email. AWS also offers pre-built models for tasks like PPE detection and social distancing, and can deploy these models in minutes without doing any machine learning work or special optimizations.
Amazon Lookout for Vision offers Automated Fast and Accurate Visual Anomaly Detection
One use case where AWS customers are excited to deploy computer vision with their cameras is for quality control. Industrial companies must maintain constant diligence to maintain quality control. In the manufacturing industry alone, production line shutdowns due to overlooked errors result in millions of dollars of cost overruns and lost revenue every year. The visual inspection of industrial processes typically requires human inspection, which can be tedious and inconsistent. Computer vision brings the speed and accuracy needed to identify defects consistently, but implementation can be complex and require teams of data scientists to build, deploy, and manage the machine learning models. Because of these barriers, machine learning-powered visual anomaly systems remain out of reach for the vast majority of companies.
Here’s how AWS can now help in quality control:
- Amazon Lookout for Vision offers customers a high accuracy, low-cost anomaly detection solution that uses machine learning to process thousands of images an hour to spot defects and anomalies. Customers send camera images to Amazon Lookout for Vision in batch or in real-time to identify anomalies, such as a crack in a machine part, a dent in a panel, an irregular shape, or an incorrect color on a product. Amazon Lookout for Vision then reports the images that differ from the baseline so that appropriate action can be taken. Amazon Lookout for Vision is sophisticated enough to handle variances in camera angle, pose, and lighting arising from changes in work environments. As a result, customers can accurately and consistently assess machine parts or manufactured products by providing as few as 30 images of the baseline “good” state. Amazon Lookout for Vision also runs on Amazon Panorama appliances. Customers can run Amazon Lookout for Vision in AWS starting today, and beginning next year, customers will be able to run Amazon Lookout for Vision on AWS Panorama Appliances and other AWS Panorama devices so customers will be able to use Amazon Lookout for Vision in locations where Internet connectivity is limited or non-existent.
“Industrial and manufacturing customers are constantly under pressure to reduce costs, improve quality, and maintain compliance. These organizations would like to use the cloud and machine learning to help them automate processes and augment human capabilities across their operations, but building these systems can be error prone, complex, time consuming, and expensive,” said Swami Sivasubramanian, Vice President of Amazon Machine Learning for AWS. “We’re excited to bring customers five new machine learning services purpose-built for industrial use that are easy to install, deploy, and get up and running quickly and that connect the cloud to the edge to help deliver the smart factories of the future for our industrial customers.”
GE Healthcare is a leading global medical technology and digital solutions innovator that develops, manufactures, and distributes diagnostic imaging agents, radiopharmaceuticals, medical diagnostic equipment, including CT and MRI machines, and intelligent devices supported by its Edison intelligence platform. “Today, we use human inspection to verify the quality of our medical equipment. To uphold our brand and deliver best-in-class products trusted by healthcare professionals, we’re excited about the possibility of using Amazon Lookout for Vision to programmatically improve the speed, consistency, and accuracy of detecting product defects across our factories in Japan and potentially in other plants globally in the near future,” said Kozaburo Fujimoto, Operating Officer, General Manager, Manufacturing Division, Plant Manager at GE Healthcare Japan.
Nukon, a SAGE Group company, is a digital transformation consultancy and delivery company that delivers custom-designed solutions which combine strategy, analysis, and technology to give visibility into key business processes so they can be optimized. “We are excited about how Amazon Lookout for Vision will help us detect product defects in real-time within the manufacturing facility for our sister company, SAGE Automation, in line with their stringent quality control program. We are excited to now apply this technology to other manufacturers and integrate it into their quality systems,” said Rafael Amaral, Chief Technology Officer at Nukon.
Doosan Infracore is a leading global manufacturer of heavy duty equipment and engines. “Leveraging AI is critical in advancing Doosan’s next generation equipment, so we are working with AWS to develop use cases where automated and scalable machine learning could be leveraged,” said Mr. Jae Yeon Cho, Vice President of Doosan Infracore. “Based on this, we are excited to continue to work with AWS to leverage Amazon Lookout for Equipment in our next generation IoT platform.”
Fender Musical Instruments Corporation is an iconic brand and the world’s foremost manufacturer of guitars, basses, amplifiers, and related equipment. “Over the past year we worked with AWS to help develop the critical but sometimes overlooked part of running a successful manufacturing business, knowing your equipment condition. For manufacturers worldwide, maintaining equipment uptime is the only way to remain competitive in a global market. Unplanned downtime is costly both in loss of production and labor due to the fire-fighting nature of breakdowns,” said Bill Holmes, Global Director of Facilities at Fender. “Amazon Monitron can give both large industry manufacturers as well as small ‘mom and pop shops’ the ability to predict equipment failures, giving us the opportunity to preemptively schedule equipment repairs.”
For more information: aws.amazon.com/industrial/