Amgen is piloting a process using artificial intelligence (AI) that has the potential to greatly enhance its ability to trend and find patterns in manufacturing deviations and to prevent their recurrence.

The AI tool will replace a manual, labor-intensive process with one that can look across large data sets and find correlations between obscure signals and events which the previous system could have missed.

Agile Software Development

In creating the AI tool, the team used agile software development. Agile development is an iterative approach under which requirements and solutions evolve through the collaborative effort of cross-functional teams and their end users.

It involves an incremental development strategy, meaning each successive version of the product is usable and each builds upon the previous version by adding user-visible functionality.

Natural Language Processing

Because the deviation reports — which Amgen calls non-conformance (NC) reports — are documents containing mostly text, the project team decided to employ an AI tool called natural language processing (NLP) to examine them.

NLP provides a way for computers to analyze, understand, and derive meaning from human language, including not only words but also concepts and how they are linked together to create meaning.

At the second Xavier Health AI Summit in Cincinnati, Ohio, Amgen Quality Data Sciences Executive Director Dan Weese and Director Mark DiMartino presented the strategy, approaches, and lessons learned from their implementation of AI tools in Amgen’s quality processes, with a specific focus on the NLP project used to analyze and trend manufacturing NCs. (A review of the first Xavier AI Summit a year earlier is available here.)

[NOTE: When thousands of FDA enforcement documents meet machine learning, you get Redica. Sign up for a FREE account now to see!]

Get Started with Redica for Free

Using Data Science In Quality Operations

Weese provided an overview of the role data science plays in Amgen’s quality operations. He noted that as a large company manufacturing, purifying, and packaging biotech drugs, a huge amount of diverse data is generated, not all of which is digitized.

The focus of his team’s efforts, Weese said, is the application of data science specifically in quality operations, using a data science process (see Figure 1).

Figure 1

Amgen AI Part 1 Figure 1

The process begins with a question, after which the team:

  • Gets the data
  • Explores, models, and visualizes it
  • Interprets it for presentation to management

Data Lake

An important component of the process is the creation of a “data lake.” A data lake is a combination of all relevant data, including raw data and transformed data, which is used for various tasks including reporting, visualization, analytics, and machine learning.

The data lake can include structured data from:

  • Relational databases
  • Semi-structured data such as CSV files
  • Unstructured data such as emails, documents, and PDFs
  • Binary data

Weese characterized the data lake as a core technology platform needed to advance data management and analytics capabilities across functions. “We have to have the ability for people to easily input data and get data.”

Those people need ‘the knowledge of a subject matter expert, the insight of a mathematician, and the discipline of a computer scientist,’ Weese said. ‘Who has all of those skills combined? Probably no one. So we have to work with these different skill sets and people.’

He noted the data lake could be large, and the company needs the right tools to analyze and visualize it.

“We have a race at the company right now to see whether [software platforms] Tableau or Spotfire are the best tools to visualize data. Then we need to be able to apply some of the data science tools such as jupyter, python, and RStudio. These are free and downloadable. So this is not a discussion about the coding — it is about how we use it to get business results.”

The next step is finding people who will access, visualize, and analyze the data to unlock value. Those people need “the knowledge of a subject matter expert [SME], the insight of a mathematician, and the discipline of a computer scientist,” Weese said. “Who has all of those skills combined? Probably no one. So we have to work with these different skill sets and people.”

Regarding the role of data scientists in quality, he said the company believes quality system vigilance provides opportunities for applying data science to core quality function responsibilities, as outlined in the FDA’s 2006 guidance on quality systems

Included in the quality system recommendations from the FDA is “continually monitoring trends and improving systems.”

This can be achieved by:

  • Monitoring data and information
  • Identifying and resolving problems
  • Anticipating and preventing problems

Amgen Quality Data Sciences Areas of Focus

Weese presented eight areas Amgen is exploring for attention by data scientists (see Figure 2).

Figure 2

Amgen AI Part 1 Figure 2

Beginning at the top of the illustration and moving clockwise, Weese began with a brief discussion of trending NCs. “Finding weak signals hidden in deviations is difficult. We can do simple things like Pareto charts, bucketing, and statistical process control charts.”

“In our case, quality owns environmental health and safety. There are a lot of safety incidents. Maybe we can use AI there. We need to keep track of and trend complaints. Then there are supplier quality trending and dashboards of metrics for our process owners.”

GMP Intelligence — that is, can we keep an eye on GMP warning letters and form 483s from agencies and find out what is trending?

Predictive Disposition — can we predict when we will be ready to disposition any one lot?

“Continuous product quality, which Xavier has a workstream on, gets into real-time release, which companies like us are very interested in.”

In addition to the continuous product quality work stream, Xavier also has a team of FDA officials and industry professionals that has taken a major step toward forging the use of AI by providing a Good Machine Learning Practices (GmLP) document for the evaluation and use of continuously learning systems.

Next Up

In the second part in this series, we will cover:

  • Amgen’s current NC trending process
  • Designing and piloting a new process
  • Q&A focusing on GMP documentation aspects

Click here to continue to the second and final part of this series.

[NOTE: See machine learning in action – sign up for Redica to discover thousands of keyword-analyzed FDA enforcement documents.]

Get Started with Redica for Free

Download the Special Report

5 GMP Case Studies Report

What You Will Learn from This Report:

In-depth analysis of the findings

Lessons learned

How companies can avoid similar shortcomings.

Download the Special Report

Download your copy of THE FDA INSPECTION LANDSCAPE IN MID-2020 AND A LOOK AT VIRTUAL INSPECTION

In this summary we identify:

  • Trend analysis of FDA inspections through mid-2020
  • Strategies for preparing and hosting virtual inspections
  • New technologies to support remote inspections
Redica Systems Enforcement Analytics

Monitor compliance at your Clinical Investigator sites.

Enter your email address and someone will contact you shortly to get you started.

Redica Systems Enforcement Analytics

Prepare for inspections of Clinical Investigator sites.

Enter your email address and someone will contact you shortly to provide more Clinical Investigator data about your sites.

Redica Systems Enforcement Analytics

Prepare for your next inspection.

Enter your email address and someone will contact you shortly to explore enforcement trends. 

Redica Systems Enforcement Analytics

Prepare for your next inspection.

Enter your email address and someone will contact you shortly to explore observations and trends. 

Redica Systems Enforcement Analytics

Prepare for your next inspection.

Enter your email address and someone will contact you shortly to run your custom report.

Redica Systems Enforcement Analytics

Get help choosing the right CRO.

Enter your email address and someone will contact you shortly to customize your insights.

Redica Systems Enforcement Analytics

Compare two companies of your choice.

Enter your email address and someone will contact you shortly to customize your report.

Download the Special Report

CDMO Comparison opt-in

In this summary we identify:

FY2018-FY2020 GMP data for Lonza & Catalent

Top GMP primary citations

Top FDA 483 observations

Redica Systems Enforcement Analytics

Compare the inspection history of your CDMO sites.

Enter your email address and someone will contact you shortly to customize your report.

Panel Discussion – Remote Audits

Panel Discussion opt in image

Featuring Panelists:
—Barbara W. Unger, Unger Consulting, Inc.
—Jerry Chapman, Redica Systems
—Stephanie Gaulding, Pharmatech Associates

Who Will Benefit?
This session will be valuable to GMP quality, regulatory, compliance, and management personnel in FDA-regulated industries who want to have a conversation on remote audits and get to know what is going on in the industry.

Turning Failure into Success

Presented on Tuesday, April 27, 2021 by Steve Greer, Executive Coach, Genesis Assist, and former Quality Leader, Procter and Gamble

What you will learn:

  • How to use the Leadership SOS Model to transform quality culture
  • How to strengthen quality systems to eliminate human error
  • How to generate ideas on how to set your organization up for success for shareholders, FDA, and staff
Redica Systems Enforcement Analytics

Get Full Access to Redica Enforcement Analytics

Enter your email address and someone will contact you shortly to answer all of your questions and get you started.

Quality Management Systems for Small Pharma and Biotech Firms

Webinar: QMS for Small Pharma and Biotech Firms

Presented by Fenton Fong, Founder, Managing Director, & Principal at xCellarate

Get instant access to the webinar video and slides.

What you will learn:

  • Common challenges small pharma firms face when developing a QMS
    Recent enforcement trends involving the Quality Unit
    Impact of the COVID-19 pandemic

Download the Special Report

APAC ad

In this summary we identify:

GMP data from FY2017 to FY2020 for the Asia-Pacific region

Top 3 GMP primary and secondary citations

Top 3 483 observations

Download the Special Report

An Analysis Of MHRA’s Latest Annual GMP Inspection Deficiencies Report

In this summary we identify:

  • Data from 2019 UK MHRA Inspections
  • Trends from 2015, 2016, 2018, and 2019 inspections
  • Conclusions drawn from an analysis of drug inspection data

Experience the Power of Redica Systems

Redica_Vert_Periwinkle_RGB_Large

SEARCH Find the inspection records you want by inspector’s name, company name, site, city, country, etc.

WARNING LETTERS Easily search the largest database of FDA Warning Letters by date, company, FDA office, or subject

SITES Quickly assess inspection records including dates and inspectors across all of your sites

INSPECTIONS Complete list of FDA inspections by date, company, category, and country

Get Complete Access to the Redica Systems Platform

Please submit your email address and one of our team members will contact you shortly to answer all of your questions and get you started with the new Enforcement Analytics platform.

Redica Systems Enforcement Analytics

Compare the enforcement history of your CDMOs.

Enter your email address and someone will contact you shortly to customize your report.

Redica Systems Enforcement Analytics

Evaluate Your CDMOs

Enter your email address and someone will contact you shortly to customize your report.

Experience the Power of Redica Systems

Redica Systems Expert Jerry Chapman to Present at SQA Annual Meeting

Index Information Redica consolidates regulatory data in real-time on the single largest database for quality, safety, and compliance intelligence.

Strengthen Datasets Redica machine intelligence algorithms identify and triage risk signals to derive meaning from vast amounts of private and public data.

Analyze & Interpret Patterns Redica instantly models the customer-specific regulatory risks, trends, and opportunities that stand to fundamentally change compliance operations.

Redica Systems Enforcement Analytics

Save your team valuable time when using External Monitoring.

Enter your email address and someone will contact you shortly. 

Download the 510(k) Sample

What You Will Learn from This Sample:

See how a 510(k) submission is structured

Find out what information to include

Review correspondence between sponsor and FDA

Redica Systems Enforcement Analytics

Unlimited Access to Reports and Data

Enter your email address and someone will contact you shortly.

Download the Special Report

5 GMP Case Studies Report

What You Will Learn from This Report:

The first countrywide import alert issued by FDA

An inadequate deviation investigation

An inadequate product specifications and a product recall

Process validation issues at a CMO

A different perspective on process validation and the culpability of the quality unit

 

A.I. for Quality and Compliance Teams

August 3 webinar

Presented by Redica Systems Senior GMP Quality Expert Jerry Chapman

What you will learn:

  • A basic understanding of data sources, machine learning, NLP, and A.I. tools
  • Building and applying Expert Models
  • Two case studies, one on sterile manufacturing/503B and one on data integrity

Get the scoop on recent data integrity 483 observations!

  • FY 2020 Data Integrity 483 Observations
  • Data Integrity Observations for Human Drugs
  • Observations Falling Under GMP
  •  

Human Factors – Compliance and Applications

June webinar

Presented by Alison Sathe, Founder, Regulatory Mark & Valerie Fenster, Director of Insights and  Human Factors, Kaleidoscope Innovation 

What you will learn:

  • Human factors strategies from simple drug products to complex surgical devices
  • Primary and secondary labeling development and evaluation for usability
  • Human factors activities from product development to post-market
  • International strategies: expectations for human factors in regulatory submissions in international markets

Experience the Power of Redica Systems

Redica Systems Enforcement Analytics

Let us know who you are and we’ll be in touch to answer all of your questions and get you started.

Redica Systems Enforcement Analytics

Keep up with the latest Regulatory Developments on Clinical Trials

Enter your email address and someone will contact you shortly. 

Redica Systems Enforcement Analytics

Save time and Resources when using External Monitoring.

Enter your email address and someone will contact you shortly. 

Experience the Power of Redica Systems

Complete the form and one of our experts will reach out to you to schedule a demo and answer questions about our subscription options.

INDEX INFORMATION  Redica consolidates regulatory data in real-time on the single largest database for quality, safety, and compliance intelligence.

STRENGTHEN DATASETS Redica machine intelligence algorithms identify and triage risk signals to derive meaning from vast amounts of private and public data.

ANALYZE & INTERPRET PATTERNS Redica instantly models the customer-specific regulatory risks, trends, and opportunities that stand to fundamentally change compliance operations.

Redica Systems Enforcement Analytics

Get immediate access to the news that matters to your sites.

Enter your email address and someone will contact you shortly. 

Redica Systems Enforcement Analytics

See how we can help you eliminate yet another spreadsheet.

Enter your email address and someone will contact you shortly. 

Redica Systems Enforcement Analytics

Stay ahead of changing regulations.

Enter your email address and someone will contact you shortly to get the data and analysis you need.

Redica Systems Enforcement Analytics

Upgrade your CDMO monitoring strategy.

Enter your email address and someone will contact you shortly to get the data and analysis you need.

Redica Systems Enforcement Analytics

Upgrade your CDMO management strategy.

Enter your email address and someone will contact you shortly to get the reports and analysis you need.

Experience the Power of Redica Systems

Redica Systems Enforcement Analytics

Sign up for your FREE account today and get instant access to Enforcement Analytics.

Redica Systems Enforcement Analytics

Upgrade your inspection strategy.

Enter your email address and someone will contact you shortly to get the reports and analysis you need.

Redica Systems Enforcement Analytics

Upgrade your inspection strategy.

Enter your email address and someone will contact you shortly to get the reports and analysis you need to prepare for your next inspection.

Discover the power of the most comprehensive database of 483s in existence.

Our database of over 20,000 483s is retyped and tagged, making it easy to create an Observation Report in seconds.

Eliminate days of work and get your FREE personalized 483 Observation Report.