When a device manufacturing deviation happens, key areas that can be problematic during the investigation into root cause include the scope, use of appropriate statistical methodology, and inclusion of all shared processes, equipment, and procedures, according to FDA investigators.

Also challenging is putting plans in place to prevent recurrence of the deviation using the firm’s Corrective and Preventive Action (CAPA) system and formulating and following up with the appropriate effectiveness checks.

At the FDA/Xavier MedCon conference held virtually in April 2021, FDA Office of Medical Device and Radiological Health Operations Medical Device Specialist Liza Garcia from the agency’s Puerto Rico duty station shared insights regarding what Office of Regulatory Affairs (ORA) field investigators with FDA review during manufacturing site inspections as they appraise whether a firm is adequately executing and documenting effectiveness checks under its CAPA program.

CAPA Effectiveness Checks

“What are some of the conditions that we typically observe that are not necessarily indicative of adequacy” when companies implement and comply with effectiveness checks requirements? she asked.

In her presentation, Garcia:

  • Reviewed the 21 CFR regulatory requirements for CAPA and effectiveness check related activities, including how the checks are adjudicated and documented, and
  • Detailed what investigators look for when trying to evaluate how adequately firms are implementing the agency’s requirements, including “the conditions that we observed, which do not necessarily represent adequacy when conducting such activities.”

She emphasized that “for the purposes of this presentation the scope is only how effectiveness checks are conducted and how they are documented. The rationales that are exercised by firms deciding whether to validate and/or verify corrective actions are outside of the scope of this presentation.”

Regulatory Requirements

Regulatory requirements are governed by 21 CFR 820.100(a)(1), Garcia explained, “that points to the variety of quality data source inputs to CAPA and whatever mechanism firms have established in the form of procedures that escalate analysis of the quality data sources in corrective and preventive actions.”

While this requirement does not necessarily or directly reference effectiveness checks, it is relevant because the same quality data sources are usually monitored to measure effectiveness.

The explicit requirement that makes direct reference to effectiveness is contained in 820.100(a)(4). That subset of the regulations states that there needs to be a verification and/or validation conducted for corrective actions after they have been implemented.

“The effectiveness of these corrective actions is to be adjudicated by virtue of the corrective actions not having an adverse impact on the finished devices,” Garcia pointed out.

All CAPA activities, including effectiveness checks, need to be documented as prescribed by 820.100(b). The precedent for the regulatory requirement, as it explicitly relates to effectiveness checks, is found in the regulation preamble comment 163:

“FDA has revised Sec. 820.100(a)(4) to reflect that preventive, as well as corrective, action must be verified or validated. The section is now consistent with ISO 9001:1994, sections 4.14.2(d) and 4.14.3(c)….”

Inspection Findings

Garcia noted that “there are typically some recurrent actions or lack thereof, that we observe during inspection, which are indicative of some type of inadequacy when adjudicating effectiveness.”

For example, a risk-based approach “is not necessarily exercised” when conducting investigations and implementing actions. Ultimately, the goal or the purpose of implementing a corrective action is that there is no adverse impact on the finished device. The expectation is that the actions use a risk-based approach as related to devices, safety, and performance.

All CAPA activities, including effectiveness checks, need to be documented as prescribed by 820.100(b)

Also noted on inspection is that the scope of affected products that is considered when determining whether an action is or will be effective is often inadequate. This can manifest itself by a lack of consideration of common denominators of reported problems—for example, products that share the same systems but are not considered as part of the corrective actions that have been implemented and/or the effectiveness checks.

Other common denominators could include anything that is related to:

  • Shared processes
  • Equipment
  • Procedures
  • Components
  • Materials

“We also often see the misuse of statistics when measuring for effectiveness or the inadequate selection of statistical methodology,” Garcia said. “An example would include when firms incorrectly interpret the methodology that is supplied by a given standard, for example, or simply use a methodology that is not able to capture what is needed to be measured.”

To adequately measure effectiveness, “it is imperative that the detectability of recurrence be measured or determined,” she stressed. “We expect that the manner or the means that firms have implemented to detect recurrence or lack thereof is adequate.”

The timeframes that are established for monitoring can also be problematic. Many are not adequate for firms to observe any recurrence that may be manifested. Some defects are dependent upon time. “We also see a lack of any action or measures of previous non-conformities as they relate to the time that the corrective actions were implemented and how that is analyzed respectively.”

Also noted by agency investigators are issues with how firms document recurrence or how firms do or do not consider recurrence when evaluating the effectiveness of corrective and preventive actions that have been implemented.

We also often see the misuse of statistics when measuring for effectiveness or the inadequate selection of statistical methodology

While many firms clearly have established a mechanism to analyze all the appropriate data sources, when it is time to document effectiveness, these may be omitted from related assessments, Garcia said.

“Sometimes the firm has a way to detect recurrence but does not detect it before determining effectiveness and the lack of continued monitoring after effectiveness has been adjudicated. That is something that is common to see.”

She also noted that it is common to see a CAPA closed as effective, but “later we see the problem being manifested or we do not see that there is a continuous analysis of those quality data sources to see whether the problem repeats itself.”

Addressing Recurrent Problems

Regarding prevention of recurrence of an issue, investigators assess and evaluate whether a firm has selected a method for verification that is able to capture the recurrence or the failure repeating itself over time. That can have a variety of forms and/or mechanisms, including acceptance activity. 

“Oftentimes, one of the first things we need to determine when a firm has implemented corrective actions for those that relate to specifications of finished products or any type of product specification is whether acceptance activities have been re-evaluated, changed, or impacted in some way,” Garcia said.

If there has been a change in acceptance activities, investigators need to determine that whatever was implemented was adequate. That includes testing methods. The firm should ask how suitable test methods are at detecting related product specifications.

If the effectiveness check that is done is dependent on something that manifests in the product after distribution—for example, the frequency of product complaints—it is important to determine whether the firm can detect that failure in the field.

The timeframes that are established for monitoring can also be problematic

Oftentimes agency investigators observe that the company does not have the ability to detect or measure the effectiveness criteria it sets.

Garcia said that FDA “likes to see that a firm has continuously and permanently implemented mechanisms in order to prevent and to detect any shifts in processes and/or product specifications that were not necessarily raised to the level of a non-conformity but can alert the firm to proactively and preventively address those potential failures.”

As it relates to documented CAPA activities, “we know that the requirement under 820.100(b) also includes verification activities. We often find that these tests for effectiveness are either not documented according to the CAPA procedure, or if they are, they are not documented adequately because the related data to substantiate the effectiveness and whatever records are to be the evidence that supports that are not included or are not generated at all, or the activity just does not occur.”

[Related: Medical device manufacturers can try out Redica Systems for free. Click here to learn more.]

Get Started with Redica for Free

Download the Special Report

5 GMP Case Studies Report

What You Will Learn from This Report:

In-depth analysis of the findings

Lessons learned

How companies can avoid similar shortcomings.

Download the Special Report

Download your copy of THE FDA INSPECTION LANDSCAPE IN MID-2020 AND A LOOK AT VIRTUAL INSPECTION

In this summary we identify:

  • Trend analysis of FDA inspections through mid-2020
  • Strategies for preparing and hosting virtual inspections
  • New technologies to support remote inspections
Redica Systems Enforcement Analytics

Monitor compliance at your Clinical Investigator sites.

Enter your email address and someone will contact you shortly to get you started.

Redica Systems Enforcement Analytics

Prepare for inspections of Clinical Investigator sites.

Enter your email address and someone will contact you shortly to provide more Clinical Investigator data about your sites.

Redica Systems Enforcement Analytics

Prepare for your next inspection.

Enter your email address and someone will contact you shortly to explore enforcement trends. 

Redica Systems Enforcement Analytics

Prepare for your next inspection.

Enter your email address and someone will contact you shortly to explore observations and trends. 

Redica Systems Enforcement Analytics

Prepare for your next inspection.

Enter your email address and someone will contact you shortly to run your custom report.

Redica Systems Enforcement Analytics

Get help choosing the right CRO.

Enter your email address and someone will contact you shortly to customize your insights.

Redica Systems Enforcement Analytics

Compare two companies of your choice.

Enter your email address and someone will contact you shortly to customize your report.

Download the Special Report

CDMO Comparison opt-in

In this summary we identify:

FY2018-FY2020 GMP data for Lonza & Catalent

Top GMP primary citations

Top FDA 483 observations

Redica Systems Enforcement Analytics

Compare the inspection history of your CDMO sites.

Enter your email address and someone will contact you shortly to customize your report.

Panel Discussion – Remote Audits

Panel Discussion opt in image

Featuring Panelists:
—Barbara W. Unger, Unger Consulting, Inc.
—Jerry Chapman, Redica Systems
—Stephanie Gaulding, Pharmatech Associates

Who Will Benefit?
This session will be valuable to GMP quality, regulatory, compliance, and management personnel in FDA-regulated industries who want to have a conversation on remote audits and get to know what is going on in the industry.

Turning Failure into Success

Presented on Tuesday, April 27, 2021 by Steve Greer, Executive Coach, Genesis Assist, and former Quality Leader, Procter and Gamble

What you will learn:

  • How to use the Leadership SOS Model to transform quality culture
  • How to strengthen quality systems to eliminate human error
  • How to generate ideas on how to set your organization up for success for shareholders, FDA, and staff
Redica Systems Enforcement Analytics

Get Full Access to Redica Enforcement Analytics

Enter your email address and someone will contact you shortly to answer all of your questions and get you started.

Quality Management Systems for Small Pharma and Biotech Firms

Webinar: QMS for Small Pharma and Biotech Firms

Presented by Fenton Fong, Founder, Managing Director, & Principal at xCellarate

Get instant access to the webinar video and slides.

What you will learn:

  • Common challenges small pharma firms face when developing a QMS
    Recent enforcement trends involving the Quality Unit
    Impact of the COVID-19 pandemic

Download the Special Report

APAC ad

In this summary we identify:

GMP data from FY2017 to FY2020 for the Asia-Pacific region

Top 3 GMP primary and secondary citations

Top 3 483 observations

Download the Special Report

An Analysis Of MHRA’s Latest Annual GMP Inspection Deficiencies Report

In this summary we identify:

  • Data from 2019 UK MHRA Inspections
  • Trends from 2015, 2016, 2018, and 2019 inspections
  • Conclusions drawn from an analysis of drug inspection data

Experience the Power of Redica Systems

Redica_Vert_Periwinkle_RGB_Large

SEARCH Find the inspection records you want by inspector’s name, company name, site, city, country, etc.

WARNING LETTERS Easily search the largest database of FDA Warning Letters by date, company, FDA office, or subject

SITES Quickly assess inspection records including dates and inspectors across all of your sites

INSPECTIONS Complete list of FDA inspections by date, company, category, and country

Get Complete Access to the Redica Systems Platform

Please submit your email address and one of our team members will contact you shortly to answer all of your questions and get you started with the new Enforcement Analytics platform.

Redica Systems Enforcement Analytics

Compare the enforcement history of your CDMOs.

Enter your email address and someone will contact you shortly to customize your report.

Redica Systems Enforcement Analytics

Evaluate Your CDMOs

Enter your email address and someone will contact you shortly to customize your report.

Experience the Power of Redica Systems

Redica Systems Expert Jerry Chapman to Present at SQA Annual Meeting

Index Information Redica consolidates regulatory data in real-time on the single largest database for quality, safety, and compliance intelligence.

Strengthen Datasets Redica machine intelligence algorithms identify and triage risk signals to derive meaning from vast amounts of private and public data.

Analyze & Interpret Patterns Redica instantly models the customer-specific regulatory risks, trends, and opportunities that stand to fundamentally change compliance operations.

Redica Systems Enforcement Analytics

Save your team valuable time when using External Monitoring.

Enter your email address and someone will contact you shortly. 

Download the 510(k) Sample

What You Will Learn from This Sample:

See how a 510(k) submission is structured

Find out what information to include

Review correspondence between sponsor and FDA

Redica Systems Enforcement Analytics

Unlimited Access to Reports and Data

Enter your email address and someone will contact you shortly.

Download the Special Report

5 GMP Case Studies Report

What You Will Learn from This Report:

The first countrywide import alert issued by FDA

An inadequate deviation investigation

An inadequate product specifications and a product recall

Process validation issues at a CMO

A different perspective on process validation and the culpability of the quality unit

 

A.I. for Quality and Compliance Teams

August 3 webinar

Presented by Redica Systems Senior GMP Quality Expert Jerry Chapman

What you will learn:

  • A basic understanding of data sources, machine learning, NLP, and A.I. tools
  • Building and applying Expert Models
  • Two case studies, one on sterile manufacturing/503B and one on data integrity

Get the scoop on recent data integrity 483 observations!

  • FY 2020 Data Integrity 483 Observations
  • Data Integrity Observations for Human Drugs
  • Observations Falling Under GMP
  •  

Human Factors – Compliance and Applications

June webinar

Presented by Alison Sathe, Founder, Regulatory Mark & Valerie Fenster, Director of Insights and  Human Factors, Kaleidoscope Innovation 

What you will learn:

  • Human factors strategies from simple drug products to complex surgical devices
  • Primary and secondary labeling development and evaluation for usability
  • Human factors activities from product development to post-market
  • International strategies: expectations for human factors in regulatory submissions in international markets

Experience the Power of Redica Systems

Redica Systems Enforcement Analytics

Let us know who you are and we’ll be in touch to answer all of your questions and get you started.

Redica Systems Enforcement Analytics

Keep up with the latest Regulatory Developments on Clinical Trials

Enter your email address and someone will contact you shortly. 

Redica Systems Enforcement Analytics

Save time and Resources when using External Monitoring.

Enter your email address and someone will contact you shortly. 

Experience the Power of Redica Systems

Complete the form and one of our experts will reach out to you to schedule a demo and answer questions about our subscription options.

INDEX INFORMATION  Redica consolidates regulatory data in real-time on the single largest database for quality, safety, and compliance intelligence.

STRENGTHEN DATASETS Redica machine intelligence algorithms identify and triage risk signals to derive meaning from vast amounts of private and public data.

ANALYZE & INTERPRET PATTERNS Redica instantly models the customer-specific regulatory risks, trends, and opportunities that stand to fundamentally change compliance operations.

Redica Systems Enforcement Analytics

Get immediate access to the news that matters to your sites.

Enter your email address and someone will contact you shortly. 

Redica Systems Enforcement Analytics

See how we can help you eliminate yet another spreadsheet.

Enter your email address and someone will contact you shortly. 

Redica Systems Enforcement Analytics

Stay ahead of changing regulations.

Enter your email address and someone will contact you shortly to get the data and analysis you need.

Redica Systems Enforcement Analytics

Upgrade your CDMO monitoring strategy.

Enter your email address and someone will contact you shortly to get the data and analysis you need.

Redica Systems Enforcement Analytics

Upgrade your CDMO management strategy.

Enter your email address and someone will contact you shortly to get the reports and analysis you need.

Experience the Power of Redica Systems

Redica Systems Enforcement Analytics

Sign up for your FREE account today and get instant access to Enforcement Analytics.

Redica Systems Enforcement Analytics

Upgrade your inspection strategy.

Enter your email address and someone will contact you shortly to get the reports and analysis you need.

Redica Systems Enforcement Analytics

Upgrade your inspection strategy.

Enter your email address and someone will contact you shortly to get the reports and analysis you need to prepare for your next inspection.

Discover the power of the most comprehensive database of 483s in existence.

Our database of over 20,000 483s is retyped and tagged, making it easy to create an Observation Report in seconds.

Eliminate days of work and get your FREE personalized 483 Observation Report.