De-Identification of Medical Records

De-identification of medical records removes information from the protections of the HIPAA Privacy Rule when the records satisfy the HIPAA de-identification standard, but it does not necessarily remove the information from other federal laws, state privacy laws, consumer health data laws, research requirements, or contractual restrictions. HIPAA provides two methods for deidentification, Safe Harbor and Expert Determination, and each addresses identification risk differently. A defensible deidentification process also needs to account for the particular dataset, anticipated recipient, release environment, available external information, and period during which the assessment remains valid.

Deidentification is therefore not a permanent status created by deleting a standard set of fields. Medical information exists on a continuum of identifiability. Information can present a sufficiently small identification risk for a defined release while retaining some residual risk and analytical value.

The Two HIPAA Methods for Deidentifying Medical Records

The HIPAA Privacy Rule provides two methods for deidentifying PHI. The Safe Harbor method requires the removal of specified identifiers concerning the individual and relatives, employers, or household members of the individual. The Covered Entity must also have no actual knowledge that the remaining information could be used alone or in combination with other information to identify the individual.

The Expert Determination method takes a different approach. A person with appropriate knowledge of and experience with generally accepted statistical and scientific principles and methods for rendering information not individually identifiable determines that the risk is very small that the information could be used, alone or in combination with other reasonably available information, by an anticipated recipient to identify an individual.

The expert must document the methods and results that justify the determination. The analysis is therefore based on measured identification risk rather than the execution of a prescribed list of removals.

Safe Harbor Is Not Automatically the Safer Method

Safe Harbor is easier to describe because it provides a defined set of identifier categories that must be removed. That simplicity does not establish that Safe Harbor produces a lower-risk dataset than Expert Determination in every situation.

HIPAA
Compliance
Checklist

Simple Guidelines
Immediate PDF Download

Immediate Access

Privacy Policy

Download Free Checklist

A medical dataset can contain rare diagnoses, sequences of diagnoses, laboratory values, treatment patterns, pharmacy histories, occupational information, and other characteristics that are not eliminated merely by removing obvious identifiers. Free-text clinical notes create another concern because identifying information can appear within narrative language rather than in a designated identifier field.

At the same time, Safe Harbor can substantially reduce analytical utility. Dates can lose the precision required for longitudinal research, while geographic information can become too broad for some forms of analysis.

Expert Determination can address the fields that actually create identification risk while retaining information that does not need the same degree of transformation. A dataset can therefore retain more analytical value while satisfying a documented risk threshold.

Safe Harbor Still Requires Judgment

Safe Harbor should not be treated as a purely mechanical deletion exercise. The method includes the condition that the Covered Entity has no actual knowledge that the remaining information could be used alone or in combination with other information to identify an individual.

This becomes relevant with high-dimensional medical records. A rare diagnosis combined with occupation, treatment history, provider specialty, geographic information, or an unusual sequence of events can distinguish a patient even when the conventional identifiers have been removed.

Clinical narratives also need examination. A note can contain references to relatives, workplaces, unusual events, geographic information, or other details that create an identification pathway even when structured identifier fields have been removed.

Expert Determination Is a Risk Analysis

Expert Determination is not Safe Harbor performed with additional scrutiny. The two methods use different approaches.

An Expert Determination can involve classifying fields according to their identification characteristics, defining an anticipated recipient, considering information reasonably available to that recipient, establishing a risk threshold, measuring baseline risk, applying transformations, and measuring the resulting risk again.

The process also considers the population against which an individual could be identified. A characteristic that is common in a national dataset can become identifying within a small geographic area or narrowly defined population.

The resulting documentation should provide enough information to explain the methodology, assumptions, transformations, measurements, and conclusion. The purpose is to establish why identification risk is very small for the defined release.

HIPAA Does Not Require Zero Identification Risk

HIPAA deidentification does not require a finding that reidentification is impossible. Medical data that retains analytical value also retains variation, and variation can produce uncommon combinations of characteristics.

Those combinations create some possibility of matching information with an individual. Removing every distinguishing characteristic could make a dataset unsuitable for the research, analytics, public health, or operational purpose for which it was created.

An Expert Determination therefore addresses whether the remaining risk is very small rather than whether risk has been eliminated. The report should identify the residual risk, the threshold against which it was assessed, and the assumptions supporting the conclusion.

Describing deidentified medical information as presenting zero reidentification risk can therefore misstate what the HIPAA standard establishes.

Deidentified Should Not Automatically Be Described as Anonymous

The terms deidentified and anonymous should not automatically be treated as interchangeable. HIPAA recognizes that properly deidentified information can retain a very small residual identification risk.

Public statements claiming that information is anonymous or cannot be reidentified can therefore create a different representation from stating that information has been deidentified in accordance with a specified HIPAA method.

Organizations should align descriptions in privacy policies, contracts, marketing materials, research documentation, and other public statements with the method actually used and the conclusion the analysis supports.

A Determination Applies to a Defined Release

An Expert Determination does not establish that a source dataset can be shared with every recipient under every release model. The anticipated recipient forms part of the HIPAA standard.

The same medical information can therefore require different transformations for different releases. A dataset intended for unrestricted public publication can require substantial transformation, while a dataset provided to a defined research partner under enforceable restrictions can support greater detail.

A controlled environment can permit another configuration. Information accessed inside a secure data enclave without allowing the recipient to download a copy presents a different identification environment from the same information published online.

Each release needs to be assessed according to the dataset, recipient, available external information, access controls, contractual restrictions, and method of release.

One Determination Does Not Cover Every Data Sharing Arrangement

A determination is bounded by the information and release circumstances that were assessed. Changing the recipient can change the information reasonably available for matching. Changing the fields can create new combinations that were not measured. Changing from controlled access to public release can change the adversary environment.

This does not prevent an organization from using the same source medical records for several purposes. It means that different versions can be created for different release environments.

A public dataset, a partner dataset subject to contractual controls, and a more detailed dataset available within a secure environment can therefore coexist when each release has been independently assessed and documented.

Deidentification Determinations Need Periodic Review

The HIPAA Privacy Rule does not prescribe a fixed expiration date for an Expert Determination, but the circumstances supporting a determination can change. Identification risk depends partly on information available outside the dataset.

New public records, commercial datasets, data brokerage services, technical capabilities, and reidentification techniques can alter what information is reasonably available. Population characteristics can also change.

Organizations can establish a review period and identify events requiring an earlier reassessment. Changes to the dataset, addition of new fields, changes to the recipient, changes to the release method, or availability of a new external dataset can affect the assumptions supporting the original determination.

Aggregate Medical Data Is Not Automatically Deidentified

Aggregation can reduce identification risk, but an aggregate statistic is not automatically safe merely because individual records are not displayed. Small cells can reveal information about identifiable people.

A report showing that two people within a small community and narrowly defined demographic group have a stigmatized diagnosis can reveal sensitive information without displaying either person’s name.

Cell suppression, minimum count thresholds, complementary suppression, geographic generalization, and related techniques can address these risks. The appropriate method depends on the population, variables, tables, and information that can be derived from published totals and percentages.

Aggregation is therefore a risk-control technique with parameters rather than an automatic deidentification status.

Removing Names Does Not Necessarily Deidentify Medical Data

Names, email addresses, telephone numbers, and medical record numbers are obvious identifiers, but other information can also provide a route to identification.

IP addresses, device identifiers, advertising identifiers, location information, session identifiers, unusual diagnoses, occupational information, treatment histories, and combinations of demographic characteristics can distinguish individuals.

The risk depends on what information can be combined. A field that appears innocuous when viewed independently can become identifying when linked with public records, commercial databases, social media information, or another healthcare dataset.

Location Information Can Reveal Identity

Location information creates particular identification risks because repeated movement patterns can distinguish individuals. A pseudonymous device that repeatedly remains at one location overnight can potentially be associated with a residence.

Public property information or other external datasets can then provide another step toward identifying the household or individual associated with the device.

Location histories can also reveal visits to substance use disorder programs, mental health facilities, reproductive healthcare providers, and other sensitive healthcare locations. Removing names from the dataset does not remove the information contained in these behavioral patterns.

The Intended Recipient Affects Identification Risk

An Expert Determination considers an anticipated recipient because recipients possess different information and capabilities. A university research team operating under contractual restrictions presents a different risk environment from a data broker receiving the same records for commercial analysis.

The intended purpose can also provide information about practical identifiability. A transfer intended to identify or target particular consumers requires examination of how the recipient expects to connect the information with those individuals.

The recipient, purpose, external information environment, and release controls should therefore be established before the deidentification analysis is completed.

Public Release Creates a Different Risk Environment

Publishing medical information for unrestricted access removes controls that exist in a managed data-sharing relationship. The organization cannot determine who downloads the information, what other datasets recipients possess, or what linkage techniques they use.

A public release therefore needs to be evaluated against a broader identification environment. Contractual restrictions cannot control unidentified members of the public in the same manner as an identified recipient.

An organization that needs both public transparency and detailed research access can create separate releases. A more heavily transformed dataset can be published publicly while a richer dataset is provided through a controlled environment subject to access and use restrictions.

Contracts Can Support the Deidentification Environment

Contractual controls can restrict reidentification attempts, linkage for identification purposes, redistribution, and other activities that would change the risk environment considered during the assessment.

Downstream restrictions can require subsequent recipients to accept equivalent conditions. This prevents protections from disappearing when information is transferred beyond the first recipient.

When an Expert Determination relies on these controls, the controls form part of the assumptions supporting the determination. Removing them can change the circumstances under which the expert concluded that identification risk was very small.

The Expert Does Not Necessarily Transform the Production Data

The person making an Expert Determination does not necessarily need direct control of the organization’s production systems. The expert can conduct the risk analysis and specify the transformations required to reach the selected risk threshold.

The healthcare organization or data holder can implement those transformations within its own environment. This can limit unnecessary movement of identifiable medical information.

The resulting dataset should then be verified against the specifications before the determination is completed. A correct transformation specification does not establish that the resulting data satisfies the assessment if the specification was implemented incorrectly.

Outside Experts Can Require a Business Associate Agreement

Properly deidentified information is no longer PHI under the HIPAA Privacy Rule and does not require a Business Associate Agreement solely because the recipient receives the deidentified information. The position is different when an outside expert receives identifiable PHI to perform the deidentification work on behalf of a HIPAA Covered Entity.

The expert is then handling PHI before deidentification has occurred. The relationship can therefore require a Business Associate Agreement and the safeguards applicable to Business Associates.

This distinction separates the status of the input from the status of the completed output. The objective of the engagement can be to create deidentified information while the work required to reach that point still involves PHI.

Retrospective Assessments Cannot Rewrite the Release History

An organization can assess a dataset after it has already been disclosed, but a later analysis does not create a determination that existed before the disclosure. The assessment can establish the characteristics and identification risk of the released information based on the available evidence.

This creates a particular problem if the subsequent analysis concludes that identification risk exceeded the applicable threshold. The organization then has information about a previous release that needs to be addressed according to the circumstances.

Deidentification should therefore be assessed before the intended disclosure whenever the organization is relying on the HIPAA de-identification standard to release information outside the protections applicable to PHI.

Some Medical Datasets Cannot Support the Intended Deidentification

Not every medical dataset can be transformed into a sufficiently low-risk form while retaining the information required for the proposed use. Small populations, unusually rich records, rare conditions, and certain physiological signals can create identification characteristics that are difficult to remove without destroying the intended utility.

The appropriate response is not to change the risk threshold after seeing the result. The organization can instead change the release architecture.

A richer dataset can be made available through a secure enclave rather than distributed as a copy. A limited data set can be provided under a data use agreement when that approach satisfies the purpose. Sparse categories can be transformed, public results can be aggregated with suppression controls, or separate public and restricted versions can be created.

Risk Thresholds Should Be Established Before Measurement

An Expert Determination needs a defined basis for deciding whether measured identification risk is sufficiently small. Establishing the threshold after seeing the result creates the possibility that the standard will be adjusted to accommodate the dataset rather than applied to it.

The same issue applies to assumptions about the anticipated recipient and external information. These parameters should be established as part of the methodology rather than changed merely because the initial result exceeds the selected threshold.

If the measured risk is too high, the data, recipient population, access environment, or transformation can be changed and the risk measured again. The documented methodology should distinguish changes to the release from changes made solely to obtain a preferred numerical result.

Data Utility Should Be Measured Alongside Risk

Deidentification can reduce the analytical usefulness of medical information. Generalizing dates can impair longitudinal analysis. Suppressing rare conditions can affect research involving small patient populations. Reducing geographic precision can prevent local analysis.

The effect of transformations should therefore be assessed alongside the reduction in identification risk. A transformation that reaches the desired risk threshold while preserving the variables required for the intended analysis can provide greater value than a mechanical approach that removes information unrelated to the principal identification risk.

This is one reason Expert Determination can produce a different result from Safe Harbor. The analysis can direct transformations toward the characteristics creating measurable risk.

Digital Metadata Needs to Be Included in Deidentification Assessments

Medical information increasingly extends beyond conventional clinical database fields. Patient portals, mobile applications, websites, analytics platforms, and connected services can generate identifying information alongside healthcare interactions.

Cookies, IP addresses, device identifiers, advertising identifiers, URLs, session identifiers, and application telemetry can contribute to an identification pathway. Their relevance depends on the context and the information available to the recipient.

A deidentification assessment limited to the visible medical record can therefore overlook information transferred through associated technical systems.

Health Information Can Be Created Through Inference

Some privacy laws regulate information based on health characteristics inferred from other information. The information entering an analytical process does not necessarily need to begin as a conventional medical record.

Consumer purchases, location histories, browsing behavior, application activity, and other data can be used to infer pregnancy, mental health status, medical conditions, treatment interests, or other health characteristics.

This means the downstream activity performed with a deidentified dataset can matter independently of its HIPAA status. A recipient can create regulated health information through analysis even when the original information was outside the definition of PHI.

Substance Use Disorder Records Require Additional Analysis

Substance use disorder information can present greater consequences if individuals are reidentified. Employment consequences, discrimination, legal proceedings, family matters, and social stigma can affect the assessment of an appropriate release.

42 CFR Part 2 also creates additional confidentiality requirements for qualifying substance use disorder records. HIPAA deidentification can be relevant to certain uses of these records, but the sensitivity of the information should be considered when determining the acceptable release environment and residual identification risk.

A risk level used for general medical information should not automatically be applied to a small dataset containing sensitive substance use disorder information without examining the population and consequences of identification.

Genetic and Physiological Data Present Distinct Identification Problems

Genetic information illustrates why identifiability cannot always be addressed through removal of conventional identifiers. A genome is associated with an individual by its nature, while expanding reference datasets can affect the ability to connect genetic information with identified people.

Physiological signals can create similar issues. Certain continuous signals and biometric characteristics can contain patterns that distinguish one person from another even after obvious demographic identifiers have been removed.

These datasets can require different analytical techniques and release architectures from conventional administrative or claims data.

Leaving HIPAA Does Not Mean Leaving Privacy Regulation

Properly deidentified information is no longer PHI under the HIPAA Privacy Rule, but that boundary does not create a general exemption from privacy law. Other federal and state requirements can continue to regulate the information or the conduct of organizations receiving it.

Consumer privacy frameworks can impose requirements concerning reasonable measures against identification, public commitments not to reidentify information, and contractual prohibitions on downstream reidentification.

State health privacy laws can regulate health information outside traditional HIPAA relationships, including information derived or inferred from consumer activity. State requirements can also restrict reidentification or impose conditions on transfers of information that qualifies as deidentified under HIPAA.

Deidentification Documentation Needs to Support Later Review

The documentation created during deidentification can become the principal evidence supporting the organization’s decision if the release is examined later. An Expert Determination should therefore record the data assessed, methodology, anticipated recipient, release model, risk threshold, measurements, transformations, residual risk, assumptions, and conditions affecting the conclusion.

The documentation should also identify circumstances requiring reassessment. This can include new data fields, new recipients, new external datasets, changes in the release environment, or other developments that alter the assumptions used in the analysis.

The organization should retain the determination and related documentation in a form that can be produced without reconstructing the analysis after an inquiry has begun.

Deidentification Is a Defined Risk Decision

De-identification of medical records requires more than deleting direct identifiers. Safe Harbor and Expert Determination provide two HIPAA pathways, but both require attention to the information remaining after transformation and the circumstances in which it will be used or disclosed.

Expert Determination is particularly dependent on context. The conclusion applies to a defined dataset, an anticipated recipient, a release environment, and the external information assumptions existing when the analysis is performed. Residual risk can remain while still satisfying the HIPAA standard.

The broader compliance analysis continues after HIPAA deidentification. State privacy requirements, contractual restrictions, consumer health information laws, digital identifiers, location data, health inferences, genetic information, sensitive medical information, and changes in available external datasets can affect what happens next. Deidentification therefore needs to be treated as a documented and reviewable risk decision rather than a permanent status created by removing a list of identifiers.

About Liam Johnson

Liam Johnson has produced articles about HIPAA for several years. He has extensive experience in healthcare privacy and security. With a deep understanding of the complex legal and regulatory landscape surrounding patient data protection, Liam has dedicated his career to helping organizations navigate the intricacies of HIPAA compliance. Liam focusses on the challenges faced by healthcare providers, insurance companies, and business associates in complying with HIPAA regulations. Liam has been published in leading healthcare publications, including The HIPAA Journal. Liam was appointed Editor-in-Chief of The HIPAA Guide in 2023. Contact Liam via LinkedIn: https://www.linkedin.com/in/liamhipaa/