When Does Profiling Make an AI System High-Risk?
Article 6(3) includes a hard boundary: an Annex III system is always considered high-risk where it performs profiling of natural persons. Profiling means automated processing of personal data to evaluate aspects of a person, such as work performance, economic situation, health, preferences, reliability, behavior, location or movements.
This matters because profiling is common in exactly the systems businesses are tempted to describe as “just supporting a human”. An HR analytics tool that scores individual employees on performance indicators is profiling, even if a manager makes the final call. A credit tool that builds an individual risk profile from transaction history is profiling, even if it only produces a recommendation.
For compliance and legal teams, a useful early triage question is: does the AI build or use an individual-level profile of a specific person to inform a decision about them? For product leaders and engineers, the difference between an aggregate analytics dashboard (lower exposure) and an individual scoring or ranking tool (higher exposure) is not cosmetic. For CISOs and DPOs, profiling inside an Annex III context is a strong signal that data governance and data protection impact assessment work should happen early, not as an afterthought.
The 8 Annex III High-Risk AI Categories Explained
Biometrics. This category covers remote biometric identification systems (matching biometric data against a reference database, typically without the person's active involvement), biometric categorization that infers sensitive attributes, and emotion recognition. Financial services firms using biometric authentication for account access are generally closer to verification than identification, though the implementation still needs review.
Critical infrastructure. This covers AI functioning as a safety component in managing critical digital infrastructure, road traffic or utility supply. A utility using AI purely for demand forecasting is in a different position from one using AI to directly control safety-relevant valve or grid operations.
Education and vocational training. Admissions decisions, assessment of learning outcomes and proctoring for exam integrity fall here. Education-technology vendors building adaptive learning tools need to separate tools that personalize content delivery from tools that determine access or pass/fail outcomes.
Employment, workers' management and access to self-employment. This is one of the most commonly triggered categories in practice. Recruitment screening, CV ranking, interview analysis and performance monitoring all sit here. HR technology vendors and internal People Analytics teams are a natural focus for scrutiny, particularly where the tool influences hiring, promotion or termination for named individuals.
Access to essential private and public services and benefits. Creditworthiness assessment, insurance pricing and risk assessment for life and health insurance, emergency-call dispatch and eligibility evaluation for public benefits fall here. Banks, insurers and public-sector benefits agencies are the most exposed.
Law enforcement. Risk-assessment tools used by or for police, polygraph-type systems, evidence-reliability tools and profiling during investigations are covered. This category carries some of the strictest conditions in the Act given the fundamental-rights stakes.
Migration, asylum and border control management. Risk and security assessment tools, polygraph-type systems and tools assisting the examination of asylum, visa or residence-permit applications fall here, as do systems that detect, recognize or identify people (other than travel-document verification).
Administration of justice and democratic processes. AI assisting judicial authorities in researching and interpreting facts and applying the law is covered, as is AI intended to influence election outcomes or voting behavior. Tools whose output people are not directly exposed to, such as campaign logistics tools, are carved out.
Across all eight categories, the category defines the subject-matter area, but classification still runs through Article 6. Different implementations within the same industry can land on different sides of the high-risk line.
Annex III Compliance Requirements
Once a system is confirmed high-risk under Annex III, a defined set of obligations applies, primarily to providers, with corresponding duties for deployers.
- Risk management system: an ongoing, documented process to identify and mitigate risks throughout the system's lifecycle, not a one-time assessment.
- Data governance and data quality: training, validation and testing data must meet quality criteria and be examined for possible biases, particularly ones affecting protected groups.
- Technical documentation: a detailed record of the system's design, capabilities and limitations, kept up to date and available to authorities on request.
- Record-keeping and logging: automatic logging of events during operation to support traceability and post-incident investigation.
- Transparency and instructions for use: deployers need enough information to use the system correctly, including its capabilities, limitations and required level of human oversight.
- Human oversight: the system must be designed so a human can effectively understand, monitor and, where necessary, override or stop it.
- Accuracy, robustness and cybersecurity: the system must perform reliably and resist manipulation, adversarial attack or unauthorized access.
- Quality management system: providers need organizational processes to ensure ongoing compliance, not a single certification event.
- Conformity assessment and registration: before market placement, providers must complete the applicable conformity assessment and register the system in the EU database.
- Post-market monitoring and incident reporting: providers must track performance after deployment and report serious incidents to authorities.
None of these are one-step tasks. They are ongoing operational disciplines that need real data infrastructure and governance behind them, not just a policy document.
Annex III Provider vs Deployer Responsibilities
The AI Act splits obligations between the organization that builds and places the system on the market (the provider) and the organization that uses it under its own authority (the deployer). Both Annex I and Annex III systems have providers and deployers. Many enterprises are deployers of third-party tools rather than providers, and the two roles carry different responsibilities.
Providers create and maintain technical documentation, carry out conformity assessment and register the system, design the system to enable effective human oversight, build in automatic logging, and report serious incidents to market surveillance authorities.
Deployers retain the instructions for use and rely on them for correct deployment, verify that the system has undergone conformity assessment before use, assign competent and trained people to exercise human oversight, retain generated logs for the legally required period, and inform the provider (and in some cases authorities) of risks or incidents observed in use. Certain deployers, particularly public bodies and some private entities in credit and insurance contexts, must also carry out a fundamental rights impact assessment.
An organization can be both. If it substantially modifies a third-party system or puts its own brand on it, a deployer can be treated as a provider for that system.
Annex III Compliance Checklist
A working checklist compliance teams can use as a starting inventory:
- Identify every AI system in use or under development across the organization.
- Determine the intended purpose of each system as it will actually be marketed or used.
- Check whether the system falls under the Annex I product-safety route.
- Check whether the system falls within one of the eight Annex III use-case categories.
- Assess the Article 6 conditions relevant to the applicable route.
- Evaluate whether the Article 6(3) exception could apply, and document the reasoning.
- Assess whether the system profiles natural persons. If so, the Article 6(3) exception does not apply.
- Document the classification decision, including the reasoning and evidence relied on.
- Review data governance practices for training, validation and input data.
- Assess the human oversight design and whether personnel are equipped to exercise it.
- Evaluate cybersecurity, robustness and accuracy testing already in place.
- Review existing technical documentation against what Annex IV requires.
- Establish or confirm post-market monitoring and incident-reporting processes.
- Review privacy and data protection implications, including any required data protection impact assessment.
- Identify sensitive or personal data flowing into the system and where it originates.
- Reassess third-party AI vendors used as part of the organization's own systems.
This list is a practical starting point, not legal advice. Organizations with material exposure to Annex III categories should involve qualified legal counsel in the classification decision.