Initial screening criteria for marketplace listing
All submitted agents undergo automated & manual analysis checking for code
vulnerabilities, prohibited functionality, and adherence to API usage
guidelines. Documentation completeness is evaluated against standardized
requirements including clear purpose statements, input/output specifications,
and limitation disclosures. Agents must demonstrate basic functionality and
reliability through preliminary testing before advancing to comprehensive
review stages.
Performance testing benchmarks
Agents are evaluated against domain-specific test suites designed to measure
accuracy, response time, and resilience under various load conditions. Stress
testing simulates high-volume usage patterns to identify potential failure
points and performance degradation scenarios. Comparative analysis positions
each agent against existing marketplace offerings with similar functionality
to establish relative performance expectations.
Ethical and safety evaluation procedures
Multi-stage safety evaluations probe for harmful outputs, testing agent
responses to adversarial inputs and edge cases. Fairness assessments measure
performance across demographic groups to identify potential bias in agent
responses or recommendations. Independent review panels evaluate high-risk
agents with additional scrutiny for applications in sensitive domains like
healthcare, finance, and legal services.
Response time SLAs for review submissions
Initial screening results are provided within 24 hours of submission, with
detailed technical feedback on any failed criteria. Standard review processes
for low and medium-risk agents are completed within 5 business days, providing
comprehensive evaluation reports. High-risk or complex agents requiring
specialized review may take up to 10 business days, with progress updates
provided at predetermined milestones.
Appeal process for rejected agents
Developers can submit appeals through a structured process that requires
addressing specific rejection reasons with evidence of remediation via emails
to [email protected] . Appeals are reviewed by different evaluators than
those involved in the initial rejection decision to ensure fresh perspective.
Expedited re-review options are available for agents that have addressed all
identified issues, with clear guidelines for qualifying for this accelerated
path.
The platform explicitly prohibits agents designed for illegal activities,
harassment, discrimination, or the generation of misleading content.
Restrictions cover agents that could enable unauthorized access to systems,
circumvent security measures, or generate spam content. Detailed examples
clarify boundaries between acceptable and prohibited use cases, with regular
updates reflecting emerging risks and regulatory changes.
Ethical AI Principles and Requirements
All agents must adhere to core principles including transparency in
capabilities, respect for user autonomy, and fairness across demographic
groups. Output traceability requirements ensure users can understand the basis
for agent recommendations and decisions, especially in high-stakes domains.
Developers must implement appropriate safeguards proportional to the potential
risks associated with their agent’s functionality and intended use cases.
Compliance Requirements by Region and Industry
Region-specific requirements address varying data protection regulations
including GDPR, CCPA, and emerging privacy frameworks. Industry-specific
compliance modules enforce additional safeguards for regulated sectors such as
healthcare (HIPAA), finance (PCI-DSS), and education (FERPA, COPPA). The
platform provides compliance verification tools that help developers ensure
their agents meet all applicable requirements for their target markets.
Content Rating System
A tiered rating system classifies agents based on content sensitivity,
complexity of outputs, and required user expertise. Professional-only
designations restrict certain agents to verified business users in appropriate
domains like legal, medical, or financial services. Clear rating display
requirements ensure users understand potential content sensitivity before
interaction with any agent in the marketplace.
Enforcement Procedures for Violations
Progressive enforcement mechanisms begin with warnings and remediation periods
for minor or first-time violations. Serious violations trigger immediate agent
suspension pending investigation and developer response. Repeat violations
lead to escalating consequences including extended review periods for future
submissions and potential developer account restrictions. All enforcement
actions include specific violation details and clear remediation requirements.
The platform implements a comprehensive STRIDE threat modeling approach
(Spoofing, Tampering, Repudiation, Information disclosure, Denial of service,
Elevation of privilege) for all components. Automated static and dynamic code
analysis tools scan agent code and configurations during submission and after
any updates. Third-party dependency scanning identifies known vulnerabilities
in libraries and frameworks used by agents, with automated notifications when
critical updates are required.
Performance Reliability Metrics
Reliability is measured through multiple dimensions including uptime
percentage, mean time between failures, and response time consistency under
varying loads. Chaos engineering practices systematically introduce controlled
failures to verify system resilience and recovery mechanisms. Performance
degradation tracking identifies subtle issues before they impact user
experience, with automated alerts when metrics fall below defined thresholds.
Bias and Fairness Testing Protocols
Agents undergo systematic testing against demographically diverse datasets to
identify performance variations across different user groups. Standard
fairness metrics including equalized odds, demographic parity, and
counterfactual fairness are calculated for each agent’s outputs. Regular
red-team exercises challenge agents with adversarial inputs designed to elicit
potentially biased or harmful responses.
Regular Security Audits and Penetration Testing
Independent security audits are conducted quarterly by certified third-party
specialists examining infrastructure, code, and operational procedures.
Continuous automated scanning supplements formal audits with daily
vulnerability checks and configuration assessments. Bug bounty programs
incentivize responsible disclosure of security issues from external
researchers and ethical hackers.
Compliance with Industry Standards
The platform maintains SOC 2 Type II certification with annual audits
verifying controls for security, availability, and confidentiality. ISO 27001
certification ensures the information security management system meets
international standards for best practices. Additional certifications for
specialized industries include HIPAA compliance for healthcare and PCI-DSS for
payment processing when applicable.
Agents should be designed to operate with the minimum data necessary to
fulfill their function, with clear documentation of required data fields.
Automated data classification identifies and flags potential collection of
excessive personal information during the review process. Just-in-time data
collection practices ensure information is only gathered when needed rather
than preemptively stored.
Anonymization Techniques for Sensitive Information
Multiple anonymization methods including tokenization, hashing, and
perturbation are applied based on data sensitivity and use case requirements.
Differential privacy techniques add calibrated noise to aggregate data while
preserving analytical utility for training and improvement. Pseudonymization
systems allow for functional operations while removing direct identifiers from
operational datasets.
Retention and Deletion Policies
Granular data retention policies specify maximum storage durations based on
data type, purpose, and regulatory requirements. Automated deletion processes
permanently remove expired data according to schedule, with cryptographic
verification of complete removal. Emergency purge capabilities enable
immediate deletion of specific data categories when required for security or
compliance reasons.
Data Localization Options for Regulated Industries
Regional deployment options ensure data remains within specific geographic
boundaries to comply with data sovereignty requirements. Industry-specific
configurations implement additional controls for healthcare, financial, and
government data with strict localization needs. Transparent documentation
specifies data storage locations and transfer mechanisms for all platform
services.
User Control Over Personal Data Usage
Self-service portals allow users to view, export, and manage personal data
stored within the platform. Granular permission settings enable users to
authorize specific data uses while restricting others. Consent management
tracks user preferences with immutable audit logs of all preference changes
and data access events.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"OptimalAgents.ai","colors":{"primary":"#6a7eff","light":"#07C983","dark":"#15803D"},"logo":{"light":"https://mintcdn.com/optimalagents/DdMc4qMPFx8hWwJh/logo/logo.png?fit=max\u0026auto=format\u0026n=DdMc4qMPFx8hWwJh\u0026q=85\u0026s=3860a681b2cde266f16698e879fe9835","dark":"https://mintcdn.com/optimalagents/DdMc4qMPFx8hWwJh/logo/logo-nobg.png?fit=max\u0026auto=format\u0026n=DdMc4qMPFx8hWwJh\u0026q=85\u0026s=453b48fba9b15079ff4cb40d4de262ca"},"favicon":"/favicon.ico","navbar":{"links":[{"label":"Support","href":"mailto:[email protected]"}],"primary":{"type":"button","label":"Dashboard","href":"https://optimalagents.ai/dashboard"}},"footer":{"socials":{"x":"https://x.com/OptimalAgentsAI","linkedin":"https://www.linkedin.com/company/optimalagents/","facebook":"https://www.facebook.com/people/OptimalAgentsai/61573068792022/"}},"navigation":{"global":{"anchors":[{"anchor":"Documentation","icon":"book-open-cover","href":"https://docs.optimalagents.ai"},{"anchor":"Login","icon":"user","href":"https://optimalagents.ai/login"},{"anchor":"Dashboard","icon":"box","href":"https://optimalagents.ai/dashboard"}]},"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"optimalagents","hasAudioNarration":false,"actualSubdomain":"optimalagents","customDomains":["docs.optimalagents.ai"],"gitSource":{"type":"github","owner":"anand-optimalagents","repo":"docs","deployBranch":"main","contentDirectory":"","isPrivate":false,"mountPath":"","label":""},"chroma":{"liveDeploymentHistoryId":"6a20c80480f8b2ad207ac9c4","collectionId":"4187cea0-dd24-4598-9fd0-3b10bbe24957","schemaVersion":"v2"},"feedback":{"issues":false,"edits":false,"thumbs":false},"entitlements":{},"buildId":"6a20c80480f8b2ad207ac9c4:success","clientVersion":"0.0.4044","searchFilterCounts":[{"language":"default","tag":"Guides","count":12},{"language":"default","tag":"Agents","count":8},{"language":"default","tag":"Get Started","count":4}]},"assistantConfig":{},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"byok-sep-25","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"vite-origin","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-updated-9-15","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":false},"customCss":[],"page":{"pagePath":"agent/evaluation","slug":"/agent/evaluation","pageMetadata":{"title":"Evaluation","description":null,"href":"/agent/evaluation"},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={code:`code`,p:`p`,..._provideComponents(),...props.components},{Accordion,Heading}=_components;if(!Accordion)_missingMdxReference(`Accordion`,true);if(!Heading)_missingMdxReference(`Heading`,true);return _jsxs(_Fragment,{children:[_jsx(Heading,{level:`2`,id:`1-agent-review-process`,children:`1. Agent Review Process`}),`\n`,_jsx(Accordion,{title:`Initial screening criteria for marketplace listing`,id:`initial-screening-criteria-for-marketplace-listing`,children:_jsx(_components.p,{children:`All submitted agents undergo automated \u0026 manual analysis checking for code\nvulnerabilities, prohibited functionality, and adherence to API usage\nguidelines. Documentation completeness is evaluated against standardized\nrequirements including clear purpose statements, input/output specifications,\nand limitation disclosures. Agents must demonstrate basic functionality and\nreliability through preliminary testing before advancing to comprehensive\nreview stages.`})}),`\n`,_jsx(Accordion,{title:`Performance testing benchmarks`,id:`performance-testing-benchmarks`,children:_jsx(_components.p,{children:`Agents are evaluated against domain-specific test suites designed to measure\naccuracy, response time, and resilience under various load conditions. Stress\ntesting simulates high-volume usage patterns to identify potential failure\npoints and performance degradation scenarios. Comparative analysis positions\neach agent against existing marketplace offerings with similar functionality\nto establish relative performance expectations.`})}),`\n`,_jsx(Accordion,{title:`Ethical and safety evaluation procedures`,id:`ethical-and-safety-evaluation-procedures`,children:_jsx(_components.p,{children:`Multi-stage safety evaluations probe for harmful outputs, testing agent\nresponses to adversarial inputs and edge cases. Fairness assessments measure\nperformance across demographic groups to identify potential bias in agent\nresponses or recommendations. Independent review panels evaluate high-risk\nagents with additional scrutiny for applications in sensitive domains like\nhealthcare, finance, and legal services.`})}),`\n`,_jsx(Accordion,{title:`Response time SLAs for review submissions`,id:`response-time-slas-for-review-submissions`,children:_jsx(_components.p,{children:`Initial screening results are provided within 24 hours of submission, with\ndetailed technical feedback on any failed criteria. Standard review processes\nfor low and medium-risk agents are completed within 5 business days, providing\ncomprehensive evaluation reports. High-risk or complex agents requiring\nspecialized review may take up to 10 business days, with progress updates\nprovided at predetermined milestones.`})}),`\n`,_jsx(Accordion,{title:`Appeal process for rejected agents`,id:`appeal-process-for-rejected-agents`,children:_jsxs(_components.p,{children:[`Developers can submit appeals through a structured process that requires\naddressing specific rejection reasons with evidence of remediation via emails\nto `,_jsx(_components.code,{children:`[email protected]`}),` . Appeals are reviewed by different evaluators than\nthose involved in the initial rejection decision to ensure fresh perspective.\nExpedited re-review options are available for agents that have addressed all\nidentified issues, with clear guidelines for qualifying for this accelerated\npath.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`2-content-guidelines`,children:`2. Content Guidelines`}),`\n`,` `,`\n`,_jsx(Accordion,{title:`Prohibited Use Cases and Content Restrictions`,id:`prohibited-use-cases-and-content-restrictions`,children:_jsx(_components.p,{children:`The platform explicitly prohibits agents designed for illegal activities,\nharassment, discrimination, or the generation of misleading content.\nRestrictions cover agents that could enable unauthorized access to systems,\ncircumvent security measures, or generate spam content. Detailed examples\nclarify boundaries between acceptable and prohibited use cases, with regular\nupdates reflecting emerging risks and regulatory changes.`})}),`\n`,_jsx(Accordion,{title:`Ethical AI Principles and Requirements`,id:`ethical-ai-principles-and-requirements`,children:_jsx(_components.p,{children:`All agents must adhere to core principles including transparency in\ncapabilities, respect for user autonomy, and fairness across demographic\ngroups. Output traceability requirements ensure users can understand the basis\nfor agent recommendations and decisions, especially in high-stakes domains.\nDevelopers must implement appropriate safeguards proportional to the potential\nrisks associated with their agent’s functionality and intended use cases.`})}),`\n`,_jsx(Accordion,{title:`Compliance Requirements by Region and Industry`,id:`compliance-requirements-by-region-and-industry`,children:_jsx(_components.p,{children:`Region-specific requirements address varying data protection regulations\nincluding GDPR, CCPA, and emerging privacy frameworks. Industry-specific\ncompliance modules enforce additional safeguards for regulated sectors such as\nhealthcare (HIPAA), finance (PCI-DSS), and education (FERPA, COPPA). The\nplatform provides compliance verification tools that help developers ensure\ntheir agents meet all applicable requirements for their target markets.`})}),`\n`,_jsx(Accordion,{title:`Content Rating System`,id:`content-rating-system`,children:_jsx(_components.p,{children:`A tiered rating system classifies agents based on content sensitivity,\ncomplexity of outputs, and required user expertise. Professional-only\ndesignations restrict certain agents to verified business users in appropriate\ndomains like legal, medical, or financial services. Clear rating display\nrequirements ensure users understand potential content sensitivity before\ninteraction with any agent in the marketplace.`})}),`\n`,_jsx(Accordion,{title:`Enforcement Procedures for Violations`,id:`enforcement-procedures-for-violations`,children:_jsx(_components.p,{children:`Progressive enforcement mechanisms begin with warnings and remediation periods\nfor minor or first-time violations. Serious violations trigger immediate agent\nsuspension pending investigation and developer response. Repeat violations\nlead to escalating consequences including extended review periods for future\nsubmissions and potential developer account restrictions. All enforcement\nactions include specific violation details and clear remediation requirements.`})}),`\n`,_jsx(Heading,{level:`2`,id:`3-safety-and-security`,children:`3. Safety and Security`}),`\n`,_jsx(Accordion,{title:`Security Vulnerability Assessment Methodology`,id:`security-vulnerability-assessment-methodology`,children:_jsx(_components.p,{children:`The platform implements a comprehensive STRIDE threat modeling approach\n(Spoofing, Tampering, Repudiation, Information disclosure, Denial of service,\nElevation of privilege) for all components. Automated static and dynamic code\nanalysis tools scan agent code and configurations during submission and after\nany updates. Third-party dependency scanning identifies known vulnerabilities\nin libraries and frameworks used by agents, with automated notifications when\ncritical updates are required.`})}),`\n`,_jsx(Accordion,{title:`Performance Reliability Metrics`,id:`performance-reliability-metrics`,children:_jsx(_components.p,{children:`Reliability is measured through multiple dimensions including uptime\npercentage, mean time between failures, and response time consistency under\nvarying loads. Chaos engineering practices systematically introduce controlled\nfailures to verify system resilience and recovery mechanisms. Performance\ndegradation tracking identifies subtle issues before they impact user\nexperience, with automated alerts when metrics fall below defined thresholds.`})}),`\n`,_jsx(Accordion,{title:`Bias and Fairness Testing Protocols`,id:`bias-and-fairness-testing-protocols`,children:_jsx(_components.p,{children:`Agents undergo systematic testing against demographically diverse datasets to\nidentify performance variations across different user groups. Standard\nfairness metrics including equalized odds, demographic parity, and\ncounterfactual fairness are calculated for each agent’s outputs. Regular\nred-team exercises challenge agents with adversarial inputs designed to elicit\npotentially biased or harmful responses.`})}),`\n`,_jsx(Accordion,{title:`Regular Security Audits and Penetration Testing`,id:`regular-security-audits-and-penetration-testing`,children:_jsx(_components.p,{children:`Independent security audits are conducted quarterly by certified third-party\nspecialists examining infrastructure, code, and operational procedures.\nContinuous automated scanning supplements formal audits with daily\nvulnerability checks and configuration assessments. Bug bounty programs\nincentivize responsible disclosure of security issues from external\nresearchers and ethical hackers.`})}),`\n`,_jsx(Accordion,{title:`Compliance with Industry Standards`,id:`compliance-with-industry-standards`,children:_jsx(_components.p,{children:`The platform maintains SOC 2 Type II certification with annual audits\nverifying controls for security, availability, and confidentiality. ISO 27001\ncertification ensures the information security management system meets\ninternational standards for best practices. Additional certifications for\nspecialized industries include HIPAA compliance for healthcare and PCI-DSS for\npayment processing when applicable.`})}),`\n`,_jsx(Heading,{level:`2`,id:`4-personal-data-handling`,children:`4. Personal Data Handling`}),`\n`,_jsx(Accordion,{title:`Data Minimization Principles`,id:`data-minimization-principles`,children:_jsx(_components.p,{children:`Agents should be designed to operate with the minimum data necessary to\nfulfill their function, with clear documentation of required data fields.\nAutomated data classification identifies and flags potential collection of\nexcessive personal information during the review process. Just-in-time data\ncollection practices ensure information is only gathered when needed rather\nthan preemptively stored.`})}),`\n`,_jsx(Accordion,{title:`Anonymization Techniques for Sensitive Information`,id:`anonymization-techniques-for-sensitive-information`,children:_jsx(_components.p,{children:`Multiple anonymization methods including tokenization, hashing, and\nperturbation are applied based on data sensitivity and use case requirements.\nDifferential privacy techniques add calibrated noise to aggregate data while\npreserving analytical utility for training and improvement. Pseudonymization\nsystems allow for functional operations while removing direct identifiers from\noperational datasets.`})}),`\n`,_jsx(Accordion,{title:`Retention and Deletion Policies`,id:`retention-and-deletion-policies`,children:_jsx(_components.p,{children:`Granular data retention policies specify maximum storage durations based on\ndata type, purpose, and regulatory requirements. Automated deletion processes\npermanently remove expired data according to schedule, with cryptographic\nverification of complete removal. Emergency purge capabilities enable\nimmediate deletion of specific data categories when required for security or\ncompliance reasons.`})}),`\n`,_jsx(Accordion,{title:`Data Localization Options for Regulated Industries`,id:`data-localization-options-for-regulated-industries`,children:_jsx(_components.p,{children:`Regional deployment options ensure data remains within specific geographic\nboundaries to comply with data sovereignty requirements. Industry-specific\nconfigurations implement additional controls for healthcare, financial, and\ngovernment data with strict localization needs. Transparent documentation\nspecifies data storage locations and transfer mechanisms for all platform\nservices.`})}),`\n`,_jsx(Accordion,{title:`User Control Over Personal Data Usage`,id:`user-control-over-personal-data-usage`,children:_jsx(_components.p,{children:`Self-service portals allow users to view, export, and manage personal data\nstored within the platform. Granular permission settings enable users to\nauthorize specific data uses while restricting others. Consent management\ntracks user preferences with immutable audit logs of all preference changes\nand data access events.`})})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Evaluation","description":null,"href":"/agent/evaluation"}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[{"title":"1. Agent Review Process","slug":"1-agent-review-process","depth":2,"children":[]},{"title":"2. Content Guidelines","slug":"2-content-guidelines","depth":2,"children":[]},{"title":"3. Safety and Security","slug":"3-safety-and-security","depth":2,"children":[]},{"title":"4. Personal Data Handling","slug":"4-personal-data-handling","depth":2,"children":[]}],"codeExamples":{}},"jsLinks":[],"subdomain":"optimalagents","siteName":"OptimalAgents.ai","title":"Evaluation - OptimalAgents.ai","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-01-07T07:40:55.398Z","originalFileLocation":"agent/evaluation.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"application-name\" content=\"OptimalAgents.ai\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Evaluation - OptimalAgents.ai\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"OptimalAgents.ai\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.optimalagents.ai/agent/evaluation\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://optimalagents.mintlify.app/_mintlify/api/og/v2?division=Agents\u0026amp;title=Evaluation\u0026amp;theme=9f24c99612566630613783aa\u0026amp;signature=6bddaebbd543445a2fea00f257dc0a1ae13dd3f6faee673bb04e27e821f73ce4\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Evaluation - OptimalAgents.ai\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://optimalagents.mintlify.app/_mintlify/api/og/v2?division=Agents\u0026amp;title=Evaluation\u0026amp;theme=9f24c99612566630613783aa\u0026amp;signature=6bddaebbd543445a2fea00f257dc0a1ae13dd3f6faee673bb04e27e821f73ce4\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/optimalagents/CsCQb-IlgsaXtTuk/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"OptimalAgents.ai\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#6a7eff\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.optimalagents.ai/agent/evaluation\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/agent/evaluation.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.optimalagents.ai/#organization\",\"name\":\"OptimalAgents.ai\",\"url\":\"https://docs.optimalagents.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/optimalagents/DdMc4qMPFx8hWwJh/logo/logo.png?fit=max\u0026auto=format\u0026n=DdMc4qMPFx8hWwJh\u0026q=85\u0026s=3860a681b2cde266f16698e879fe9835\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.optimalagents.ai#website\",\"name\":\"OptimalAgents.ai\",\"url\":\"https://docs.optimalagents.ai\",\"publisher\":{\"@id\":\"https://docs.optimalagents.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.optimalagents.ai/agent/evaluation#webpage\",\"url\":\"https://docs.optimalagents.ai/agent/evaluation\",\"name\":\"Evaluation\",\"dateModified\":\"2026-01-07T07:40:55.398Z\",\"isPartOf\":{\"@id\":\"https://docs.optimalagents.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.optimalagents.ai/agent/evaluation#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.optimalagents.ai/agent/evaluation#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Agents\",\"item\":\"https://docs.optimalagents.ai/agent/overview\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Evaluation\",\"item\":\"https://docs.optimalagents.ai/agent/evaluation\"}]},{\"@type\":[\"Article\",\"TechArticle\"],\"@id\":\"https://docs.optimalagents.ai/agent/evaluation#article\",\"headline\":\"Evaluation\",\"name\":\"Evaluation\",\"url\":\"https://docs.optimalagents.ai/agent/evaluation\",\"mainEntityOfPage\":{\"@id\":\"https://docs.optimalagents.ai/agent/evaluation#webpage\"},\"dateModified\":\"2026-01-07T07:40:55.398Z\",\"publisher\":{\"@id\":\"https://docs.optimalagents.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.optimalagents.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"OptimalAgents.ai\",\"creator\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","siteName":"OptimalAgents.ai","nav":{"global":{"anchors":[{"anchor":"Documentation","icon":"book-open-cover","href":"https://docs.optimalagents.ai"},{"anchor":"Login","icon":"user","href":"https://optimalagents.ai/login"},{"anchor":"Dashboard","icon":"box","href":"https://optimalagents.ai/dashboard"}]},"tabs":[{"tab":"Guides","groups":[{"group":"Get Started","pages":[{"title":null,"href":"/introduction"},{"title":"User Guide","href":"/userguide"},{"title":"Account Management","href":"/account"},{"title":"Credits","href":"/credits"}]},{"group":"Agents","pages":[{"title":"Overview","href":"/agent/overview"},{"title":"Development","href":"/agent/development"},{"title":"Secrets","href":"/agent/secrets"},{"title":"Upload Agent","href":"/agent/upload"},{"title":"LLM","description":null,"href":"/agent/LLM"},{"title":"Evaluation","href":"/agent/evaluation"},{"title":"Usage","description":null,"href":"/agent/usage"},{"title":"Financials","href":"/agent/financials"}]}]}]},"basePath":"","title":"Evaluation - OptimalAgents.ai","buildId":"dpl_DeHjVRGfFnhYQwHnfC2pjeXXv8h9","deploymentId":"dpl_DeHjVRGfFnhYQwHnfC2pjeXXv8h9","dynamics":[],"chunks":[]}