{"status":"BENCHMARK_FRAMEWORK_ACTIVE","publicSuperiorityClaimsAllowed":false,"reason":"External side-by-side measurements are not yet complete.","methodology":{"version":"1.2","principle":"No superiority claim without reproducible evidence.","metrics":["p50/p95 latency","task success rate","valid structured-output rate","source/citation completeness where applicable","freshness/date coverage where applicable","failure and retry rate","downstream calls required to finish the task","cost per successful task","integration steps/time"],"qualityRubric":{"completeness":25,"correctness":25,"structure":20,"freshnessOrEvidence":20,"integrationEase":10},"testRules":["Use the same input set for Nexus and each compared alternative.","Use at least 50 representative tasks before publishing comparative superiority claims.","Run warm and cold tests separately when caching can affect latency.","Record failures, timeouts, retries and malformed outputs; do not discard them.","Publish sample size, test date, configuration and scoring rubric.","Keep vendor-published benchmark claims separate from IMPOCOR-AI reproduced measurements.","Do not compare unlike services only by per-call price.","Prefer cost per successful completed task over sticker price."],"plannedSuites":[{"id":"json-repair","cases":200,"goal":"repair common malformed AI JSON and validate required fields"},{"id":"web-clean","cases":100,"goal":"convert supplied HTML/text to compact agent-ready output"},{"id":"document-intelligence","cases":100,"goal":"extract dates, money, obligations and actions from supplied text"},{"id":"fact-evidence","cases":100,"goal":"score supplied evidence metadata for freshness and coverage"},{"id":"api-normalization","cases":100,"goal":"normalize heterogeneous API payloads into a stable schema"}]},"competitorReference":[{"vendor":"Parallel","searchUsdPer1k":"1 Turbo; 5 Basic/Advanced","extractUsdPer1k":"1","publishedLatency":"~200ms Turbo; ~1s Basic; ~3s Advanced","security":"SOC 2 shown on pricing page","source":"https://parallel.ai/pricing"},{"vendor":"Exa","searchUsdPer1k":"7","extractUsdPer1k":"1 per 1k content pages","publishedLatency":"180ms-1s configurable","security":"enterprise security/SLA options","source":"https://exa.ai/pricing?tab=api"},{"vendor":"Tavily","searchUsdPer1k":"5-8 basic equivalent depending plan; advanced uses 2 credits","extractUsdPer1k":"credit-based; failed URL extractions not charged","publishedLatency":"varies by search depth","security":"SOC 2 and zero data retention stated in docs","source":"https://docs.tavily.com/documentation/api-credits"},{"vendor":"Bright Data MCP","searchUsdPer1k":"1-1.5 per 1k results","extractUsdPer1k":"1-1.5 per 1k results","publishedLatency":"not standardized on pricing page","security":"enterprise SLA and compliance options","source":"https://brightdata.com/pricing/mcp-server"},{"vendor":"Browserbase","searchUsdPer1k":"7 after included quota","extractUsdPer1k":"4 without proxies; 7 with proxies","publishedLatency":"not standardized on pricing page","security":"production browser infrastructure and enterprise controls","source":"https://www.browserbase.com/pricing"}],"trustScorecard":{"rule":"Describe implemented controls accurately; never imply an external certification that has not been obtained.","operatingStandard":"docs/NEXUS_TRUST_OPERATIONS_STANDARD.md","dimensions":[{"name":"Payment integrity","status":"implemented","evidence":"Server-side LIVE Stripe entitlement verification."},{"name":"Auditability","status":"implemented","evidence":"API gateway audit middleware and audit repository."},{"name":"Rate limiting","status":"implemented","evidence":"Gateway rate-limit middleware plus tests."},{"name":"Project isolation","status":"implemented","evidence":"Supabase RLS/project-isolation security tests."},{"name":"Least privilege","status":"partial","evidence":"Scoped agent/tool architecture and credential-operations controls exist; per-product provider credential/network scope review remains in progress.","nextAction":"Complete and retain a provider-by-provider privilege-scope review."},{"name":"Secret rotation","status":"partial","evidence":"Environment/secret-manager based secrets and a rotation runbook now exist; a completed production rotation evidence record is still required.","nextAction":"Perform and record a production secret rotation without exposing secret values."},{"name":"Data minimization","status":"implemented","evidence":"Nexus sales telemetry stores product/event/payment metadata rather than raw customer working payloads; operating standard prohibits copying prompts, documents, API payloads or secrets into analytics merely for telemetry."},{"name":"Retention policy","status":"partial","evidence":"A technical retention standard is now defined; definitive public retention periods still require owner/legal approval and corresponding enforcement where applicable.","nextAction":"Approve final customer-facing retention periods and implement any required expiry/archive jobs."},{"name":"Uptime/SLO history","status":"partial","evidence":"Runtime health and Nexus telemetry-health endpoints exist; long-term production availability history still needs to accumulate before an uptime percentage is published.","nextAction":"Accumulate dated production measurements before publishing an SLA/SLO percentage."},{"name":"Incident response","status":"partial","evidence":"Autonomous recovery/circuit-breaker architecture and a formal incident lifecycle/severity standard now exist; an exercised tabletop or live drill evidence record is still needed.","nextAction":"Run and retain evidence from an incident-response tabletop/drill."},{"name":"External attestation","status":"external_action_needed","evidence":"SOC 2, ISO 27001, independent penetration-test attestation or similar external assurance has not been claimed.","nextAction":"Engage an independent assessor only when commercially justified."}]},"nextEvidenceNeeded":["Run Nexus suites and retain raw results.","Run identical comparable suites against named providers where API access permits.","Calculate p50/p95, success rate, quality score and cost per successful task.","Publish only reproducible results and date-stamp every price comparison.","Complete the remaining Trust Scorecard operational evidence actions before upgrading partial controls to implemented."]}