Skip to main content

Resource

DEMO ADMIN CONSOLE

Unified operations view with complete chatbot analytics, website health, API reliability, and compliance posture in one command surface.

Group

KPIs

Executive KPIs for platform performance, service outcomes, and delivery posture.

+0.06%

API Availability

99.98%

-114ms

P95 Latency

812ms

-12

Open Compliance Issues

54

+2.7%

AI Answer Quality

91.4%

-3

Critical Alerts

2

-7m

Mean Time To Resolve

19m

Group

AI / Conversation Observability

Conversation quality, retrieval signals, policy guardrails, and assistant operations health.

Conversation Analytics

Full chatbot metrics set: usage, quality, retrieval, feedback, and failures.

Demo metrics preview

Total Conversations

Today120
Week840
Month3,600

Active Users

Now7
DAU72
WAU294
MAU900
Returning42%
New58%

Messages Sent

User3,960
Assistant4,140
Total8,100

Engagement

Avg conversation length6.4 msgs
Avg session duration5.8 min

Avg Response Latency

P95929 ms
Serieschat_router_latency

Conversation Success

Resolved12
Abandoned431
Success rate2.7%

Device Breakdown

Mobile58%
Desktop39%
Other3%

Peak Usage Times

9-11am210
12-2pm260
3-5pm190

Top Entry Pages

/report-issue312
/payments248
/utilities210
/contact185

Model Usage

gpt-4.1740
gpt-4.1-mini420
gpt-4o-mini210

Tokens & Cost

Input tokens1,872,000
Output tokens2,304,000
Cost per convo$0.04
Total$144.00

Quality & Retrieval

Fallback / hallucination4.2%
Confidence score0.92
Missing knowledge50 (3.4%)
Retrieval success95.8%

Tool Call Frequency

search420
summarize240
form_fill110

Top Documents Cited

Services2
Departments2
Utilities2
Payments2

Most Searched Topics

permits455
payments368
report issue359
contact181

Citation Engagement

Clicks1,108
Impressions6,245
Click rate17.7%

Index Freshness

Last ingestMar 8, 2026 08:41
Age (hrs)1.1
Docs ingested4,218
Failed docs9
Indexcity-guide-v3

Failed Responses

Count22
Rate0.9%

Errors By Type

timeout9
upstream_5037
empty_context6

User Feedback Ratings

Helpful1,248
Not helpful126
Flagged14

Escalations To Human

Count168
Rate4.7%

Guardrail Triggers

Total37
policy_limit14
safety_block11
pii_block12

Rate Limit Events

Count6
Rate0.2%

Top Users

resident_104284
resident_55965
resident_20362

Top Organizations

Palo Verde2,102
CivIQ Demo1,080
Austin Pilot418

AI Admin Command Center

Est. 30-day window

Executive KPIs

Deflected

98%

Hours Saved

275

After-Hours

100%

Cost / Interaction

AI $0.45 vs Call $6.25

-93% vs call center

Quality & Guardrails

Escalations

98

3.5% of questions

Refusals

113

4.04% of questions

Flagged Answers

1

0.04% of questions

Top Policy Trigger

185

answer mismatched question type

Top Policy Trigger Reasons

  • answer mismatched question type185
  • numeric sensitive policy103
  • legal or dispute98

Group

Platform Observability

Website reliability, API health, latency, traffic mix, and infrastructure dependencies.

Website Health + Reliability

Site traffic, latency, runtime errors, lambda dependencies, and OpenSearch posture.

Last refresh: Mar 8, 2026 13:09 UTC

Site Hits (Invocations)

Current window18,204
Window60 minutes

Resident Questions

30 days3,412
Daily avg114

Router Errors

Count28
Error rate0.15%

Degraded Downstream

Lambda functions1
OpenSearchhealthy

Top Runtime Errors

timeout11
upstream_5039
vector_query_fail6

OpenSearch Health

Clustergreen
Nodes3
Active shards62
Unassigned0

Latency Over Time

12 points • min 493ms • max 644ms

Traffic Mix

  • Payments32%
  • Permits24%
  • Utilities19%
  • 311 Requests15%
  • Other10%

Downstream Lambda Status

  • chat-router

    State: Active • Update: Successful

    healthy

  • knowledge-fetch

    State: Active • Update: Successful

    healthy

  • site-extraction-runner

    State: Active • Update: InProgress

    warming new index segment

  • wcag-scan-executor

    State: Active • Update: Successful

    healthy

API Up / Down Board

APIStatusUptimeP95Err%
Chat Router APIup99.99%734ms0.12%
Knowledge APIup99.97%641ms0.09%
News Feed APIdegraded99.88%1.38s0.71%
Compliance APIup99.96%882ms0.21%
Dispatch APIup99.95%947ms0.31%

Channel Health (API Section)

Live health layout from admin console: chat router, downstream lambdas, and OpenSearch.

Chat Router

Avg latency: 929 ms

Error rate: 0.15%

18,204 invocations / 28 errors (last 60m)

12 points • min 493 ms • max 644 ms

Downstream Lambdas

chat-router

State: Active • Update: Successful

healthy

knowledge-fetch

State: Active • Update: Successful

healthy

site-extraction-runner

State: Active • Update: InProgress

warming new index segment

wcag-scan-executor

State: Active • Update: Successful

healthy

OpenSearch

Cluster status: green

Nodes: 3

Active shards: 62

Unassigned shards: 0

API Endpoint Health Snapshot

Endpoint status rollup per configured API base.

EndpointStatusLatencyLast Check
GET /admin/assistant-statushealthy214 ms09:12
GET /admin/channel-healthhealthy241 ms09:12
GET /admin/chat-analyticsdegraded876 ms09:11
POST /admin/accessibility/scanhealthy312 ms09:10
GET /admin/knowledge-freshnesshealthy193 ms09:10

Last refreshed: Mar 8, 2026 13:09 UTC

Group

Alarms

Alerting rules, severity states, and recent incident activity.

Alarm Center

Alarm sets mirrored from admin console alert groups for incident and quality monitoring.

Active alarms: 1Monitoring: 1Resolved today: 1

Alarm Rules

Critical Alarms

criticalactive

Chat router error rate > 2.5% for 10m

Last triggered: Mar 8, 2026 09:11 UTC • Owner: SRE on-call

Quality Regressions

highmonitoring

Confidence score < 0.82 or fallback > 6%

Last triggered: Mar 8, 2026 08:43 UTC • Owner: AI operations

Daily Summary

mediumresolved

Scheduled daily digest of unresolved incidents

Last triggered: Mar 8, 2026 00:05 UTC • Owner: Ops reporting

Recent Alarm Activity

  • 09:11

    Critical alarm opened

    Error budget burn crossed threshold in /chat.

  • 09:18

    Escalation routed

    Assigned to SRE on-call with incident bridge link.

  • 09:34

    Mitigation applied

    Read-only fallback enabled while dependency recovered.

  • 09:47

    Quality monitor stable

    Fallback and confidence metrics returned to baseline.

Group

Compliance Observability

WCAG 2.1 AA posture, remediation workflow, and governance reporting.

Compliance Dashboard

WCAG 2.1 AA operations center with severity analytics, remediation workflow, governance reporting, and evidence tracking.

Tenant: primiq

Overall WCAG Score

91

Pages Scanned

142

Pages Passing

128

Total Issues

54

Critical Issues

4

Last Scan

Latest

Mar 8, 2026 13:02 UTC

Status

At Risk

Trend

+2 score vs previous scan

Severity Breakdown

Critical4
Serious17
Moderate21
Minor12

WCAG Principles

Perceivable

19
  • Missing alt text
  • Low contrast
  • Missing captions
  • Missing transcripts

Operable

14
  • Keyboard traps
  • Missing focus indicators
  • No skip link
  • Hover-only interactions

Understandable

11
  • Form errors not described
  • Missing labels
  • Inconsistent navigation
  • Missing language declaration

Robust

10
  • Invalid ARIA attributes
  • Landmark misuse
  • Invalid HTML structure
  • Screen reader compatibility issues

Automated WCAG Rule Checks

RuleCategorySeverityPagesStatusSuggested Fix
Images missing alt textPerceivableSerious11FailingAdd descriptive alt text or mark decorative images with empty alt.
Decorative images not marked correctlyPerceivableModerate7At RiskUse empty alt and aria-hidden for purely decorative media.
Empty linksOperableCritical3FailingRemove empty anchor tags or provide meaningful labels.
Links without discernible textOperableSerious6FailingProvide visible text or aria-label for icon-only links.
Missing H1UnderstandableModerate5At RiskEnsure each route contains one primary H1.
Incorrect heading orderUnderstandableModerate8At RiskNormalize heading levels to maintain semantic order.
Form inputs missing labelsUnderstandableSerious9FailingBind labels via for/id and descriptive field text.
Placeholder used instead of labelUnderstandableModerate4Needs ReviewKeep placeholder supplemental and add persistent labels.
Invalid ARIA usageRobustSerious6FailingRemove unsupported aria-* attributes and values.
Missing landmarksRobustModerate5At RiskAdd main/nav/header/footer landmarks for page structure.
Missing skip navigationOperableSerious4FailingInclude skip-to-content link as first focusable element.
Focus visibility failuresOperableCritical2FailingRestore focus indicators with accessible contrast levels.
Table header issuesRobustModerate3Needs ReviewAssign th headers and scope for data relationships.
Missing lang attributeUnderstandableMinor2At RiskSet page language at the document root.
Button name issuesOperableSerious5FailingProvide accessible button names for icon/action controls.
Dialog accessibility issuesRobustCritical2FailingSet role=dialog, accessible name, focus trap, and escape handling.

Color & Contrast

Text Contrast Failures

13

Link Contrast Failures

8

Button Contrast Failures

6

Background Contrast Issues

5

Normal text threshold: 4.5:1 • Large text threshold: 3:1

Keyboard Accessibility

Keyboard Accessible Pages

122

Keyboard Failures

20

Focus Order Issues

11

Focus Visibility Issues

7

Keyboard trap detections: 2

Screen Reader & Structure

Landmark Usage

89%

Controls With Accessible Names

93%

ARIA Validation Failures

9

Screen Reader Compatibility

90%

Dialog role and naming issues: 2

Forms Accessibility

Labels Connected

92%

Required Fields Identified

95%

Accessible Validation Errors

88%

Grouped Controls Labeled

91%

Form completion barriers: 12

Media Accessibility

Video Captions

86%

Audio Transcripts

79%

Autoplay Issues

1

Media Control Issues

4

Document Accessibility

Tagged PDFs

82%

Document Titles Present

94%

Heading Structure

88%

Alt Text In Documents

80%

Accessible export status: Partial - remediation in progress

Page-Level Compliance

URL / PageScoreIssuesSeverity SummaryStatusLast Scanned
/accessibility7412Critical 2 • Serious 5 • Other 5Non-CompliantMar 8, 2026 13:02 UTC
/services/permits828Critical 1 • Serious 3 • Other 4Non-CompliantMar 8, 2026 13:02 UTC
/payments847Critical 0 • Serious 3 • Other 4At RiskMar 8, 2026 13:02 UTC
/departments866Critical 0 • Serious 2 • Other 4Needs ReviewMar 8, 2026 13:02 UTC
/utilities885Critical 1 • Serious 1 • Other 3Non-CompliantMar 8, 2026 13:02 UTC

Issue Tracker / Remediation Queue

Issue IDWCAG CriterionPage URLSeverityOwnerStatusDateSuggested Remediation
WCAG-18422.4.7 Focus Visible/utilities/paymentsCriticalFrontend PlatformIn ProgressMar 9, 2026Restore visible focus ring for payment method controls.
WCAG-18381.1.1 Non-text Content/services/permitsSeriousContent OpsOpenMar 9, 2026Provide meaningful alt text for permit checklist diagrams.
WCAG-18293.3.1 Error Identification/forms/report-issueSeriousForms TeamNeeds Manual ReviewMar 8, 2026Expose validation error summary with field-level references.
WCAG-18144.1.2 Name, Role, Value/departments/public-worksModerateDesign SystemResolvedMar 7, 2026Correct aria-expanded state and button name semantics.
WCAG-18061.4.3 Contrast (Minimum)/services/permitsModerateBrand + UXAccepted RiskMar 6, 2026Legacy PDF render fallback accepted until Q2 template migration.

Scan Score Over Time

Last successful: Mar 8, 2026 13:02 UTC

Open Issues Over Time

Last failed: Mar 2, 2026 03:20 UTC

Resolved Issues Over Time

Remediation throughput weekly

Compliance Evidence & Audit

  • scan completed

    wcag-scan-executor: Weekly scan finished with 54 open violations.

    Updated Mar 8, 2026 13:02 UTC

  • manual review saved

    compliance.lead: Keyboard flow checklist updated for /payments and /services/permits.

    Updated Mar 8, 2026 12:41 UTC

  • conformance export

    compliance.ops: PDF conformance statement generated and attached to audit workspace.

    Updated Mar 8, 2026 11:18 UTC

  • rescan requested

    platform.engineer: Triggered targeted re-scan for /accessibility route.

    Updated Mar 8, 2026 10:52 UTC

ADA / Title II Governance

WCAG 2.1 AA Readiness

WCAG 2.1 AA - At Risk

Department Coverage

87%

Remediation Progress

74%

Public Service Coverage

92%

Deadline status: On track for April readiness gate

Legal exposure: Moderate - concentrated in Utilities and Public Works

Department / Service Compliance

DepartmentScoreIssuesRiskLast Scan
Utilities8318HighMar 8
Permits8613ModerateMar 8
Police926LowMar 7
Parks899ModerateMar 7
Public Works8216HighMar 8

AI Remediation Suggestions

  • Payment form submit button has no accessible name

    Set explicit aria-label from visible intent label and remove hidden duplicate icon text.

    Button: aria-label='Submit utility payment' + icon aria-hidden=true

    Recommendation Confidence: High
  • Permit checklist PDFs missing semantic heading structure

    Regenerate PDFs using tagged export profile and mapped heading styles.

    Export preset: tagged PDF + heading mapping + alt text retention

    Recommendation Confidence: Medium
  • Keyboard trap in date picker modal

    Add escape close, focus return target, and tab loop guards.

    Dialog trap util + onClose restoreFocus('#date-input')

    Recommendation Confidence: High

Automated Fix Tracking

AI Fixed

37

Manual Fixed

52

Remaining

54

Fix Rate Over Time

Combined AI + manual fix closure rate

Risk / Executive Impact

Legal Risk Level

Moderate

Critical Blockers

4

Top Departments At Risk

Utilities, Public Works, Permits

Posture

Compliance posture is improving but high-impact resident services still need closure.

Public service impact: Permit and utility workflows still contain critical operable and contrast defects.

Critical Alarms

criticalactive

Quality Regressions

highmonitoring

Daily Summary

mediumresolved
Compliance operations note

This dashboard is designed as an accessibility operations layer: continuous scans, severity-driven remediation, evidence retention, and governance reporting for WCAG 2.1 AA and ADA Title II readiness.

Demo note

This page is intentionally not connected to live APIs and is designed as a public walkthrough surface that mirrors the admin console structure.