Analytics Dashboard
Monitor query performance, usage metrics, and system health with comprehensive analytics.
📊 Overview
The Analytics Dashboard provides insights into:
- Usage metrics: Query volume, user activity, agent usage
- Performance: Query execution time, success rates
- Cost tracking: API usage, token consumption
- User behavior: Popular queries, common patterns
📈 Key Metrics
Usage Statistics
📊 Total Queries
Number of queries executed
👥 Active Users
Users who ran queries
🤖 Agent Usage
Queries by agent type
📝 Template Runs
Scheduled and manual executions
Performance Metrics
⚡ Avg Response Time
Average query execution time
✅ Success Rate
Percentage of successful queries
⚠️ Error Rate
Failed query percentage
🔄 Retry Count
Queries requiring regeneration
Cost Metrics
💰 API Costs
Azure OpenAI usage costs
🎫 Token Usage
Input and output tokens consumed
📊 Cost per Query
Average cost per query
📈 Monthly Spend
Total spending by month
📊 Dashboard Views
1. Overview Dashboard
High-level summary of system health and usage:
- Total queries (today, week, month)
- Active users
- Average response time
- Success rate
- Recent query history
2. Usage Analytics
Detailed breakdown of how the system is being used:
- Query volume trends: Line chart over time
- Queries by agent: Bar chart showing agent usage
- Queries by user: Top users and their activity
- Queries by hour: Peak usage times
- Queries by day: Day-of-week patterns
3. Performance Dashboard
Monitor query performance and identify bottlenecks:
- Response time distribution: Histogram of query times
- Slowest queries: Identify optimization opportunities
- Error analysis: Common error types and frequencies
- Database performance: Query execution times by data source
4. Cost Analytics
Track AI API costs and optimize spending:
- Daily cost trends: Spending over time
- Cost by agent: Which agents cost the most
- Cost by user: User spending patterns
- Token usage: Input vs output tokens
- Projections: Estimated monthly costs
5. User Activity
Understand user behavior and adoption:
- User engagement: Active vs inactive users
- Query frequency: How often users query
- Popular queries: Most common questions
- Agent adoption: Which agents are most used
🎯 Query History
Features
- Full query log: Every query with timestamps
- User tracking: Who ran each query
- Agent context: Which agent was used
- Execution details: Response time, tokens, cost
- Results preview: See query outputs
- SQL inspection: View generated SQL
Filtering
Find specific queries quickly:
- Filter by date range
- Filter by user
- Filter by agent
- Filter by status (success/error)
- Search by query text
Export
Export query history for analysis:
- CSV export
- Excel export
- JSON API access
📊 Custom Reports
Available Reports
📈 Executive Summary
High-level KPIs for leadership
👥 User Adoption
User growth and engagement metrics
💰 Cost Analysis
Detailed spending breakdown
⚡ Performance Report
Query performance over time
Scheduling Reports
Automate report delivery:
- Select report type
- Configure parameters
- Set schedule (daily, weekly, monthly)
- Add recipients
- Choose format (PDF, Excel, Email)
🔍 Query Insights
Popular Queries
See what questions users ask most:
- Top 10 most frequent queries
- Trending queries (rising in popularity)
- Query templates derived from common patterns
Query Patterns
Understand how users interact with data:
- Time-based: Users focus on recent data
- Aggregation-heavy: Mostly summary queries
- Exploratory: Many ad-hoc queries
- Reporting: Scheduled template runs
⚙️ System Health
Monitoring
🟢 Database Status
Connection health for all data sources
🟢 API Status
Azure OpenAI service availability
🟢 Queue Health
Background job processing
🟢 Storage Status
File upload and cache health
Alerts
Get notified of issues:
- High error rate: More than 10% queries failing
- Slow performance: Average response time > 30s
- Cost spike: Unusual increase in API costs
- Database issues: Connection failures
📱 Mobile Dashboard
View key metrics on mobile devices:
- Responsive design
- Real-time updates
- Quick stats at a glance
- Query history access
🔐 Access Control
Dashboard Permissions
- Admin: Full access to all analytics
- Manager: Team-level analytics
- User: Personal query history only
Data Privacy
- Query results are not stored (only metadata)
- PII is excluded from analytics
- Users can only see their own queries
- Admins see aggregated metrics only
📊 Usage Limits
Monthly Limits
Track usage against license limits:
- Queries per month: 10,000 / 10,000 (100%)
- Active users: 45 / 50 (90%)
- API tokens: 8.5M / 10M (85%)
You'll receive notifications when approaching 80% and 90% of limits.
🎓 Best Practices
✅ Regular Monitoring
Check dashboard weekly for trends
✅ Set Alerts
Configure notifications for issues
✅ Optimize Costs
Identify expensive queries and optimize
✅ Track Adoption
Monitor user engagement metrics