Activity Log Service
The Activity Log Service is a robust microservice designed to capture, store, and retrieve comprehensive activity logs and audit trails across SchoolCity's educational platform. Built with Golang for high performance and low resource consumption, the service utilizes ScyllaDB as a distributed NoSQL database for scalable data storage and AWS ECS for containerized deployment. The service provides real-time logging capabilities with advanced querying and filtering options for compliance and monitoring purposes.
The Challenge
SchoolCity needed a scalable, high-performance activity logging service that could handle millions of log entries while providing fast query capabilities for audit trails and compliance reporting. The challenge included designing a system that could capture detailed activity data from multiple services, store it efficiently for long-term retention, and provide quick access for compliance audits and monitoring without impacting application performance.
- High-performance activity logging
- Distributed NoSQL data storage
- Real-time log ingestion
- Advanced querying and filtering
- Comprehensive audit trails
- Auto-scaling container deployment
- Compliance reporting capabilities
- Multi-service integration
The Solution & Results
Developed a microservice architecture using Golang for high performance and low latency. Implemented ScyllaDB as the primary database for distributed, scalable data storage with high write throughput. Designed efficient data models for activity logging with proper indexing for fast query performance. Deployed the service using Docker containers on AWS ECS with auto-scaling capabilities. Implemented comprehensive API endpoints for log ingestion, retrieval, and advanced filtering.
Successfully delivered a production-ready activity logging service that handles millions of log entries daily with sub-second query response times. The service now provides comprehensive audit trails for compliance requirements and real-time monitoring capabilities. The solution has significantly improved system observability and compliance reporting across SchoolCity's educational platform.
