top of page
estrellas 2.png

Building a Production-Grade DevOps Operating Model for a Multi-Tenant Financial Services Platform on AWS

About the client

The company is a financial technology company specializing in agentic AI-powered loan servicing automation for credit unions, community banks, and consumer lenders. Its platform, AcctVault, delivered through the company Builder (CBR), automates loan management workflows including skip-a-pay requests, payment deferral processing, and member self-service interactions across voice, digital banking, chat, and text channels.

AcctVault operates as a white-labeled, multi-tenant SaaS platform: each financial institution client receives a dedicated, branded deployment, including an administrative portal and member-facing portal, hosted under the acctvault.com domain and integrated with the institution's core banking systems. The platform serves credit unions, community banks, and auto finance lenders, enabling institutions to offer modern digital loan servicing experiences to their members without building or maintaining the underlying infrastructure themselves.

Teracloud engaged with the company to design and implement a production-grade DevOps operating model capable of supporting the platform's growing tenant base, improving deployment reliability, and establishing the security and compliance posture required to serve regulated financial institution clients.

Challenges

The company's AcctVault platform delivers loan servicing automation to financial institutions whose members depend on it for time-sensitive operations, loan payment deferrals, skip-a-pay requests, and self-service account management. In this context, platform reliability, deployment consistency, and security posture are not internal engineering concerns: they translate directly into service continuity for regulated institutions and their members. At the time of the engagement, a set of interconnected operational deficiencies limited the company's ability to scale the platform reliably or demonstrate the technical maturity required by its growing financial institution client base.

  • Infrastructure without automation. AWS infrastructure was provisioned and managed manually, with no Infrastructure as Code discipline in place. Without Terraform, there was no repeatable mechanism to provision environments consistently, configuration drift between development, QA, staging, and production was structurally guaranteed. Changes made through the AWS Management Console left no audit trail and could not be reviewed, approved, or rolled back in a controlled manner. For a platform managing individual tenant environments for nearly 20 financial institutions, each uncontrolled infrastructure change carried compounding risk.
     

  • Deployment risk at every release. Application deployments were not automated through a formal CI/CD pipeline. Releases required manual steps, lacked standardized validation stages, and were not reproducible across environments. In a multi-tenant architecture where each financial institution client operates an independent deployment, 40+ CloudFront distributions and individual service configurations, a single deployment error could cascade across multiple institutions' member-facing portals simultaneously, with no automated rollback capability.
     

  • Hybrid connectivity fragmentation. A core architectural requirement of the AcctVault platform is secure connectivity between the cloud-hosted application and each financial institution's core banking infrastructure, many institutions maintain on-premise or legacy systems that must communicate with the platform in real time during loan servicing workflows. Without a centralized networking layer, each client integration required a separate, ad-hoc connectivity approach, increasing operational complexity and fragility as the client base grew.
     

  • Identity and access governance gaps. Access to AWS environments was not governed through centralized identity management. Without IAM Identity Center and a defined permission model, access controls were inconsistent across accounts, least-privilege enforcement was manual and unreliable, and individual user actions were not fully attributable, a meaningful compliance exposure for a platform handling personally identifiable information and financial transaction data on behalf of regulated institutions.
     

  • Observability and incident response immaturity. The platform lacked structured application performance monitoring. There were no formalized runbooks or incident playbooks to guide the team through failure scenarios, no defined application performance baselines, no API response time targets, and no structured error rate monitoring, and no distributed tracing capability to diagnose request-level behavior across tenant services. When issues arose, diagnosis relied on individual knowledge rather than documented procedures, extending resolution time and increasing operational risk.
     

  • Security baseline below financial sector standards. The platform had no WAF protecting tenant endpoints, no organization-level CloudTrail trail, no unified encryption policy across services, and no formalized KMS key management strategy. For a SaaS provider serving regulated financial institutions, entities subject to NCUA examination and increasingly stringent vendor security requirements, this posture represented a commercial and compliance risk that would become a direct obstacle to client acquisition and retention.
     

  • Immediate risks. Any deployment failure in the shared infrastructure could disrupt loan servicing operations across multiple credit union clients simultaneously, with no automated recovery mechanism. Manual infrastructure changes without peer review created a standing risk of production outages from human error.
     

  • Long-term risks. The company's business model depends on onboarding additional financial institution clients, each new client adds a new tenant deployment, a new VPN connection to the institution's core systems, and new operational surface to monitor and maintain. Without automation, the cost of growth scaled linearly with manual effort. The platform could not expand its client base without a proportional investment in headcount performing repetitive, error-prone operational tasks.

Risk of not addressing this challenge

  • Manual infrastructure changes with no IaC or peer review create a standing risk of production outages across all active tenant deployments simultaneously, with no automated rollback.
     

  • Without CI/CD automation, each release cycle carries human error risk in a multi-tenant environment where a single failure impacts multiple regulated financial institution clients at once.
     

  • The absence of a centralized networking model for client VPN connectivity makes onboarding new financial institution clients operationally unsustainable as the tenant base grows.
     

  • Without IAM Identity Center and least-privilege enforcement, access to AWS environments is ungoverned, a direct compliance exposure for a platform handling PII and financial transaction data for regulated institutions.
     

  • No structured observability or runbooks means incident resolution depends on individual knowledge, extending MTTR and increasing the risk of repeated failures without root cause remediation.
     

  • A security baseline lacking WAF, encryption policy, and organization-level audit trails disqualifies the platform from vendor security assessments conducted by regulated clients, becoming a direct obstacle to commercial growth.
     

  • Operational costs scale linearly with headcount: without automation, each new client added to the platform requires proportional manual effort, making scale structurally impossible for an 18-person team.

Goals and Objectives

The company engagement was structured around a single overarching objective: establish a production-grade DevOps operating model that would allow a small engineering team to operate and grow a multi-tenant financial services platform reliably, securely, and without operational overhead scaling proportionally with the client base. All technical objectives were defined working backwards from that business outcome.

Business Objectives
 

  • Enable a scalable client onboarding model. Enable the company to onboard new credit union and financial institution clients into AcctVault through a standardized, automated, and repeatable process, eliminating the manual operational burden that made growth structurally unsustainable.
     

  • Establish a security posture fit for the regulated financial sector. Establish a security and compliance posture capable of withstanding vendor security assessments from regulated financial institution clients subject to NCUA and other regulatory oversight, turning security from a growth obstacle into a competitive differentiator.
     

  • Achieve measurable operational resilience. Achieve platform resilience sufficient to detect, diagnose, and resolve failures quickly and consistently, without dependence on individual institutional knowledge, reducing the operational risk of serving multiple regulated clients on shared infrastructure.
     

  • Reduce manual operational overhead. Reduce the operational overhead associated with routine tasks, service provisioning, client VPN onboarding, deployments, hotfixes, through documented runbooks and automated pipelines, freeing the engineering team to focus on product development.
     

Technical Objectives
 

  • Infrastructure as Code with Terraform. Migrate all AWS infrastructure management to Terraform across a structured multi-repository model (thecompany-base-infra, thecompany-builder-infrastructure, thecompany-builder), with parameterized environment configurations (dev, QA, stage, prod), remote S3 state per environment, and mandatory pull request review with two independent approvals and automated Terraform Plan before any production change.
     

  • Automated CI/CD with Bitbucket Pipelines. Implement a fully automated CI/CD pipeline via Bitbucket Pipelines, building container images, executing tests, publishing versioned images to Amazon ECR, and deploying to Amazon ECS through rolling deployments, authenticated to AWS via OIDC to eliminate long-lived credentials from the pipeline.
     

  • Centralized hybrid networking with Transit Gateway. Deploy AWS Transit Gateway as the centralized networking hub for all financial institution client VPN connectivity, enabling new client onboarding through a standardized, Terraform-managed process rather than ad-hoc point-to-point configurations.
     

  • Identity governance with IAM Identity Center. Implement IAM Identity Center as the centralized identity layer across all AWS accounts, with role-based permission sets mapped to defined user groups, eliminating IAM users and long-lived credentials for all human access.
     

  • Observability and structured incident response. Deploy AWS Distro for OpenTelemetry (ADOT) as the APM instrumentation layer for distributed tracing across AcctVault application services, integrated with AWS X-Ray and CloudWatch Application Signals for request-level latency analysis, error rate tracking, and service dependency mapping. Combine with Amazon CloudWatch alarms and Google Chat notification integration via AWS Chatbot for infrastructure-level alerting, establishing measurable API response time and error rate targets as the operational performance baseline for the platform.
     

  • Operational runbook library. Create a formal runbook library covering the full operational lifecycle: deployment execution, new service and user provisioning, service decommissioning, release branch tagging, the company Builder installation, client VPN onboarding, hotfix handling, and SSO profile setup.
     

  • Security and encryption baseline. Implement AWS WAF on all CloudFront distributions, enforce TLS 1.2+ across all 40+ tenant endpoints, establish KMS customer-managed keys with automatic rotation, and enable encryption at rest across all data stores (S3, EBS, EFS, ECR, Secrets Manager).
     

  • Multi-account audit and governance. Configure an organization-wide CloudTrail trail with centralized log delivery to a dedicated security account S3 bucket, protected by an SCP preventing trail deletion or disabling across all member accounts.

Solution and Execution

Teracloud designed and implemented a comprehensive DevOps operating model for the AcctVault platform, addressing each identified challenge through a structured, phased delivery. The solution was built entirely on AWS managed services and established automation, observability, and security controls capable of supporting the company's growing financial institution client base.
 

  • Infrastructure as Code with Terraform. All AWS infrastructure was migrated to Terraform across a three-repository structure that separates concerns by infrastructure domain: thecompany-base-infra manages shared networking components including AWS Transit Gateway, Site-to-Site VPN connections, and Route53 hosted zones; thecompany-builder-infrastructure manages core application infrastructure including ECS clusters, ALB, CloudFront, WAF, ElastiCache, Cognito, Secrets Manager, CloudWatch, IAM, and S3; and thecompany-builder manages ECS task definitions and container parameters. Environment-specific configuration is managed through Terraform workspaces and dedicated .tfvars files for development, QA, staging, and production, enabling a single codebase to provision fully isolated environments. Remote Terraform state is stored per environment in dedicated Amazon S3 buckets with encryption and versioning enabled. All infrastructure changes follow a standardized Git workflow: feature branch creation, automated CodeRabbit review, two independent peer approvals, automated Terraform Plan, manual approval, and Terraform Apply. Production infrastructure is never modified through the AWS Management Console, operational exceptions are documented and reconciled back into Terraform to maintain environment parity.
     

  • Automated CI/CD pipeline with Bitbucket Pipelines. Application deployments were fully automated through Bitbucket Pipelines. On each commit, the pipeline builds Docker container images, executes application tests, and publishes versioned images to Amazon ECR. Deployment to Amazon ECS is triggered automatically, updating ECS task definitions and performing rolling deployments with minimal service interruption. Authentication between Bitbucket Pipelines and AWS is implemented using OpenID Connect (OIDC), eliminating long-lived AWS credentials from the CI/CD platform entirely. Changes are validated sequentially across development, QA, and staging environments before reaching production.
     

  • Container platform with Amazon ECS. The AcctVault application is hosted on Amazon ECS using the EC2 launch type, selected over Amazon EKS to minimize operational complexity while providing the required scalability and deployment automation. ECS Service Auto Scaling adjusts the number of running tasks dynamically based on demand, while EC2 Auto Scaling Groups automatically provision and retire underlying compute capacity. Application Load Balancer distributes traffic across healthy ECS tasks across multiple Availability Zones, performing continuous health checks and automatically routing away from unhealthy instances. Container images are stored in Amazon ECR with IAM-controlled access and versioned image management.
     

  • Centralized hybrid networking with AWS Transit Gateway. The company's architecture requires secure, real-time connectivity between the AcctVault platform and each financial institution client's on-premise core banking infrastructure. Teracloud deployed AWS Transit Gateway as the centralized networking hub for all client VPN connectivity, with each institution connected via IPSec Site-to-Site VPN tunnels. This centralized model replaced ad-hoc point-to-point connectivity approaches with a standardized, Terraform-managed architecture, enabling new client VPN onboarding to be executed through a repeatable operational runbook rather than custom per-client configuration.
     

  • Multi-tenant content delivery with CloudFront and WAF. Each financial institution client is served through a dedicated Amazon CloudFront distribution, providing branded, tenant-specific endpoints for both administrative and member-facing portals under the acctvault.com domain. All 40+ distributions enforce TLS 1.2+ (TLSv1.2_2021) with HTTPS-only viewer protocol policies and ACM-managed certificates. AWS WAF is attached to CloudFront, filtering incoming HTTP/HTTPS traffic through managed rule groups before requests reach the application layer.
     

  • Identity governance with IAM Identity Center. All human access to AWS accounts was centralized through AWS IAM Identity Center, eliminating IAM users and long-lived credentials for console and CLI access. Role-based permission sets, Administrator, PowerUser, DevLead production access, ReadOnly, SecurityAudit, and Billing, are mapped to user groups and assigned per account. Temporary session credentials are issued per login, and all access is fully auditable through CloudTrail. Bitbucket Pipelines accesses AWS through OIDC-issued temporary credentials, with no static access keys stored in the CI/CD platform.
     

  • Observability with ADOT, AWS X-Ray, and CloudWatch. AWS Distro for OpenTelemetry (ADOT) was deployed as an ECS daemon service, providing auto-instrumented distributed tracing for the Node.js API across all AcctVault services and capturing request-level latency, error rates, and service dependency maps via AWS X-Ray and CloudWatch Application Signals. Amazon CloudWatch monitors infrastructure-level metrics across ECS, EC2, ALB, and ElastiCache, with custom alarms and Google Chat notification integration via AWS Chatbot for operational alerting. CloudTrail Insights provides anomalous API activity detection. Together, these tools established measurable API response time and error rate targets as the operational performance baseline for the platform for the first time.
     

  • Operational runbook library. Teracloud created a formal library of eight operational SOPs covering the complete day-to-day operational lifecycle of the platform: deployment GUI execution (CBR Deployment GUI), new service and user provisioning, service decommissioning, release branch tag creation in Bitbucket, the company Builder installation, new client VPN onboarding, core hotfix handling, and SSO profile setup. These runbooks provide documented, step-by-step procedures for every routine and incident scenario, reducing dependence on individual knowledge and enabling consistent execution across the team.
     

  • Security baseline and encryption. Customer-managed KMS keys, prod-parameter-store-kms-key and prod-s3-kms-key, were created with automatic rotation enabled, providing centralized key management for Secrets Manager and S3 encryption. Encryption at rest was validated and enforced across all data stores: 49 S3 buckets (SSE-S3 AES-256), 9 EBS volumes, EFS file system, 3 ECR repositories, and 51 Secrets Manager secrets. AWS Secrets Manager was configured as the runtime credential provider for all ECS workloads, eliminating hardcoded application credentials. An organization-wide CloudTrail trail was configured with centralized log delivery to a dedicated security account S3 bucket, protected by block public access, server-side encryption, versioning, and an SCP at the organization root level denying cloudtrail:StopLogging and cloudtrail:DeleteTrail across all member accounts.

Architecture Overview

The AcctVault platform is deployed on AWS in the us-east-2 region, following a multi-tier, multi-Availability Zone architecture designed for high availability, automated scaling, and secure multi-tenant content delivery. The solution integrates container orchestration, centralized hybrid networking, managed authentication, in-memory caching, and a fully automated CI/CD delivery pipeline, with centralized identity governance and observability across all components.

clients-architecture
  • Edge layer: Amazon CloudFront (40+ tenant-specific distributions) with AWS WAF enforcing managed rule groups; TLS 1.2+ (TLSv1.2_2021) and HTTPS-only viewer protocol enforced on all distributions; ACM-managed certificates.
     

  • Load balancing: Internet-facing Application Load Balancer deployed across multiple Availability Zones; continuous health checks routing traffic exclusively to healthy ECS tasks.
     

  • Application layer: Amazon ECS on EC2, with ECS Service Auto Scaling and EC2 Auto Scaling Groups providing horizontal scaling; CloudWatch Agent deployed as an ECS daemon service enabling ADOT-based APM instrumentation.
     

  • Container registry: Amazon ECR storing three private repositories (thecompany-api, thecompany-api2, db-migration); IAM-controlled access; versioned image management fed by Bitbucket Pipelines.
     

  • Caching layer: Amazon ElastiCache (Valkey) providing in-memory session storage and API response caching with encryption at rest and automatic failover support.
     

  • Authentication: Amazon Cognito managing application user authentication with MFA enforcement and custom Lambda triggers for authentication flow customization.
     

  • Database: MongoDB Atlas connected to the VPC via IP allowlisting over TLS-encrypted connections, providing persistent application data storage.
     

  • Shared storage: Amazon EFS providing shared persistent file storage for ECS workloads, encrypted at rest with an AWS-managed KMS key.
     

  • Hybrid networking: AWS Transit Gateway serving as the centralized hub for all financial institution client connectivity via IPSec Site-to-Site VPN tunnels; centralized network routing across all tenant VPN attachments.
     

  • Networking: Amazon VPC spanning multiple Availability Zones with public subnets (CloudFront, ALB) and private subnets (ECS, ElastiCache, EFS); Security Groups and NACLs enforcing least-privilege traffic rules; NAT Gateways for outbound internet access from private subnets.
     

  • Secret management: AWS Secrets Manager (51 secrets) providing runtime credential delivery to ECS tasks; encrypted with KMS; eliminating hardcoded application credentials.
     

  • CI/CD pipeline: Bitbucket Pipelines building Docker images, running tests, publishing to ECR, and deploying to ECS via rolling deployments; OIDC authentication to AWS; Terraform Plan and Apply pipeline for infrastructure changes.
     

  • Infrastructure as Code: Terraform managing all AWS resources across three repositories (thecompany-base-infra, thecompany-builder-infrastructure, thecompany-builder); Terraform workspaces and .tfvars files per environment (dev, QA, stage, prod); remote state in Amazon S3.
     

  • Observability: ADOT + AWS X-Ray (distributed tracing); CloudWatch Application Signals (APM: latency, error rate, fault rate); Amazon CloudWatch (infrastructure metrics, alarms, Logs, dashboards); AWS Chatbot → Google Chat (operational notifications); CloudTrail Insights (anomalous API activity detection).
     

  • Identity and access: AWS IAM Identity Center (SSO) with role-based permission sets across all AWS accounts; AWS Organizations with dedicated security account; SCP preventing CloudTrail deletion.
     

  • Audit and compliance: Organization-wide CloudTrail trail delivering logs to a centralized S3 bucket in the security account; S3 block public access, SSE encryption, and versioning enforced; SCP denying StopLogging and DeleteTrail across all member accounts.
     

  • DNS and routing: Amazon Route53 managing hosted zones for all tenant domains; ACM certificates provisioned in us-east-1 for CloudFront compatibility.

KPIs And Outcomes

The following key performance indicators were defined at the outset of the engagement to measure the operational impact of the DevOps transformation on the AcctVault platform. Metrics reflect the operational state established during the engagement, compared against the pre-engagement baseline where applicable.

clients-kpis

API Response Time P95, < 500ms Target Established and Achieved: Prior to the engagement, the AcctVault platform had no application performance monitoring in place. No response time baselines were defined, no distributed tracing was active, and request-level latency behavior across tenant services was entirely opaque. The deployment of AWS Distro for OpenTelemetry (ADOT) with CloudWatch Application Signals established P95 response time tracking as a defined operational KPI for the first time, actively monitored across 60+ tracked API operations with automated alarms triggering escalation when thresholds are approached. The production environment now operates with a confirmed P95 response time under 500ms for the srv-api service. For a platform serving time-sensitive loan servicing workflows including real-time skip-a-pay processing and loan deferral requests, response time consistency is a direct measure of member service quality across all active financial institution tenants.
 

HTTP 5xx Error Rate, < 0.1% Target Achieved (0% Faults in Production): Before the engagement, the platform had no structured error rate monitoring and no automated alerting on application failures. Incidents were surfaced reactively through client reports rather than internal detection. The implementation of CloudWatch Application Signals, AWS X-Ray distributed tracing, and a dedicated CloudWatch metric filter (prod-cbr-error-filter) tracking ERROR-level log events established a defined 5xx error rate KPI of under 0.1% and a server-side error threshold of fewer than 5 errors per evaluation period. Production X-Ray trace data confirms a current fault rate of 0% across active tenant sessions. The automated error enrichment pipeline, CloudWatch alarm → SNS → Lambda cbr-error-enricher-v2 → Google Chat via AWS Chatbot, delivers contextually enriched incident notifications to the engineering team within seconds, replacing the reactive, client-reported incident model that previously characterized platform operations.
 

Deployment Automation, Fully Automated CI/CD Pipeline Across 4 Environments: Prior to the engagement, application deployments were performed through manual, multi-step processes with no formalized pipeline, no automated test execution, and no standardized promotion path across environments. Each release carried human error risk across a 40+ tenant architecture where a single failure could cascade across multiple financial institution clients simultaneously, with no automated rollback capability. Teracloud implemented a fully automated Bitbucket Pipelines CI/CD pipeline that builds Docker container images, executes unit tests as a pre-deploy gate and end-to-end Playwright tests as post-deploy validation, publishes versioned images to Amazon ECR, and deploys to Amazon ECS via rolling deployments with no service interruption. Authentication to AWS is implemented via OIDC with no long-lived credentials stored in the pipeline. Changes are validated sequentially across development, QA, staging, and production with manual promotion approval at each stage, replacing ad-hoc manual releases with a consistent, auditable, and fully automated delivery process.
 

Infrastructure as Code Coverage, 0% → 100% via Terraform: At the outset of the engagement, all AWS infrastructure was provisioned and managed manually through the AWS Management Console with no Infrastructure as Code discipline, no audit trail of infrastructure changes, and no mechanism to provision environments consistently or roll back changes in a controlled manner. Configuration drift between development, QA, staging, and production was structurally guaranteed. Teracloud migrated 100% of AWS infrastructure to Terraform across a three-repository structure, thecompany-base-infra, thecompany-builder-infrastructure, and thecompany-builder, with parameterized Terraform workspaces and dedicated .tfvars files per environment, and remote state stored per environment in dedicated Amazon S3 buckets. Every infrastructure change now follows a mandatory Git workflow: feature branch creation, automated CodeRabbit review, two independent peer approvals, automated Terraform Plan, and manual approval before Apply. Production infrastructure is never modified through the AWS Management Console, and all operational exceptions are documented and reconciled back into Terraform to maintain environment parity.
 

Beyond the measured KPIs, the engagement delivered the following operational outcomes:
 

  • Infrastructure consistency established. All AWS resources across four environments are now provisioned and managed exclusively through Terraform, eliminating configuration drift and providing a complete, auditable history of every infrastructure change.
     

  • Deployment risk eliminated at scale. Automated rolling deployments via Bitbucket Pipelines and Amazon ECS replaced manual release processes, enabling consistent, repeatable releases across a 40+ tenant architecture without risk of human error cascading across multiple financial institution clients simultaneously.
     

  • Client onboarding standardized. AWS Transit Gateway and a formal VPN onboarding runbook established a repeatable, Terraform-managed model for connecting new financial institution clients to the AcctVault platform, replacing ad-hoc per-client connectivity approaches.
     

  • Identity governance centralized. IAM Identity Center provides federated, role-based access across all AWS accounts with full session auditability, eliminating long-lived credentials and ungoverned access patterns.
     

  • Observability baseline established. ADOT-based distributed tracing, CloudWatch Application Signals, and Amazon CloudWatch now provide continuous application and infrastructure visibility, with defined performance targets and alert thresholds against which ongoing operational performance is measured and improved.
     

  • Security posture formalized. WAF protection, TLS 1.2+ enforcement across all 40+ tenant endpoints, KMS key management, encryption at rest across all data stores, and a Secrets Manager-based credential model meet the vendor security requirements of regulated financial institution clients.
     

  • Audit trail protected across the organization. An organization-wide CloudTrail trail with SCP-enforced protection ensures complete, tamper-resistant API activity visibility across all AWS accounts, a prerequisite for clients operating under NCUA and financial sector regulatory frameworks.
     

  • Operational procedures documented. Eight formal runbooks covering the full operational lifecycle eliminate dependence on individual institutional knowledge, enabling consistent execution of routine tasks and incident response regardless of team composition.

Business Impact

The operational improvements delivered through this engagement translate directly into the company's ability to serve its existing financial institution clients reliably and to grow its tenant base with the confidence that the platform's operational model can absorb that growth without breaking.

AcctVault is not a discretionary tool for the credit unions and community banks it serves. When a member submits a skip-a-pay request or initiates a loan deferral through their institution's digital banking portal, that interaction is handled in real time by the AcctVault platform, connected via VPN to the institution's core banking system. A platform outage is not an internal engineering event: it is a service disruption visible to members performing financial transactions, and a compliance exposure for regulated institutions whose member commitments do not pause for infrastructure incidents. The confirmation that AcctVault now operates with a 0% fault rate across active tenant sessions and an API P95 response time under 500ms, both monitored continuously via CloudWatch Application Signals and AWS X-Ray across 60+ tracked API operations, is not a technical achievement. It is the operational foundation on which regulated institutions can stake their member-facing loan servicing commitments with confidence.
 

Before the engagement, incidents were surfaced reactively through client reports. There was no distributed tracing, no structured error rate monitoring, no automated alerting. When something went wrong, the engineering team had no visibility into which tenant was affected, which API operation had failed, or how request behavior was degrading across the multi-tenant environment. The deployment of ADOT-based distributed tracing, CloudWatch metric filters, and the automated error enrichment pipeline, delivering contextually enriched alerts to Google Chat within seconds of detection, fundamentally changed the incident response model. For a platform serving nearly 20 financial institution clients simultaneously on shared infrastructure, the difference between reactive and proactive incident detection is the difference between an isolated engineering event and a multi-client service failure propagating through active member sessions before anyone on the team is aware.
 

The 0% → 100% migration to Infrastructure as Code and the full automation of the CI/CD pipeline carry equal commercial weight, though their impact is less visible to end users. Manual deployments across a 40+ tenant architecture, where a single error could cascade across multiple institutions simultaneously, constrained the company's ability to ship improvements and respond to client requests. Every release was a high-stakes coordination event with no automated rollback and no standardized validation path. With automated rolling deployments through Bitbucket Pipelines and Amazon ECS, validated sequentially across development, QA, staging, and production before reaching tenant-facing infrastructure, the engineering team can now release with confidence across the entire tenant roster. And with 100% of infrastructure managed through version-controlled Terraform, every environment is consistent, every change is auditable, and the risk of a manual configuration error cascading through shared infrastructure is structurally eliminated.

Perhaps most significant for the company's commercial trajectory is what the engagement established structurally. With centralized identity governance, a standardized client VPN onboarding model, a formalized runbook library, and a security posture capable of meeting regulated financial institution vendor requirements, the company can now grow its tenant base against a known, documented operational baseline, not against a manually managed infrastructure that would require proportional headcount to scale. For an 18-person company competing in the regulated credit union technology market, where institutional trust and vendor security posture are prerequisites for client acquisition, that foundation is not a technical achievement: it is the operating condition for sustainable commercial growth.

Get in touch

Take your business to the next level.

bottom of page
window.addEventListener('load', function() {   var search = window.location.search;   if (!search || search === '?') return;   var params = search.slice(1);   setTimeout(function() {     document.querySelectorAll('iframe').forEach(function(fr) {       try { fr.contentWindow.postMessage({type:'TERACLOUD_UTM', params: params}, '*'); } catch(e) {}     });   }, 1500); });