Case study
Building an automation module for a network observability solution
Business background
Client type
Business goal
Our approach
- Provide a team of developers and DevOps engineers with expertise in network monitoring and observability, cloud and automation
- Design and build an entire solution from the ground up: architecture, technology stack, execution, testing
- Enable configuration of customer's observability platform using Infrastructure-as-Code (IaC) approach
- Ensure close cooperation with the client and a fast feedback loop
- Organize regular, recorded demos of new features
- Ensure the client’s feedback is promptly implemented
Business benefits
- Reduced number of errors: the error-prone manual process of integrating a virtual private cloud with the client’s platform was fully automated.
- Saved time and labor: integrating new cloud deployment with the client’s network observability platform is faster and simpler.
- Reproducibility ensured: the IaC approach allowed for an easily reproducible and trackable configuration.
- Ensured adherence to industry standards: the integration was implemented utilizing widely adopted technologies.
Technical highlights
-
Prepared a configuration of AWS Cloud to be consumed by the client’s platform:
- IAM roles and policies that provide access to the client’s platform to EC2 and S3 resources
- S3 bucket to store flow logs for the client’s platform
- Flow Log configuration
-
Prepared configuration of GCP Cloud to be consumed by the client’s platform:
- Enabled flow logs for required subnets
- Flow log sink to filter logs from required subnets to PUB/SUB topic
- Created PUB/SUB topic
- Created PUB/SUB topic subscription
- Assigned roles to allow the client’s platform to pull logs from PUB/SUB
-
Prepared configuration of Azure Cloud to be consumed by the client’s platform:
- Turned on appropriate providers to enable flow logs and network watchers
- Network watcher and flow logs to get logs from resource group
- Granted Azure roles access to the client's platform
- Configured storage account
-
Prepared Terraform/Ansible modules to automatically integrate new virtual private clouds with the monitoring and observability platform.
-
Implemented Terraform provider (in Golang) allowing to automate configuration of flow log export from cloud deployment to the observability platform. The Terraform provider utilizes observability platform's API to implement changes.
-
Ensured that Terraform modules support automated export of AWS and GCP clouds to the client’s platform.
-
Implemented Golang SDK for the platform API.
-
Implemented unit tests.
Technology stack
Get your project estimate
For businesses that need support in their software or network engineering projects, please fill in the form and we'll get back to you within one business day.
