
Data fundamentals on AWS: Data Pipelines
As our world becomes more and more data-oriented, we need good conceptual frameworks for communicating our ideas and for making the best design decisions. On one hand, this blog post describes a mental model of a data processing pipeline with two main goals: to establish common language and concepts and to help us to design data pipeline architectures following the best practices. From a practical standpoint, this framework will guide you in designing and evaluating any data

Introducing ec2-instance-selector
When provisioning a spot fleet, getting the correct instance type can be a little bit overwhelming, log in to the console, look for instance capacity, etc That's why AWS provides us a really useful tool from the cli, ec2-instance-selector (https://github.com/aws/amazon-ec2-instance-selector) This makes our lives much easier. You just need to run the command passing resource criteria like vcpus, network performance, ram, etc. Be sure to have your AWS credentials loaded when yo

Hitting Github API REST with the Linux console
The very first step to hit any API REST is to read the documentation because every API is a world. While some of them are very intuitive, others require a lot of time on thinking about how to make every single call due to the resource's format required. The Github API REST has calls requiring a very specific format of input parameters. Might be in the header, in the URL's path, as URL GET parameters, or inside a JSON formatted body. But this is not all, because the answer wil

Teracloud achieves AWS Advanced Consulting Partner Status
This week Teracloud has achieved the Amazon Web Services Partner Network (APN) Advanced Consulting Partner status, further cementing its position as a global leader in helping customers design, architect, build and migrate cloud-native solutions on AWS. The AWS Partner Network (APN) is the global community of Partners who leverage Amazon Web Services to build customer solutions and services. AWS helps Partners build, market, and sell their AWS offerings by providing valuable

Cross account access to S3 using IRSA in EKS with Terraform as IaaC
We have many options to get cross-account access to resources, but when talking about the Kubernetes cluster, things can get a little bit tricky! So, in this blog, I'll share a solution to do it in the safest way using the principle of least privilege. A typical scenario is to have two accounts, Account A, with an EKS cluster and Account B with an S3 bucket (example_bucket) that needs to be accessed by a pod from account A.
We have many options for this: We can create a bucke

Again that mail about the need of rotating the Github Tokens of your pipelines?
“CodeStar Connect” will release you of that pain. Everybody knows the inconvenience of working with secrets like Tokens or Webhooks: You need to create them, save them in the Parameter Store to avoid leakage, and rotate them every couple of months. But now, using CodeStar connections and the Github App on AWS you are completely free of them! Creating this connection is as simple as you can see in this link; however, in Terraform you will find that it’s as easy as in the AWS M

Your AWS invoice is getting bigger and bigger because of CloudWatch Logs, and you don't know why?
If when you look at your invoice you see that the amount you have to pay because of CloudWatch Logs keeps growing, this tip will definitely interest you. One of the main items that make the monthly CloudWatch Logs charge increase is PutLogEvents, which is the ingestion of logs into log groups. But the problem now is to find how much each log group is getting charged to know how to reduce the costs. It might seem that there is not a straightforward way to do this. However, the

Why are organizations moving towards containerization?
As a company's operations grow, so does its IT system. Any change can present a challenge because new features are added and scaled. Containerization has evolved over the years and has allowed companies to grow while maintaining an efficient organization. Just as a businessman revolutionized the shipping industry more than 60 years ago by using containers the size of a trailer to transport merchandise; Today's container technology is changing how companies deploy and use appl

Every format with its parser
In this Teratip scenario, we are in a GNU/Linux console environment, which could be inside a Jenkinsfile for example, and we need a JSON object. A very common situation actually. Along many years we have seen things like: echo '{"channel":"main","text":"Hello %%USER%%"}' > message.json With also very complex to read sed structures to fill placeholders. Or even run a sh script in a jenkinsfile that calls python code to be able to use the python library to create the JSON and l

How to configure different event webhooks in Sendgrid
SendGrid is a cloud-based SMTP provider for transactional and marketing email. You can send email via SMTP relay or through the web API. When an email is processed, events are generated. There are two types of events: delivery and engagement. Delivery events indicate the status of the email delivered. Engagement events specify how the recipient interacts with the email. Then, you can configure Sendgrid’s Event Webhooks to notify a custom URL via HTTP POST with information abo