Ider – Python, Agile, Django

Ider worked on two major initiatives for a financial organization client (name under NDA) during his tenure:

• The first project involved developing an end-to-end data orchestration and ingestion streaming platform, designed to dynamically process, filter, map, and persist massive data volumes into cloud data lakes.
• The second project focused on the optimization, maintenance, and automation of a high-volume product usage and billing report system, managing billions of records and providing on-demand analytics tools for internal teams.

• Designed and implemented a dynamic data orchestration pipeline utilizing Digdag, DuckDB, and Apache Pulsar to stream, filter, and route complex data sources from S3/Parquet files downstream;
• architected a global persistence service using PySpark and AWS Glue/Iceberg tables, significantly improving processing speeds and data reliability during high-volume data ingestion;
• optimized a core billing report system by creating custom Python/Pandas migration scripts to successfully transition approximately 500 billion records from an AWS DocumentDB database to a Grafana Loki store;
• improved the stability and reliability of multiple core microservices (built on Flask and FastAPI) by creating automated integration test suites with Pytest, increasing test coverage up to 80%;
• automated on-demand report generation by building a secure FastAPI service integrated with JWT permissions and seamless license system mapping;
• streamlined CI/CD deployments by creating optimized Docker images and configuring robust pipelines via CircleCI, Jenkins, and GitHub Actions across QA, Staging, and Production environments.

Ider worked on two projects for two different clients for this company (names under NDA):

• the first project is a recommendation engine for a Colombian multinational company leader in food delivery across Latin America;
• the second project is a platform for renting analytics resources and billing based on time; this is for a Global financial company specializing in credit rating and analytics.

• Improved the stability of various microservices;
• increased the coverage by implementing many integration tests for all the information flow;
• created the scripts for migrating almost 60M of records from a non-relational database to a time series database.

Interwoven is an application that suggests art pieces related to a previously selected one, using ML/AI technologies and image processing.

• Took charge of the initial architecture and data pipe flow;
• created the analyzer microservice for new art pieces;
• developed the CI/CD environments for the rest of the microservices;
• managed the server architecture using Azure cloud services.

Xapo is a fully regulated bank with the blockchain at its core; it has military-grade security and an easy and flexible application and offers a debit card for fiat and crypto assets.

• Worked on a microservice that allows an onboard process to access a credit card for users in Brazil;
• improved the experience of users by developing enhancements in the accounting microservice for SEPA transfers.