Ioan – GCP, Apache Spark, AWS

Built and owned a GCP-based data platform for batch and streaming ingestion into BigQuery, including ingestion architecture, PII governance, and onboarding of new data sources.

• Served as Technical Lead / Senior Data Engineer on a GCP-based data platform supporting batch and streaming ingestion into BigQuery for financial analytics;
• Reduced costs by 50%+ on an over-provisioned Dataflow streaming pipeline without increasing latency;
• Owned the ingestion architecture and PII governance across batch and streaming workloads;
• Defined and implemented the onboarding process for new data sources.

A cloud consulting and engineering firm focused on minimizing risk and optimizing data workflows during large-scale Google Cloud migrations.

• Worked on large-scale Google Cloud migration projects, optimizing data workflows for performance and reliability;
• Migrated a 5B+ row Scala Spark pipeline to Dataform and BigQuery for a high-profile client;
• Reduced pipeline runtime by 50% while preserving correctness and scalability.

Worked on a multi-petabyte data platform, building scalable CDC pipelines, lake analytics, and the Databricks and Airflow infrastructure supporting data ingestion and processing.

• Contributed to the design and implementation of a large-scale data platform managing over 5 PB of data;
• Architected scalable solutions across multiple AWS and Databricks accounts for secure and efficient cross-account data integrations;
• Leveraged Databricks for large-scale job execution and Airflow for reliable orchestration and automation;
• Took ownership of data ingestion pipelines;
• Managed backfills during outages;
• Optimized Spark workloads to improve performance and stability;
• Drove continuous enhancements in scalability, cost efficiency, and system resilience across the data ecosystem;
• Delivered a custom S3-access-log analytics solution at 90% lower cost than AWS CloudWatch.

Led the design and production operations of a greenfield Industry 4.0 platform for real-time parts tracking with strict no-loss/no-duplicate guarantees, designed for deployment across 30+ manufacturing plants.

• Led a critical initiative for tracking real-time part availability across assembly lines;
• Designed a highly scalable and resilient system ensuring zero data loss, no duplication, and real-time accuracy at scale;
• Architected the backbone for a global rollout from PoC to full production across 30+ manufacturing plants worldwide;
• Optimized system performance and storage to reduce infrastructure costs while maintaining high availability;
• Led a team through complex engineering challenges in manufacturing data systems;
• Drove warehouse digitization and process automation for a large-scale Industry 4.0 initiative;
• Built end-to-end real-time and batch data pipelines using Apache Beam on Google Cloud Platform;
• Designed backup and recovery strategies for business continuity and fail-safe operations;
• Fine-tuned Dataflow jobs to optimize resource usage and improve throughput;
• Integrated BigQuery, Pub/Sub, and Dataflow into the production environment to deliver scalable insights.

A bank's car-sales platform integrating external services over REST. Led the integration of a new external service, worked on the Drools-based discount engine, and built the CI/CD setup.

• Developed a flexible and scalable sales platform for car loans, adapting to new bank promotions;
• Utilized Factory, Builder, and Adapter design patterns to address complex business needs;
• Ensured high availability and seamless integration through continuous updates and maintenance.