Juan
From Mexico (UTC-6)
Juan – SQL, Python, RAG
Juan Pablo is a data engineer and architect working in Python, SQL, Spark, Databricks, and Snowflake. He led lakehouse pipelines that unified 1,000+ public datasets with 45% faster ETL and 30% lower compute costs, and built a healthcare lakehouse consolidating data from 30+ practices and 1.1M patient records.
11 years of commercial experience in
Main technologies
Additional skills
Direct hire
PossibleReady to get matched with vetted developers fast?
Let’s get started today!Experience Highlights
Tech Lead
The company's mission is to empower Americans by providing access to factual and transparent data. By aggregating information from federal, state, and local government sources, we make comprehensive government data easily accessible via our online platforms. Building the product with Claude Code help.
- Improved ETL performance by 45% and reduced compute costs by 30% by optimizing Databricks Lakehouse pipelines.
- Unified 1,000+ federal, state, and local datasets for public-facing analytics.
- Implemented Delta Lake and Unity Catalog to make dashboard data reproducible and auditable.
- Built API integrations and visualization feeds supporting near-real-time civic data access for millions of users.
- Used Claude Code to support development of the Answer Pages product.
Senior Data Architect
A medical DataLake house importing several SQL Server and MySQL data to Snowflake for Patient and Clinical data Analytics. It handles data from over 30 cardiovascular practices across America, caring for 1.1 million patients.
- Engineered a Snowflake Data Lakehouse integrating multi-source data from SQL Server and MySQL systems across 30+ cardiovascular practices, consolidating 1.1M+ patient records for clinical and operational analytics;
- Designed and optimized ELT pipelines for patient, procedure, and EHR data, improving processing efficiency by 40% and enabling daily refreshes of key clinical KPIs;
- Implemented data quality, lineage, and governance frameworks, ensuring HIPAA compliance and consistent metrics across sites;
- Partnered with clinical and analytics teams to deliver interactive dashboards supporting physician performance tracking, patient outcomes, and RVU-based financial reporting.
Project Technical Manager
A hardware lifecycle management platform designed to support OEM operations and device division projects.
- Reduced manual reconciliation by approximately 35% through improvements to platform usability and data consistency.
- Managed end-to-end delivery of a hardware lifecycle management platform across engineering, UX, and operations.
- Defined MDM and UX requirements to standardize device metadata and user experiences across product lines.
- Established governance frameworks for secure, traceable, and ethical use of training and inference data.
- Refined AI-driven user flows with UX and engineering teams to align interfaces with model capabilities and business objectives.
- Led Agile planning, stakeholder coordination, and sprint delivery for integration with global supply chain systems.
Tech Lead
Migration of external file processing from Scala to PySpark on Databricks to modernize Mexico’s tax data infrastructure.
- Migrated legacy Scala-based ETL pipelines to PySpark within Databricks, modernizing SAT’s large-scale tax data processing framework and improving maintainability and performanceж
- Optimized data ingestion and transformation workflows for high-volume fiscal datasets, reducing processing time by 40% and enabling more efficient reconciliation of taxpayer and fiscal records;
- Implemented Delta Lake architecture and parameterized notebooks for scalable, auditable, and reusable data pipelines across multiple tax data domains;
- Collaborated with internal data governance teams to ensure data lineage, compliance, and auditability within Mexico’s national tax data ecosystem.