Juan – SQL, Python, RAG, experts in Lemon.io

Juan

From Mexico (UTC-6)flag

Data Engineer|Senior
AI Engineer|Middle

Juan – SQL, Python, RAG

Juan Pablo is a data engineer and architect working in Python, SQL, Spark, Databricks, and Snowflake. He led lakehouse pipelines that unified 1,000+ public datasets with 45% faster ETL and 30% lower compute costs, and built a healthcare lakehouse consolidating data from 30+ practices and 1.1M patient records.

11 years of commercial experience in
Accounting
Administration
Analytics
Data analytics
Fintech
Govtech
Healthcare
Healthtech
Product management
Project management
Social impact
Data monetization
Hardware
Main technologies
SQL
14 years
Python
7 years
RAG
1 year
LLM
1 year
AWS
5 years
Microsoft Azure
7 years
GCP
1 year
Additional skills
BigQuery
Apache Spark
.NET
Snowflake
DBT
Databricks
JavaScript
C#
ETL
MySQL
NoSQL
MongoDB
Airflow
React
PySpark
REST API
PowerBI
SQL Server
Azure DevOps
Amazon S3
Claude Code
Django
Flask
FastAPI
Direct hire
Possible
Ready to get matched with vetted developers fast?
Let’s get started today!

Experience Highlights

Tech Lead
May 2025 - Ongoing1 year 5 months
Project Overview

The company's mission is to empower Americans by providing access to factual and transparent data. By aggregating information from federal, state, and local government sources, we make comprehensive government data easily accessible via our online platforms. Building the product with Claude Code help.

Responsibilities:
  • Improved ETL performance by 45% and reduced compute costs by 30% by optimizing Databricks Lakehouse pipelines.
  • Unified 1,000+ federal, state, and local datasets for public-facing analytics.
  • Implemented Delta Lake and Unity Catalog to make dashboard data reproducible and auditable.
  • Built API integrations and visualization feeds supporting near-real-time civic data access for millions of users.
  • Used Claude Code to support development of the Answer Pages product.
Project Tech stack:
Databricks
Python
JavaScript
SQL
PySpark
Amazon S3
Claude Code
LLM
Senior Data Architect
Jan 2024 - Jun 20251 year 4 months
Project Overview

A medical DataLake house importing several SQL Server and MySQL data to Snowflake for Patient and Clinical data Analytics. It handles data from over 30 cardiovascular practices across America, caring for 1.1 million patients.

Responsibilities:
  • Engineered a Snowflake Data Lakehouse integrating multi-source data from SQL Server and MySQL systems across 30+ cardiovascular practices, consolidating 1.1M+ patient records for clinical and operational analytics;
  • Designed and optimized ELT pipelines for patient, procedure, and EHR data, improving processing efficiency by 40% and enabling daily refreshes of key clinical KPIs;
  • Implemented data quality, lineage, and governance frameworks, ensuring HIPAA compliance and consistent metrics across sites;
  • Partnered with clinical and analytics teams to deliver interactive dashboards supporting physician performance tracking, patient outcomes, and RVU-based financial reporting.
Project Tech stack:
Snowflake
Microsoft SQL Server
Python
SQL
Transact-SQL (T-SQL)
SQL Server
DBT
MySQL
Airflow
PowerBI
Fivetran
Project Technical Manager
Jan 2024 - Oct 20249 months
Project Overview

A hardware lifecycle management platform designed to support OEM operations and device division projects.

Responsibilities:
  • Reduced manual reconciliation by approximately 35% through improvements to platform usability and data consistency.
  • Managed end-to-end delivery of a hardware lifecycle management platform across engineering, UX, and operations.
  • Defined MDM and UX requirements to standardize device metadata and user experiences across product lines.
  • Established governance frameworks for secure, traceable, and ethical use of training and inference data.
  • Refined AI-driven user flows with UX and engineering teams to align interfaces with model capabilities and business objectives.
  • Led Agile planning, stakeholder coordination, and sprint delivery for integration with global supply chain systems.
Project Tech stack:
.NET
React
Microsoft SQL Server
Azure DevOps
SQL Server
PowerBI
Agile
Jira
Confluence
REST API
Tech Lead
Nov 2022 - Feb 20233 months
Project Overview

Migration of external file processing from Scala to PySpark on Databricks to modernize Mexico’s tax data infrastructure.

Responsibilities:
  • Migrated legacy Scala-based ETL pipelines to PySpark within Databricks, modernizing SAT’s large-scale tax data processing framework and improving maintainability and performanceж
  • Optimized data ingestion and transformation workflows for high-volume fiscal datasets, reducing processing time by 40% and enabling more efficient reconciliation of taxpayer and fiscal records;
  • Implemented Delta Lake architecture and parameterized notebooks for scalable, auditable, and reusable data pipelines across multiple tax data domains;
  • Collaborated with internal data governance teams to ensure data lineage, compliance, and auditability within Mexico’s national tax data ecosystem.
Project Tech stack:
Apache Spark
PySpark
Scala
Python
Databricks
SQL
Git

Education

2024
Technology and Systems
Bachelor's
2026
Artificial Intelligence and Machine Learning
Postgraduate

Languages

Spanish
Advanced
English
Advanced

Hire Juan or someone with similar qualifications in days
All developers are ready for interview and are are just waiting for your requestdream dev illustration
Copyright © 2026 lemon.io. All rights reserved.