Daniel R.

🏆 Microsoft Certified Data Engineer and Analyst
🏆 Senior Data Engineer and Analyst with over 10 years of experience

I am a Senior Data Engineer and Analyst specializing in building scalable data pipelines, designing data architectures, and delivering impactful dashboards. My expertise spans data integration, transformation, and analytics, ensuring optimized and actionable solutions tailored to business needs.

Expertise includes:

🔶 Data Engineering & Architecture:
● ETL Mastery: Expert in cloud-based ETL tools such as AWS Glue, Azure Data Factory, GCP Data Fusion, and Snowflake ELT workflows for seamless data ingestion, transformation, and loading.
● SQL Proficiency: Mastery of SQL query optimization, advanced joins, window functions, and stored procedures across T-SQL, MySQL, PostgreSQL and Snowflake SQL (micro-partition pruning, clustering, semi-structured data queries).
● Data Pipeline Orchestration: Experienced in using workflow management tools like Apache Airflow and Snowflake Tasks to automate and monitor data pipelines efficiently.
● Data Warehousing: In-depth experience with Snowflake, Redshift, and BigQuery, including dimensional modeling and normalization best practices.

🔶 Data Analysis & Dashboard Development:
● Power BI: Skilled in creating dynamic, interactive reports using centralized datasets, PowerQuery, DAX measures, and Python scripting for complex data transformations.
● Tableau: Advanced expertise in integrating diverse data sources, creating calculated fields, and developing visually compelling dashboards.
● Looker: Proficient in LookML for data modeling, custom visualization, and embedding analytics for seamless integration with business workflows.
● Real-Time Insights: Delivered actionable dashboards connected directly to cloud-based sources for up-to-date analytics.

🔶 Cloud Platform Expertise:
● AWS: Advanced knowledge of Lambda, Glue, S3, and Redshift for scalable and secure data processing.
● Azure: Extensive experience with Function Apps, Synapse, Data Factory, and Data Lake Gen 2 for robust data solutions.
● GCP: Expertise in BigQuery, Cloud Functions, Data Fusion, and Looker for analytics and data management.
● Snowflake: End-to-end warehouse development including schema design, performance tuning, ELT, RBAC security, semi-structured data (VARIANT), Streams & Tasks, external tables, and cost optimization

🔶 Data Governance & Transformation:
● Strong Python scripting skills for automation, API integration, and advanced data cleansing. ● Hands-on experience with tools like Pandas Profiling, OpenRefine, and Trifacta Wrangler for data profiling, quality assurance, and anomaly detection. ● Proficient in implementing secure access controls using IAM roles, Lake Formation, and APIs, as well as Snowflake RBAC, masking policies, and secure data sharing for governance and compliance.