HARIKRUPA VEDERE

Built and managed bronze-silver-gold lakehouse platforms using Delta Lake and Microsoft Fabric, enforcing ACID guarantees, schema governance, and zone-based data quality across 15M daily patient records.

Designed and optimized multi-source ETL and ELT pipelines handling batch, incremental, and CDC-based data movement with watermarking, schema drift handling, and dependency scheduling at scale.

Integrated EHR systems using FHIR and HL7 standards, building ingestion pipelines with Apache Kafka and Apache NiFi to consolidate patient records across hospital endpoints and reduce physician data retrieval time by 40%.

Implemented HIPAA-compliant data security including patient de-identification, column-level encryption, and role-based access control across clinical data platforms.

Improved analytical query performance by over 45% through Delta Lake optimization techniques including Z-ordering, partition pruning, and automated table maintenance orchestrated via Airflow.

Built GenAI-powered data assistants using LLMs and RAG architectures, reducing report generation time from days to hours for clinical and business stakeholders.

Deployed Agentic AI workflows using LangGraph and Bedrock Agents to automate complex multi-step clinical data enrichment tasks, cutting manual curation effort significantly per workflow cycle.

Delivered end-to-end retail analytics consolidating Salesforce, Shopify, and SAP data using PySpark across cloud environments, driving 20% better inventory distribution and 30% improvement in demand forecasting accuracy.

Built clinical and operational BI dashboards in Power BI with row-level security, connecting gold-layer lakehouse tables to support high-concurrency reporting across regulated cloud environments.

Built and optimized ETL ingestion pipelines for CDRs and network logs at terabyte scale, applying watermarking, dependency scheduling, and adaptive query execution to meet strict processing SLAs across streaming and batch workflows.

Implemented event-driven ingestion using Apache Kafka for high-frequency network signaling events, utilizing Apache HBase for near real-time metric storage and Apache Druid for fast OLAP queries across 500 billion telecom events monthly.

Optimized cloud analytical datasets through partitioning, clustering, and materialized views, significantly reducing dashboard load times across multi-terabyte telecom workloads.

Orchestrated multi-cloud data workflows using Airflow DAGs coordinating streaming, batch processing, and query jobs, implementing retry logic and SLA sensors for reliable pipeline recovery.

Implemented CI/CD pipelines using GitHub Actions and Terraform alongside centralized monitoring with Grafana and Prometheus to automate deployments and track pipeline latency and Spark job performance across cloud-hosted workloads.

Built real-time transaction ingestion pipelines using Apache Kafka and Confluent Kafka, configuring topic partitioning and replication for fault-tolerant delivery under peak transaction volumes.

Designed Apache Flink streaming jobs with Flink SQL and CEP patterns to detect complex fraud scenarios including location mismatches, velocity spikes, and blacklisted merchant interactions, enabling sub-second suspicious transaction flagging.

Implemented dynamic risk scoring combining rule-based fraud signals with ML model outputs managed via MLflow, integrating Redis for sub-5-millisecond lookups and Apache HBase historical patterns to achieve 94% detection accuracy with minimal false positives.

Built batch ingestion pipelines using Apache Beam to move 5+ years of mainframe transaction records into cloud storage, sustaining over 10,000 messages per second, and optimized cloud analytical datasets reducing fraud trend query runtimes from hours to minutes.

Optimized BigQuery datasets through partitioning and clustering, reducing fraud trend query runtimes from hours to minutes for risk reporting.

Built centralized payroll data migration pipelines using Talend ETL and Azure Data Factory, supporting full historical loads and incremental updates across multi-state tax jurisdictions for over 650,000 client businesses.

Migrated ETL orchestration from legacy cron jobs to Airflow DAGs with fault-tolerant retry logic and SLA sensors, reducing failed payroll runs by 78% during peak cycles.

Reduced end-to-end tax processing time from 18 hours to 4.5 hours using Apache Spark with ACID-compliant Delta Lake operations, maintaining complete audit trails and SOX and PCI-compliant security controls throughout.

Developed ML models using PySpark ML and Scikit-Learn to improve payroll cash flow forecasting, achieving 89% precision in predicting client funding requirements 30 days ahead, with results surfaced through Power BI dashboards.

Built ETL pipelines using Oracle Data Integrator, Informatica PowerCenter, and Talend integrating data from Oracle, MySQL, MongoDB, and cloud storage across 12 interconnected aviation ERP systems, cutting nightly processing windows from 8 to 2.5 hours.

Automated ETL job scheduling using Oozie and Oracle Enterprise Manager, creating dependency-aware sequences for interdependent payroll and inventory processes across regions.

Built Oracle Business Intelligence reports sourcing curated data from data warehouses and cloud data marts using star schemas, with role-based access controls for executives, managers, and operational teams.