VARSHITH MANCHIKANTI

Accomplished Data Engineer & Architect

Summary

Accomplished and certified Data Engineer & Architect with 11+ years of experience designing, orchestrating, and streamlining large-scale data engineering and analytics solutions. Demonstrated track record in leveraging AI/GenAI to automate processes, accelerate insights, and drive innovation across finance, telecom, retail, and healthcare domains.

Education

M.Tech in Software Systems (Data Analytics)

Birla Institute of Technology & Science, Pilani

B.Tech in Computer Science

JNTU College of Engineering, Pulivendula

Experience

Candescent

Sept 2025 – Present

Software Engineer IV | Hyderabad, India

  • Driving real-time big data stream processing in the digital banking domain, handling volumes of 70-100 million transactions per day.
  • Engineered and optimized large-scale data pipelines on GCP utilizing PySpark, Databricks, Dataflow, and Dataproc for processing and storing data in BigQuery and Bigtable.
  • Applied advanced data engineering techniques to support critical financial analysis and compliance reporting.

Franklin Templeton Investments

Aug 2020 – Sept 2025

Lead Data Engineer | Hyderabad, India

  • Orchestrated deployment of a Copilot Studio–powered chatbot for Compliance, earning runner-up in a global PoC showcase.
  • Engineered a Streamlit application to classify and enrich third-party distribution data via Databricks Llama endpoints and Crew.ai, accelerating data quality efforts.
  • Migrated Azure Databricks workloads (ADLS Gen2) to AWS with UC workflow upgrades during a major cloud consolidation—streamlined operations across teams.
  • Implemented a production-grade, fine-tuned SparkNLP NER solution, standardizing entity extraction at minimal cost.
  • Spearheaded Xceptor-based automation of 105+ internal processes, realizing 260 man-days in annual savings and significantly reducing error rates.

SpringML Inc.

Nov 2018 – Aug 2020

Senior Data Engineer | Hyderabad, India

  • Architected and optimized end-to-end ML pipelines on GCP (Kubeflow, TFX, Composer), enabling seamless model training & serving.
  • Developed ETL jobs to ingest and transform terabyte-scale data into BigQuery, Bigtable, and Cloud Storage—accelerating analytics readiness.
  • Designed and deployed Angular/React UIs and Python Flask back-ends on App Engine for real-time dashboards and data APIs.
  • Migrated legacy Hadoop workloads to GCP Dataproc, streamlining Spark job orchestration and reducing infrastructure costs.
  • Key Client Achievements:
    • **Publishers Clearing House:** Automated ML model lifecycle (Kubeflow, KFServing) with CI/CD, yielding $142K annual savings.
    • **CBRE Inc.:** Engineered secure GCP VPCs, VPNs, Dataflow pipelines, and BigQuery schemas for enterprise data migration.
    • **iHuddl Investments:** Built real-time dashboards (Angular, D3.js), WebSocket data pipelines, and scalable App Engine services.

ScriptBees IT Pvt Ltd.

Feb 2017 – Oct 2018

Senior Software Engineer | Hyderabad, India

  • Designed PySpark architectures and authored fuzzy-logic engines for invoice processing (EY GST solution).
  • Scraped and structured multi-source news data using BeautifulSoup and Dryscrape for a regional media portal.
  • Developed RPA bots (Automagica, Python) and integrated testing pipelines via Jenkins for Verizon Wireless process automation.

Tech Mahindra Limited

Sept 2014 – Jan 2017

Software Engineer | Hyderabad, India

  • Processed and provisioned OSS/BSS orders for TalkTalk & BT integration, enhancing order-tracking portals.
  • Led data exploration, feature engineering (SciPy, Pandas), and visualization (Matplotlib) for retail analytics on the X-Retail platform.

Technical Skills

Programming & Frameworks

Python SQL Flask Django FastAPI PySpark Keras

Data, Cloud & Databases

GCP Azure AWS Dataflow Dataproc Snowflake MongoDB PostgreSQL

Data & AI Engineering (MLOps, GenAI, Tools)

Kubeflow MLflow TFX Airflow CI/CD (GitLab, Jenkins) Databricks Mosaic AI Agent Framework Crew.ai LangChain Copilot Studio Docker/Kubernetes

Domain Expertise & Leadership

Financial Services Clinical/Health-Admin Data Retail & E-Com OSS/BSS & Telecom Project Management Cross-functional Collaboration Innovation & Problem-Solving

Innovation & Projects

Data Quality Orchestration

Built a custom Mosaic AI orchestration system for efficient data quality triage.

ZPL Rendering Engine

Developed a Python-based ZPL-to-image converter (Zebra Programming Language).

Compliance Chatbot Pioneer

Created a Copilot Studio–driven Compliance chatbot for Franklin Templeton.

Community Engagement

Regular speaker and organizer at Hyderabad Data Community hackathons.