Sougata Konar
Data Engineer | Azure Cloud Specialist
Kolkata, IN.About
Experienced Data Engineer with 4+ years of expertise in Azure cloud services, Big Data technologies, and data virtualization platforms like Denodo. Proven ability to design, develop, and administer robust data pipelines and solutions, driving real-time analytics and business intelligence for client-facing engagements.
Work
Tata Consultancy Services
|Systems Engineer - Data Engineer and Analyst (Azure)
Kolkata, West Bengal, India
→
Summary
Served as a Systems Engineer, Data Engineer, and Azure Analyst at Tata Consultancy Services, leading end-to-end data solution development and administration for major clients like Becton, Dickinson and Company and GlaxoSmithKline.
Highlights
Administered and developed on Denodo Platform, managing data virtualization and integration for critical business applications across multiple client projects.
Designed and implemented complex data virtualization solutions using Denodo Virtual DataPort, creating Base, Integration, and Report Views from diverse sources (Hive, SQL, SharePoint) to enable real-time analytics for Qlik and Power BI.
Managed data security and authentication within Denodo, enhancing data governance, and utilized Denodo Data Catalog for metadata management.
Streamlined SDLC by migrating Denodo Views and tables across Dev, QA, and Production environments using Denodo Solution Manager, ensuring SSL certification and Java-based system updates.
Developed and monitored Azure Data Factory (ADF) pipelines and datasets for clients, ensuring real-time data ingestion and processing, and providing real-time monitoring support.
Created Hive and HQL tables using DB Visualizer, integrating data from diverse sources including Attunity Replication, Oracle ETL, JDE, Everest, SAP, and Salesforce.
Integrated Microsoft SQL Server data with Power BI and Qlik dashboards via dedicated Azure Data Factory pipelines, enhancing business intelligence capabilities for end-users.
Leveraged Azure Databricks and PySpark to integrate SQL services within a Python framework, executing Scala code in a distributed environment for large-scale data processing and modeling.
Volunteer
E-cell (Institution Innovation Council-TMSL)
|Head of Sponsorship
→
Summary
Led sponsorship efforts for the E-cell (Institution Innovation Council-TMSL) and organized the 'Enviasge' fest in 2021.
Highlights
Secured sponsorships and managed logistics for the annual 'Enviasge' fest in 2021, fostering a vibrant entrepreneurial ecosystem.
Contributed to promoting innovation and entrepreneurship as part of an MHRD-maintained council, impacting student engagement.
Hult Prize Techno Main Salt Lake
|Campus Co-ordinator
→
Summary
Coordinated the Hult Prize competition at Techno Main Salt Lake campus, promoting social entrepreneurship.
Highlights
Orchestrated campus-wide activities and engagement for the prestigious Hult Prize social entrepreneurship competition in 2021.
Education
Techno Main Saltlake
→
Bachelor of Technology (B.Tech)
Computer Science & Engineering
Grade: 8.39 / 10 CGPA
Bankura Banga Vidyalaya
→
Higher Secondary - WBCHSE
Science
Grade: 87.5%
Awards
Top 100 Participant in 5G Hackathon
Awarded By
TCOE India (Department of Telecommunications, Government of India)
Achieved a rank among Top 100 participants in a national 5G hackathon, securing a 1 lakh INR prize for innovative solutions.
National Innovation Contest - Successful Prototype
Awarded By
National Innovation Contest
Contributed to Team Edlox, developing one of 127 successful prototypes recognized in the National Innovation Contest.
Inter-College Robotic Competition Winner
Awarded By
Various Inter-College Competitions
Secured multiple first prizes in inter-college robotic competitions for an Arduino Autonomous line follower robot from 2018 to 2020.
Languages
English
Hindi
Bengali
Certificates
Databricks Fundamentals-Academy Accreditation
Issued By
Databricks
Azure AZ-900
Issued By
Microsoft
Azure DP-900
Issued By
Microsoft
Azure AI-900
Issued By
Microsoft
Azure DP-203
Issued By
Microsoft
Azure DP-600
Issued By
Microsoft
Databricks Certified Generative AI Engineer Associate
Issued By
Databricks
Generative AI Fundamentals
Issued By
Microsoft
Reltio Workflows Overviews and User Experience
Issued By
Reltio
Azure AZ-204T00: Developing Solutions for Microsoft Azure
Issued By
Microsoft
Skills
Programming Languages & Tools
Python, SQL, PySpark, Scala, Hive, HQL, DB Visualizer, Microsoft SQL Server, Crontab Scheduler, Java.
Cloud & Big Data Platforms
Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Denodo Virtual DataPort Administration Tool, Denodo Data Catalog Tool, Denodo Solution Manager, Denodo Scheduler, Big Data.
Data Visualization & BI
Power BI, Qlik.
ETL & Data Integration
Pipeline Building, Declarative Delta Pipelines, Data Ingestion, Data Modeling, Attunity Replication, Oracle ETL.
Other Technical Skills
Real-time monitoring, SSL Certification, Distributed Frameworks.