Design, develop, and maintain scalable ETL/ELT pipelinesusing Python, SQL, and GCP toolsBuild batch and real-time data processing workflowsAutomate data pipelines using Apache Airflow (CloudComposer) for orchestrationDevelop and manage data solutions using BigQuery, CloudStorage, Dataflow, and Pub/SubImplement scalable data warehousing and lakehouse architecturesMonitor and optimize cloud infrastructure performance,reliability, and cost3.
Data Modeling & TransformationDesign and implement logical and physical data modelsPerform data cleansing, transformation, and aggregationfor analytics readinessEnsure high data quality, integrity, and consistency acrosssystems (expertia.ai)Enable business insights through dashboards using LookerStudio / LookMLCollaborate with analysts and business teams to definereporting requirements5.
Collaboration & StakeholderEngagementWork closely with data scientists, analysts, and businessstakeholders to gather requirementsProvide data platform support and resolve data-related issuesCommunicate technical solutions effectively to non-technicalstakeholders6.
Data Governance, Security &ComplianceImplement; data governance, access control,



and security bestpracticesEnsure compliance with data privacy regulations and enterprisepoliciesIdentify and implement performance optimizations acrosspipelines and databasesIntroduce automation and best practices for DataOps and CI/CDStay updated with evolving GCP and data engineeringtechnologiesTechnical SkillsStrong programming expertise in Python and SQLHands-on experience with Google Cloud Platform (BigQuery,Dataflow, Pub/Sub, Cloud Storage)Workflow orchestration using Apache Airflow / Cloud ComposerExperience with ETL/ELT pipeline design and data warehousingVisualization and reporting using Looker Studio / LookMLFunctional & Process SkillsStrong understanding of data lifecycle (ingestion transformation analytics)Expertise in data modeling, data integration, and pipelineoptimizationFamiliarity with Agile / DevOps practices in dataengineeringSoft SkillsStrong analytical and problem-solving capabilitiesExcellent communication and stakeholder management skillsAbility to work in cross-functional, global teamsQualifications & ExperienceBachelor's / Master's degree in Computer Science, DataEngineering, or related field5+ years of experience in dataengineering or similar rolesProven experience working with GCP-based data platformsHands-on experience in Python, SQL, Airflow orchestrationGood to HaveExperience with PySpark / Spark / Kafka (streamingpipelines)Knowledge of CI/CD, Docker, KubernetesExposure to AI/ML pipelines and advanced analyticsCertifications such as Google Qualified Data EngineerPipeline performance and reliability (uptime, latency)Data quality and accuracy metricsTime-to-deliver data for business insightsCost optimization on cloud data infrastructureAdoption and usability of dashboards (Looker Studio)
#J-*****-Ljbffr

📌 Gcp Data Engineer (New South Wales)
🏢 Tata Consultancy Services
📍 New South Wales