Job Description

n
- Design, develop, and maintain scalable ETL/ELT pipelinesusing Python, SQL, and GCP tools
n
- Build batch and real-time data processing workflows
n
- Automate data pipelines using Apache Airflow (CloudComposer) for orchestration
n
- Develop and manage data solutions using BigQuery, CloudStorage, Dataflow, and Pub/Sub
n
- Implement scalable data warehousing and lakehouse architectures
n
- Monitor and optimize cloud infrastructure performance,reliability, and cost
n

n

3. Data Modeling & Transformation

n

n
- Design and implement logical and physical data models
n
- Perform data cleansing, transformation, and aggregationfor analytics readiness
n
- Ensure high data quality, integrity, and consistency acrosssystems [expertia.ai]
n
- Enable business insights through dashboards using LookerStudio / LookML
n
- Collaborate with analysts and business teams to definereporting requirements
n

n

5. Collaboration & StakeholderEngagement

n

n
- Work closely with data scientists, analysts, and businessstakeholders to gather requirements
n
- Provide data platform support and resolve data-related issues
n
- Communicate technical solutions effectively to non-technicalstakeholders
n

n

6. Data Governance, Security &Compliance;

n

n
- Implement data governance, access control, and security bestpractices
n
- Ensure compliance with data privacy regulations and enterprisepolicies
n
- Identify and implement performance optimizations acrosspipelines and databases
n
- Introduce automation and best practices for DataOps and CI/CD
n
- Stay updated with evolving GCP and data engineeringtechnologies
n

n

Technical Skills

n

n




- Strong programming expertise in Python and SQL
n
- Hands-on experience with Google Cloud Platform (BigQuery,Dataflow, Pub/Sub, Cloud Storage)
n
- Workflow orchestration using Apache Airflow / Cloud Composer
n
- Experience with ETL/ELT pipeline design and data warehousing
n
- Visualization and reporting using Looker Studio / LookML
n

n

Functional & Process Skills

n

n
- Strong understanding of data lifecycle (ingestion transformation analytics)
n
- Expertise in data modeling, data integration, and pipelineoptimization
n
- Familiarity with Agile / DevOps practices in dataengineering
n

n

Soft Skills

n

n
- Robust analytical and problem-solving capabilities
n
- Excellent communication and stakeholder management skills
n
- Ability to work in cross-functional, global teams
n

n

Qualifications & Experience

n

n
- Bachelor's / Master's degree in Computer Science, DataEngineering, or related field
n
- 5+ years of experience in dataengineering or similar roles
n
- Proven experience working with GCP-based data platforms
n
- Hands-on experience in Python, SQL, Airflow orchestration
n

n

Good to Have

n

n
- Experience with PySpark / Spark / Kafka (streamingpipelines)
n
- Knowledge of CI/CD, Docker, Kubernetes
n
- Exposure to AI/ML pipelines and advanced analytics
n
- Certifications such as Google Professional Data Engineer
n
- Pipeline performance and reliability (uptime, latency)
n
- Data quality and accuracy metrics
n
- Time-to-deliver data for business insights
n
- Cost optimization on cloud data infrastructure
n
- Adoption and usability of dashboards (Looker Studio)
n

📌 GCP Data Engineer (New South Wales)
🏢 Tata Consultancy Services
📍 New South Wales