Job Description
n
n
Design, develop, and maintain
scalable ETL/ELT pipelines
using Python, SQL, and GCP tools
n
Build batch and real-time data processing workflows
n
Automate data pipelines using
Apache Airflow (CloudComposer)
for orchestration
n
Develop and manage data solutions using
BigQuery, CloudStorage, Dataflow, and Pub/Sub
n
Implement scalable data warehousing and lakehouse architectures
n
Monitor and optimize cloud infrastructure
performance,reliability,
and cost
n
3. Data Modeling & Transformation n
n
Design and implement logical and physical data models
n
Perform
data cleansing, transformation, and aggregation
for analytics readiness
n
Ensure high data quality, integrity, and consistency acrosssystems (expertia.ai)
n
Enable business insights through dashboards using
LookerStudio / LookML
n
Collaborate with analysts and business teams to definereporting requirements
n
5. Collaboration &
StakeholderEngagement
n
n
Work closely with
data scientists, analysts, and
businessstakeholders
to gather requirements
n
Provide data platform support and resolve data-related issues
n
Communicate technical solutions effectively to non-
technicalstakeholders
n
6. Data Governance, Security &Compliance; n
n
Implement data governance, access control, and security bestpractices
n
Ensure compliance with data privacy regulations and enterprisepolicies
n
Identify and implement performance optimizations acrosspipelines and databases
n
Introduce automation and best practices for DataOps and CI/CD
n
Stay updated with evolving
GCP and data
engineeringtechnologies
n
Technical Skills n
n




Solid programming expertise in
Python and SQL
n
Hands-on experience with
Google Cloud Platform
(BigQuery,Dataflow,
Pub/Sub, Cloud Storage)
n
Workflow orchestration using
Apache Airflow / Cloud Composer
n
Experience with
ETL/ELT pipeline design and data warehousing
n
Visualization and reporting using
Looker Studio / LookML
n
Functional & Process Skills n
n
Strong understanding of
data lifecycle (ingestion transformation analytics)
n
Expertise in
data modeling, data integration, and
pipelineoptimization
n
Familiarity with
Agile / DevOps practices in dataengineering
n
Soft Skills n
n
Strong analytical and problem-solving capabilities
n
Excellent communication and stakeholder management skills
n
Ability to work in cross-functional, global teams
n
Qualifications & Experience n
n
Bachelor's / Master's degree in Computer Science, DataEngineering, or related field
n
5+ years of experience
in dataengineering or similar roles
n
Proven experience working with
GCP-based data platforms
n
Hands-on experience in
Python, SQL, Airflow orchestration
n
Good to Have n
n
Experience with
PySpark / Spark / Kafka
(streamingpipelines)
n
Knowledge of
CI/CD, Docker, Kubernetes
n
Exposure to
AI/ML pipelines and advanced analytics
n
Certifications such as
Google Professional Data Engineer
n
Pipeline performance and reliability (uptime, latency)
n
Data quality and accuracy metrics
n
Time-to-deliver data for business insights
n
Cost optimization on cloud data infrastructure
n
Adoption and usability of dashboards (Looker Studio)
n
n
#J-*****-Ljbffr

📌 Gcp Data Engineer (New South Wales)
🏢 Tata Consultancy Services
📍 New South Wales