Design, develop, and maintainscalable ETL/ELT pipelinesusing Python, SQL, and GCP tools
Build batch and real-time data processing workflows
Automate data pipelines usingApache Airflow (CloudComposer)for orchestration
Develop and manage data solutions usingBigQuery, CloudStorage, Dataflow, and Pub/Sub
Implement scalable data warehousing and lakehouse architectures
Monitor and optimize cloud infrastructure performance,reliability, and cost
3. Data Modeling & Transformation
Design and implement logical and physical data models
Performdata cleansing, transformation, and aggregationfor analytics readiness
Ensure high data quality, integrity, and consistency acrosssystems [expertia.ai]
Enable business insights through dashboards usingLookerStudio / LookML
Collaborate with analysts and business teams to definereporting requirements
5. Collaboration & StakeholderEngagement
Work closely withdata scientists, analysts, and businessstakeholdersto gather requirements
Provide data platform support and resolve data-related issues
Communicate technical solutions effectively to non-technicalstakeholders
6. Data Governance, Security &Compliance;
Implement data governance, access control, and security bestpractices
Ensure compliance with data privacy regulations and enterprisepolicies
Identify and implement performance optimizations acrosspipelines and databases
Introduce automation and best practices for DataOps and CI/CD
Stay updated with evolvingGCP and data engineeringtechnologies
Technical Skills




Solid programming expertise inPython and SQL
Hands-on experience withGoogle Cloud Platform (BigQuery,Dataflow, Pub/Sub, Cloud Storage)
Workflow orchestration usingApache Airflow / Cloud Composer
Experience withETL/ELT pipeline design and data warehousing
Visualization and reporting usingLooker Studio / LookML
Functional & Process Skills
Strong understanding ofdata lifecycle (ingestion transformation analytics)
Expertise indata modeling, data integration, and pipelineoptimization
Familiarity withAgile / DevOps practices in dataengineering
Soft Skills
Strong analytical and problem-solving capabilities
Excellent communication and stakeholder management skills
Ability to work in cross-functional, global teams
Qualifications & Experience
Bachelor's / Master's degree in Computer Science, DataEngineering, or related field
5+ years of experiencein dataengineering or similar roles
Proven experience working withGCP-based data platforms
Hands-on experience inPython, SQL, Airflow orchestration
Good to Have
Experience withPySpark / Spark / Kafka (streamingpipelines)
Knowledge ofCI/CD, Docker, Kubernetes
Exposure toAI/ML pipelines and advanced analytics
Certifications such asGoogle Professional Data Engineer
Pipeline performance and reliability (uptime, latency)
Data quality and accuracy metrics
Time-to-deliver data for business insights
Cost optimization on cloud data infrastructure
Adoption and usability of dashboards (Looker Studio)
#J-*****-Ljbffr

📌 Gcp Data Engineer (New South Wales)
🏢 Tata Consultancy Services
📍 New South Wales