21 Oct
|
Tech Mahindra
|
Sydney
21 Oct
Tech Mahindra
Sydney
Designation / Job title : Developer programmer - 261312
Primary or Mandatory skills :-
- Advanced proficiency in Google Cloud Platform (GCP): BigQuery, Dataflow, Composer, Cloud Storage, Cloud Functions, Cloud Run, Pub/Sub, Firestore, Cloud Build, Cloud SQL, Cloud Monitoring & Logging, Compute Engine, VPC and Kubernetes (GKE), plus IAM administration for cloud-native data pipeline design, development and optimization.
- Experience in AI/ML integration and AI agent development using Vertex AI, BigQuery ML, Agent Builder and Streamlit for anomaly detection and predictive monitoring.
- Hands on building and deploying AI agents through Glean, Gemini Enterprise and Claude Code to automate and enhance operational and business processes.
- Expertise in Site Reliability Engineering (SRE) practices: SLIs/SLOs/SLAs, error budgets, incident response, postmortems/RCA documentation
- Hands-on experience with IBM Databand for data observability: real-time alerts, predictive monitoring, data lineage tracking.
- Proficient in Python, Pyspark, Unix/Shell scripting, and Google Apps Script for automation and alerting.
- Advanced SQL skills with BigQuery, Vertica, and Oracle
- Strong understanding of Apache Airflow for DAG orchestration and pipeline scheduling.
- Terraform and GitHub for infrastructure-as-code and CI/CD pipeline management
Good to have skills :
- Familiarity with Agile methodologies, Jira, and ServiceNow
- Experience with Looker Pro and Tableau for advanced BI and reporting
- Exposure to cloud migration strategies and cross-platform data integration
- Experience with Atlan for data governance: metadata cataloging, lineage tracking, access control, and collaboration across data teams
- Knowledge of Profisee for reference data management: mastering business-critical entities, hierarchy management, and golden record creation
- Google Cloud certifications - Professional Data Engineer and Professional Machine Learning Engineer — plus IBM Databand training or certification.
Detailed : -
- Lead the development, deployment, and support of scalable data pipelines on Google Cloud Platform, using services such as Dataflow, BigQuery, Cloud Functions, Firestore, Composer, Cloud Storage, Cloud Run, Cloud Build, and Pub/Sub.
- Architect and optimize complex SQL queries in BigQuery to improve performance and reduce query costs.
- Design and orchestrate workflows using Apache Airflow, including DAG creation, scheduling, and monitoring.
- Integrate AI/ML capabilities into operations using Vertex AI, Agent Builder, BigQuery ML and Streamlit to detect anomalies, predict failures and reduce recurring incidents; develop AI agents through Glean, Gemini Enterprise and other tools to automate or enhance operational and business processes
- Implement platform wide cost and resource optimization strategies:
- Archive historical and cold data to lower-cost storage tiers.Delete unused datasets and files from Cloud Storage
- Monitor service usage across projects and decommission idle or redundant resources
- Set up new GCP projects with cost-productive architecture
- Maintain GitHub repositories for CI/CD pipelines and automate infrastructure using Terraform.
- Automate operational workflows and alerting systems using Python, Unix/Shell scripting, and Google Apps Script, enabling real-time notifications for pipeline failures and anomalies.
- Apply SRE principles to improve system reliability, scalability, and operational efficiency:
- Define and monitor SLIs/SLOs/SLAs for critical services
- Conduct post-incident reviews and prepare RCA documentation
- Manage error budgets and balance feature velocity with system stability
- Automate incident detection and resolution workflows to reduce MTTR
- Deploy and manage IBM Databand for advanced data observability and integrate with Opsgenie or other alerting tools/services.
- Configure real-time alerts for pipeline delays, schema changes, and data freshness
- Enable predictive monitoring and data lineage tracking
- Improve operational resilience and data reliability across critical workloads
- Perform Google Cloud administration tasks:
- Manage IAM roles and access policies
- Perform Composer upgrades and environment tuning
- Configure VPC networks, firewall rules, and service accounts
- Provision and monitor Compute Engine instances and Kubernetes clusters (GKE)
- Perform Platform level security audits/UAR and cleanups related to the same
- Use Terraform for infrastructure-as-code deployments
- Collaborate with business and technical teams for Finance month-end and year-end closures, including data loads and issue resolution.
- Provide SME level support for Finance, Subscription, AdSales, and Consumer,Editorial and Pubops data domains.
- Manage sprint planning and change control processes using Jira and ServiceNow.
- Investigate and resolve data issues raised by business users in BigQuery, Looker reports, and other platforms; prepare RCA documentation.
- Conduct stakeholder meetings for requirement gathering, technical mapping, and production deployment planning.
- Review and approve production deployments from various development teams, maintaining change management workflows and coordinating release windows
- Mentor junior engineers and support team development through training and documentation.
Experience Range – 8+ years
📌 Developer programmer - 261312 (Sydney)
🏢 Tech Mahindra
📍 Sydney