Data Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Senior Level
Full Job Description
About the Role
Unison Consulting is seeking a Data Engineer to join their team in Hyderabad, Telangana, India. This role involves close collaboration with application development, data protection, information security, and risk management teams to implement robust data security and management solutions. You will be responsible for continuously improving security and observability telemetry services, incorporating feedback from a wide range of internal and external stakeholders. Key responsibilities include defining and managing data models, schemas, metadata, and security rules, as well as designing, creating, deploying, and managing on-premise and cloud-based databases and data structures to meet business requirements. The role also encompasses threat analysis to identify and mitigate security risks within the organization's data architecture, ensuring compliance with data privacy laws and regulations, and conducting risk assessments to mitigate data security risks. You will also be involved in training and educating stakeholders on data practices and collaborating with IT team members, stakeholders, and executives to ensure the security of data architectures.
Requirements
- Minimum of 6 years of experience in Data Ingestion, Integration, ETL, or security engineering for large-scale, globally distributed implementations.
- Extensive knowledge of globally distributed environments across multiple platforms including AWS, Azure, and GCP.
- A data-driven mindset with a strong understanding of Data Management or Data Engineering principles.
- Solid foundation in data analysis and related processes.
- Proven experience in Agile methodologies and familiarity with the Atlassian stack (e.g., JIRA) or similar tools.
- Ability to develop roadmaps and strategies for data-centric products and services.
- Experience with standard monitoring frameworks and observability products.
- Experience with hybrid environment data sources, data collectors, and instrumentation.
- Expertise in using SIEM solutions for basic and advanced detection methods, including cloud-based data sources.
- Experience with security monitoring and observability solutions such as Splunk, Sumo, Datadog, New Relic, or AppDynamics.
- Experience working with cloud and data security in DevSecOps/IRE and agile environments.
- Expertise in at least one scripting language (PowerShell, Python, Bash).
- Experience with containerization and orchestration technologies like Docker and Kubernetes.
- Experience with systems configuration orchestration tools such as Ansible or Terraform.
- Understanding of Infrastructure as Code (IaC) concepts.
- Relevant security certifications (e.g., CISSP, CCSP, SABSA, ITIL) are a plus.
- Familiarity and experience with the Splunk SPL query language.
- 3+ years of familiarity and experience with Linux/Ubuntu/Mac systems.
- Experience in creating dashboards, queries, and alerts in Splunk, Datadog, or Sumo.
- Experience troubleshooting Splunk connectivity issues, including networking, server (Windows and Linux), and application tiers.