Software Engineer - Data Infrastructure - OpenSearch/ElasticSearch

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Software Engineer - Data Infrastructure - OpenSearch/ElasticSearch is responsible for designing, implementing, and maintaining efficient data pipelines and storage solutions utilizing OpenSearch and ElasticSearch technologies. This role requires collaboration with data scientists, analysts, and other engineering teams to ensure robust data infrastructures are in place that support real-time data analytics and search functionality. The ideal candidate will possess strong problem-solving skills and a deep understanding of data modeling and querying techniques, contributing significantly to the development of scalable and high-performing systems.

Job Responsibilities

• Design and build scalable data infrastructure using OpenSearch and ElasticSearch technologies.
• Implement data ingestion pipelines to process diverse data sets from various sources.
• Optimize existing search functionalities for speed and relevance.
• Collaborate with cross-functional teams to analyze and translate business requirements into technical solutions.
• Ensure data integrity and implement best practices for data management and security.
• Monitor and troubleshoot data systems and conduct performance tuning as required.
• Develop and maintain documentation for data flows and data governance policies.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• Minimum of 3 years of experience in software engineering, specifically in data infrastructure roles.
• Proficiency in OpenSearch, ElasticSearch, and related ecosystem tools.
• Strong programming skills in languages such as Java, Python, or Go.
• Experience with data modeling, ETL processes, and data warehousing solutions.
• Familiarity with containerization tools such as Docker and orchestration using Kubernetes.
• Excellent problem-solving and troubleshooting abilities.

Technologies & Tools

This position will primarily utilize OpenSearch and ElasticSearch for data indexing and searching capabilities. The role may also involve other technologies such as Apache Kafka for event-driven data streaming, relational databases such as PostgreSQL or MySQL for transactional data, and cloud platforms like AWS or GCP for scalable infrastructure management. Familiarity with CI/CD pipelines and DevOps practices is essential for streamlined deployment processes.

Ideal Candidates

The ideal candidate possesses a strong analytical mindset, is detail-oriented, and can adapt quickly to evolving business needs. They demonstrate a commitment to continuous learning and improvement in both technical skills and data management practices. A collaborative spirit that fosters teamwork, along with the capacity to handle complex data challenges independently, positions these individuals as strong contributors to the overall success of the engineering team and the organization.