Software Engineer - Data Infrastructure - OpenSearch/ElasticSearch

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Overview

The Software Engineer - Data Infrastructure specializing in OpenSearch/ElasticSearch at Jobs via Dice will play a pivotal role in designing, implementing, and maintaining scalable data infrastructure solutions. This position entails working collaboratively with cross-functional teams to enhance system performance and ensure data integrity. The successful candidate will bring their expertise in search technologies to tackle complex data challenges while innovating and optimizing the existing systems for future growth.

Job Responsibilities

• Design, develop, and maintain data pipelines and architectures for handling large volumes of data.
• Implement and optimize OpenSearch/ElasticSearch clusters for high availability and performance.
• Conduct troubleshooting and performance tuning of existing data infrastructures.
• Collaborate with data scientists and analysts to integrate their findings into production systems.
• Develop and enforce best practices for data management and data quality assurance.
• Document solutions and create user guides for data processes and systems.
• Create and maintain monitoring systems to track usage and performance metrics.
• Participate in code reviews and contribute to team knowledge sharing.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
• Proven experience with OpenSearch or ElasticSearch in a production environment.
• Strong programming skills in languages such as Java, Python, or Go.
• Familiarity with data modeling, ETL processes, and API development.
• Understanding of cloud platforms (AWS, Azure, GCP) and associated services.
• Experience with containerization and orchestration tools (Docker, Kubernetes).
• Strong analytical skills and problem-solving abilities.
• Excellent communication and teamwork skills.

Technologies & Tools

This position will utilize a variety of technologies and tools including OpenSearch, ElasticSearch, Apache Kafka, Docker, Kubernetes, MongoDB, SQL, Python, Java, and cloud services such as AWS or Azure. Familiarity with CI/CD pipelines and data visualization tools may also be beneficial.

Ideal Candidates

Ideal candidates for the Software Engineer - Data Infrastructure role will possess a strong technical background combined with a proactive and innovative mindset. They should be detail-oriented, capable of adapting to changing requirements, and highly motivated to optimize data infrastructures. Furthermore, successful candidates will thrive in a collaborative work environment and demonstrate a passion for developing efficient, scalable solutions that enhance data accessibility and usability.